I think he discovered the farms secret that's why the uncle panic and banned him but he actually forgot about it because he's young and just saddened because he's uncle sent him away? Also I think the parents controlling and making him see the psychiatrist makes him lose the memory
Now I'm wondering, what did Little A do? Any theories?