Theory

After those flashbacks, they definitely met when they were younger and I think the older brother is the cause of his memory loss and him being trapped in a room