Either he remembers everything OR, his twisted obsessive personality is something that will never leave him. He likes having him freak and panic over even the smallest things about him…maybe..?