the fact that the kid remembers that memory even at one year old means that he also remembers the memory of when his older bro tried to KILL THEM BOTH bu drowning at the sea
Not only remember but him as a little child realised and was conscious of the whole situation(taeju even mention this in that scene saying he is scared)...
They only remember selective fragments, and a lot of times those memories are kind of random, not necessarily related to strong emotions or anything, just random
the fact that the kid remembers that memory even at one year old means that he also remembers the memory of when his older bro tried to KILL THEM BOTH bu drowning at the sea