Why Sam sudently remember him? Am I missing something?

he's think these two have sex before.

Yeah, weird. I even thought that it is another new, unkown guy from Sam's past. What does that guy's connection with Sam??

This is their first time. He can't help but remember that he's not Min's first.