What is Seungho referring to when he says pathetic for having felt such joy at his words?

In the earlier episodes, he started developing feelings towards Nakyum as he spent more time around him, but now he's mad as himself for starting a "close" relationship with a low born

I was wondering at what words Seungho was thinking about specifically, that he said he felt joy hearing. Maybe when Nakyum told he was waiting for them to go back together?