I think it's referencing how Baek Youngchan beat up Seo's stalker and we saw part of his violent side (we've also steadily seen more of this aggressive side with the whole situation entirely). So that has probably made him anxious, especially when you factor in that he's always hyper-aware of his appearance and actions so as to not get labelled as aggressive or scary by others (hence the goofiness). Also, their relationship did have a rocky start with Baek Youngchan forcing himself on Seo when they shared a room together at the company bonding trip thing (it would also be considered a violent act).

Then his mood briefly soured……did he remember something? Are we gonna get a YC past chapter next (๑•ㅂ•)و✧