I get where you're coming from but I think it makes sense. He's saying that Namin sleeping with other men isn't going to change his feelings for him, but it doesn't mean he likes it. They're not dating so he can't dictate who Namin sleeps with but he wants an exclusive relationship to be end game.
Didn't he just say he doesn't care who he sleeps with, then he proceeded to tell him to stay away from the new guys cuz it makes him jealous lol.