I think he knew the yuke liked him from before.... and I think the reason he didn't want him there was because he already had feelings for him but was afraid of rejection... but this is all speculation on my part..
That is how it came across to me too.
Oh cool ... then I'm not the only one who picked up on it.... that makes me feel a lot better ....then thinking I was jumping to conclusions... (●'◡'●)ﾉ
I still also think that their relationship, and the whole manga, progressed rather quickly, but it didn't feel like the seme had no reason for liking the uke. All of the seme's feelings were delivered through inner monologue (in the square bubbles) and kind of vague pictures of women being injured, frightened and ultimately rejecting him. The reader had to pay pretty close attention to those little hints to really understand what the seme meant in his inner monologue. Those little hints wouldn't be hard to miss or misinterpret, but I think you picked up on them rather well. I do wish there had been more comfortable and pleasant interactions between the uke and seme, but you still get that the uke meets the seme's simple criteria for a partner. Which is accepting him for who, and what, he is.
kinda quick... i mean i didn't see the development of feelings from the seme, seemed out of no where as if the reason to going out with the uke was to fix the curse