Deluding myself into believing I like men or am I just the worst person alive

Met my ex today and we did not break up on good terms so yes it was super awkward. But then this mf starts getting super chummy for no reason asking if we could hang out. Ofc I declined at first but it felt criminal in giving up an offer for free food so we did hang out, and that made me realise that he isn't even a bad guy. I don't have plans on reconciliation but this incident was quite an eye opener. I've dated 3 people till now, and broke up with all of them for arbitrary reasons, it's like whenever I get into a relationship with someone, I start getting irritated by their very existence. My last ex was the sort of the blockhead type of guy, and this was the reason I found him cute before dating him, he was simple and wasn't the type to approach someone with ulterior motives, just a really naive person. We started dating and the more time we spent together, the more I realised that we weren't compatible, he was spineless, couldn't form strong opinions, did not add anything of value to conversations. These by no means are bad qualities, he was treating me very well, and now I feel really bad about treating him like shit. And this sort of thing happened with every guy I've dated.
I'm not planning on getting into a relationship for atleast 5 years because it seems like I'm still immature when it comes to understanding others.
I hope this habit dies with time because I'm never making any meaningful human connections if I act like this for the rest of my life.