Does size matter??

I have been going out with my bf who I've met in college for a year now then we started to take it to the next level...but I was so disappointed with the size of his d*ck don't get me wrong I like him but not only that our first time was so awkward we can't even do the doggy position since it's too short, I dunno what to do I don't wanna be too shallow and just break up with him and say "dude sorry your pepper is not cutting it we should break up"