If he already decided on his fated love why did this need to be a harem? At least make it seem like he could end up with anyone if you're gonna have the mc sleep with a bunch of dudes.