I think he just doesn't want anyone to come between him and his ambition for his clan to rule the empire trough his marriage. Since he does not love the princess I don't think he sees the bodyguard as a potential love rival but more as an other party who could influence the new ruler.
Maybe if her fiancé had encouraged her feelings for him when they were kids, he wouldn't have to worry about the bodyguard now