Yeah, but if you think about it, she has nothing to gain by betraying them and she spends most of her time with the duke, maybe that's why he's not suspicious. If you add that to the fact that he is also starting to develop an interest, it is pretty normal
Tbh if I'm the Duke I might get grossed out or suspicious, especially since he distrust females