Asking dont be rude

You need to sit down and ask him if he's saying it just for funsies or if he's genuinely questioning his gender. No one can make a judgement on this just from that one line, so talk to him a little more and ask him to specify   reply