I'd be suspicious too if my relationship started off as us being fuck buddies (or something similar) honestly his worries are so valid