Probably it's because even his wounds that he obtained in that other world are gone. Meaning that when he said he came back to the same PLACE and TIME could also mean that its as if he never went to that world. (He could have returned on the time before he fell into that portal in the 1st place.)
Since there is no magic in our place. Time would pass normally for him. (No time skips)
It took Mel 10 years of his time to able to reach Yuta's time line that has passed 3 months.
Oh wow, that makes it all make sense! That means Yuta aged down and lost those 5 years or so he was there. Oh god what would happen if Mel died of old age and then a portal opened and took an old Yuta back and he became young again! That's is so cool but awful at the same time. I mean I'm sure someone by then could bring him back but he'd have to live a young life with out his husband. I've made myself sad.

If time means anything then when Yuta went back home then 200 years should have past in our world. Ten years to pass in three months our time, that's 3.33 years their time a month. He was there for 5 years, thus doing the math it's 200. So Time is a weird mess in this manga.