Don't take my word for this, as the translations were confusing for me too. This is just my opinion after going over the chapters again and trying to understand them. Mimori seeing his ghost is like him finally coming to terms with the past (that he had with Iku when he was a ghost himself). So when he says, "Hey spectre (ghost), do you not want to let go of him (Iku)?" He's actually saying that to himself. Mimori had dreams about Iku, actually and couldnt understand why he felt the need to keep seeing him. He was drawn to Iku in ways that he couldn't rationalize. So he says this to himself because the ghost symbolizes his past with Iku, which Mimori doesn't want to let go of even if he can't remember. Iku did say before this that he would leave Mimori alone, and Mimori didn't want that to happen at all.
All we can know for sure is Mimori keeps getting weird feelings and dreams about the uke that he can't explain, and he keeps seeing his ghost self (the station clerk also seemed to be able to see him, so it's left ambiguous whether the ghost is or isn't really there), so he wonders whether the ghost is like the projection of a part of himself that likes the uke and thus wants him to give in to theunexplainable feelings, no matter what the truth about his coma is...
And yes, Miki is annoyed at Iku because he is misunderstanding Mimori: As he, Miki, knows Mimori better than Iku, he thinks he knows better than Iku why it is that Mimori is acting the way he is...

Can anyone tell me what does this page mean? http://www.mangago.zone/read-manga/23_45_re/uu/23_45_re-chapter-3/25/
And why is it that Miki seem annoyed with Iku? Is it because Iku is misunderstanding Mimori?