idk for sure but your description reminds me of this! https://www.mangago.zone/read-manga/it_seems_that_kiyoi_kugii_can_see_the_director_s_xxx/
It's not exactly a ghost he is shooing away, but there is a scene where the MC shoos back mist away from the ML (who is in a suit) pretty early on. So maaaaaaaybe it's The Words in Your Snare?
https://www.mangago.zone/read-manga/hwanghyeon_text/
Thank you so muchl yes it's this one! (●'◡'●)ﾉ
Thank you so much for your response. (●'◡'●)ﾉ I love this story, it's great
Thank you sooo much! It's not this one but it looks great so I'll read it, thank you (●'◡'●)ﾉ
Main character would pretend that he's removing dirt from LI's clothes (his boss, I think) but he's actually shooing a ghost away. Thanks in advance guys (●'◡'●)ﾉ