
it feels so awkward and uncomfortable whenever manga have scenes like this... like it is that terrible and inconvenient to interact with someone who isn't japanese...?

Some Japanese people have a lot of trouble interacting with foreigners, it is hard to say exactly why, Japanese people will mostly say they are "shy", it must be part of it but I think there is also a fundamental fear of what's different that plays a bit. And if they are scared about a white tourist, it can be worse when it implies a black person. Not long ago I read this thing about a cashier in a touristic spot that was actually so scared of a misunderstanding with foreigners that he let hundred of thousands people pass by without paying, because he didn't want to interact with them. I worked in a hostel in Japan that was mainly addressed torwards Japanese girls and many couldn't look me in the eye or prefered asking things to the asian volunteers rather than me. It takes a little while to get through to them, and I understood it was not meant to be hurtful in any way, they just don't really know how to act.
And also don't worry, there are tons of Japanese people who are really happy about seeing foreigners and that would gladly come to you to help or have a chat.
link to raws please?
https://bomtoon.com/comic/ep_list/JM_OF_J