I'm a gay man, but I only can speak for me. I'm absolutely okay with it.
Here's why:
1.) Plot! If you read for a certain plot (like history plot or enemies to lovers, it fine!!). It not fetish then.
2.) I, personally, read straight manhwa and GL as well because I like seeing relationship. If gay women okay with me, I okay with them!
3.) Men are hot......