I wanna highlight one of your points here because i agree with you 100%. You state: “ most of the time the stories doesn't even need it like the plot is genuinely brilliant but it's like there's this invisible force that just compels authors to add a sprinkle of that into the story.”
THIS.
My story: I was reading a BL (not going to say the na......