I hope there is this kind of story...

I need this

Girl ice queen but ml not clutz- Reimei no arcana
Same as above- orange marmalade
I do hve the other way around
Guy cold and girl clingy nd cute- revenge wedding

Im sorry i ddnt exactly answer ur question did i

Yeonwoo's Innocence: https://www.mangago.zone/read-manga/yeonwoo_s_innocence/ The girl looks ICE COLD cuz she rejects basically mostly everyone except the ML but really she's very kind inside!

Mizutama Honey Boy: https://www.mangago.zone/read-manga/mizutama_honey_boy/ The boy isn't a total klutz he's just feminine lmao. But the GIRL is definitely the ice cold type.

I remembered one!
Temple Romance
And girl ice queen, guy mischievous but not clutz-
Namaiikizakari
And Purple Hyacinth (available fr free in webtoon)