
Well, he says that he hates having a "doll wife" but his actions says otherwise. If he didn't want a doll wife, he wouldn't ignore and avoid her after she has shown anger or frustration. The talk about him wanting her to "open up her heart" rings false to me if he can't even handle that much.
And he acting hurt at her saying they don't live each other is also unreasonable. Like ofc he doesn't like to hear that, he can feel hurt, but he must understand he can't expect her to love him first when they have literally made a contract that says she can't? He just can't be angry about that. He himself has said nothing about his feelings. He can just kick her out if he doesn't think she fulfills her role as as a wife, but what can she do? Their relationship is not equal, so he can't expect much from her.

I think the feeling I got from the novel is he has a hard time understanding that his feelings are love because he doesn't consider himself human. He doesn't ever feel love, or joy, or happiness, so it's all very unsettling to him. He's never not been in control so he's scared. Scared that she will leave and he will lose the only thing that has ever made him happy.
But he did make me want to shake him a few times, with the whole wanting her to confess first.
... Spoiler if it makes you feel better, when they are all good she runs him. She gets more confident and he is just whipped.
Right now I can't sympathize with Hue. He has monopolized her and attempted to isolate her from friends as well as other potential love interests. He won't let her leave him and he basically holds all the power in the relationship. What does he expect from her? That she should say she loves him when he has explicitly expressed he does not want that? He says "she's mine" and now he says "I can't return feelings of love" DUDE.
She loses her temper once, for very understandable reasons and now he ignores her. It sounds to me like he really only wants an obedient doll for a wife. If the butler hadn't called him out I might have dropped this. I like the story, and the other characters, but I don't like him. And yes, I know he has some awful trauma, but do does Lucia! It doesn't excuse his behavior.