I've only read a few chapters of the light novel, but apparently Vio's mother was obsessed with him. He couldn't handle it and went to the arms of his "true love" (Maryjun's mother). He was a little concerned about Vio, but thought that her mother and the maids would take good care of her. He doesn't know that Vio's mother tried to use Vio as his replacement. When Vio was around 6 I think, her mother destroyed all her dresses and raised her as a boy. When Vio was around 13, her mother could no longer pretend that Vio was the father. Then she stopped caring about Vio and wasted away, pining for her husband. He only stayed away from the house to stay away from her, so of course he returned as soon as she died. And brought his illegitimate family with him.
But why does he acts like he hates Vio? I can understand he hates his wife because he didn't love her, but he abandoned Vio and now he sees her like he doesn't want her there!!! He is openly hostile against Vio!!!
Prolly coz Vio looks like her crazed mother.
Kinda of a spoiler but to those that read the ln, what is the father's problem? Do we ever get his pov? Or does he just stay an asshole the whole time?