This is not a spoiler but just my theory. I think lily and swan are actually twins. That explained why lily has a bit resemblence to the duke but it just not prominent since she's still young
