The emperor isn't showing them all that much that he cares. Plus 1. They feel abandoned since he waited so long to find them 2. He's sending them back to the place of their trauma 3. They have major trust issues. They have every right in the world to think that way, even if they are wrong.
They're about to die but they still can accept the fact that the emperor actually treasure them.. it's like they doing this on purpose