I think there's already a history and some people in the palace are aware of what happened in the past. That's why his eunuch(I think he's a eunuch or some sort of advisor) was so threatened by the uke and wanted him to run away before. And sorry I forgot the names.
Does that mean that the emperor has a fragments of memories about his past life and what he did to his guest?