Sammyeong could have just left while he was asleep.
If you go back to the chapter you'll see where Kang said something about waking up late meaning he doesn't wake up late. Sammyeong had to drug him because he needed a lot of time maybe because Kang is a light sleeper.
Sammyeong could have just left while he was asleep.