If you spent a lot of time with them, then you'll obviously feel sentimental about leaving them, no matter how annoying they are.
I think people underestimate how much of an effect sentimentality has on people. It can last years if you let it brood for long.
As for why sometimes people are sad, I find that most people feel sad when it's boring, ......
