Just say you have reversed claustrophobia or something... and that you need to sit right next to him and even hold his hand.
