I feel that he did not take her as his wife because he respects her and that he may have a secret crush (just speculating)