I actually think that he doesn't really blame his brother and that he rather just needed to vent because of the pity other people gave them instead of truly helping in any way...sometimes feelings break free and things are said that people don't really mean
Speaking from experience, it's really hard to give up everything you've worked for to focus on taking care of someone else's kid. It is very hard to raise your brother when they're already at an age that you can't properly discipline them. They don't see you as a guardian either, they still see you as just their bro. Can you imagine what it's like to busy your ass all day to provide for your brother just to gave him say, "you don't care about me, you care about what others think"?
He was pretty harsh when he said those things to his little brother . If he didn't want to sacrifice his life for him, he should have said so from the beginning rather than blaming his little bro