Definitely the latter since the Duke spoke of him returning, and Alois seem to have forgotten about who saved him until after that night. I also believe the ending was just to match with the final words about when the Duke's life changed since they technically first met at those ages respectively.
So did he raise Alois since he was little or did he just rescue him from his dad and then they met again later when Alois was older?