Well, maybe when he jumped into the sea of zombies?
but it would be weird if he's the only one that got infected...
The only time we saw Neumann getting in contact with a zombie is way in the beginning when they went out of the prison for the first time. One zombie got hold of his shoulder but that doesn't explain anything since he wasn't scratched or bitten.
But continuing from the fist comment, it could also be a possibility that Neumann got bitten from when they jumped into that pile of zombies.
He mustn't got infected by the rare f-virus because it took a really long time to show symptoms.

So when did Neumann get infected? I can't remember if it was shown in the manga or not