170mm should be fine, even though 165 is the standard fixie crank length.

Take out a ruler and look at how long 5mm actually is. It's not very long.