Isn't it supposed to contact the rubber face on the drive side?

Have you over-torqued the non-drive side crank bolt? too much tension there will put too much preload on the bearings.