It's either your pump-head or the valve. Work out which by trying your pump on someone else's presta valve, or borrowing another pump.

Or perhaps it's you - if you try both of the above and it still happens then I'd be suspicious.