That's normal for any barometric based altimeter. If it's a problem you can program in the actual elevation at the coffee shop you stop at and the 500 will correct itself.

edit: sorry I originally just looked a the blip and didn't notice that it was 300'. If it is always that much after a 20 min stop I would talk to Garmin. Perhaps you have a defective unit.