Much of the noise made by cars is from the tires, not the engines, especially if they're going 25 mph or faster. Also, there is a considerable noise from air resistance.

But yeah, at slow speeds, like in parking lots, they can be virtually silent.