My times have been reasonable similar. I find I ride faster uphill (forced by 42x16 gearing) but slower downhill (restricted by 42x16 gearing)
On a somewhat related note, riding almost exclusively fixed for a summer caused a notable increase in my average cadence.