I would agree. Your foot does swell (at least mine do) once you're a good half hour or so into your ride. I found what felt too lose at the beginning of the ride was just right once I was warmed up.
f