Depends on your club and the purpose of the ride. If it was a part of a goal oriented, race specific training then no, you were not wrong. If it was a season end social ride or an ego stroker then maybe you could lighten up a little.