it is the harsher ride of small wheels that make them sub par for long rides, and slower overall. if you are uncomfortable you will ride slower no matter if your wheels are faster
but yes I can spin my brommie up to speed very quickly due to less rotational weight