I would agree that the hybrid is more forgiving on the potholes, as the tires are wider and higher.
What I do not like about my hybrid is the short fenders. This really sucks in rain. I plan do buy some additional fenders or something. I did not figure out how solve it yet.
If you wish to increase the speed - buy the clipless pedals. Then you will be able to not only push the pedals, but to pull them up too.
It seems it depends more on the "engine", than on the bicycle. Sometimes I can not even keep pace with a cyclist on a hybrid, but sometimes I can easilly take over a cyclist on a roadbike. Depends on the cyclist, more than on his/her bicycle.