When I made a uninformed decision and bought a mountain bike to ride on the road I was miserable. The one thing I did to make it a lot easier was to swap out to slicks. Made a night and day difference, until I bought a road bike.

Don't worry about the speed right now.As you build your muscular endurance and lungs up, the speed will come. Just keep on riding and you will see.