Ride ride ride and ride!
OP - How many miles do you ride each year? Going from 15mph average pace (average, beginner pace) towards 18-20mph (serious hobby cyclist) is a big step up. There are no shortcuts but thousands and thousands miles of training.
Keep riding and it will just happen.