I have never used a GPS.
1) Go to your local Tourist Information centre and get some maps of your area (and any other areas of interest)
2) Have a good look at the map. Pick a place you want to go this weekend. Decide how you want to get there.
3) Place the map in your map case which is located on top of your handlebar bag
4) Cycle there, following the map. And yes, there may be some points where you will stop to double check things on the map. But that's OK.
5) Do that several times and you'll start to get good at following maps.