By all means, Go for it.
Pick a park or campsite 30 to 50 miles from home with a safe, relatively flat road to it.
Get your stuff together and go for an overnight weekender. A great experiment to find out if you like touring, and figure out how to go about it.
If possible, talk a friend into going with you. Hopefully you are compatible and can laugh through all the lessons along the way.
If that works, plan a longer trip. Maybe a week or 10 days. Still flat country.
you will learn on the hills why mountain bike gearing is particularly favored among bike tourists. If the idea of touring still turns your crank, then think about a touring bike.
But not before you have completed a trip or two on what you have got.
Good Luck, and have fun.