You can tour on a Varisty. The frame is strong. If I remember correctly from another thread the rims have been upgraded to aluminum. Is that correct? The Varsity is havier than a sportier, bike with higher end tubing, but that doesn't mean you can't do it. It just means the bike is heavier. You will be loaded up with stuff so the weight of frame is not that much of an issue.
Then it sounds like you are doing this already, do short tours and see how things go. You will learn what you like and what you don't. Always keep an eye out for a bike. Even if you find something sporty and too light for touring. It may be fun to have a sporty bike for daytrips.
You got the bike tatoo'd on your leg. Then you have to tour with it. It is just a matter of making it work.
A few more posts and you can post pictures of where you have been.