I agree swapping the wheels is the most obvious test you can try without much fuss.
I've always loved the ride of my GS and I know others feel the same.
I have no experience with Fuji but that's a nice looking bike. Ride it, be happy, get used to it, then you can be pleasantly surprised by how quick the Raleigh is when you get it back into service.