Tires can make a huge difference; the Panaracer Pasela are hybrid tires, while the Conti/Forte are more on the road side. There is also air pressure and the age/condition of the tires. I would switch the wheels if possible and see if the Fuji is less sluggish with the Raleigh wheels.