Ride those.

Do not ride hand made glued on tread tires. Rollers will de-laminate tread. Use a less expensive clincher. This is an area not to use a racing tubular. I won't let junior roller ride for race warm-up on tubulars.

The small dia ones offer more resistance, and destroy tires faster. Just go bigger - 5" and enjoy. You are doing the gym you said. Spin out and chill on the rollers.