Coming in from the Taroko Gorge is beautiful. If you like mountains you can continue up the cross-island highway #8. But be aware that that's an entire day driving by car, let alone by bike.

Same for the Southern cross-island highway #20. Yushan is a beautiful park.

Kening NP in the south is nice but very hot during summer because of its tropical location.