I have the same book you do, the Bikeline Esterbauer Rhein Radweg. I rode the route you are planning to do last year on my ride to Spain.
The Rhein from Frankfurt to Basel is absolutely beautiful the entire way. You will have a wonderful ride. The bikeline book is a great asset, even if you don't speak german. The maps are self explanatory.
Where are you from? I live in Frankfurt. Would you like some company on your ride out of Frankfurt?