Definitely a reasonable day trip. You will ride through Eastsound on your way up to Mt. Constitution. Depending on how much more mileage you want, one option is to ride down to Olga before turning around and heading back to the ferry.