Fueled by Boh,
the problem is getting on the other side of the Bay. I would advise highly using the Tangier Ferry. You will see a wonderful island town that is very unqiue.
http://www.tangierislandcruises.com/Cross_Bay_Ferry.htm
Of course, you can always try to get a ride across one of the bridges or swing way to the north and cross that way. The Bay Bridge used to do a service to get your bike across but I think it was discontinued.