I was also thinking of the Williamsburg Bridge but I use the Pulaski Bridge when I'm going to Astoria. Then you can continue north on either Vernon Blvd, which now has a bike lane, or use 21st Street which doesn't take you as far west.