Yeah, that's the impression I've gotten from riding around there. I remember a time when I rode to the border of Markham and Scarborough; it was probably one of the worst experiences I have ever had, as far as driver-awareness is concerned. Downtown driver's are bad, but not so callous, I don't think. There are so many other obstacles and hindrances to their commute that I think adding a bicycle to it doesn't make much of a difference to them.
My commute is about 8 km one way, and 8 back. I ride from Rogers and Caledonia down to the U of T campus on most days, and other days until Danforth and Donlands. I much rather prefer riding downtown, and on a street like Bloor. I'm not sure why... I'm not a fan of bike lanes, to be sure.
Have you ever seen Sheldon's Lookout along the waterfront bike path?
What is the commute to York like otherwise? I am probably going to do Teacher's College there and I'd like to be able to commute by bicycle. A lot of bike thefts?