I've cycled in -40C/F ... on a commute.
And then there was my coldest century (100 mile ride) ...
http://www.machka.net/brevet/Coldest_Century.htm I started at -32C and the high for the day reached -25C.
People ski in those temps ... so why not cycle. But just be prepared for S-L-O-W.