I don't really like cold weather, however if you can keep yourself warm and have ready access to warm fluids and a warm way to sleep you should be good to go. I have camped (backpacking) in temps near 0*F (-18*C) However we went prepared knowing it was going to be C-O-L-D, funny part was it warmed up and started snowing...
Coldest I have ever camped while cycling has been just below the freezing mark, no issues.
Aaron