Just dress for it and you can do it. I did a 3 hour ride yesterday (1/3) with temps about 18F and wind 20-40MPH. The crosswinds were a bit much, but I was dressed for the part and had a good ride. Only annoyance was my water bottle froze.

There is no such thing as too cold, only insufficient clothing.

PS How is the cycling in Malaysia??