Nope, I wouldn't consider you crazy, since I was planning my winter riding yesterday while on late afternoon ride.
I rode 3-4 times a week until Jan 22 of this past winter, as long as the temp allow the trails to remain clear of ice, I will ride. Too much ice makes it way to dangerous to ride, zero traction is a condition to be experiecned.
I have ridden at temps down to 18 degrees, many of those rides after dark with full lighting. It is a really unique experiece to ride at night, snow falling and the lights reflecting of the snow already on the ground, I can hardly wait.