Obviously, there are lithium batteries for cars, and these must tolerate low temperatures, so the technology is there. If you Google around, you can find low-T versions in 18650 such as
here.
do they publish any sort of datasheet with performance data or charts?
Steve in Peoria