I wouldnt ride with a down jacket. I have a thin bonfire with primaloft, and I wear a warm fleece underneath... no problems with that. Plus, you can get a jacket with zippered pit vents.