The first jersey should work, and that's really as heavy you want to go for the temp range you mentioned.

There is no need for long tights or bib tights. You just need a pair of knee warmers.

Merino wool works great also in that temp range. You can start with a nice baselayer to see if you like that.

Toe covers are a good thing when it's in the 40s.