Jeans are almost always the worst pants that you can wear. I have done plenty of riding in them.
I now wear poly-cotton hiking pants for casual riding in most conditions.
In the wet and cold I wear waterproof rain pants on top.
In dry cold, long johns underneath.