I think in most cases it's a resounding yes, but there are exceptions noted above.
If you have a relatively short commute, drive a paid-for beater with no repair issues, or a motorcycle, it seems the cost savings are about a wash with a reasonable amount of good riding gear. But these are hard costs.
For us older folks, the savings on health related issues are incalculable.