Yes worth it.

You can get a set of decent, entry level shoes AND pedals for under $100.

That being said, it's not mandatory...case in point:

There is a very strong rider in my club who smokes 90% of the riders, and he rides in tennis shoes. He's dutch, maybe that helps?