That's basically a variation on a foam roller, which does help.

There's a couple things that can dramatically decrease soreness. Foam roller or massage following a hard ride. Riding lightly the next day (~45min no effort spin. Think riding to the neighborhood coffee shop in your lowest gear). The idea is to work the latic acid out of your muscles.