I tried some Specialized Sonoma casual leisure shoes with toe clips. The sole lacks sufficient grippyness to engage the pedal and it just slips out the back.
The Shimano leisure shoes have a softer rubber compound sole and are quite effective.
Most trail shoes have a sufficiently stiff sole unit but some have too much grip and ****** foot removal.