Mallets sound like a good choice for you. I ride mostly clipped in and here and there I like to just cruise around in flip flops or sneakers and since I take it pretty easy then, I am not too worried about the lesser grip.

Martin