Do you have pedestrain signs asking them to stay to the right? Do you have signs that tell bikes to call out "on your left" and/or ring a bell when announcing that they're behind the pedestrian? Not like I'm being accusing, but you have to have some kind of plan and rules set in place before you do this. Then campus police should be roaming and ready to issue tickets on both sides- to pedestrians walking on the wrong side or not staying to the right, as well to bikes that don't warn before passing.
It just sounds like you need a plan, then enforcement.
Koffee