Depending on your laws, you may be breaking the law by riding on the sidewalk.
I am all for more people riding to work, but if that guy really was only going 10mph during rush hour, then he may be a little nuts. That's a good way to get some aggressive cager to run you over.