You don't HAVE to, but on long, straight downhills the fastest you can go how fast gravity takes you unless you spin like mad. If you're not racing, though, it doesn't really matter. You can coast fast enough downhill to have fun. It's just the easiest way to pick up speed if you do have gears.