Yeah, make it out and you can learn the route most of the way. After you do it once you'll be able to do it by yourself, there are only two or three places that are a bit confusing, but after that it's easy.
If you want to watch the races though, a more time-effective way to get down there would be to take caltrain to Diridon or tamien and ride from there. I'm always happy to have new people on the ride though, makes for good conversation.