My dad grew up in Canoga Park (the area now renamed Winnetka) and told me a story about climbing the fence with his Gitane and biking around the track, it probably would have been around 1975-6?
Could one of those crazy old man tales, but if it was the same fence they have now it seems possible.