This is my setup, also an old Raleigh. I dunno what the maximum size tires your track bike can take, but for dirt and gravel I would recommend at least 28 mm tires, preferably some tough ones.
I have tried riding my Continental GP 4000's in 28 mm in the dirt and gravel quite a few times, and have flatted almost every single ride. However, YMMV.