seems to me that lotsa people ride trackbikes that are a touch smaller than the corresponding size roadbike they might ride.

like 47x16 said, your bike will be snappier and lighter. and i think the steep drop from saddle to bars also stretches you out more than a classic road position.

but whatever, ride what's comfortable. as a side note, i couldn't ride half of y'all's bikes - while i love the look of a pursuit or track bike with the bars 2 feet below the saddle, my back just refuses to cooperate with the aesthetic.