Do it, you'll love the light weight and stiffness. The road geometry should be more comfortable than buying an aluminum track frame.
I know most people don't NEED a frame which doesn't flex under hard pedaling but it feels nice. Make sure you source a good 1-1/8 stem and 31.8mm bar to maintain the stiffness and get some brake levers which let you hold on to the hoods like Tektros.