Track bikes are designed to be raced - they like very smooth surfaces, react very quickly to steering input and when chosen for the track, place you in a low racing position.

You can address that last item by buying a larger track frame than you'd use on the track as along with the higher head tube, you'll also get a longer top tube so. The thing to watch is that you don't go too big and have to reach too far for the bars. You'll still have a twitchy bike that likes smooth surfaces.

More road orientated bikes won't be as twitchy, be more forgiving of the road surface and it will be easier to get a frame that fits a road riding position.

For an urban bike, look for places to mount fenders, front and rear brakes, carriers, drink bottles - pure track bikes won't have any of them, many roadies won't either. Many bikes designed for the urban environment do, at least in part.