You should be fine.

There's a lot of funny things people do with track bikes that are 'not too healthy,' but it typically holds up well. Front braking stress will most likely not be an issue.