I have white coat syndrome. My BP is always higher when at the doctor's office. This may have happened to you to some degree when you where being compared with other unfit people. BP is a funny thing and should be checked out by your doctor. I would also recommend the home testing. Learn to relax and try to test yourself without stress for the results. You may benefit by taking it a couple of times. I get a lowere reading on several occassions on the second try. Try to take it in the morinings and in the evenings on non work days, vacations, etc to see if there is a difference for you.
If it still is high, look at some of the diet issues and high blood pressure.
Good luck