You will gain fitness, the more you ride. Don't be discouraged. Headwinds are definitely hard, both physically and mentally.

Did you eat and drink enough during the ride? That can make a huge difference. 2.5 hours is long enough to need to eat.