As we get older it takes some of us longer to build our fitness. I'm 65 and it is a very slow process but I have been making gains since I retired from work.
Don't know about the grumpiness I usually feel calm after a hard effort. Lack of sleep is the main thing that makes me grumpy.