I guess looking back, it was not a good idea for the pushups. I don't do that many. 5 sets of 20.
I don't believe that it is the bike fit, as I have had the same setup on that bike for about 6 + years. So, I guess I will rest the elbow and do core and lower body work.