Have you checked that your chainline is straight? Might be getting thrown off when you apply back pressure. Also, normally the chain doesn't have to be "tight" so much as "not loose". There was a riveting discussion on this not too long ago that you'd be better off not reading.
Similarly, check the condition of your chainring, cog, and bottom bracket.