I can't ride my road bike with no hands when my torso is in normal position (hoods or drops). I have to sit up very straight, just like a kid on a bmx bike.
Not sure what that has to do with this thread, no offense to Lester.
I am guessing it is the bend in your back. Arch your back the other way when you need to signal.