As @FastJake and @Iride01 noted above, make sure you're applying torque in the proper direction. Use penetrating oil, try heat, and a breaker bar with an Allen socket can provide more leverage.