Definitely from behind the dropout. The most fragile part of these derailers is in fact how the tabbed washer is attached to the end of the sprung pivot bolt. It's easily forced, making your derailer useless. To be on the safe side, use 2 allen keys, one to loosen (inside of the dropout) and one to keep the pivot bolt steady.