i have a jersey that the pocket is shallow, so I cut the inside of the jersey & added material to make it deeper. Only thing I've dumped from that jersey was a water bottle.
As long as the elastic band at the top goes over the phone, it hasn't raised any concern for the phone to pop out.
__________________
-YMMV