Since you had a stop sign, and he had a stop sign, I'm thinking in terms of right-of-way, the person who arrived at his stop sign first had it, after yielding to all north-south traffic.