I have a few of those "angled" intersections by me and it seems like people just lose their minds at those intersections - I don't know why. Suddenly the rules for a 4-way stop go out the window, people forget to check the crosswalks, turn in front of on-coming traffic, etc.

That said, I'm pretty sure you're in the right. I'd probably keep crossing like that because I think you'd be less visible to cars turning left at the other crosswalk.