How about having the week start at the two second interval between 11:59pm on Sunday night and 12:01am on Monday morning? That way the week will start on both days.

I think if you are religious, it'd be whatever day falls after the "day of rest" for your particular religion. The day God (or Whomever) decided to really chill out.