I'm safest where drivers are most attentive to what's going around. In my area, this is usually downtown. More pedestrians everywhere, cyclists, people stopping to park, etc. More people's wits are about them. Slower traffic is nice too.
Arterials are nice with less traffic lights, but our downtown is also more flat, so I can just keep up with traffic instead of having it blow by.