A less expensive way to gather traffic data
#1
Happy banana slug
Thread Starter
Join Date: Sep 2015
Location: Arcata, California, U.S., North America, Earth, Saggitarius Arm, Milky Way
Posts: 3,273
Bikes: 1984 Araya MB 261, 1992 Specialized Rockhopper Sport, 1993 Hard Rock Ultra, 1994 Trek Multitrack 750, 1995 Trek Singletrack 930
Mentioned: 27 Post(s)
Tagged: 0 Thread(s)
Quoted: 1297 Post(s)
Liked 1,131 Times
in
696 Posts
A less expensive way to gather traffic data
It's an AI that runs on a Raspberry Pi computer. Looks pretty interesting. https://sf.streetsblog.org/2022/12/1...fight/#new_tab
#2
Full Member
The cellular providers have all the data. Every single one of their customers is tracked by GPS and the record of those tracks is stored indefinitely. They aggregate that data and sell it through consultancy services. A query like "how many people traverse this roadway," is a simple thing. Of course, it costs something, but the data is there. From what I've heard, they won't sell access to the data outright, but sell consultancy services so the questions the data answers are mediated for their fees. It is frequently applied for issues like traffic and parking. If a proposal is going to bring a lot more traffic into an area, there's analysis about where all those cars will park. Planners need to know things like how much of the traffic is parking and for how long.
The RPi solution is cute and cheap, but scale it out to the whole city or state and it's impractical. The GPS tracks of every cell phone are already in the database sitting at the query prompt.
The RPi solution is cute and cheap, but scale it out to the whole city or state and it's impractical. The GPS tracks of every cell phone are already in the database sitting at the query prompt.
#3
Senior Member
Join Date: Apr 2009
Location: New Rochelle, NY
Posts: 36,926
Bikes: too many bikes from 1967 10s (5x2)Frejus to a Sumitomo Ti/Chorus aluminum 10s (10x2), plus one non-susp mtn bike I use as my commuter
Mentioned: 132 Post(s)
Tagged: 1 Thread(s)
Quoted: 4881 Post(s)
Liked 920 Times
in
552 Posts
Yes the data is there, but it's sometimes difficult to tease out critical details.
Discounting idiots like myself who keep location turned off, the problem is that the data only says where the cell phone is, which isn't always the whole story, because we don't know how it got there or what kine of vehicle (if any) is involved.
While it might be possible to tease it out by speed, ie 3mph implies walking, 30mph is driving, etc., it's lots of work and not reliable in many instances. For example, in dense metropolitan traffic, my bicycling speed is closely matched to general traffic. In parts of Manhattan, so is my walking speed. If I'm moving at 25mph in the burbs, am I driving, riding as a car passenger, on a bus, or a strong bicyclist?
Businesses measuring traffic for marketing purposes don't have a reason to care, and urban planners also don't care about small skews. But if one's purpose is to analyze vehicle use, the raw data isn't nearly as usable as implied.
Discounting idiots like myself who keep location turned off, the problem is that the data only says where the cell phone is, which isn't always the whole story, because we don't know how it got there or what kine of vehicle (if any) is involved.
While it might be possible to tease it out by speed, ie 3mph implies walking, 30mph is driving, etc., it's lots of work and not reliable in many instances. For example, in dense metropolitan traffic, my bicycling speed is closely matched to general traffic. In parts of Manhattan, so is my walking speed. If I'm moving at 25mph in the burbs, am I driving, riding as a car passenger, on a bus, or a strong bicyclist?
Businesses measuring traffic for marketing purposes don't have a reason to care, and urban planners also don't care about small skews. But if one's purpose is to analyze vehicle use, the raw data isn't nearly as usable as implied.
__________________
FB
Chain-L site
An ounce of diagnosis is worth a pound of cure.
“Never argue with an idiot. He will only bring you down to his level and beat you with experience.”, George Carlin
“One accurate measurement is worth a thousand expert opinions” - Adm Grace Murray Hopper - USN
WARNING, I'm from New York. Thin skinned people should maintain safe distance.
FB
Chain-L site
An ounce of diagnosis is worth a pound of cure.
“Never argue with an idiot. He will only bring you down to his level and beat you with experience.”, George Carlin
“One accurate measurement is worth a thousand expert opinions” - Adm Grace Murray Hopper - USN
WARNING, I'm from New York. Thin skinned people should maintain safe distance.
#4
Full Member
Turning off location does not stop the GPS tracking. All that does is stop location tracking by software or app providers like Google. The cellular provider cannot not know where the phone is. Unless the phone is off, it's location is being tracked. Without location data, you could not connect to the nearest cell tower. But that brings up the point that the location tracking data is available from multiple sources. The cellular network providers like Sprint, Verizon, AT&T, T-Mobile, Spectrum, etc. and then also app providers like Apple, Google, Microsoft, Facebook, etc. Users can opt-out of location tracking for the latter, but not the former. But with many people not choosing to opt-out, the data is available from several sources. The data set doesn't need to be complete or perfect. Margins of error can be calculated and the data presented with measures of center and standard deviation. The raw data isn't what drives decisions anyway, but the summary metrics of the aggregate.
The street in question was closed to motor vehicle traffic, so that was sufficient to determine non-motorized traffic, pedestrians, bicycles, unicycles or whatever. Either the slow street was being used or not. To get more sophisiticated use data like to split bicycle from pedestrian traffic, it could be estimated by rate of speed as you say (available from GPS data) or just interpolated from sample data. It's a lot easier if a targeted survey only needs to determine a ratio than if it bears the entire burden of data collection.
The street in question was closed to motor vehicle traffic, so that was sufficient to determine non-motorized traffic, pedestrians, bicycles, unicycles or whatever. Either the slow street was being used or not. To get more sophisiticated use data like to split bicycle from pedestrian traffic, it could be estimated by rate of speed as you say (available from GPS data) or just interpolated from sample data. It's a lot easier if a targeted survey only needs to determine a ratio than if it bears the entire burden of data collection.
Last edited by greatbasin; 01-11-23 at 11:35 PM.
#5
Senior Member
Join Date: Apr 2009
Location: New Rochelle, NY
Posts: 36,926
Bikes: too many bikes from 1967 10s (5x2)Frejus to a Sumitomo Ti/Chorus aluminum 10s (10x2), plus one non-susp mtn bike I use as my commuter
Mentioned: 132 Post(s)
Tagged: 1 Thread(s)
Quoted: 4881 Post(s)
Liked 920 Times
in
552 Posts
Thanks for that. FWIW, my reference to turning off location was simply an intro to thr real issue of teasing out vehicle type.
On that point we seem to agree that some kind of visual census would be necessary to estimate the mix ratios, after which info could be extrapolated from the totals.
In any case, I get grief (what if there's an emergency, etc.) because l generally don't take my phone, or keep it off when riding.
Now I have another excuse, so thanks again.
On that point we seem to agree that some kind of visual census would be necessary to estimate the mix ratios, after which info could be extrapolated from the totals.
In any case, I get grief (what if there's an emergency, etc.) because l generally don't take my phone, or keep it off when riding.
Now I have another excuse, so thanks again.
#6
Happy banana slug
Thread Starter
Join Date: Sep 2015
Location: Arcata, California, U.S., North America, Earth, Saggitarius Arm, Milky Way
Posts: 3,273
Bikes: 1984 Araya MB 261, 1992 Specialized Rockhopper Sport, 1993 Hard Rock Ultra, 1994 Trek Multitrack 750, 1995 Trek Singletrack 930
Mentioned: 27 Post(s)
Tagged: 0 Thread(s)
Quoted: 1297 Post(s)
Liked 1,131 Times
in
696 Posts
The cellular providers have all the data. Every single one of their customers is tracked by GPS and the record of those tracks is stored indefinitely. They aggregate that data and sell it through consultancy services. A query like "how many people traverse this roadway," is a simple thing. Of course, it costs something, but the data is there. From what I've heard, they won't sell access to the data outright, but sell consultancy services so the questions the data answers are mediated for their fees. It is frequently applied for issues like traffic and parking. If a proposal is going to bring a lot more traffic into an area, there's analysis about where all those cars will park. Planners need to know things like how much of the traffic is parking and for how long.
The RPi solution is cute and cheap, but scale it out to the whole city or state and it's impractical. The GPS tracks of every cell phone are already in the database sitting at the query prompt.
The RPi solution is cute and cheap, but scale it out to the whole city or state and it's impractical. The GPS tracks of every cell phone are already in the database sitting at the query prompt.

#7
Full Member
I don't carry a smart phone. Even so, what is the portion of traffic that does not? I'd guess less than 1%. Even if you don't have a smart phone, virtually all late-model cars are equipped with GPS and cellular. Even if a subscription of any kind isn't activated, the radio is still contacting the cell tower. It isn't denied service until several more hops on the network, and even then it isn't denied emergency service. It's increasingly an "internet-of-things" and if you have anything, you're probably being tracked. We could say that the data missing from the people who don't have anything isn't as significant as the data from the things.