On the internet, traffic is easily tracked. Google and social media have algorithms that know what users are searching for. Online retailers can monitor what shoppers are buying. Newspapers can see in real-time how many readers are viewing an article.
The same hasn’t been true for traffic in the physical world, where data-gathering has been decidedly more low-tech.
Want to know how many people are getting on at a certain bus stop? Hire someone to stand at the stop with a clicker. Tracking how many passengers are on a train? Do an on-board survey. Figuring out traffic congestion? Get a view from a chopper. Or, as many motorists do every day, just sit in it.
And if that wasn’t cumbersome enough, when companies do finally collect that data, they’re often overwhelmed by it. Big data, as it’s called, gets its name from the sheer quantity of information that pours in when companies start tracking something. Most companies hit a technical ceiling when it comes time to crunch the numbers.
Urban Engines, a Silicon Valley startup, wants to change that. The 5-year-old company helps transit agencies, delivery companies and taxi services make sense of all that data. The company employs about 50 people with engineering and data science backgrounds to develop an analytics tool that helps its clients process and understand the data they collect.
“There’s a lot of low-cost sensors coming on board, and collecting movement data is now a big trend,” said Shiva Shivakumar, co-founder and chief executive of Urban Engines. “Our insight is: How do we take some of the ideas we learned from the digital world and apply it to the real world?”
Many large technology companies, such as Uber, Google and Apple, have already figured out ways to cobble together the vast amounts of movement data their drivers, map makers and devices collect, and make sense of it.
For instance, Google and its subsidiary Waze, a mapping app, use big data to tell drivers in real-time which roads are congested and where accidents have occurred. Uber and its competitor Lyft use big data to identify hot spots where there’s high demand for rides.
But smaller companies that don’t have those technical resources are turning to Urban Engines for help. The company’s Space Time Engine is a platform that lets companies and transit agencies plug in whatever data they have and see what they can do with it.
Instead of having information such as trip data and delivery times sitting in a spreadsheet, the Space Time Engine creates real-time visualizations so agencies can see the movement of people, vehicles and packages on a map. It can also make predictions based on past data.
The company counts the Bay Area Rapid Transit rail service, the Washington Metropolitan Area Transit Authority and Delhivery, a logistics firm in India, among its customers. The company, which is backed by big-name venture capital firms such as Google Ventures, Andreessen Horowitz and Greylock Partners, declined to reveal how many clients it has or how much money it has raised.
The Washington Metropolitan Area Transit Authority, for example, had for years analyzed tap-in/tap-out data to find out where passengers were getting on and off, with the hope of improving the commuter experience. But the amount of data it collected overwhelmed its old technology systems. The agency had custom tools but Shyam Kannan, its director of planning, said they were “costly and time-consuming.”
Urban Engines streamlined the data that the transit agency collected, enabling it to visualize customer travel patterns, quickly identify delays and congestion, and better understand platform crowding and wait times.
“We are now able to get a granular view into our transit system across all stations in 15-minute increments,” Kannan said.
In India, Delhivery has a ground staff of more than 12,000 people who process more than 250,000 packages a day across 375 cities.
Although the company collects its own data about each package, it hit a wall when it came to figuring out where packages were being held up.
“Every shipment gets scanned 30 times before it gets delivered, and the scans tell you how the network is doing,” said Kapil Bharati, Delhivery’s chief technical officer. “By putting this data into Urban Engines, we could see across the country where parcels were getting delayed and stuck, and whether goods were moving on time.”
Now, when packages have fallen behind schedule, the company’s central team receives alerts in its system and is able to contact ground staff directly.