Shutterstock

"Sentiment analysis" of social media could change the way you report potholes forever.

You probably know about a couple of ways to log formal gripes with your city about things like downed tree limbs, crummy garbage service, or graffiti. You could call up your councilmember, or file a 3-1-1 ticket, or even turn up for a public meeting. Many cities have long been trying to modernize this process for the 21st century, by allowing residents to track responses to their complaints online, or by letting them dash off geotagged missives by smart phone app.

But what if technology could go just one step further? What if you never even had to contact City Hall about that needed road repair on Main Street, because City Hall already saw your tweets? (And we know you spend a lot of time on Twitter moaning about #potholes).

We wrote back in January about this idea, after some academics at Purdue proved that they could track live customer satisfaction on the Chicago Transit Authority’s ‘L’ trains by data-mining riders’ tweets. Now the concept – social sentiment analysis – is coming to whole cities. IBM, under its Smarter Cities program, is now marketing software to municipalities that claims it can determine aggregated public opinion – positive, neutral and negative – in the millions of data points that make up our social media ramblings. Its most impressive trick, as an algorithm, is that it can read natural language (as opposed to the Proper English you were taught in freshman composition, which none of us speak online). IBM (which, yes, is an occasional advertiser on this website) even claims that its software can reason out the difference in intent between sarcasm and sincerity.

Municipal governments are, not surprisingly, a little slower to this leading edge of social media analysis. For-profit companies have already figured out how to deploy software that trolls the Internet for consumer reaction to products and brands. Even the federal government has expressed an interest in similarly data-mining social media for clues about upcoming civil unrest or disease outbreaks (in America and abroad).

The challenge for cities is how they might parse social media sentiment about not just one dish detergent (or one frequently Googled query during flu season), but about numerous interlocking indexes of civic life. Are parents in Chicago supportive of the teachers’ strike? What are New York subway riders saying about that new trash program? Or Los Angelenos about the crackdown on pot dispensaries? Is there a flare-up of graffiti concern on the west side of the city? Or a collision on the east side about to erupt into an all-out traffic jam?

Our world now spits out by the second unconnected data points on all of these questions. This is both a boon and a problem. “Those inputs are now starting to overwhelm structures,” says Chris O’Connor, vice president for IBM Industry Solutions Software, “whether that’s a public structure like a city, or a private structure like the people who run a football stadium or an airport.”

Cities have always had old-school, plodding ways of collecting smaller quantities of this information. In addition to those 3-1-1 reports you file, you may have taken a phone survey for a government agency or responded to a mailer.

"There are a bunch of analog versions where you’re more intrusive in asking the person to take a minute to respond," O’Connor says. "We’re trying to go where the people are already publicly expressing themselves."

If the thought bothers you of a government-deployed algorithm listening in on your public expression, maybe you don’t want to complain about potholes on Twitter after all. These sentiment analysis tools work precisely because we’ve made so many of our private thoughts publicly available in cyber space. From a city’s perspective, the Internet is the new town hall.

Before IBM unveiled its Social Sentiment Index this week, it tested the system in India, scouring social media in Mumbai, Bangalore and New Delhi around the subject of traffic. People in Bangalore, it turns out, view their parking situation three times more negatively than commuters in Mumbai and New Delhi, although Delhites appear much more stressed when it comes to traffic than residents of the other two cities. Sentiment analysis is valuable when it aggregates the moods of so many people, but the big picture that emerges could also point to specific action.

"Think about health care services, think about the pothole, think about the bus and transportation capability that could be rerouted and moved as a result of understanding things a few minutes sooner," O’Connor says. And, yes, you’re probably tweeting about problems faster than bureaucracies can report them. "Five minutes one way or the other makes a huge difference in a traffic jam."

Top image: Verticalarray/Shutterstock.com

About the Author

Most Popular

  1. A sign outside a storefront in Buffalo, New York.
    Environment

    Will Buffalo Become a Climate Change Haven?

    The Western New York city possesses a distinct mix of weather, geography, and infrastructure that could make it a potential climate haven. But for whom?

  2. photo: a high-speed train in Switzerland
    Transportation

    The Case for Portland-to-Vancouver High-Speed Rail

    At the Cascadia Rail Summit outside Seattle, a fledgling scheme to bring high-speed rail from Portland to Vancouver found an enthusiastic reception.

  3. Tents with the Honolulu skyline behind them
    Life

    Where Is the Best City to Live, Based on Salaries and Cost of Living?

    Paychecks stretch the furthest in smaller cities for most workers, but techies continue to do best in larger, more expensive cities.

  4. Design

    How Advertising Conquered Urban Space

    In cities around the world, advertising is everywhere. We may try to shut it out, but it reflects who we are (or want to be) and connects us to the urban past.

  5. A photo of a police officer in El Paso, Texas.
    Equity

    What New Research Says About Race and Police Shootings

    Two new studies have revived the long-running debate over how police respond to white criminal suspects versus African Americans.

×