Location-based social media monitoring

Beacon Hill, Sunday night, 10:50 p.m.: Sitting at my kitchen table, I heard a series of pops followed immediately by the sound of sirens.  “Were those gunshots or fireworks?  Should I be worried?  And are the sirens related to the pops I heard?”  

My first reaction was to search for possibly related posts on Twitter while looking for a live audio feed of Boston police scanners.  Instead, I remembered reading about the location-based social media search services that aggregated posts from across several platforms, and I tried the first one I could quickly get a free trial for: Echosec.

Instead of searching across several social media platforms separately, Echosec allowed me to search for all geotagged posts in an area of my choosing and within specified date ranges.  My story has a simple ending — I found on Echosec that neighbors on reddit posted that it was definitely fireworks, which was later confirmed by the police through the live feed.  

Nothing became of this tiny story, but imagine the uses for location-based social media monitoring services in situations with more impact and higher stakes.  

Using Echosec (and other similar services) for discovery and identification

Google “location-based social media monitoring,” and you’ll find pages of lists suggesting various services, most of which appear to be enterprise services.  While many of these services appear to primarily serve police departments, security companies, and marketing departments of large businesses, over the last couple years, journalists have also used these tools to assist their reporting.  For example:

  • At NBC 5 in Chicago, a producer used Geofeedia to quickly find photos of people who were hiding inside a building after an employee shot his boss.  Based on these photos, the station was able to identify potential sources.
  • A social media editor for The Associated Press used SAM to identify students at a South Dakota high school where a shooting was foiled, which led to a reporter being able to conduct an interview to confirm details seen on social media.

In more general cases, these tools can also be used to get a sense for people’s reactions to news and events across the board, not only to identify sources and images.  Broadly, using geolocated social media search tools as several benefits over simply searching on Twitter.

  • Aggregating data from many social media platforms saves time in pressing situations.
  • Aggregation also provides more comprehensive coverage, especially as different social media platforms are prominent in different areas of the world.
  • Searches can be more location-specific and time-specific than most apps allow within their own search function.

Drawbacks to these services

However, there are two major hurdles these services have to overcome to gain more mainstream traction:

  1. They’re relatively costly.  At the lower end, Echosec costs $129 per user per month, and as of 2012, the much more powerful Geofeedia’s preliminary pricing was $1,450 per month for five users.  (And as I searched through lists of services that were only a couple years old, I found that free versions don’t seem to last long in the marketplace, or if they still exist, are not well supported.)  Either the prices have to come down, or the services have to become much, much better than they currently are in order to make the price tag worth it for newsrooms that are satisfied searching on their own.
  2. The vast majority of social media posts are not geolocated. While the percentage varies by platform (Instagram, for example, tends to have “a lot more [geolocated posts] than Facebook, Youtube, or other platforms”), a Knight Lab sample of 200,000 tweets run in 2015 found less than 0.4% were geocoded.  This means that while you can get a sample of tweets that are geolocated, you do have to make sure not to rely on these tools too much — you could miss an important non-geocoded post that does not turn up in your searches.

That said, for many reporting purposes, simply knowing how to strategically search on popular social media sites is enough.  For journalists without access to these fancier aggregated geolocation search tools, old-fashioned hashtag-hunting and keyword-monitoring may be sufficient.

The potential

A common accusation recently is that the “mainstream media” has lost touch with the average American.  One way to gain easy access to some representation of those viewpoints (although we do then get into the issue of comment rage and trolls — which we’ll sidestep for now) is to see what everyone is saying across various social media channels and be able to check for location-based trends.  After all, the Internet is supposed to be the great equalizer — according to a 2016 Pew Research study, 87% of Americans use the internet.  That percentage will only grow.

Going forward, I do think location-based social media monitoring tools have the potential to become even more powerful as a way to explore the public conversation and identify trends, or simply to get the “pulse” of the public.  

Creativity and collaboration –aspects of future quality work

Even though the speed of processing information is extremely relevant in today’s sea of news, I believe that tools which help us be more creative and collaborative play an extremely important role for criticality and depth of what we perceive. In particular, working in interdisciplinary teams and viewing a topic from multiple perspectives seem like a crucial quality for any future work and meaningful storytelling.

For this reason I found the app GroupMap very interesting for managing creative and productive group flow. The tool helps us improve group brainstorming and creative processes but it also enables easier team decision making.

To facilitate a discussion, one can create its own map or choose from a list of templates and customize them to group’s needs. I found particularly useful templates for Charts where a group of people can visualize everyone’s opinions and thus ease decision making. For instance, there is an Important vs Urgent map and Effort vs Impact chart where, through dot voting, a group can set priorities and organize their time accordingly. In a way, this tool can help us quickly work together and visualize subjective opinions which can have powerful implications for group’s quality of work and outcomes.

Dijana’s Bio

Hi all! I am Dijana Milenov and I am a graduate student of architecture at MIT.

I lived in Serbia until I was seventeen when I moved to an international boarding school in Italy. After that I finished an architecture and design degree at the University of Florida and this is my second year of graduate studies at MIT.

As a designer I am interested in the ways art can reveal knowledge and trigger possible new realities. In the times of abundance of data I believe that it is important to promote problem-solving skills in designing for knowledge. My architectural explorations question the function of beauty in our daily lives and in our relation to the environment. I have spent the last year away from MIT travelling in Serbia, Israel, and France working with architects with similar agendas.

My hope for this class is to improve my writing skills and to become freer and more creative using this media. I am very excited to work in a diverse group and learn from everyone!

Posted in Bio

Josh’s bio

I’m Josh, a second year graduate student in Comparative Media Studies. My previous credits include working as a Research Assistant at the University of Oxford’s Internet Institute, and as a Field Organizer on the Obama re-election campaign in New Hampshire. I’ve also worn several media hats: I previously sub-edited a news website called The Vibe, which provides a space for writing and original journalism by students and young people, and I’m a staff writer for MIT’s The Tech. (I also do the occasional radio interview for The Monocle 24.)

From my perspective, this class sits perfectly at the intersection of research and practice. My graduate thesis (due in May) looks at how Donald Trump was able to gain the attention and support needed to win the presidency, especially in respect to the use of his Twitter account. The story I’m telling obviously has a lot to do with the news media and its reporting role, in the age of email hacks, dossier leaks, nocturnal tweets, and other virtual flotsam.

Get @ me @JoshCowls, and on www.joshcowls.com. I’m also part way through an attempt to write 100 words every day for 100 days – you can follow my progress at medium.com/@JoshCowls.

Posted in Bio

Mika’s bio

Gallery

This gallery contains 1 photo.

Hi, I’m Mika, a Tokyo-based TV producer of documentary and educational shows at NHK, a public broadcaster in Japan. This year, I am spending time at MIT Media Lab as a visiting scientist, working with the Civic Media group led … Continue reading

Posted in Bio

Maddie’s Bio

I’m Maddie Perez, a second year MBA at MIT Sloan. Before coming to MIT I had a mixed bag of a career, including working in sports journalism, crisis communication, education PR, R&D research and consulting, and venture capital. I’m an aspiring venture capitalist with the hope of funding media companies that have found ways to create high-quality, accurate content with a profitable business model—we’ll see how long that takes. Here are a few more random facts about me:

  • I’m an army brat and moved around a bit growing up, but I consider Fayetteville, NC home
  • Coding-wise, I’ve focused primarily on front end work, and am pretty proficient in CSS/HTML and quasi-proficient in JavaScript
  • I’m currently working on a VR platform for autism therapy. The hope is that using different types of media in new ways (in this case building simulation exercises for VR) can improve the efficacy of autism therapy while drastically reducing costs
  • I was an English major in undergrad with a minor in policy journalism and media studies, so in some ways I feel like I get to relive some of my favorite classes
  • I’m a proud Slytherin

Décodex: on Classifying News Sources and Fact-Checking Fact-Checkers

On February 1st, the biggest daily newspaper in France, Le Monde, launched an initiative to combat fake news and biased information sources called « Décodex ». Or at least try to.

Décodex is made of several components. It consists in a search engine, Mozilla and Chrome add-ons, a Facebook Bot and pedagogical documentation on how to be a more careful online news reader. It catalogues 600 websites and classifies them according to their « reliability ». I put the term in quotation mark, as this reliability is assessed by the team building the tool, team called Les Décodeurs. Les Décodeurs is a branch of Le Monde specialized in data journalism and fact checking headed by Samuel Laurent.

Firefox add-on: -What does it mean? A barely reliable website propagating conspiracy theories. -Is this website reliable? This website regularly features fake news or misleading articles. Be careful and look other more reliable sources. If possible, look for the origin of the information.

The tool has a straightforward – yet arguably unattainable – ambition: verify if a website is, or not, reliable. It can be used by journalists, but also by anyone reading an article online. Its functioning is very simple, perhaps even too simplistic. You, curious yet naive reader (until now) surf the web, end up on a website, click on the Décodeurs extension that will give you one of the 5 following answers concerning the visited website’s credibility:

From Top to Bottom: [GREY] – Warning, this website is not a source, or its reliability is too variable to fit our criterias. To know more, look for other sources and the origin of the information. [BLUE] – Warning, this is a satirical website that is not made to propagate real information. It is a second degree read. [RED] – This website regularly propagates fake news or misleading articles. Beware and look for other more reliable sources of information. If possible, look for the origin of the information. [YELLOW] – This website can regularly be imprecise, not giving information about its sources and not conducting regular fact checking. If possible, search for the origin of the information. [GREEN] – This website is considered as reliable. Do not hesitate to confirm the information by looking for other reliable sources or the origin of the information.

The Facebook bot version leads to the following user experience:

In many instances, you will end up clicking on the link to the documentation, and learn how to find the original source of an information, and how to cross check what you are reading. If the website is not classified yet, you can also report it to the Décodex Team.

This documentation is, to me, the most innovative part of the tooI. I had never heard of any team in a newspaper sitting down to write proper guidelines to information search and evaluation. Perhaps because there are no definite guidelines, but I find the effort legitimate and fair in the current state of the industry, as social medias are blurring the line between fake and truth. At the heart of the Décodex initiative is the will to give the power back to the people and avoid the propagation of erroneous information. As they put it themselves, the tool represents « a first step towards mass checking information ». Hence, a democratization of the ability to identify what is reliable, and what is not. However, a first critique can already be made when looking at the Décodex classification. Websites categorized as « reliable » are mainly mainstream medias ( Le monde, NYT, CNN, etc…). Is it because you are an independent blogger that you are unreliable? Not necessarily, would I argue, but Décodex’s answer to this question is yes.

Additionally, the very existence of this tool triggers concerns. First of all, many websites, especially some that are considered as being on the right side of the political spectrum, have fired back at the initiative as some were classified by Décodex as « biased » newsources. Le Figaro rightfully asked the question « who will fact check the fact checkers? », and this is, I think, important: how can one claim, as Décodex seems to be doing, that she is completely unbiased, hence has the aptitude to judge others’ biases? How can one claim her classification of reliable sources is the « right one », that everyone should abide by? What prevents other sources to build the same tool, and classify the first classifier as non reliable in retaliation?
In some instances, however, the classification can hardly be argued. The Onion, for example, is classified as being parodic: everyone knows and acknowledges that The Onion is a satirist « news source ». The editors of the publication acknowledge it themselves and that is the very essence of their editorial line. The entire « not fully reliable category », is vague on purpose and encompasses platforms from breitbart.com to Russia Today. It seems hard to find generalized and cross cutting definitions of what makes a website enter this category.

Another important problem with this tool is the following: are the people who tend to share and read fake news going to use it? As a tool built by the mainstream media that is Le Monde, and the media undergoing an unprecedented credibility and trust crisis, is the initiative going to be considered as having enough credibility? Or is it going to be judged as biased and be a subject of an even more intense criticism? Is it going to be truste or not? Can it be relied on? A large amount of articles have been released criticizing the Décodex classification. Which brings in the big question: does Décodex even make a difference?

Posted in All

Tyler’s bio

I’m Tyler Dukes, and I’m a 2017 fellow at the Nieman Foundation for Journalism at Harvard. In real life, I’m an investigative reporter for the state politics team at WRAL News in Raleigh, North Carolina, where I work on longform stories and specialize in data and public records. I’m really interested in finding ways to use technology to enhance in-depth reporting and make data journalism more accessible to underserved media markets. That means (I think) developing better methods for training working journalists and educating journalism students in ways that allow them apply these skills practically on the beat.

At WRAL, I’ve led the reporting on deep dives into the state’s mental healthcare system, deaths in the prisons and, oddly enough, the search for sunken treasure off the Carolina coast. I also built systems that allow readers to search more than a million pages of records from a major university athletic scandal and explore the campaign cash fueling each state lawmaker’s election bid. Prior to working at WRAL, I managed a research project at Duke University’s DeWitt Wallace Center for Media and Democracy called the Reporters’ Lab, aimed at finding ways to reduce the cost of investigative reporting. I also freelanced as a science and technology reporter for several newspapers and worked as an adviser to North Carolina State University’s (then-)daily student newspaper.

While my background is in reporting, writing, editing etc., I’m also proficient in Python, JavaScript and HTML/CSS (although far, far, far from being an expert). I’m also really good at prying records from the clutches of government officials.

I’m a native North Carolinian, devotee of Eastern-NC barbecue and fan of gas station coffee. I love all dogs and very few cats.

Follow me on Twitter and Instagram.

Posted in Bio

Sruthi’s Bio

Hi, my name is Sruthi. I am a 2nd year MBA student at MIT Sloan and an engineer at heart. I have always been interested in understanding how technology can make a social impact. To be precise I am interested in how technology combined with business strategy could be used to make a social impact.

Prior to joining Sloan, I studied computer engineering and worked in fin-tech. Last summer, I interned as a data science intern at Microsoft, where I used data to influence internal strategy decisions. Combining my interest in both technology and strategy, I am going to be a future management consultant in the digital space.

I have always been fascinated with how news and media brings people on to a common platform to share their voices and identity. Given my interest in the social sector, I am taking this class to understand how the power of media can mobilize people behind a cause. My personal goals for the class are to:

  • Enter my stretch zone by utilizing more of the right side of my brain
  • Become more of an active contributor using media
  • Work with an interdisciplinary group of people (I was very impressed with the cultural and intellectual diversity in the class)
  • Understand how to use media / understand the power of media to engage global citizens

Apart from my “slightly obvious” skills in programming (Matlab, R etc), I like to travel and try/cook multi-cultural cuisines. I am coffee and chocolate snob and occasionally addicted to Instagram.

You can find me on: LinkedIn, Facebook, Instagram

Anne’s Bio

[I’m Anne, spelled A-N-N-E but pronounced “Annie.”]

I’m a first-year MBA at MIT Sloan, and I’m interested in the intersection of tech and media, especially from the angle of understanding how consumers interact with and are affected by products or information. Before Sloan, I worked in the Boston office of Analysis Group as an economic consultant, where my favorite cases involved running survey experiments and analyzing market data to understand consumer behavior for a variety of clients.

I studied Math and Political Science at MIT as an undergraduate, while serving as a reporter, news editor, and finally Editor in Chief of the campus newspaper, The Tech. Newspapers have been a huge part of my life since the fourth grade, when I started a school newsletter with a handful of friends, inspired by the surprise removal of our playground’s bamboo grove. I’ve worked on school newspapers ever since, plus a short stint as a writer for the local newspaper of Charleston, SC.

Going forward, I want to learn from working with all of you and come up with solutions to the challenges facing the news media industry (or at the very least, through our discussions, I want to train myself to think critically about all the media I consume and maybe produce).

In my spare time, I play violin in a quintet through MIT’s Chamber Music Society, revisit 30 Rock and Parks and Rec, crochet tiny animals,cook, and drink tea while contemplating how to bring more “artsiness” into my life.

Posted in Bio