How to Measure Impact Effectively: Best Practices for Media Organizations

By: Stephen Abbott Pugh | 12/16/2015

How do you measure media impact? Is your journalism successful? And who is your audience?

These existential topics were all up for discussion at the recent Dissection event in Seattle run by the Center for Investigative Reporting (CIR) and attended by a wide variety of high profile, often donor-funded media organizations.

There has been a notable rise in handwringing over the topics of impact and engagement as media organizations seek to understand more about their online audiences in order to safeguard their futures. But the attention has often focused on grabbing big numbers or tracking measures that don't necessarily lead to a healthy future relationship with audiences.

So to move the conversation on, the guiding principles for discussion in Seattle were: how organizations should use analytics to effectively make decisions; how to understand your audience beyond analytics; and how to track and measure offline impact.

The key lesson I took away from the event was that all those organizations that had found the greatest success had started projects with clearly defined goals, experimented rapidly and chosen the best methods of measuring progress towards the original goals.

This may sound like common sense but even the most forward-thinking media organizations have had to do a lot of soul searching and changed their traditional ways of working to align their work with specific, measurable goals rather than claiming, more vaguely, that all their work was done in the public interest.

Whether it was Nollywood Workshops speedily putting together viral video content to spread correct information about Ebola instead of creating a full-length movie or The Conversation’s team who are busy creating their own metric after realizing that there was no online standard for engagement with academic works, success was always relative with no simple "God metric" (or universal metric) on show that could be tracked by all organizations.

This key point was espoused by Dana Chinn of the Media Impact Project who also warned against the practice - common among media organizations who may simply focus on growth - of collecting or monitoring every measure of success without having an agreed target to focus efforts on.

And this observation was reinforced just a few days later at a Measuring What Matters session held during the 2015 Mozilla Festival in London. Leading that session, Livia Labate, an OpenNews fellow based at National Public Radio in Washington, said that tracking everything about a story and all the reactions after publication are often of no use if you can't link all this information back to the pursuit of an original goal.

The good news for media organizations is that once they create goals for their coverage, there were a plethora of tools on show at "Dissected" which can be used to track key aspects of how stories are received, how they spread through networks and what online and offline impact they generated.

Tools showcased for understanding audiences and tracking impact included the MIT Center for Civic Media's MediaCloud, CIR's Impact Tracker, Betaworks' Scale Model, Newslynx, EJC's Impact Monitor and Ludopoli/Project Syndicate's Flowli.

Many media organizations would probably love it if there was a simple online metric that the industry could coalesce around as a gauge of success. The reality is going to be more complicated and nuanced than that. But the rewards on offer are great for those organizations that gain clarity in their missions and can prove movement towards their goals.

This post is also published on IJNet, which is produced by ICFJ.

Image CC-licensed on Flickr via Net Doktor.

Latest News

ICFJ se Suma a Otras 9 Organizaciones Internacionales Para Presentar un Amicus Curiae en el Caso del Periodista Guatemalteco Encarcelado José Rubén Zamora

Un grupo de 10 organizaciones internacionales presentó esta semana un amicus curiae ante la Corte Suprema de Justicia de Guatemala en el caso del periodista José Rubén Zamora Marroquín. El amicus, presentado el 26 de marzo, argumenta que el retorno de Zamora a prisión preventiva constituye una violación de sus derechos fundamentales bajo el derecho guatemalteco e internacional, e insta a la Corte a otorgar un recurso de amparo pendiente y permitir que el Sr. Zamora lleve su proceso bajo medidas sustitutivas.

ICFJ Joins 9 Other International Organizations in Submitting Amicus Brief in Case of Imprisoned Guatemalan Journalist José Rubén Zamora

A group of 10 international organizations submitted an amicus curiae brief to Guatemala’s Supreme Court in the case of journalist José Rubén Zamora Marroquín. The brief, filed on March 26, argues that Zamora’s return to preventive detention constitutes a violation of his fundamental rights under Guatemalan and international law, and urges the Court to grant a pending amparo appeal and allow Zamora to return to house arrest.

Press Freedom on Campus: Why it Matters and What Student Journalists Need Most

In February, ICFJ partnered with Vanderbilt University and Freedom Forum, with support from the Lumina Foundation, to bring university faculty and students, international and U.S. journalists, and media leaders together for a discussion about the importance of press freedom in democratic societies. Participants stressed how U.S.-based journalists can learn from the experiences of their colleagues abroad, and they dived into the challenges campus reporters face, such as a lack of funding and harassment from fellow students, offered advice for engaging audiences, and more.