Beyond the algorithm: How human analysts bring real value to PR measurement

At P+ Measurement Services, we have observed firsthand that while automation has revolutionized PR data gathering and increased the speed and efficiency of media monitoring, there is a substantial difference between raw PR data collection and insightful analysis

 

By: Philip Odiakose I Tuesday, October 29, 2024

 

LAGOS, Nigeria – In public relations, data-driven decision-making has become a pivotal element of PR success. The ability to accurately monitor and measure media coverage is essential for PR and communication professionals who need to gauge public sentiment, assess brand reputation, and drive impactful communication strategies.

However, as automated PR measurement tools become increasingly popular, it is critical to consider the limitations of these tools and their potential shortcomings. When metrics are purely derived from automated tools, the insights provided can often be misleading or, in some cases, dangerously inaccurate.

Studies indicate that automated PR measurement tools can achieve accuracy levels of, at best, around 55%, which poses a significant question for decision-makers: can we afford to be wrong nearly half the time? – Quote by Todd Murphy President of Truescope – North America

At P+ Measurement Services, we have observed firsthand that while automation has revolutionized PR data gathering and increased the speed and efficiency of media monitoring, there is a substantial difference between raw PR data collection and insightful analysis.

Automated tools are excellent for aggregating large volumes of information quickly, especially across web and digital media. However, PR measurement is not just about volume; it is about context, sentiment, relevance, and, most importantly, actionable insights.

This is where human expertise becomes indispensable. A trained media analyst brings depth and understanding that automated tools simply cannot replicate. Contextual nuances, industry trends, sentiment analysis, and the ability to distinguish between relevant and irrelevant mentions are all areas where human expertise significantly outshines automated systems.

In a notable case at P+ Measurement Services, we were engaged by a client in the fast-moving consumer goods (FMCG) industry who was dealing with a public perception issue. Initially, automated media monitoring had flagged a large number of mentions across various news outlets and digital platforms. The automated tool reported a neutral to positive sentiment based on keyword analysis.

However, upon deeper inspection by our team of analysts, it became apparent that a significant portion of the mentions were, in fact, laced with subtle criticisms, sarcasm, and negative undertones that the automated tool failed to detect.

Through manual review and contextual sentiment analysis, our analysts identified a negative trend that would have otherwise gone unnoticed, allowing us to provide the client with an accurate assessment and actionable recommendations. Without human intervention, the client might have interpreted the automated results as positive, potentially leading to complacency and an inadequate response to the underlying issues.

Furthermore, automated tools often lack the ability to perform SWOT (Strengths, Weaknesses, Opportunities, and Threats) analysis with the level of detail and depth that a human analyst can offer. PR measurement isn’t just about capturing mentions; it is about understanding how these mentions align with a brand’s strategic objectives, identifying potential threats to reputation, recognizing strengths in communication strategies, and highlighting opportunities for brand engagement.

For instance, in another engagement, our analysts at P+ Measurement Services went beyond the numbers by conducting a comprehensive SWOT analysis for the client, providing them with a roadmap for strengthening their messaging.

Through this analysis, we uncovered underlying threats and weaknesses in their communication approach that were not evident in automated reports, helping the client make informed adjustments to their strategy.

The importance of human input does not imply that automation should be discarded entirely. On the contrary, automation is invaluable for tasks that require the rapid aggregation of data across vast networks, particularly on web media.

At P+ Measurement Services, we leverage automated tools to streamline data gathering, reducing the time it takes to collect mentions across platforms. Automation serves as a powerful support system, allowing analysts to access a wide range of data points with ease. However, we recognize that the role of these tools is to assist rather than replace human analysis. The ideal approach, and one that we consistently employ, is a hybrid model where automation handles data collection while human expertise brings context, analysis, and strategic insight to the table.

The danger of relying solely on automated measurement tools is the risk of oversimplifying complex media narratives. For instance, an automated system may be programmed to count the number of mentions, track keyword appearances, and assign sentiment scores based on preset algorithms. However, without the human capacity to understand cultural nuances, recognize irony, and analyze sentiment in context, the resulting data can be skewed, leading to misguided conclusions.

PR and communication professionals depend on accurate insights to make strategic decisions, especially in times of crisis, and relying on metrics that may only be 55% accurate can be a costly error. The reality is that numbers alone do not tell the full story; they require interpretation, depth, and a human touch to truly reflect a brand’s position in the media landscape.

Ultimately, the combination of automated tools and human analysts offers the most powerful approach to media measurement. At P+ Measurement Services, we advocate for a balanced integration where machines support humans, not replace them. Automation excels at data gathering, but human analysis brings the insights needed to transform raw data into meaningful narratives.

The power of PR measurement lies not just in counting media mentions but in understanding their impact and aligning them with strategic objectives. By embedding human expertise into the measurement process, brands can gain an accurate, nuanced, and actionable view of their media presence.

In the world of media monitoring and analysis, getting it right half the time is not good enough. Brands need—and deserve—the precision and insight that only skilled analysts can provide, complemented by the efficiency of automated tools.

 

NB: Philip Odiakose is a leader and advocate of Media Monitoring, PR Measurement and Evaluation in Nigeria. He is also the Chief Media Analyst at P+ Measurement Services, a member of AMEC, NIPR, and AMCRON.