The Broadcasters’ Audience Research Board (BARB) has long been the gold standard for measuring TV viewership in the UK. Established in 1981, BARB was created to provide a reliable and independent measurement of television audiences, crucial for broadcasters and advertisers alike. The methodology involves a “statistically robust” panel of approximately 16,000 people across 7,000 households, carefully selected to mirror the entire UK population. This panel-based approach has served the industry well for decades, offering insights into who is watching what, on which device, and for how long.

However, in today’s digital age, where streaming services like Netflix, Amazon Prime Video, and Disney+ dominate the viewing landscape, the question arises: Is BARB’s methodology becoming outdated?

The Rise of Streaming Services

Streaming services have revolutionized the way we consume content. Netflix alone boasts nearly 283 million subscribers worldwide as of the third quarter of 2023. The platform provides detailed viewing data through reports like the “What We Watched: A Netflix Engagement Report,” which includes hours viewed for every title, both original and licensed. This level of granularity and real-time data collection is something that traditional panel-based methods struggle to match.

Comparing BARB and Netflix Data

BARB’s panel of 16,000 people provides a representative sample of the UK population, but it pales in comparison to the vast amount of data that streaming services can collect directly from their users. Netflix, for example, can track exactly who is watching, what they are watching, and for how long, down to the individual user level. This “real” data offers a more comprehensive and accurate picture of viewing habits.

Historical Reasons for BARB

BARB was established to provide an independent and transparent measurement of TV audiences, ensuring that advertisers and broadcasters had a reliable source of data for making informed decisions. The panel-based approach was necessary at a time when technology did not allow for the direct measurement of viewing habits. It provided a common currency for the industry, enabling fair comparisons and informed decision-making.

The Need for Change

While BARB has adapted its methodology to include data from streaming services and online viewing, the reliance on a panel-based approach raises questions about its relevance in today’s data-rich environment. The industry needs to consider whether clinging to traditional methods is hindering progress. With the availability of real-time, granular data from streaming services, there is an opportunity to move towards more accurate and comprehensive measurement systems.

Challenges of Small Sample Sizes

The limitations of the BARB panel become even more apparent when considering niche audiences. For example, if we wanted to measure the viewing habits of Bangladeshi heritage families, the small number of such households in the panel might not provide a statistically robust representation. If only a fraction of these households are active viewers, it becomes challenging to draw meaningful conclusions.

In such cases, relying on a small sample size can lead to inaccuracies and potential biases. Streaming services, on the other hand, can provide detailed and granular data on niche audiences, offering a more accurate and comprehensive understanding of their viewing habits.

Uncovering Over-Reporting?

One of the concerns with traditional panel-based methods is the potential for over-reporting. Panels are designed to be representative, but they can never capture the full diversity and complexity of viewing habits. By relying on a small sample, there is always a risk of inaccuracies and biases. Moving towards data-driven measurement systems could help uncover any discrepancies and provide a more accurate picture of audience behavior.

Support and Counterarguments

Support for the Argument:

• Granularity and Accuracy: Streaming services can provide detailed and real-time data on viewing habits, which is more accurate than panel-based methods.
• Niche Audiences: Streaming data can offer insights into niche audiences that are difficult to capture with a small panel.
• Transparency: Streaming services’ data is direct and unfiltered, reducing the risk of over-reporting.

Counterarguments:

• Independent Verification: BARB provides an independent, third-party verification of viewing figures, which is essential for maintaining trust with advertisers, broadcasters, and the public.
• Comprehensive Measurement: BARB’s hybrid approach combines panel data with census-level online viewing data, ensuring a comprehensive measurement of total identified viewing.
• Industry Benchmarking: BARB’s data serves as a common measurement standard, allowing for comparison across different platforms and services.

Conclusion

BARB has played a crucial role in the UK advertising industry for decades, providing reliable and independent measurement of TV audiences. However, in the age of streaming, it is time to question whether this methodology is still fit for purpose. With the availability of real-time, granular data from streaming services, the industry has an opportunity to move towards more accurate and comprehensive measurement systems. By embracing these changes, we can ensure that our understanding of audience behavior is as accurate and up-to-date as possible.

Interested in helping me explore this further? I’m writing a paper on this subject, and I welcome collaborators to contact me.

: BARB FAQ : BARB Panel : Netflix Engagement Report : Netflix Statistics