A new topic editor dashboard is helping newsroom staff at Nine's Sydney Morning Herald and The Age keep track of the metrics most likely to drive subscriptions.

Head of audience development Aimie Rigas (pictured) says until 2019, staff had to access multiple data tools to answer what should have been very simple questions. "Instead of gaining useful insights quickly, editors found themselves wasting valuable time asking where they needed to look for information or doubting inconsistent numbers," she says in an INMA blog.

The past year has been spent consolidating those sources, after listening to editors, considering which metrics would have the biggest impact on content output, and examining how to create more of what the audience wanted.

Given the pride in newsrooms' dedication to attracting and retaining subscribers, the news that just 40 per cent of their content made up 87 per cent of what subscribers were reading online was a "confronting but powerful" lesson, she says.

"No one wants to focus too hard on their weak points, but we discovered the newsroom could learn more from the 60 per cent of content failing to find a meaningful audience than the content already working hard for us.

"The problem was editors had no easy way of identifying underperforming content."

The quest for answers led to the birth of the topic editor dashboard (TED) and with it a new way of communicating editorial strategy to the newsroom. Rigas says the data team created custom benchmarks for teams, journalists, article formats, and content themes (tags).

These are defined by four key metrics: subscriber pageviews, best prospects (the group of people whose behaviours have been identified as making them most likely to subscribe), pageviews, average engaged time, and completion rate, with TED is a visual representation of these benchmarks.

Teams are defined by reporting lines so editors have a view of content they commission directly. Tag benchmarks help editors understand the context and performance of content when different teams are producing articles about the same subject. For example, multiple teams create journalism that is tagged 'coronavirus pandemic'.

Word count benchmarks help editors understand the performance of articles of different lengths and in different templates, such as short articles, features, explainers, and investigations.

Benchmarks represent a quartile-split of a historical 12-month reporting period. The four quartiles are split into coloured zones, where green represents the top 25 per cent benchmark, and red represents the bottom 25 per cent benchmark.

Team, journalist, and word count benchmarks are static. "Keeping benchmarks static allows us to measure improvement over time," she says.

Tag benchmarks are rolling in order to capture newly created tags and understand the content in the context of current subscriber engagement.

"Establishing benchmarks was never about ranking journalists or teams; it's about being able to identify what content didn't engage subscribers as we expected and why.

"Before benchmarks, editors had no clear definition of what success for their teams looked like in a subscription-driven newsroom. We had to connect day-to-day content commissioning and distribution to the bigger picture of subscriber acquisition and retention."

She says historically, when the business goal was reach, editors knew what to do. "For them, it was simple to connect the concept of 'lots of pageviews' to what stories they should write, and how to distribute them. But it also led to clickbait content that wasn't particularly on brand or worth paying for.

"Today, our editors focus on what subscribers and best prospects read and how they interact with our content. We know our subscribers and best prospects navigate to our content from the homepage above any other referral method. We also know in-article referrals for these user segments are higher than Google, Facebook, and Twitter.

"This is an empowering insight for editors because it means, for the most part, they have control over what our most valuable audience sees and when they see it. Home page promotion, related article widgets and placement, headlines, and image choice are all things we can control and track."

But she says it's not as simple as recognising an article flopped and making an immediate decision to stop writing about that subject. "For every coronavirus story at the top, there are at least 20 at the bottom. But if a story is important, it's our job to make it interesting."

Sometimes editors recognise it's as simple as fixing the headline, pitch, publish time, or distribution. Other times they work together to identify patterns in content that are at odds with the audience's values or interests.

"With that lens, incremental updates from multiple teams become in-depth explainers with context," she says. "Unnecessary embargoes are lifted. Headlines are workshopped for the homepage in the same way they are for page one in print. And, ultimately, we create more content worth paying for."

Aimie Rigas says there isn't time or financial resources to waste on content nobody reads: "Our goal is to cultivate a culture of learning from our mistakes and telling important stories in the most engaging way possible.

"To achieve this required a reset. We'd tried (and failed) to launch new data products with the newsroom in the past. Without accountability, initial enthusiasm was overtaken by the daily grind of the news cycle. On top of that, editors had never been asked to articulate their content strategy to anyone outside their team.

"With that knowledge, we made red zone analysis compulsory and gave editors six weeks to present their findings back to their managers and peers. At first, they were sceptical. But as the weeks went on, they became more excited by what they were discovering.

"Every editor found the content in the green zone backed up decades of gut feelings, while the red zone was full of opportunities. Together they workshopped solutions and set goals to produce less, but make what they produced better.

"Editors presented their findings throughout the second half of 2020, and they're already seeing results. Our lifestyle team produced 50 per cent fewer articles last year when compared to 2019. As of September, the team had no content appearing in its red zone. The number of subscriber pageviews on its worst-performing article is now 40 times higher than it was before TED was introduced."

She says bringing editors on the journey has ensured their expertise is reflected in our content strategy. "We don't just celebrate success, but rigorously interrogate how we tell a story.

"After all, every minute wasted creating content nobody reads is a minute that could be spent creating content worth subscribing to."

Based on an INMA Satisfying Audiences Blog, with permission.