times puzzles

By unbundling puzzle content from the core product, can a standalone puzzle app deliver revenue growth for TNL?

Team
Android Engineers (3)
iOS Engineers (3)
Product Owner
QA Manager
Head of UX/UI (Me)
UX Researcher
UX Designer
UI Designer
My Responsibilities
Research
UX design
User testing
UI design

Business opportunity

There is an audience of puzzlers who aren't willing to subscribe to the full Times News Limited (TNL) proposition but would pay for a puzzles-only product at a reduced price.

Challenge

Validate whether unbundling puzzle content from the core product will generate customer revenue, with the logic of converting those who are not willing to pay for the full news app into subscribers.

Our process

Objectives

Understand typical customer motivation behind subscribing to The Times to gain access to puzzle content

Identify areas of opportunity for the business; can the proposition be more than just playing puzzles?

Identify and deliver a best-in-class puzzle app experience that encourages subscription

Understand what the appropriate subscription price point for a dedicated puzzles app is (live store test)
empathize

UX and design objectives

Understand typical customer motivation behind subscribing to The Times to gain access to puzzle content
Identify areas of opportunity for the business; can the proposition be more than just playing puzzles?
Identify and deliver a best-in-class puzzle app experience that encourages subscription
Understand what the appropriate subscription price point for a dedicated puzzles app is (live store test)

Competitor landscape

There was a business assumption that offering a broader range of puzzles and games may be an opportunity to attract younger audiences; in-direct competitors that solely offered brain and memory training games were analysed, in addition to direct publishing competitors.

empathize

Empathising with customers

The primary goal was to understand motivations for engaging with puzzle content. I also wanted to investigate customer motivation behind subscribing to the complete Times product if predominantly only engaging with puzzle content. Five hundred customers completed the survey.

70%
Stated their main motivation for doing puzzles was to keep their brain active
47%
Stated they like to complete at least one puzzle a day
60%
Stated they are very unlikely to pay for a dedicated puzzles app
51%
Preferred puzzles like Crossword and Sudoku over brain training games
92%
Had never done a Crossword Club puzzle, feeling "it was for advanced users"
30%
Stated they involve family and friends when doing a puzzle

I interviewed ten 'Times mindset' prospects to gain qualitative insight into their behaviour playing puzzles. I also wanted to understand their desire for a dedicated paid puzzles app from The Times.

High level qualitative findings
The 'daily puzzler' empathy map
The 'daily puzzler' persona
6
Interviewees stated they were unlikely to pay for a Times puzzles app because they could get access to puzzles elsewhere for free
4
Stated they would perhaps pay, but that £6.99/month was excessive and suggested between £3 and £4/month at the most

“Frankly I subscribe to get the puzzle section. If that were not available I would cancel. 'Rest of the paper is fine, but the puzzles seal the deal for me”

empathize

A 'new-user' experience

I wanted to test how prospective customers interacted with the app in their first session following generative research. So I mapped out a 'new user' flow to help inform wireframe solutions.

empathize

Usability test learnings

Though minimal from an information architecture perspective, I wanted to gauge participants' mental models and expectations when navigating through discovery tasks.

Puzzle discovery
Displaying puzzles by category on the homepage felt intuitive to participants - most stated it was a simple way to find their puzzle of choice
Displaying progress
Participants stated they were frustrated at not being able to find puzzles they had started and not finished; some liked to complete puzzles in multiple sessions
Personalisation
Some participants stated a more personalised experience that allowed them to only see or prioritise the puzzles they engage with would be helpful
Puzzle on-boarding
Less experienced puzzlers stated they'd like more guidance on how to interact with unknown puzzles, which would encourage more engagement
Filtering
Filtering puzzles by ease and difficulty was expected by some participants
Sharing
Some participants expected to be able to do a puzzle with another person, whilst some wanted to be able to share questions for help

Participants were asked on a scale of 1 (very difficult) to 5 (very easy) where they'd rate their ability to navigate the app.

“I like the layout of the Crossword category screen and how it shows puzzles available by date...It would be good to have a way to only show the puzzles I like to play”

Progressing into high-fidelity

The original business challenge was to gauge the prospect's will to pay for a dedicated puzzles app from The Times. A small timeframe was set to get an MVP into stores to test consumer desire.

Engineers were in place to commence development, so I needed to hand over high-fidelity designs.

Customer feedback

Store reviews provided varied feedback on usability, features and price points, giving helpful insight on where improvements could be made.

Fantastic

Great to have all the puzzles to save downloading and printing - better for the environment. Very well designed. Hope they add the Codeword too.

Mislead

The app said it was free but as soon as I downloaded it said I had to pay a subscription, I wish it had said that before I’d downloaded it!

Can't even try it out

This is not free, it requires you to subscribe - there is a 7 day period during which you can cancel. I didn’t, I just deleted the app, waste of time.

At last a Times Puzzle app

Much better than using the puzzles within the Digital Times app. With this app you have historical puzzles as well as todays, plus you have Killer Sudoku, which is missing from the The Times Digital app.

Klunky

It’s OK, but it is really annoying to have no simple way of changing to “note mode”. The button to switch to note mode should be on the same screen as the puzzle.

Good, but a few annoyances

Clean, simple app and loads of challenging puzzles...However, the app keyboard is smaller than the system keyboard, and supremely annoying. Perhaps the worst part is completed puzzles don't show as completed!

empathize

What I learned

Next steps

Continue running subscription price and free trial A/B tests to find the optimal offer that helps retain customers. Then, depending on budget approval, continue customer research, design exploration, and testing to deliver an optimal product that provides revenue for the business.