Page MenuHomePhabricator

Product Analytics: Improve verification email - measure email verification rate before and after copy changes
Open, MediumPublic3 Estimated Story Points

Description

User Story:

As the Growth team,
we want newcomers to receive a warm and helpful welcome email that encourages them to verify their email address,
so that they feel more supported in their early Wikipedia experience and are more likely to remain engaged and return to contribute.

As the Product Safety and Integrity team,
we want a higher proportion of accounts to have a verified email address,
so that we can improve account security, and ensure users have access to recovery options like password reset.

Related:

Goals and Rationale:

  • Drive higher email verification rates by including a clear call to action with context about why verification matters.
  • Support positive onboarding by making the email feel personal, welcoming, and action-oriented.
  • Strengthen account integrity across the platform by increasing the percentage of accounts with verified contact information.
  • Reduce burdens related to account recovery and forgotten credentials.
Industry Benchmarks:
  • For verification (confirmation) emails, the open rate is very high. Verification emails often get 80–95% open rates, because recipients expect them and see them as necessary to complete an action. - 1
  • A double opt-in flows tend to see confirmation rates between 60–80%. - 2

Goal: Aiming for a 60–80% verification/confirmation rate is reasonable, based on industry baselines.

Acceptance Criteria
  • On a representative sample of wikis, compare email verification rates pre and post rollout. Wikis:
    • Enwiki
    • Wikimedia Commons
    • Wikidata
  • Basic data visualization, similar to the two graphs here. Share results in this task
Deliverables
  • 12/19/25: Provide a brief two-sentence summary of the first 10 days of pilot-wiki post-release performance to flag any early signs of unexpected impact; Nice to have: include a simple chart if time allows.
  • 1/15/26: Deliver comparative pilot-wiki email-verification rate charts of pre- and post-release performance (MoM, 2024 YoY, 2023 YoYY), using the previously shared visualization style. Include an assessment (text) of email-verification rates before and after rollout. Findings submitted in this task.

Event Timeline

KStoller-WMF moved this task from Inbox to Needs Discussion on the Growth-Team board.
KStoller-WMF renamed this task from Improve verification email: measure email verification rate before and after copy changes to Product Analytics: Improve verification email - measure email verification rate before and after copy changes.Nov 12 2025, 5:44 PM

Timeline update:

Dates shifted out slightly due to engineering delays.

The current timeline is as follows:

  • December 9th, 2025: release to pilot wikis.
  • December 19th, 2025: quick check on weekly email verification numbers. We will not have enough data to draw conclusions, but let's check to make sure the release hasn't had any unexpected negative impact.
  • January 14, 2026: Irene and I will meet to review monthly data (pre-post release email verification data)
KStoller-WMF set the point value for this task to 3.Sun, Dec 14, 7:54 PM

Timeline update:

There were issues with the release last week, so December 15th, 2025 is the actual release to pilot wikis: Enwiki, Commons, and Wikidata.

I know that will give us very minimal data before December 19th, but if possible we would still appreciate a quick check on email verification numbers.