Here is the analysis comparing baseline data with data post-change ( September 11th to December 1st). Please refer to this notebook for detailed analysis.

Final analysis in this report and entry_points_analysis

The first version of the dashboard in here https://superset.wikimedia.org/superset/dashboard/wikifunctions-ve-usage.

Tested and confirmed that all the events are logged in visualeditorfeatureuse schema.

I tested and confirmed the translation_difficulty_level logged in dashboard_translation_start events in mediawiki_content_translation_event table.

Please find Part 1 of the analysis here https://nbviewer.org/urls/gitlab.wikimedia.org/conniecc1/we2.1.1-kr-2025/-/raw/main/central-notification-banner-PART1.ipynb

Worked on:

• Collected and processed article-creation data for Wikipedia (2023–2025).
• Collected and processed content-translation event data for Wikipedia (2023–2025).
• Analyzed data for CX entry points and translation start step
  • Breakdown by user global edit bucket
  • Breakdown by the comparative wiki size of target languages
• Proportion of articles created by a user using CX (within 2023 - 2025), to check the user's preference for using CX vs. other tools.
  • Breakdown by user global edit bucket
  • Breakdown by the comparative wiki size of target languages
  • Breakdown by mobile vs. desktop
  • Also checked user tenures
• Proportion of user counts in each global edit bucket, to check when users start to use CX (with their editing experience change).
  • Breakdown by the comparative wiki size of target languages
  • Breakdown by mobile vs. desktop

Notebook for tracking baselines: https://gitlab.wikimedia.org/conniecc1/we2.1.2-kr-2025/-/blob/main/baselines-tracking.ipynb

@Nikerabbit, I confirm the publish_success events now contain valid published_revision_id and valid published_page_id.

Here are the baselines using data between April 1, 2025, and July 1, 2025. Please refer to this notebook for detailed calculations.

Thank you @JMeybohm!

@SBisson Hmmm, let's put 'unknown' then, in case there's any data issue and we need to check missing values and unknown values.

@SBisson, sure, to confirm the possible values for difficulty level will be easy, medium, and hard.

@SBisson, I’d recommend adding a new column to the schema to log the recommendation difficulty level.
And it can apply to event types dashboard_translation_start.

I queried the data destination, event.mediawiki_content_translation_event for August. There's 1 event with dashboard_open event type with event source as recent_edit.

I agree that using the global edit count bucket makes sense.

@kostajh please finds the reports for ip reputation data analysis related to blocked account https://analytics.wikimedia.org/published/reports/ip_reputation_data/report_blocked_accounts.html and related to reverted edits https://analytics.wikimedia.org/published/reports/ip_reputation_data/report_reverted_edits.html here.

The report is posted here https://analytics.wikimedia.org/published/reports/magru_datacenter_analysis/report.html
and related code is here https://gitlab.wikimedia.org/conniecc1/magru-data-cernter-analysis/-/tree/main?ref_type=heads

The queries files have been checked in through Gitlab merge, changes include:

@mforns - I've added you as a reviewer on this patch to add the mediawiki_product_metrics_incident_reporting_system_interaction schema to the allowlist. Here's a link to the instrumentation to fields. Please let me know if you have any questions or suggested revisions. Thank you!

In T383299#10528073, @kostajh wrote:

In T383299#10527033, @cchen wrote:

Here's the link to the IRS metrics dashboard. Please review it and let me know if anything needs to be updated.
https://superset.wikimedia.org/superset/dashboard/561

LGTM, thanks @cchen! Will the dashboard automatically include new projects as the incident reporting system is enabled on them?

Here's the link to the IRS metrics dashboard. Please review it and let me know if anything needs to be updated.
https://superset.wikimedia.org/superset/dashboard/561

@Madalina, I completed post-deployment QA checks and confirmed that all data from the new instrumentation implemented to track the metrics are logged as expected.

I don't have the credentials to access the logs of the beta cluster. We will need an engineer to do the instrumentation check on Beta cluster.

The dashboards listed have been deleted.

sub-tasks resolved

Adding QA queries:

@MusikAnimal Thanks for sharing the data!

the required metrics are updated here https://docs.google.com/spreadsheets/d/1_baSI_SO4GeCA8U1qDkR32ayptVPzQB_6IWbxYpKLMw/edit?gid=1545174062#gid=1545174062