Page MenuHomePhabricator

Test Kitchen (Experiment Platform Sprint 15)Milestone
ArchivedPublic

Members (8)

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

Starts 2025-11-06
Ends 2025-11-27

Recent Activity

Nov 25 2025

Milimetric archived Test Kitchen (Experiment Platform Sprint 15).
Nov 25 2025, 4:08 PM
Milimetric closed T401706: Implement debugging for events in the PHP SDK, a subtask of T384704: Measure data loss of the client-side part of the analytics event submission pipeline, as Resolved.
Nov 25 2025, 4:06 PM · Test Kitchen (Experiment Platform Sprint 15), OKR-Work
Milimetric closed T401705: Implement debugging for events in the Javascript SDK as Resolved.
Nov 25 2025, 4:06 PM · Test Kitchen (Experiment Platform Sprint 15), MW-1.46-notes (1.46.0-wmf.1; 2025-11-05), Patch-For-Review, OKR-Work
Milimetric closed T407404: Update Test Section of Docs to make clear recommendation as Resolved.
Nov 25 2025, 4:06 PM · Test Kitchen (Experiment Platform Sprint 15), Reader Growth Team, Documentation
Milimetric closed T401706: Implement debugging for events in the PHP SDK as Resolved.
Nov 25 2025, 4:06 PM · Test Kitchen (Experiment Platform Sprint 15), MW-1.45-notes (1.45.0-wmf.25; 2025-10-28), OKR-Work
Milimetric closed T405727: Remove wgMetricsPlatformEnableExperimentOverrides config variable as Resolved.
Nov 25 2025, 4:06 PM · Test Kitchen (Experiment Platform Sprint 15), Technical-Debt
Milimetric closed T401705: Implement debugging for events in the Javascript SDK, a subtask of T384704: Measure data loss of the client-side part of the analytics event submission pipeline, as Resolved.
Nov 25 2025, 4:06 PM · Test Kitchen (Experiment Platform Sprint 15), OKR-Work
Milimetric closed T409546: Remove duplicated code from xLab API experiment service controller as Resolved.
Nov 25 2025, 4:06 PM · Essential-Work, Test Kitchen UI, Test Kitchen (Experiment Platform Sprint 15)
Milimetric closed T354822: [JS] Remove dispatch method as Resolved.
Nov 25 2025, 4:06 PM · MW-1.46-notes (1.46.0-wmf.3; 2025-11-19), Patch-For-Review, Test Kitchen (Experiment Platform Sprint 15), Essential-Work, Technical-Debt, Metrics Platform
Milimetric closed T384704: Measure data loss of the client-side part of the analytics event submission pipeline as Resolved.
Nov 25 2025, 4:06 PM · Test Kitchen (Experiment Platform Sprint 15), OKR-Work
Milimetric closed T405249: Unify page_namespace_id spelling as contextual attribute for Java and Swift client libraries as Resolved.
Nov 25 2025, 4:06 PM · MW-1.46-notes (1.46.0-wmf.3; 2025-11-19), Test Kitchen (Experiment Platform Sprint 15), Essential-Work
Milimetric closed T408178: Decommission the Wikistories instruments as Resolved.
Nov 25 2025, 4:05 PM · Test Kitchen (Experiment Platform Sprint 15), MW-1.46-notes (1.46.0-wmf.2; 2025-11-12), Essential-Work, Wikistories
Milimetric set the point value for T409965: Enable experiment enrollment in the MediaWiki Action API to 2.
Nov 25 2025, 3:54 PM · MW-1.46-notes (1.46.0-wmf.5; 2025-12-02), Test Kitchen (Experiment Platform Sprint 16)
CodeReviewBot added a project to T384506: Update event debug logging in EventLogging extension: Patch-For-Review.

sfaci opened https://gitlab.wikimedia.org/repos/data-engineering/metrics-platform/-/merge_requests/111

Nov 25 2025, 12:16 PM · Test Kitchen (Test Kitchen (Experiment Platform Sprint 18)), Essential-Work, MW-1.44-notes (1.44.0-wmf.25; 2025-04-15)
phuedx moved T410896: Expose Experiment Enrollment Sampling method from Ready for Development to Needs Review on the Test Kitchen (Experiment Platform Sprint 15) board.
Nov 25 2025, 11:13 AM · Test Kitchen (Test Kitchen (Experiment Platform Sprint 17)), MW-1.46-notes (1.46.0-wmf.7; 2025-12-16), OKR-Work
phuedx edited projects for T410896: Expose Experiment Enrollment Sampling method, added: Test Kitchen (Experiment Platform Sprint 15); removed Test Kitchen.
Nov 25 2025, 11:13 AM · Test Kitchen (Test Kitchen (Experiment Platform Sprint 17)), MW-1.46-notes (1.46.0-wmf.7; 2025-12-16), OKR-Work

Nov 24 2025

Sfaci added a comment to T384506: Update event debug logging in EventLogging extension.

@phuedx @Milimetric Can I assume that the replacement is the following?

  • mw.log() -> console.log
  • mw.log.warn()-> console.warn()
  • mw.log.deprecate() -> console.warn()
  • mw.log.error() -> console.error()

Only mw.log() needs to be replaced. mw.log.warn() and .error() call the equivalent methods on the console object. We shouldn't replace mw.log.deprecate() as it's for marking methods as deprecated / tracking deprecations via a dashboard.

Nov 24 2025, 5:17 PM · Test Kitchen (Test Kitchen (Experiment Platform Sprint 18)), Essential-Work, MW-1.44-notes (1.44.0-wmf.25; 2025-04-15)
Maintenance_bot removed a project from T409591: Load synthethic data into the growthbook_test database: Patch-For-Review.
Nov 24 2025, 4:32 PM · Product-Analytics (Kanban), Test Kitchen (Experiment Platform Sprint 15), OKR-Work, Data-Platform-SRE (2025.11.07 - 2025.11.28)
gerritbot added a comment to T409591: Load synthethic data into the growthbook_test database.

Change #1210616 merged by Brouberol:

[operations/puppet@production] dse-k8s: delete the stat-> PG on k8s ingress firewall rule

https://gerrit.wikimedia.org/r/1210616

Nov 24 2025, 3:45 PM · Product-Analytics (Kanban), Test Kitchen (Experiment Platform Sprint 15), OKR-Work, Data-Platform-SRE (2025.11.07 - 2025.11.28)
gerritbot added a project to T409591: Load synthethic data into the growthbook_test database: Patch-For-Review.
Nov 24 2025, 3:40 PM · Product-Analytics (Kanban), Test Kitchen (Experiment Platform Sprint 15), OKR-Work, Data-Platform-SRE (2025.11.07 - 2025.11.28)
gerritbot added a comment to T409591: Load synthethic data into the growthbook_test database.

Change #1210616 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/puppet@production] dse-k8s: delete the stat-> PG on k8s ingress firewall rule

https://gerrit.wikimedia.org/r/1210616

Nov 24 2025, 3:40 PM · Product-Analytics (Kanban), Test Kitchen (Experiment Platform Sprint 15), OKR-Work, Data-Platform-SRE (2025.11.07 - 2025.11.28)
phuedx added a comment to T384506: Update event debug logging in EventLogging extension.

@phuedx @Milimetric Can I assume that the replacement is the following?

  • mw.log() -> console.log
  • mw.log.warn()-> console.warn()
  • mw.log.deprecate() -> console.warn()
  • mw.log.error() -> console.error()
Nov 24 2025, 3:19 PM · Test Kitchen (Test Kitchen (Experiment Platform Sprint 18)), Essential-Work, MW-1.44-notes (1.44.0-wmf.25; 2025-04-15)
phuedx added a parent task for T408133: [Spike] Explore Generalizing Enrollment Authorities: T410896: Expose Experiment Enrollment Sampling method.
Nov 24 2025, 2:54 PM · Test Kitchen (Experiment Platform Sprint 16), MW-1.46-notes (1.46.0-wmf.4; 2025-11-25), OKR-Work
Sfaci added a comment to T384506: Update event debug logging in EventLogging extension.

Definition of Done here:
. . .

  • Replace all instances of mw.log() with console.log()

. . .

Nov 24 2025, 2:37 PM · Test Kitchen (Test Kitchen (Experiment Platform Sprint 18)), Essential-Work, MW-1.44-notes (1.44.0-wmf.25; 2025-04-15)
phuedx edited projects for T384506: Update event debug logging in EventLogging extension, added: Essential-Work; removed OKR-Work.
Nov 24 2025, 2:34 PM · Test Kitchen (Test Kitchen (Experiment Platform Sprint 18)), Essential-Work, MW-1.44-notes (1.44.0-wmf.25; 2025-04-15)
Sfaci added a comment to T384506: Update event debug logging in EventLogging extension.

Definition of Done here:

  • Legacy EventLogging has a visual debug mode that is very rarely used. We killed it but we didn't tell anyone (including ourselves!). Tell people we killed it.

. . . .

Nov 24 2025, 11:57 AM · Test Kitchen (Test Kitchen (Experiment Platform Sprint 18)), Essential-Work, MW-1.44-notes (1.44.0-wmf.25; 2025-04-15)
Sfaci moved T384506: Update event debug logging in EventLogging extension from Ready for Development to In Progress on the Test Kitchen (Experiment Platform Sprint 15) board.
Nov 24 2025, 11:23 AM · Test Kitchen (Test Kitchen (Experiment Platform Sprint 18)), Essential-Work, MW-1.44-notes (1.44.0-wmf.25; 2025-04-15)
Sfaci claimed T384506: Update event debug logging in EventLogging extension.
Nov 24 2025, 11:22 AM · Test Kitchen (Test Kitchen (Experiment Platform Sprint 18)), Essential-Work, MW-1.44-notes (1.44.0-wmf.25; 2025-04-15)

Nov 22 2025

dr0ptp4kt updated the task description for T398021: Consider increasing the length of action_context property in the base schemas.
Nov 22 2025, 12:13 PM · Test Kitchen (Experiment Platform Sprint 16)

Nov 21 2025

JVanderhoop-WMF moved T398021: Consider increasing the length of action_context property in the base schemas from In Progress to Needs Review on the Test Kitchen (Experiment Platform Sprint 15) board.
Nov 21 2025, 7:13 PM · Test Kitchen (Experiment Platform Sprint 16)
JVanderhoop-WMF added a comment to T398021: Consider increasing the length of action_context property in the base schemas.

Decision Record: http://wikitech.wikimedia.org/wiki/Test_Kitchen/Decision_Records/Increase_action_context_limit

Nov 21 2025, 7:13 PM · Test Kitchen (Experiment Platform Sprint 16)
mpopov moved T398021: Consider increasing the length of action_context property in the base schemas from Ready for Development to In Progress on the Test Kitchen (Experiment Platform Sprint 15) board.
Nov 21 2025, 6:38 PM · Test Kitchen (Experiment Platform Sprint 16)
mpopov edited projects for T398021: Consider increasing the length of action_context property in the base schemas, added: Test Kitchen (Experiment Platform Sprint 15); removed Test Kitchen.

Moving into sprint since Julie is working on this (drafted decision record, shopping it around with stakeholders)

Nov 21 2025, 6:38 PM · Test Kitchen (Experiment Platform Sprint 16)
Gehel moved T409591: Load synthethic data into the growthbook_test database from Done to Reported on the Data-Platform-SRE (2025.11.07 - 2025.11.28) board.
Nov 21 2025, 8:51 AM · Product-Analytics (Kanban), Test Kitchen (Experiment Platform Sprint 15), OKR-Work, Data-Platform-SRE (2025.11.07 - 2025.11.28)
Sfaci moved T354822: [JS] Remove dispatch method from To Deploy to Done on the Test Kitchen (Experiment Platform Sprint 15) board.
Nov 21 2025, 12:18 AM · MW-1.46-notes (1.46.0-wmf.3; 2025-11-19), Patch-For-Review, Test Kitchen (Experiment Platform Sprint 15), Essential-Work, Technical-Debt, Metrics Platform
Sfaci moved T405249: Unify page_namespace_id spelling as contextual attribute for Java and Swift client libraries from To Deploy to Done on the Test Kitchen (Experiment Platform Sprint 15) board.
Nov 21 2025, 12:18 AM · MW-1.46-notes (1.46.0-wmf.3; 2025-11-19), Test Kitchen (Experiment Platform Sprint 15), Essential-Work

Nov 20 2025

JVanderhoop-WMF closed T405074: xLab: Allow user re-enrollment at specific times, a subtask of T408134: [Epic] Generalize Enrollment Authority, as Resolved.
Nov 20 2025, 4:08 PM · Test Kitchen (Experiment Platform Sprint 20), Epic

Nov 19 2025

cjming moved T384704: Measure data loss of the client-side part of the analytics event submission pipeline from Sign Off to Done on the Test Kitchen (Experiment Platform Sprint 15) board.
Nov 19 2025, 5:10 PM · Test Kitchen (Experiment Platform Sprint 15), OKR-Work
cjming added a comment to T384704: Measure data loss of the client-side part of the analytics event submission pipeline.

just so we have the data here too -- here is the section in the report (created for SDS2.1.2) that provides insight by browser - https://docs.google.com/document/d/1XK8sZ2CCpFurOUV6PUXgCApjBrx-yOKVQe5BbPDsxsc/edit?tab=t.0#heading=h.fevi2ziuetdv

Nov 19 2025, 5:06 PM · Test Kitchen (Experiment Platform Sprint 15), OKR-Work
JVanderhoop-WMF added a comment to T407570: Test the impact of incremental increase in traffic for cache splitting experiments.

This setup looks good to me @Sfaci! A good question you raised is: Do we want to stop at 1.6% (so that we can say that 1% of enwiki is safe for experimentation), or do we want to keep going until we see an impact?

Nov 19 2025, 3:27 PM · Test Kitchen (Experiment Platform Sprint 20), OKR-Work, Traffic
EBernhardson added a comment to T408133: [Spike] Explore Generalizing Enrollment Authorities.

Regarding CirrusSearch: Do you already have particular open questions/obstacles related to the A/B test scenarios covered in the backend?

  • Session starting by following a link to blank Special:Search
  • Session starting by following a link to Special:Search with a query
  • Session starting at Special:Search with a 'go'

Thanks @pfischer. A couple of questions spring to mind:

  1. Is Scenario 1 treated the same as the other scenarios? In my mental model, a user searching or interacting with the search autocomplete starts a session. Is that correct?
Nov 19 2025, 1:40 PM · Test Kitchen (Experiment Platform Sprint 16), MW-1.46-notes (1.46.0-wmf.4; 2025-11-25), OKR-Work
phuedx moved T409965: Enable experiment enrollment in the MediaWiki Action API from Needs Review to To Deploy on the Test Kitchen (Experiment Platform Sprint 15) board.
Nov 19 2025, 1:02 PM · MW-1.46-notes (1.46.0-wmf.5; 2025-12-02), Test Kitchen (Experiment Platform Sprint 16)
ReleaseTaggerBot added a project to T408133: [Spike] Explore Generalizing Enrollment Authorities: MW-1.46-notes (1.46.0-wmf.4; 2025-11-25).
Nov 19 2025, 12:00 AM · Test Kitchen (Experiment Platform Sprint 16), MW-1.46-notes (1.46.0-wmf.4; 2025-11-25), OKR-Work

Nov 18 2025

Maintenance_bot removed a project from T408133: [Spike] Explore Generalizing Enrollment Authorities: Patch-For-Review.
Nov 18 2025, 11:30 PM · Test Kitchen (Experiment Platform Sprint 16), MW-1.46-notes (1.46.0-wmf.4; 2025-11-25), OKR-Work
Maintenance_bot removed a project from T409965: Enable experiment enrollment in the MediaWiki Action API: Patch-For-Review.
Nov 18 2025, 11:30 PM · MW-1.46-notes (1.46.0-wmf.5; 2025-12-02), Test Kitchen (Experiment Platform Sprint 16)
gerritbot added a comment to T409965: Enable experiment enrollment in the MediaWiki Action API.

Change #1204815 merged by jenkins-bot:

[mediawiki/extensions/MetricsPlatform@master] Enable experiment enrollment in the MediaWiki Action API

https://gerrit.wikimedia.org/r/1204815

Nov 18 2025, 11:08 PM · MW-1.46-notes (1.46.0-wmf.5; 2025-12-02), Test Kitchen (Experiment Platform Sprint 16)
gerritbot added a comment to T408133: [Spike] Explore Generalizing Enrollment Authorities.

Change #1204815 merged by jenkins-bot:

[mediawiki/extensions/MetricsPlatform@master] Enable experiment enrollment in the MediaWiki Action API

https://gerrit.wikimedia.org/r/1204815

Nov 18 2025, 11:08 PM · Test Kitchen (Experiment Platform Sprint 16), MW-1.46-notes (1.46.0-wmf.4; 2025-11-25), OKR-Work
Sfaci moved T409546: Remove duplicated code from xLab API experiment service controller from Sign Off to Done on the Test Kitchen (Experiment Platform Sprint 15) board.
Nov 18 2025, 11:03 PM · Essential-Work, Test Kitchen UI, Test Kitchen (Experiment Platform Sprint 15)
Maintenance_bot removed a project from T409546: Remove duplicated code from xLab API experiment service controller: Patch-For-Review.
Nov 18 2025, 4:32 PM · Essential-Work, Test Kitchen UI, Test Kitchen (Experiment Platform Sprint 15)
gerritbot added a comment to T409546: Remove duplicated code from xLab API experiment service controller.

Change #1206840 merged by jenkins-bot:

[operations/deployment-charts@master] Test Kitchen UI: Deploying v1.1.2 release to production

https://gerrit.wikimedia.org/r/1206840

Nov 18 2025, 3:48 PM · Essential-Work, Test Kitchen UI, Test Kitchen (Experiment Platform Sprint 15)