User Story:
As a the Growth team, I want to interpret the WE1.2.9 experiment results, so that we can understand the impact on constructive activation on mobile.
Related:
- T377096: Measurement Plan: Surfacing Structured Tasks experiment (WE1.2.6)
- T377097: Instrumentation: Surfacing Structured Tasks experiment (WE1.2.6)
Task scope:
Analyze the collected data from the WE1.2.9 Experiment to assess its impact on constructive activation on mobile.
Present findings to the Growth team and document the results on the project’s MediaWiki page: https://www.mediawiki.org/wiki/Growth/Constructive_activation_experimentation#Measurement_and_Results
Background
- Project page: Constructive activation experimentation
- Related epic: T362584: [EPIC] Surface Structured Tasks to new editors (FY24/25: WE1.2.3 & WE1.2.6 & WE1.2.9)
- Related work: Structured tasks & Edit check
Current full-page editing experiences require too much context, patience, and trial and error for many newcomers to contribute constructively. To support a new generation of volunteers, we will increase the number and availability of smaller, structured, and more task-specific editing workflows (E.g. Edit Check and Structured Tasks). The Growth team will primarily focus on Structured Tasks, while working closely with the Editing team to ensure our work integrates well with Edit Check.
This project aims to address the following user problem: Getting started editing on Wikipedia is difficult and especially frustrating on mobile devices. I want the editing interface to provide the in-the-moment policy and technical guidance I need, so my initial efforts aren't reverted.
This project aims to achieve the following user outcome: As a new Wikipedia volunteer, I feel confident and enthusiastic about contributing to the Wikimedia movement by editing Wikipedia articles. The tools provided guide me step-by-step, limit distractions, and allow me to learn progressively so I can successfully contribute on my mobile device.
As part of the Growth team 2024/2025 Annual Plan, the Growth team will explore various ways to increase constructive activation on mobile. This is part of the Wikimedia Foundation 2024-2025 Annual Plan, specifically the Wiki Experiences 1.2 Key Result
Experiment Report
Acceptance Criteria
- Draft Measurement Plan
- Discuss scope of the experiment with Growth's PM
- Instrumentation discussion with tech lead and engineers
- QA
- Ensure we are collecting the necessary data after the experiment release; Review experiment and instrumentation for experiment analysis.
- Review Data Collection Guidelines and obtain/seek L3SC approval as needed
- Review Data Modeling Guidelines as needed
- Review Dashboard(ing) Guidelines as needed
- Share initial leading indicators
- Code Review
- ✨Perform analysis✨
- Prepare Quarto report
- Determine and add the appropriate license
- Review data Reporting guide and Guidelines to ensure compliance
- Report review
- Share draft analysis
- Review publishing reports guidelines
- Enter data publication into the data publication log form registry
- Post analysis notebook to Gitlab
- Clean and Post all notebook to Gitlab
- Publish the Quarto report following the web publishing guidelines including the Gitlab repo link
- Share report link with the Growth team
- Clear all interim tables and csv files per the Data Retention Guidelines
- Kirsten to summarize experiment results on the related MediaWiki project page.
- Kirsten to add link to analysis from the Edit Tag explanation.