Page MenuHomePhabricator
Create Task
Maniphest T389401

Deploy first set of Patroller Tools surveys
Closed, ResolvedPublic3 Estimated Story Points
Actions

Description

To help us figure out sampling rates for big wikis, we would like to deploy the Patroller Tools survey with 100% coverage on the following wikis:

  • id.wiki
  • ar.wiki
  • en.wiktionary
  • simple.wiki
  • hu.wiki
  • ur.wiki
  • en.wikisource

We will then use the response rate data to inform further deployment to the remaining 5 projects.

Audience:

  • Minimum edits: 500
  • Registration end: ~ deployment date - 6 months
  • Registered users only (no anons)

It should have a duration of one month.

More context and other details can be found in the parent task.

Details

SubjectRepoBranchLines +/-
Undeploy first set of Patroller Tools surveysoperations/mediawiki-configmaster+0 -203
Fix link for first set of Patroller Tools surveysoperations/mediawiki-configmaster+7 -7
Deploy first set of Patroller Tools surveysoperations/mediawiki-configmaster+203 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

Samwalton9-WMF created this task.Mar 19 2025, 6:21 PM
Restricted Application added a subscriber: hubaishan. · View Herald TranscriptMar 19 2025, 6:21 PM
Samwalton9-WMF triaged this task as High priority.Mar 19 2025, 6:21 PM
Restricted Application added a subscriber: alaa. · View Herald TranscriptMar 19 2025, 6:21 PM
Samwalton9-WMF renamed this task from Deploy first set of Patrooler Tools surveys to Deploy first set of Patroller Tools surveys.Mar 19 2025, 6:23 PM
Samwalton9-WMF edited projects, added Moderator-Tools-Team (Kanban); removed Moderator-Tools-Team.
jsn.sherman changed the task status from Open to In Progress.Mar 20 2025, 3:37 PM
jsn.sherman claimed this task.
jsn.sherman moved this task from Ready to In Progress on the Moderator-Tools-Team (Kanban) board.
jsn.sherman changed the task status from In Progress to Stalled.Mar 20 2025, 4:21 PM

Stalled due to the absence of a privacy statement

jsn.sherman set the point value for this task to 3.Mar 25 2025, 6:37 PM
OTichonova added a comment.Apr 2 2025, 2:22 PM

Hi @jsn.sherman, the privacy statement has now been added to the survey.

jsn.sherman changed the task status from Stalled to In Progress.Apr 2 2025, 3:04 PM
YLiou_WMF mentioned this in T377264: Moderator tools baseline satisfaction surveys.Apr 4 2025, 9:45 PM
Trizek-WMF subscribed.Apr 10 2025, 11:27 AM
Trizek-WMF mentioned this in T381984: Deploy QuickSurvey for Patroller Tools Use survey.EditedApr 10 2025, 11:35 AM
Trizek-WMF added a project: User-notice.

Added to Tech News.

Trizek-WMF moved this task from To Triage to In current Tech/News draft on the User-notice board.Apr 10 2025, 11:35 AM
Quiddity moved this task from In current Tech/News draft to Already announced/Archive on the User-notice board.Apr 17 2025, 6:04 PM
jsn.sherman changed the task status from In Progress to Open.Apr 17 2025, 6:35 PM
jsn.sherman removed jsn.sherman as the assignee of this task.
jsn.sherman updated the task description. (Show Details)
jsn.sherman moved this task from In Progress to Ready on the Moderator-Tools-Team (Kanban) board.
jsn.sherman subscribed.

@OTichonova @Trizek-WMF we've sorted through all of the prerequisites and this should now be deployable on 2024-04-24

jsn.sherman changed the task status from Open to Stalled.Apr 23 2025, 4:31 PM
In T389401#10753519, @jsn.sherman wrote:

@OTichonova @Trizek-WMF we've sorted through all of the prerequisites and this should now be deployable on 2024-04-24

This will be delayed another week. I didn't realize that an announcement had gone out the day before that there will be no train this week:
https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/thread/5JGHJRB6K6MRQCQA66XBTTTWM4ENPUDO/

YLiou_WMF mentioned this in T391717: [Q4 FY 24-25 Applied Science] Knowledge Integrity Research.Apr 25 2025, 4:39 PM
Kgraessle changed the task status from Stalled to Open.May 1 2025, 8:37 PM
jsn.sherman changed the task status from Open to In Progress.May 5 2025, 5:34 PM
jsn.sherman moved this task from Ready to In Progress on the Moderator-Tools-Team (Kanban) board.
gerritbot added a comment.May 5 2025, 6:09 PM

Change #1141947 had a related patch set uploaded (by Jsn.sherman; author: Jsn.sherman):

[operations/mediawiki-config@master] Deploy first set of Patroller Tools surveys

https://gerrit.wikimedia.org/r/1141947

gerritbot added a project: Patch-For-Review.May 5 2025, 6:09 PM
gerritbot added a comment.May 5 2025, 8:12 PM

Change #1141947 merged by jenkins-bot:

[operations/mediawiki-config@master] Deploy first set of Patroller Tools surveys

https://gerrit.wikimedia.org/r/1141947

Stashbot added a comment.May 5 2025, 8:15 PM

Mentioned in SAL (#wikimedia-operations) [2025-05-05T20:15:06Z] <jsn@deploy1003> Started scap sync-world: Backport for [[gerrit:1141569|Design Research Participant Survey: Undeploy (T392325)]], [[gerrit:1141947|Deploy first set of Patroller Tools surveys (T389401)]]

Stashbot mentioned this in T392325: QuickSurvey request for Design Research participant database recruitment.May 5 2025, 8:15 PM
Stashbot added a comment.May 5 2025, 8:21 PM

Mentioned in SAL (#wikimedia-operations) [2025-05-05T20:21:11Z] <jsn@deploy1003> dani, jsn: Backport for [[gerrit:1141569|Design Research Participant Survey: Undeploy (T392325)]], [[gerrit:1141947|Deploy first set of Patroller Tools surveys (T389401)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Maintenance_bot removed a project: Patch-For-Review.May 5 2025, 8:30 PM
Stashbot added a comment.May 5 2025, 8:35 PM

Mentioned in SAL (#wikimedia-operations) [2025-05-05T20:35:05Z] <jsn@deploy1003> Finished scap sync-world: Backport for [[gerrit:1141569|Design Research Participant Survey: Undeploy (T392325)]], [[gerrit:1141947|Deploy first set of Patroller Tools surveys (T389401)]] (duration: 19m 58s)

gerritbot added a comment.May 5 2025, 8:46 PM

Change #1141969 had a related patch set uploaded (by Jsn.sherman; author: Jsn.sherman):

[operations/mediawiki-config@master] Fix link for first set of Patroller Tools surveys

https://gerrit.wikimedia.org/r/1141969

gerritbot added a project: Patch-For-Review.May 5 2025, 8:46 PM

Change #1141969 merged by jenkins-bot:

[operations/mediawiki-config@master] Fix link for first set of Patroller Tools surveys

https://gerrit.wikimedia.org/r/1141969

Stashbot added a comment.May 5 2025, 8:48 PM

Mentioned in SAL (#wikimedia-operations) [2025-05-05T20:48:49Z] <jsn@deploy1003> Started scap sync-world: Backport for [[gerrit:1141969|Fix link for first set of Patroller Tools surveys (T389401)]]

Stashbot added a comment.May 5 2025, 8:55 PM

Mentioned in SAL (#wikimedia-operations) [2025-05-05T20:55:47Z] <jsn@deploy1003> jsn: Backport for [[gerrit:1141969|Fix link for first set of Patroller Tools surveys (T389401)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug)

Stashbot added a comment.May 5 2025, 9:03 PM

Mentioned in SAL (#wikimedia-operations) [2025-05-05T21:03:33Z] <jsn@deploy1003> Finished scap sync-world: Backport for [[gerrit:1141969|Fix link for first set of Patroller Tools surveys (T389401)]] (duration: 14m 43s)

Maintenance_bot removed a project: Patch-For-Review.May 5 2025, 9:30 PM
jsn.sherman moved this task from In Progress to QA on the Moderator-Tools-Team (Kanban) board.May 6 2025, 11:41 AM
Kgraessle moved this task from QA to Done on the Moderator-Tools-Team (Kanban) board.May 7 2025, 5:39 PM
YLiou_WMF added a comment.Jun 2 2025, 5:58 PM

Hi! Can we undeploy this? We've already stopped the survey on Limesurvey so no one can take it. Thank you! @jsn.sherman are you still the one to ask?

jsn.sherman added a comment.Jun 2 2025, 6:24 PM
In T389401#10876822, @YLiou_WMF wrote:

Hi! Can we undeploy this? We've already stopped the survey on Limesurvey so no one can take it. Thank you! @jsn.sherman are you still the one to ask?

Yep, we'll get it undeployed this week. Thanks!

gerritbot added a comment.Jun 2 2025, 7:06 PM

Change #1152797 had a related patch set uploaded (by Jsn.sherman; author: Jsn.sherman):

[operations/mediawiki-config@master] Undeploy first set of Patroller Tools surveys

https://gerrit.wikimedia.org/r/1152797

gerritbot added a project: Patch-For-Review.Jun 2 2025, 7:06 PM
jsn.sherman moved this task from Done to Eng review on the Moderator-Tools-Team (Kanban) board.Jun 2 2025, 7:07 PM
gerritbot added a comment.Jun 2 2025, 8:38 PM

Change #1152797 merged by jenkins-bot:

[operations/mediawiki-config@master] Undeploy first set of Patroller Tools surveys

https://gerrit.wikimedia.org/r/1152797

Stashbot added a comment.Jun 2 2025, 8:38 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-02T20:38:46Z] <jsn@deploy1003> Started scap sync-world: Backport for [[gerrit:1152797|Undeploy first set of Patroller Tools surveys (T389401)]]

Stashbot added a comment.Jun 2 2025, 8:41 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-02T20:41:23Z] <jsn@deploy1003> jsn: Backport for [[gerrit:1152797|Undeploy first set of Patroller Tools surveys (T389401)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there.

Stashbot added a comment.Jun 2 2025, 8:51 PM

Mentioned in SAL (#wikimedia-operations) [2025-06-02T20:51:42Z] <jsn@deploy1003> Finished scap sync-world: Backport for [[gerrit:1152797|Undeploy first set of Patroller Tools surveys (T389401)]] (duration: 12m 55s)

jsn.sherman moved this task from Eng review to Done on the Moderator-Tools-Team (Kanban) board.Jun 2 2025, 8:55 PM

undeployed

Maintenance_bot removed a project: Patch-For-Review.Jun 2 2025, 9:30 PM
KCVelaga_WMF subscribed.Jun 5 2025, 10:44 AM

Based on Slack conversation with @OTichonova

session count
impression_sessions15023
responded_sessions1554
responded_yes_sessions769
responded_no_sessions789

Ideally, responded_sessions = responded_yes_sessions + responded_no_sessions
but there is a difference of 4 above, could be someone force loading the survey, something with cookies etc.

Query used:

SELECT
    COUNT(DISTINCT init.event.surveySessionToken) AS impression_sessions,
    COUNT(DISTINCT resp.event.surveySessionToken) AS responded_sessions,
    COUNT(DISTINCT
        CASE 
            WHEN resp.event.surveyResponseValue='ext-quicksurveys-external-survey-yes-button' THEN resp.event.surveySessionToken 
        END) AS responded_yes_sessions,
    COUNT(DISTINCT
        CASE 
            WHEN resp.event.surveyResponseValue='ext-quicksurveys-external-survey-no-button' THEN resp.event.surveySessionToken 
        END) AS responded_no_sessions
FROM
    event.quicksurveyinitiation init
LEFT JOIN
    event.quicksurveysresponses resp
    ON init.event.surveySessionToken = resp.event.surveySessionToken
WHERE
    init.year = 2025
    AND init.event.surveyCodeName = 'Patroller tools external survey'
jsn.sherman closed this task as Resolved.Jun 6 2025, 6:50 PM
jsn.sherman claimed this task.
In T389401#10887189, @KCVelaga_WMF wrote:

Based on Slack conversation with @OTichonova

session count
impression_sessions15023
responded_sessions1554
responded_yes_sessions769
responded_no_sessions789

Ideally, responded_sessions = responded_yes_sessions + responded_no_sessions
but there is a difference of 4 above, could be someone force loading the survey, something with cookies etc.

Query used:

SELECT
    COUNT(DISTINCT init.event.surveySessionToken) AS impression_sessions,
    COUNT(DISTINCT resp.event.surveySessionToken) AS responded_sessions,
    COUNT(DISTINCT
        CASE 
            WHEN resp.event.surveyResponseValue='ext-quicksurveys-external-survey-yes-button' THEN resp.event.surveySessionToken 
        END) AS responded_yes_sessions,
    COUNT(DISTINCT
        CASE 
            WHEN resp.event.surveyResponseValue='ext-quicksurveys-external-survey-no-button' THEN resp.event.surveySessionToken 
        END) AS responded_no_sessions
FROM
    event.quicksurveyinitiation init
LEFT JOIN
    event.quicksurveysresponses resp
    ON init.event.surveySessionToken = resp.event.surveySessionToken
WHERE
    init.year = 2025
    AND init.event.surveyCodeName = 'Patroller tools external survey'

Thanks KC!

YLiou_WMF mentioned this in T396250: Deploy remaining Patroller Tools surveys.Jun 9 2025, 7:50 PM
Maintenance_bot edited projects, added User-notice-archive; removed User-notice.Thu, Jun 19, 8:30 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits