Wikimedia Release Engineering Team/Checkin archive/2024-09-25

2024-09-25

• Last time

📋 Agenda

• JR is here
• Old TODOs/Reminders
• Wins/anti-wins
• Important dates
• Train
• Discussions
  • WikiLead recap (where was Tyler last week)
  • Triage

Old TODOs

• TODO: thcipriani add thoughts to private repo for PrivateSettings task
• [x] TODO: thcipriani Reach out to office it about getting a bot email
• [x] TODO: thcipriani: Reach out to O11y re:federation/find task
  • https://phabricator.wikimedia.org/T363919
• [x] REMINDER: vote for board of trustees https://meta.wikimedia.org/wiki/Wikimedia_Foundation_elections/2024/Candidates Voting closes at 23:59 UTC on September 17.
• [x] TODO: thcipriani/andre: gerrit policy talk page—ambiguity in the policy about emailing wikitech/lack of consensus. New idea: when there is no consensus, have folks email wikitech even for non-MediaWiki repos, wait two weeks, impelement consensus.
  • https://www.mediawiki.org/wiki/Topic:Yczkcjnu474mmczl
  • Should probably send to Wikitech/poke Tim
• TODO: screen/tmux for scap
  • Updated
    • https://wikitech.wikimedia.org/wiki/Backport_windows/Deployers
    • https://wikitech.wikimedia.org/wiki/How_to_deploy_code
  • Needed: email to wikitech

🏆 Wins/winterrogation

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments

Sep 2024

• Fixed scap prep bug https://phabricator.wikimedia.org/T373425, https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/424
• GraphQL data queries for bitergia are published—important for determining users that are the same person across tool within bitergia https://www.mediawiki.org/wiki/User:AKlapper_(WMF)/Bitergia_data_quality_queries
• train branch cutting credentials are all good—unified credentials for gerrit api and git
• Use sqlite to store scap sync-world history (https://gitlab.wikimedia.org/repos/releng/scap/-/merge_requests/423)
• Make automatic-branch-cut re-runnable: https://phabricator.wikimedia.org/T373709 (https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/115)
• Dan helped me stumble through adding an alert for PVC space in gitlab-cloud-runner (well, half of adding an alert, anyway)
• Antoine enabled error logging for everything to reveal hidden errors ( https://phabricator.wikimedia.org/T228838 )
• Antoine enhanced https://grafana.wikimedia.org/d/000000102/mediawiki-production-logging
• Wikifunctions has issues https://phabricator.wikimedia.org/T374241 / https://phabricator.wikimedia.org/T374231
• spiderpig data model and jobrunner merged
• https://gerrit.wikimedia.org/r/c/operations/puppet/+/1072786 gitlab: Sync people/wmde GitLab group w/ wmde LDAP group
• New phatality deployment, including bugs, downtime, and an eventual fix:
  • Incident report: https://docs.google.com/document/d/1Otic_JQbqHG0BNkMyU2dQ7K6yMSHUPxjgBnCsDIPdrk/edit
  • https://gerrit.wikimedia.org/r/c/releng/phatality/+/1073286 (https://phabricator.wikimedia.org/T374880)
• Removed deprecated Greenballs plugin from releases-jenkins . There are many more to go.
• Prepared an initial gitlab CI for https://gitlab.wikimedia.org/repos/data-engineering/schemas-event-secondary
• Trying to get Volunteer NDAs signed for folks who will be the next Toolforge Standards Committee: https://phabricator.wikimedia.org/T374993
• Working on presentation about WMCS things for WikiCon NA the first week of October
• Progress on group-1
  • wmf/next branch is cut nightly
  • image build process via scap is blocked on lack of php dependencies on releases server and lack of mwscript
    • Currently looking at containerizing the execution of l10n update script to side-step this problem
• WikimediaDebug update published
• Dan's new work laptop
• Containerizing mwscript
• PatchDemo catalyst backend supports all extensions/skins/etc

Stuff in process

• Idea: group -1 step 2 -- debug host that runs group -1, run selenium tests against it
• SpiderPig API
  • Jobrunner -- pulls jobs from the queue runs them, adds interactions from the user to a queue to be processed by API
• PHPUnit tests running in paraellel deployed and reverted for php74 yesterday

📅 Vacations/Important dates

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2024

https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• Sept 02: US Labor day (WMF US holiday)
• Sept 06: Bryan
• Sept 13: Bryan
• Sept 13: Brennen part day
• Sept 16–20: Tyler AFK (mostly) that week
• Sept 18-19: Brennen Winfield 🪕
• Sept 19-20, 23: Bryan Riot Fest in Chicago!
• Sept23-27: Andre
• Sept24: Dancy
• Sept 9-Oct 11 Jeena
• Sept 27: Bryan
• Sept 27, 30-Oct 02: Dan
• Sep 30–Oct 7: Tyler Managment offsite + WikiConNA
• Oct 01-11: Jeena
• Oct 01–02: Dan
• Oct 01 (Tue; only first half of UTC day): Andre
• Oct 03-07: Bryan, Tyler @ WikiConNA
• Oct 03-06: WikiCon North America (Indianapolis)
• Oct 06: Dancy
• Oct 11: Bryan
• Oct 14: Indigenous Peoples' Day (also Columbus Day) US Staff w/reqs
• Oct 18: Bryan
• Oct 18: Jaime
• Oct 25: Bryan
• Oct 28: Andre public holiday
• Oct 29 - Nov ~18 maybe: Andre
• Nov 1: Bryan
• Nov 8: Bryan
• Nov 11-19 or so maybe: Andre
• Nov 11 (Mon): Veteran's Day, US staff with reqs
• Nov 15: Bryan
• Nov 28–29 (Thu, Fri): Thanksgiving holiday, US staff with reqs
• Dec 23: Andre
• Dec 24–31 (Tue–Tue): End of Year Holiday, Global Holiday

🔥🚂 Train

https://versions.toolforge.org/

https://train-blockers.toolforge.org/

https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar

Rotation

• 05 Aug (05-09) – 1.43.0-wmf.17 – Jaime + Brennen (Dan out, Global holiday Friday)
• 12 Aug (12–16) – 1.43.0-wmf.18 – Jeena + Jaime (Ahmon out, Antoine out)
• 19 Aug (19–23) – 1.43.0-wmf.19 – Andre + Jeena (Antoine out)
• 26 Aug (26–30) – 1.43.0-wmf.20 – Antoine + Andre (Brennen out)
• 02 Sep (02–06) – 1.43.0-wmf.21 – Ahmon + Antoine (US holiday Monday, Brennen out Tues)
  • Group0 rollback due to warnings and errors
  • Antoine backported fixes earlier + one going out now
• 09 Sep (09–13) – 1.43.0-wmf.22 – Dan + Ahmon
• 16 Sep (16–20) – 1.43.0-wmf.23 – Jaime + Dan (Brennen out)
• 23 Sep (23–27) – 1.43.0-wmf.24 – Brennen + Jaime (andre out)
• 30 Sep (30–Oct 4) – 1.43.0-wmf.25 – Antoine, Brennen (Out: Jeena, Dan, Andre (Tue), Ahmon (Fri), Bryan, Tyler)
• 07 Oct (07–11) – 1.43.0-wmf.26 – Andre, Antoine (Out: Jeena, Bryan (Fri))
• 14 Oct (14–18) – 1.43.0-wmf.27 – Jeena, Andre (Holiday: Mon (US only), Out: Bryan (Fri), Jaime (Fri))
• 21 Oct (21–25) – 1.43.0-wmf.28 – Ahmon, Jeena (Out: Bryan (Fri))
• 28 Oct (28–Nov 1) – 1.44.0-wmf.1 – Dan, Ahmon (Out: Andre)
• 04 Nov (04–08) – 1.44.0-wmf.2 – Jaime, Dan
• 11 Nov (11–15) – 1.44.0-wmf.3 – Brennen, Jaime (Out: Andre; Holiday: Mon (US only))
• 18 Nov (18–22) – 1.44.0-wmf.4 –
• 25 Nov (25–29) – 1.44.0-wmf.5 – (Out: <>, Holiday: Thu, Fri (US only))
• 02 Dec (02–06) – 1.44.0-wmf.6 –
• 09 Dec (09–13) – 1.44.0-wmf.7 –
• 16 Dec (16–20) – 1.44.0-wmf.8 –
• 23 Dec (23–27) – 1.44.0-wmf.9 – NO TRAIN (Holiday: Tue–Fri (Global))
• 30 Dec (30–Jan 03) – 1.44.0-wmf.10 – (oh noes) NO TRAIN (Holiday: Tue–Fri (Global))
• 06 Jan (06–10) – 1.44.0-wmf.11 –
  • TODO: create blocker tasks for train

🌻 Open source/Upstream contributions

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Upstream