Wikimedia Release Engineering Team/Checkin archive/2024-03-20

2024-03-20

• Last time

🏆 Wins/winterrogation

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments

Mar 2024

• Nightly security patch failures updating phabricator tasks merged, ready to release
• Merged deploys-in-progress reset script
• Two repos have patches for git-fat → git-lfs
• scap: replaced canary swagger checks with test server httpbb checks
• Phorge integration with GitLab in its third round of review
  • https://gitlab.com/gitlab-org/gitlab/-/merge_requests/145863
• GitLab webhooks also still going, looks like it'll go through
• People like scap backport - more patches, fewer things typed into terminals.
• Security patch notification now working!
• GitLab webhooks have a more accurate regex for "Bug: TXX"
• Foreachwiki in beta
• Getting rid of the /srv/mediawiki/php symlink
• Upgraded GitLab k8s/cloud cluster to new k8s version and documented the process
• Andre has returned to us \o/
• Phab deploy is out (but stuff is broken (not terribly (probably)))
• scap backport now works for non-extension submodules
• gitlab cloud runner dependencies
• scap backport -2 fix merged, need to release

📅 Vacations/Important dates

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2024

https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off (page needs updating for Dayforce)

Mar 2024

• 29 Feb, 1st Mar, 4th Mar - 8th Mar - Antoine
• 14 Mar–14 May: Dan
• 29 Mar: Brennen, Jeena, Andre

Apr 2024

• Mon 01 Apr: Andre
• Fri 05 Apr: Brennen
• Fri 05 Apr–Fri 12 Apr -- Tyler, eclipse viewing
• Mon 22 Apr: Global holiday, all staff
• 26 Apr: Brennen (tentative)
• Apr 29 - May 02: Andre less available

May 2024

• Mon 27 May: Memorial Day (US staff with reqs)

Future

• A few days around July 4: Brennen
• 25 Aug - 03 Sep: Brennen

🔥🚂 Train

https://tools.wmflabs.org/versions/

https://train-blockers.toolforge.org/

https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar

Rotation

• 3 Dec – 1.42.0-wmf.8 – No Train offsite
• 11 Dec – 1.42.0-wmf.9 – Brennen + Antoine (Jaime out)
• 18 Dec – 1.42.0-wmf.10 – Ahmon + Brennen (Jaime out)
• 25 Dec – 1.42.0-wmf.11 – No Train
• 1 Jan – 1.42.0-wmf.12 – Dan + Ahmon (Jaime out)
• 8 Jan – 1.42.0-wmf.13 – Jeena + Dan (Jaime out)
• 15 Jan – 1.42.0-wmf.14 – Jaime + Jeena
• 22 Jan – 1.42.0-wmf.15 – Antoine + Jaime
• 29 Jan – 1.42.0-wmf.16 – Ahmon + Antoine(Brennen out Wed–Fri)
• 05 Feb – 1.42.0-wmf.17 – Brennen + Ahmon
• 12 Feb – 1.42.0-wmf.18 – Brennen+Antoine (Friday)
• 19 Feb – 1.42.0-wmf.19 – Jeena+Brennnen
• 26 Feb – 1.42.0-wmf.20 – Dan + Jeena
• 04 Mar – 1.42.0-wmf.21 – Jaime + Dan (Antoine out)
• 11 Mar – 1.42.0-wmf.22 – Antoine + Jaime (Dan out)

People for train: Ahmon, Antoine, Brennen, Jeena, Jaime

• 18 Mar – 1.42.0-wmf.23 – Ahmon + Antoine
• 25 Mar – 1.42.0-wmf.24 – Jeena + Ahmon
• 1 Apr – 1.42.0-wmf.25 – Jaime + Jeena
• 8 Apri – 1.42.0-wmf.26 – Antoine + Jaime
• 15 Apr – 1.42.0-wmf.27 – Ahmon + Antoine
• 22 Apr – 1.42.0-wmf.28 – Brennen + Ahmon (Global holiday Monday; Brennen out Friday)

Team Discussions

Annual planning

WE6.2:

• If we make single version MediaWiki containers for production and remove configuration from the container, we reap the benefit of Kubernetes by getting individual changes to production faster on a per-deploy basis

• If we make our existing deployment UI safer and more user-friendly, we reduce the toil of deployers as measured by the number of users of the deployment tool.

Things we care about:

• We care about moving routing to k8s to ensure fast train rollback
• ramp up one version, ramp down other version

Things mentioned today in IC meeting:

• Wikitech, votewiki, videoscaling
• Issue with beta cluster—how do we have pre-production testing?
• Worries about db corruption

• * *

Let's do some inbox triage: https://phabricator.wikimedia.org/maniphest/query/7vRDrcVnt8OI/#R