Wikimedia Release Engineering Team/Checkin archive/2024-08-07

2024-08-07

• Last time

🏆 Wins/winterrogation

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments

August 2024

• Fixed issue with deployment-deploy04 free space. Added a 40GB volume and copied /srv to it.
• Buildkit 0.15.1 release deployed
• Helped data-engineering Airflow DAGs with their Gitlab CI.
• Rewrote remainder of make-container-image stuff in Python: https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/99 \o/
  • Scap invokes this repo during deployment
  • Current status: Create a php7.4 image + debugging packages
  • Future: php7.4 + php8.1
  • Single version images: there's a change in mw-config to override wikiversions.json
• Updated train-dev to use debian:11 base image.
• Kicked off nomination process to reboot the Toolforge standards committee (https://phabricator.wikimedia.org/T370474)
• Moved a tool to toolforge build service
  • https://extloc.toolforge.org/
• Fixed links in patchdemo for catalyst wikis
• merged persistence for k8s patchdemo
• Added read-only flag for patchdemo
• Fixed a Phab code bug not checking user permissions creating a form
• Merged more Phorge upstream stuff to get bugfixes + features once we pull, e.g. logging errors for broken Herald rules. See some stuff as deps: https://phabricator.wikimedia.org/T370266 (when downstream tasks exist)
• Played with checking for active Phab accounts linked to locked WMF SUL accounts (TODO: other way round)

📅 Vacations/Important dates

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2024

https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• Aug 02: Bryan
• Aug 05-08: Dan
• Fri 09 Aug – Global holiday: International Day of the World’s Indigenous Peoples
• Aug 12: Dan
• Mon 12 Aug-16: Ahmon out
• Mon 12 Aug - Fri 23 Aug: Antoine
• Aug 16: Bryan
• Aug 23: Bryan
• Aug 23: Jaime
• Sat 24 Aug - 03 Sep: Brennen 🔥
• Aug 30: Bryan
• Sept 02: US Labor day (WMF US holiday)
• Sept 06: Bryan
• Sept 13: Bryan
• Sept 18-19: Brennen Winfield
• Sept 19-20, 23: Bryan Riot Fest in Chicago!
• Sept 27: Bryan
• Sept 11-30 Jeena
• Oct 03-06: WikiCon North America (Indianapolis)
• Oct 1-11 Jeena
• Oct 14: Indigenous Peoples' Day (also Columbus Day) US Staff w/reqs

🔥🚂 Train

https://versions.toolforge.org/

https://train-blockers.toolforge.org/

https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar

• https://phabricator.wikimedia.org/T371977 is a bug affecting the mwclient python library caused by a change in this week's train. Deploying the backport of the revert (https://gerrit.wikimedia.org/r/c/mediawiki/core/+/1060468) would be a nice temp move to give the upstream time to fix the library.
• https://phabricator.wikimedia.org/T371986 affecting https://extloc.toolforge.org/extensions/FlaggedRevs

Rotation

• 05 Aug (05-09) – 1.43.0-wmf.17 – Jaime + Brennen (Dan out, Global holiday Friday)
• 12 Aug (12–16) – 1.43.0-wmf.18 – Jeena + Jaime (Ahmon out, Antoine out)
• 19 Aug (19–23) – 1.43.0-wmf.19 – Andre + Jeena (Antoine out)
• 26 Aug (26–30) – 1.43.0-wmf.20 – Antoine + Andre (Brennen out)
• 02 Sep (02–06) – 1.43.0-wmf.21 – Ahmon + Antoine (US holiday Monday, Brennen out Tues)
• 09 Sep (09–13) – 1.43.0-wmf.22 – Dan + Ahmon
• 16 Sep (16–20) – 1.43.0-wmf.23 – Jaime + Dan (Brennen out)
• 23 Sep (23–27) – 1.43.0-wmf.24 – Brennen + Jaime

Team Discussions

Things happening:

• Wikimania started today: https://wikimania.wikimedia.org/wiki/2024:Wikimania/en
• Discussion of options re:Beta cluster to turn into a pumpkin
  • Beta MediaWiki is provisioned using mediawiki puppet roles, which are due to be removed (after videoscalers, wikitech, and dumps move to k8s)
  • Do nothing: these classes will likely be removed which leaves beta unmanaged + no way to provision new mw instances
  • How much work should be done and what work needs to be done before we no longer need puppet
  • Existing options:
    • keep using the puppet code and don't remove it
    • Put some kind of k8s in beta
      • Would this make beta go away, eventually?
      • It lets us replace MediaWiki. And probably the services using docker/systemd.
      • One of the options is magnum
    • Hand-rolled mediawiki servers? something like that.

K8s sync update

• videoscalers running in k8s for group0
• Hugh is turning the knobs, ping serviceops in general

🌻 Open source/Upstream contributions

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Upstream