Wikimedia Release Engineering Team/Checkin archive/2023-07-19
2023-07-19
editπ Wins & Gratitude
edit- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- Jul '23 edition
- Bunch of GitLab accounts created ~200 accounts
- Tooling for recurring account syncing
- Default phabricator.wikimedia.org frontpage has a "I need access or permissions to..." tab panel - https://phabricator.wikimedia.org/W2984
- Building out a deployment pipeline
- Good reviews and talented engineers on the team
- Desiloed
- Did math!
- JohnBond upgrading to puppet 7
- Contint servers upgraded to in-warranty hardware! (Dzahn, John Bond, Jelto)βssds! zuul-merger should be way faster
- git::clone puppet resource updated! LDAP group sync stuff
- Great team + smart people + good reviews
- ^ +1 + Daniel Zahn, Eoghan, Ahmon's review
- Meeting yesterday with Dzahn, grateful for him reaching out, having a plan for phab migration stuff
- Mention of doing a git blame on stacktraces. Experiment in scap was https://gerrit.wikimedia.org/r/c/mediawiki/tools/scap/+/773870
- Phatality digging
- BuildKitd allowlist is deployed to production
- Phab backlog cleaning
- Boldly deleting wikipages!
- Andre has phab-root, gerrit-root, contint-root
- Toronto is beautifulΒ :)
- List of supergroupers (DX)
π» Open source/Upstream contributions
edit- Antoine reviewed/fixed a stack of patchset for python-jenkins https://opendev.org/jjb/python-jenkins (used by JJB) + granted release rights to one of the participants
πΆ Let's keep these empty
editCode review
edit- +1'd gerrit changes
- TODO: gitlab equivalent
Gerrit Access requests
editGitLab Access requests
editπ Vacations/Important dates
edit- https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2023
- https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off
July 2023
edit- 03-04 Mon: U.S. July Holiday, US staff with reqs
- 05 Wed & 06 Thu: Andre CZ public holidays
- 06 Wedβ11 Tue: Dancy out (wedding, not mine)
- 14 Fri Antoine (Bastille Day, France national holiday)
- 18 Tue - 21 Fri Jaime
- 23 Fri Junβ18 Fri Aug: Jeena β Mongolia :D :D
- 25Tue-28Fri Andre less available (conference)
- 27 Thr - 28 Fri Dan
- 28 Fri: Brennen probably out for RockyGrass πͺ
- 31 Mon Jul β 21 Mon Aug Antoine
August 2023
edit- 31 Mon Jul β 21 Mon Aug β Antoine
- 23 Fri Junβ18 Fri Aug: Jeena β Mongolia :D :D :D
- 07 Fri: Brennen flying back from NYC
- 09 Wed: International Day of the World's Indigenous Peoples, US staff with reqs
- 11 Fri: Brennen out for Folks Fest (?)
- 7-11 Mon-Fri: Dan out for family vacation
- 27 Augβ04 Sep: Brennen (π₯)
September 2023
edit- 26 Augβ05 Sep: Brennen (π₯)
- 13 Wedsβ17 Sun: Brennen β KS (approximate)
October 2023
editπ₯π Train
edit- https://tools.wmflabs.org/versions/
- https://train-blockers.toolforge.org/
- https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
- 2 Jan - wmf.17 - Dan + Antoine (Jaime out)
- 9 Jan - wmf.18 - Jeena + Dan (Jaime out)
- 16 Jan - wmf.19 - Jaime + Jeena
- 23 Jan - wmf.20 - Brennen + Jaime
- 30 Jan - wmf.21 - Ahmon + Brennen
- 6 Feb - wmf.22 - Chad + Ahmon
- 13 Feb - wmf.23 β Dan + Chad
- 20 Feb - wmf.24 β Antoine + Dan
- 27 Feb - wmf.25 β Jaime + Antoine
- 6 Mar β wmf.26 β Jeena + Jaime
- 13 Mar β wmf.27 β Brennen + Jeena
- 20 Mar β wmf.1 β Ahmon + Brennen
- 27 Mar β wmf.2 β Chad Dan + Ahmon
- 3 Apr β wmf.3 β Antoine + Dan
- 10 Apr β wmf.4 β Chad + Antoine
- 17 Apr β wmf.5 β Jaime + Chad
- 24 Apr β wmf.6 β Jeena + Jaime
- 1 May β wmf.7 β Brennen + Jeena
- 8 May β wmf.8 β Antoine + Brennen (Ahmon out + Antoine Out 8th)
- 15 May β wmf.9 β Ahmon + Antoine (Dan out + Chad out)
- 22 May β wmf.10 β Chad + Ahmon (Dan out + Jeena out 26th)
- 29 May β wmf.11 β Dan + Chad (Memorial Day 29th)
- 5 Jun β wmf.12 β Jeena + Dan (Brennen out, Jaime out)
- 12 Jun β wmf.13 β Jaime + Jeena
- 19 Jun β wmf.15 β Cancelled for offsite
- 26 Jun β wmf.16 β Brennen + Jaime (Jeena out)
- 3 Jul β wmf.17 β Antoine + Brennen (3rd + 4th holidays)
- 10 Jul β wmf.18 β Dan + Antoine (Ahmon out)
- 17 Jul β wmf.19 β Ahmon+Dan (Brennen out Friday)
- 24 Jul β wmf.20 β Jaime+Ahmon
Team discussions
editContint Decomm
- Objections or other thoughts on the plan? https://phabricator.wikimedia.org/T342017
Move Phab to Phorge
- Migrate ganetti VM to phorge, send around login information
- Build a testing planβhappy path of workflows
- Investigate aphlict upgrade
Next sprint!
editPhab stuff
editObjective: prepare for bullseye upgrade
- 7.4 incompatibilities
- Get our repo in-order vs upstream (stack patches better)
- Stretch: pair on deploys
- Upgrade dev-tools instance?
- Via Jaime 1-on-1: develop environment
PipelineLib β GitLab
editObjective: Migrate 1 SRE service thing
- GitLab running out of diskspace https://phabricator.wikimedia.org/T340887
- storage the for the registryβwe have a device we can use for storage space
- Bigger instances
- Restarting BuildKitd on a timer
- Figure out how to reduce the number of jobs running on WMCS runners
- 1031 is instance-wide
- Common patterns may not work here since there's no registry
- WMCS vs K8s runners
- There are pros and cons
- Proposal: Disable WMCS runners for a week and track the impact
- Collect data about job failures/job run time
- General schemaβsending events *somewhere* and calculating events later
- Example: https://people.wikimedia.org/~dduvall/jenkins/2019-06-07/30-day/durations-by-builton.html
- Let's use our prometheus/grafana...somehowΒ :)
- Stacked patchsets: https://phabricator.wikimedia.org/T300819
- Push rule for GitLab: https://phabricator.wikimedia.org/T341638
- Investigate whether push rules are just .git/hooks with a UI
- Rendering for T\d+: https://phabricator.wikimedia.org/T337570 +1
- Running some javascript on MR pages...somehow
- Writing an integrationβwe know where the ruby code lives
- Others?
- Meeting tomorrow will likely yield more tasks