Wikimedia Release Engineering Team/Checkin archive/20190708
2019-07-08
editVacations/Important dates
edit- June 10–July 21 - Dan leave (6 weeks, then additional leave later)
- July 5 - Some people off.
- July 10 - Lars off (swapped with weekend)
- July 19 - Jeena volunteering
- July 19 - Brennen traveling midafternoon
- July 22–August 9 - Željko vacation
- August 7–19 - James off (inc. Wikimania)
- August 12 - September 8 - Dan leave
- August 12 (Glorious Twelfth) - US Staff
- August ??? - ??? - Antoine
- August 14–18 - Wikimania
- Attending: James, Lars, Jean-Rene
- August 15 - Željko, Assumption of Mary
- August 25 - September 4 - Brennen vacation
- September 2 (Labor Day) - US Staff
- September 26 - October 1 - JR Vacation
- October 14 (Indigenous Peoples' Day) - US Staff
- November 11 (Veterans' Day) - US Staff
- November 28–29 (Thanksgiving) - US Staff
- December 6 - Lars, Finnish Independence Day
- December 25–31 (Christmas) - US Staff
- December 25–26 - Lars, Christmas
- 2020 January 1 (New Year's Day) - US Staff, Lars
Rotating positions
editTrain
edit- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
- June 24 - wmf.11 - Jeena (with Mukunda)
- July 1 - wmf.12 - No train (Fourth of July)
- July 8 - wmf.13 - Jeena
- July 15 - wmf.14 - Lars (with Antoine)
- July 22 - wmf.15 - Lars
- July 29 - wmf.16 - Brennen (with Tyler)
- Aug 5 - wmf.17 - Brennen
- Aug 12 - wmf.18 - No Train (Wikimania)
- Aug 19 - wmf.19 - Zeljko 😱
- Aug 26 - wmf.20 - Zeljko 😭
SoS
edit- Zeljko 4eva! :)
Team Business
editTimespent spreadsheet
edit- For the avoidance of doubt: fill out the sheet week number for the previous week
- New spreadsheet! https://docs.google.com/spreadsheets/d/1UEmjIbv6voTF5bOnHdjOltw47AwPDtnmUo0h78wgYDY/edit#gid=0
- Changes:
- Categories aligned with our new workboard categories (cf: https://phabricator.wikimedia.org/project/board/20/ )
- Included a "Time off" column to explicitly track time off you've taken
- Last quarter's
- Please review for missing data! https://docs.google.com/spreadsheets/d/1urCLNQXeEi1DOR8Iu0qW0yPt-glxX1laqlMovbGyCW0/edit#gid=695570696
Book club
edit- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
- Notes: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club/Continuous_Delivery
- Next: July 12th, chapters 14+15 (the rest of the book) (9am Pacific)
Quarterly Planning
edit- https://docs.google.com/spreadsheets/d/1TrkGTfPLR0C74va3XyY6faYplSh6UggGiPdmxIVm1uo/edit#gid=0
- Some final edits this week
- Will be copied over (by me) by Friday to https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2019-20_Q1
Monthly reflection on accomplishments - July '19 edition
edit- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- Add as you have them!
Incoming/Needs attention
edit- User unable to login to Gerrit: https://phabricator.wikimedia.org/T223266
- In the Ready column of our current kanban
- Assigned to Tyler
Scrum of Scrums
editIncoming from last week
editOutgoing this week (wrong section heading level is on purpose for copy/pasting into Scrum of Scrums etherpad)
editRelease Engineering
edit- Blocked by:
- Core Platform Team:
- (low priority): https://phabricator.wikimedia.org/T205361 is blocking undeployment of CodeReview.
- MediaWiki installer silently ignores invalid extensions https://phabricator.wikimedia.org/T225512
- Core Platform Team:
- Blocking:
- Security team: We need to fix the ast availability in CI images to allow phan-seccheck upgrades https://phabricator.wikimedia.org/T227385
- Updates:
- Train Health
- Last week: 1.34.0-wmf.12 - NO TRAIN, WMF HOLIDAY (4 July)
- This week: 1.34.0-wmf.13 - https://phabricator.wikimedia.org/T220738
- Next week: 1.34.0-wmf.14 - https://phabricator.wikimedia.org/T220739
- Code Health
- Log Health
- All: Input greatly wished for on the "Future of CI" planning document: https://lists.wikimedia.org/pipermail/wikitech-l/2019-June/092227.html
- bd808/Niharika: We're going to move CI for wikimania-scholarships to only test in PHP7 so we can drop php56 from CI. https://phabricator.wikimedia.org/T224906
- Train Health
Callouts
edit- Release Engineering
Train status and happenings
edit
Standup!
edit- Make sure your tasks are correct on our kanban board!
Note for week of July 8th
edit- I (Greg) removed all of the tasks that were in the Ready column of the current monthly kanban board (201907)
- You can find them in the Next column: https://phabricator.wikimedia.org/project/board/4104/
- If you are working on it, move it to the Doing column on the kanban board
- And remember, try to limit in-progress work!
Antoine
edit- What I did last week
- contint1001 has a new partition
- reviews!
- Quibble jobs and Zuul branch filters are a mess :-\
- Back in the deployment pipeline meeting
- What I plan to do this week
- get the puppet patch for contint1001 partition to be applied T207707
- Maybe polish the CI docker container for Gerrit (we got a bazel image https://gerrit.wikimedia.org/r/#/c/integration/config/+/493638/ )
- What I'm blocked on
- Pin Docker version for CI to not be coupled with others agenda. https://phabricator.wikimedia.org/T226236
- Blocks switching Jenkins instances to Stretch
- clean up patches for puppet
- Pin Docker version for CI to not be coupled with others agenda. https://phabricator.wikimedia.org/T226236
- Other?
- what is going on with phan php-ast? :D
- It's all broken. :-(
- what is going on with phan php-ast? :D
Brennen
edit- What I did last week
- Read version control chapter in book
- Fail to make progress on pipelinelib config validation and mediawiki blubber build step
- What I plan to do this week
- Actually make progress on above
- Finish book
- Convert pipelinelib notes to documentation
- Revisit how PHP is run in dev-images
- Spend quality time with Phabricator
- What I'm blocked on
- Doesn't seem like blubber builder happens in the right place, maybe should abandon that line of attack
- Other?
Dan
edit- What I did last week
- What I plan to do this week
- What I'm blocked on
- Other?
Greg
edit- What I did last week
- Short week
- "Feedback & Performance WG" meeting
- Talked with Erika re team changes
- 1:1s (a sizable chunk of the week normally, but even more so last week)
- tried to start the old motorhome (Tues afternoon)
- What I plan to do this week
- Prep for next week's presentation
- TechConf meeting, sending out next batch of invites (based on who didn't confirm from the first batch)
- figure out this 3rd party stuff
- Read a book!
- What I'm blocked on
- figure out why keyboard is being weird, I did turn it over and shake out all the debris last week, maybe a stuck something
- Other?
James
edit- What I did last week
- Not enough. Holidays, psh. ;-(
- Hitting my head against the PHP docker image upgrade https://phabricator.wikimedia.org/T218719
- Some progress on Zero removal from production ahead of SRE https://phabricator.wikimedia.org/T212865
- Minor support for Proton and Maps migration into pipeline https://phabricator.wikimedia.org/T225680 https://phabricator.wikimedia.org/T216826
- Various administrivia (New monitor! Travel for WikidataCon in October! Annual pension accrual adjustment! Such joy!)
- What I plan to do this week
- More on https://phabricator.wikimedia.org/T218719 -> https://phabricator.wikimedia.org/T226420 -> https://phabricator.wikimedia.org/T225457 (hopefully)
- Decide with the Web team what to do about https://phabricator.wikimedia.org/T224997
- Land some of the initial work for static variant prod config https://phabricator.wikimedia.org/T223602
- At least file tasks with relevant teams for https://phabricator.wikimedia.org/T211784 blockers
- Supporting further the PHP unit/integration test split; there should be an e-mail announcement from the team this week. https://phabricator.wikimedia.org/T87781
- What I'm blocked on
- PHP docker image help appreciated, both for the inheritance of PHP extensions (phan issue) and also for general advice (OOUI issue)
- Other?
Jean-Rene
edit- What I did last week
- Prepared for Code Review WG and Code Health OH meetings
- Other than that ^ not a whole lot.
- What I plan to do this week
- Code Health Metrics - add extensions to CH Pipeline
- Read book
- Code Health Office Hours
- Code Review WG
- Quarterly planning wrap-up
- What I'm blocked on
- Other?
Jeena
edit- What I did last week
- Read book
- fix and merge deployment-charts scaffold updates
- Professional development - Kubernetes
- Work on porting mediawiki chart to deployment-charts
- What I plan to do this week
- Train
- Read book
- mediawiki chart
- Work with Tyler on deploying blubberoid
- What I'm blocked on
- Other?
Lars
edit- What I did last week
- Worked on assisting services around GitLab for CI. Done: VCSWorker, artifact store, deployment worker, and automated setup of all.
- Read CD book chapter 14.
- Discussed MediaWiki testing, CI, CD, and everything with James. Conclusion: MW test suite needs improvements, but there's no need to panic.
- What I plan to do this week
- Review the new workboard and open/update/close/move any tickets that are relevant to me.
- Finish CI assisting services: controller, and possibly various things need fixing. Goal is that by Friday, the prototype can be tested by at least one releng team volunteer.
- Finish reading CD book. Atend book club.
- Carch up on pending email from last week (INBOX currently at 13).
- Respond to a little more CI architecture feedback I've received.
- Sketch a short CI progress report and find somewhere suitable to publish it.
- What I'm blocked on
- I am a hacker of very little brain
- Other?
- Would someone like to volunteer to test the CI prototype for some toy project? I.e., from source in a git repor somewhere, have CI prototype build something, and publish it on a mock test environment as a static file.
- Where would be a good place to publish a "new CI progress report"?
- Do we want to upgrade Zuul to v3 at least temporarily to avoid hitting Python2 EOL? Raised by Antoine last week.
- I'm away on Wednesday.
Mukunda
edit- What I did last week
- Upgraded phabricator
- Dealt with fallout from the upgrade https://phabricator.wikimedia.org/T227251
- Vacation, though I worked through much of it due to ^
- Went over herald and workboard triggers with William Doran
- Upgraded phabricator
- What I plan to do this week
- read a book,
- kibana / phab integration stuff https://phabricator.wikimedia.org/T185155
- phabricator task triage and workboard gooming
- write a blog post about workboard triggers
- What I'm blocked on
- Other?
Tyler
edit- What I planned vs did last week
- Done Cannot assign user name "XXX" to account ####; name already in use. https://phabricator.wikimedia.org/T216605
- Done Merge Barricade remove lucene deps https://gerrit.wikimedia.org/r/519168/ + other barricade work
- Done Clear error dashboard of gerrit (on the chance that one of these errors is our problem)
- Done Email for pipeline cross-team meeting ( Thursday :( )
- Not done Stretch: blubber update
- Not done Stretch: pipeline docs touching
- What I plan to do this week
- Blubberoid update
- helmfile update
- Stretch: Deploy?
- Roll back out Gerrit 2.15.14 after clearing Gerrit error dashboard
- Inactive Gerrit user -- file security task, ping security folks
- Contint1001 cleanup maintenance job
- Stretch: Scap php7 restart
- Stretch: Pipeline docs
- Stretch: Prometheus Metrics for Blubberoid
- Blubberoid update
- What I'm blocked on
- Other?
- Reading Book.
Zeljko
edit- What I did last week
- T226586 MediaWiki `cryptiles` in package-lock.json affected by CVE-2018-1000620 [fixed]
- T224903 First Selenium automation test for GrowthExperiments extension (Homepage) [deployed]
- T227009 selenium-daily-beta-Echo Jenkins job failing [fixed]
- T220621 Jenkins job to run core tests against commons.wikimedia.beta.wmflabs.org
- What I plan to do this week
- Read the book
- T199113 All repositories with Selenium tests should use wdio-mediawiki
- T188742 Run tests daily targeting beta cluster for all repositories with Selenium tests
- What I'm blocked on
- Other?