Wikimedia Release Engineering Team/Checkin archive/20191030
2019-10-30
edit
- https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
- How to do it
- November 1 (All Saints' Day): Željko, Antoine holiday
- November 8–10: WikiCon North America (James)
- November 11 (Veterans' Day): US Staff
- November 12–15: TechConf19
- November 16–20: Offsite
- November 21–30: Jeena
- November 25–29: Dan
- November 28–29 (Thanksgiving): US Staff
- December 1–2: Jeena
- December 6: Lars (Finnish Independence Day)
- December 25–31 (Christmas): US Staff (+ everyone?)
- December 25–26: Lars, Željko, Christmas
- 1 January (New Year's Day): US Staff, Lars, Željko
- 20 January (Martin Luther King Jr. Day): US Staff
- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
- 14 Oct - wmf.2 - Jeena + Lars
- 21 Oct - wmf.3 - Lars + Brennen
- 28 Oct - wmf.4 - Brennen + Mukunda
- 4 Nov - wmf.5 - Mukunda + Antoine
- 11 Nov - wmf.6 - No Train (Tech conf)
- 18 Nov - wmf.7 - No Train (Off site)
- 25 Nov - wmf.8 - Group0 on Tuesday Brennen + Mukunda (Thanksgiving)
- 2 Dec - wmf.8 part 2 - Wednesday Group1 + Thursday Group2
- 9 Dec - wmf.10 - TBD
- 16 Dec - wmf.11 - TBD
- 23 Dec - wmf.12 - No Train or any other deploys (Winterval)
- 30 Dec - wmf.13 - No Train or any other deploys (Still Winterval)
- 6 Jan - wmf.14 - TBD
- 13 Jan - wmf.15 - TBD
- Aug 14 onward: Zeljko 🎸 🎷 \o/
Timespent spreadsheet
edit
- For the avoidance of doubt: fill out the sheet week number for the previous week
Clinic Duty Proposal
edit
November Offsite/Summit
edit
- TechConf19: November 12–15
- Offsite: November 16–20
Book club
edit
Monthly reflection on accomplishments - October '19 edition
edit
- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- Add as you have them!
Incoming/Needs attention
edit
- Wikidata load issues; NFA for us right now. T236928 // T234948 // …
- Branch cut didn't work with the new script, had to use the old one.
Scrum of Scrums for next week
edit
Internal team notes, not for pasting into the SoS notes
edit
Incoming from last week (aka this morning)
edit
Outgoing next week
edit
Callouts
edit
Train status and happenings
edit
- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor
- No Gerrit GC cycle during branch cut. How was branch cut?
- Make sure your tasks are correct on our kanban board!
Last week
edit
- Best thing
- JJB to be used directly from integration/config: tox -e jenkins-jobs -- <arguments>
- Will probably phase out integration/jenkins-job-builder
- Couple of JJB patch upstream to speed it up (from 28s down to 4s on my machine)
- Fixed Zuul gearman monitoring probe. Raised threshold
- sync-up Slides for tech conf
- Worst thing
- Docker containers on Stretch are 20% slower than Jessie ones T236675
- liw: could this be a spectre problem?
- hashar: I think there is a problem with that security patch and docker
- What I planned vs did
- Unplannned
This week
edit
- What I plan to do
- Blockers
- Not there friday Nov 1st (holiday: All Saints)
Last week
edit
- Best thing
- Decreasing sense of terror about train.
- Worst thing
- What I planned vs did
- Done Train backup for Lars / train lead this week
- Done Sort out all hands travel
- Dev environment hackery
- N Not done Check out k3sup?
- Done Think about TechConf local dev sessions / discuss
- And also In progress
- N Not done Improve sshecret pull req: https://github.com/thcipriani/sshecret/pull/2
- Decided after discussion that current state is Good Enough™, Tyler merged
- May devote some future yak shaving time
- Unplannned
- T236333: Install wikidiff2 into mediawiki-quibble-api-testing-vendor-mysql-php72-docker
- Discovered Antoine's jjb changes firsthand
- Help on some local-charts bugfixen:
- T236471: `Error: validation failed` during `make deploy`
- T233960: Error: error installing: the server could not find the requested resource
This week
edit
- What I plan to do
- Train, including some updates to docs
- Improve a log-tailing script and document
- Write a "This Week in Logspam"
- Work on tech conf session
- Review pending local-charts patches
- Take a crack at TimedMediaHandler on local-charts
- Blockers
Last week
edit
- Best thing
- Learned a lot about statistical forecasting
- Worst thing
- Learned a lot about statistical forecasting
- What I planned vs did
- Finished (enough) the Seakeeper proposal for presentation to SRE Service Ops
- Presented proposal to SRE Service Ops
- Unplannned
- Fixed up Jenkins build reports
This week
edit
- What I plan to do
- Following conversations about Zuul's Dependent Pipeline Manager and how it will need to fit with New CI, looking into it a bit
- Calculating overhead
- Looking at implementation
- Revisiting notes from Dec 2018 offsite and how we might test it's efficacy
- Start working with Lars on pipelinelib user documentation
- Blockers
Last week
edit
- Best thing
- Worst thing
- Thought I lost the hardware for the desk for a day, luckily my partner is smarter than I
- What I planned vs did
- Unplannned
This week
edit
- What I plan to do
- Blockers
Last week
edit
- Best thing
- Worst thing
- WikidataCon-related travel.
- What I planned vs did
- Done WikiDataCon from tomorrow onwards; back in the US next Wednesday.
- N Not done YAML/static builds of dblists; not had the time yet today to deploy the next step.
- Unplannned
- Some extra PHP 7.0 / 7.1 CI removal patches for MW-related libraries.
- Additional linting: we now lint require() JS calls to work with ResourceLoader https://github.com/wikimedia/eslint-plugin-mediawiki
- Some more clean-up/support for PHPUnit upgrade, Phan upgrade, removal of globals, etc. T192167, T159283, T160811, …
- Built some early images for PHP74 CI testing; paused waiting for PHP 7.4.0 release. T236132
- Explored replacing Travis CI with GitHub Actions CI for some of our GitHub-hosted repos. https://github.com/wikimedia/less.php/pull/18
- Helped Analytics by putting a "Statistics" link in the footer of every page: T235803.
This week
edit
- What I plan to do
- Static YAML generation of dblists
- Static YAML generation of InitialiseSettings
- LocalDev support
- TechConf planning
- Blockers
- Waiting on feedback from FR-Tech on whether we can proceed with PHPUnit stuff as it effects them (pinged in SoS) T192167
- Working from the East Coast from Sunday onwards.
Jean-Rene
edit
Last week
edit
- Best thing
- Worst thing
- What I planned vs did
- Unplannned
This week
edit
- What I plan to do
- Blockers
Last week
edit
- Best thing
- fixed some bugs in local-charts
- Worst thing
- What I planned vs did
- In progress tech conf session planning
- N Not done changes to mw core image publish pipeline to log more and fail if prereq script errors
- N Not done re-open patchsets to build restbase dev image
- N Not done timespent spreadsheet
- In progress work with zeljko on getting local-charts running
- Unplanned
This week
edit
- What I plan to do
- tech conf session planning
- changes to mw core image publish pipeline to log more and fail if prereq script errors
- re-open patchsets to build restbase dev image
- timespent spreadsheet
- fix admin username/password issue for mw core on local-charts
- Blockers
- need Marko to review my deployment-charts restrouter patch (thcipriani: IIRC he's OOO today....)
Last week
edit
- Best thing
- Ran the train and didn't break anything too badly
- Worst thing
- Realized that my technical writing isn't very useful
- What I planned vs did
- Done Train, 1.35.0-wmf.3
- In progress Skim Go book, write a small program from scratch: fetch a web page, diff against previously fetched version.
- Done Attempt to set up study groups, or possibly SIGs, for Go and Rust.
- Unplanned
- First meeting with SRE on hardware to new CI and general sync on this.
- First meeting in rebooted series of Deployment Pipeline meetings.
This week
edit
- What I plan to do
- Ponder what came out of the SRE meeting on CI hardware meeting, and what I can learn from that, and what I can do for future discussssions on this.
- Help prepare CI/CD related sessions at Tech Conf.
- Respond to email thread started by Tyler. Especially: suggest goals and desired outcomes of the session and other related discussions from Tech Conf.
- Fill out https://phabricator.wikimedia.org/T234641 best I can.
- Sketch a distillation of my CI architecture document.
- Update and fill out my personal travel checklist for Tech Conf.
- Read up about last year's Tech Conf to be better prepared for this years'.
- Install at least a rudimentary, "hello world" level Argo some K8s somewhere.
- Skim Go book, write a small program from scratch: fetch a web page, diff against previously fetched version.
- Have first Go study club meeting, on coming Monday. https://office.wikimedia.org/wiki/Go
- Stretch: Arrange first meeting for Rust study club. https://office.wikimedia.org/wiki/Rust
- Stretch: Look at Zuul's dependent pipeline manager and think hard about it for new CI.
- Blockers
Last week
edit
- Best thing
- Making good progress on phabricator redundancy and failover stuff with dzahn. phd (async job queue) is now running on two servers.
- Worst thing
- All of my planned tasks are N Not done because of a lot of time sunk on unplanned stuff.
- What I planned vs did
- N Not done Test out phabricator's built-in search engin
- N Not done Drum up interest in patch-triage (email wikitech-l, not sure what else to do)
- Get branch.py ready for full automation in releases-jenkins
- still blocked on code review
- N Not done Deploy phatality (after https://gerrit.wikimedia.org/r/#/c/545593/ merges)
- N Not done Deploy phabricator
- Tried with scap, it didn't work. Turns out it was my fault (scap.cfg change fixed it)
- Unplanned
This week
edit
- What I plan to do
- Still working on branch.py, it didn't quite work as expected during the train branch cut this week, hope to have it working next time.
- Deploy phabricator (with scap)
- Deploy Phatality
- Get branch.py working
- Be the backup train conductor
- Blockers
Last week
edit
- Best thing
- New CI moving/public/momentum!
- Worst thing
- 113 Résumés + cover letters
- What I planned vs did
- Done Resumé review
- N Not done Work out clinic duty rotation
- Done Next bookclub email
- Done Gerrit/JVM tuning to make use of Moar Memory™
- Unplanned
- Figured out Thanksgiving train (kinda/sorta)
- Design moving to git-LFS
This week
edit
- What I plan to do
- Work out clinic duty rotation
- Techconf session planning
- Gerrit review notes splitbrains
- More gerrit tuning
- Blockers
Last week
edit
- Best thing
- local-charts powered mediawiki works on my machine!
- Worst thing
- /me grumbles something containing words: savings, daylight, time
- What I planned vs did
- Unplanned
- mediawiki-vagrant
- local-charts
This week
edit
- What I plan to do
- Blockers