Wikimedia Release Engineering Team/Checkin archive/20191204
2019-12-04
editVacations/Important dates
edit- December 1–2: Jeena
- December 6: Lars (Finnish Independence Day)
- December 23: James, Brennen, Greg (need to put it in Namely)
- December 24–31 (Christmas): Staff with reqs (everyone? (yes))
- December 25–26: Lars (Christmas)
- 1 January (New Year's Day): Staff with reqs, Lars
- 2–3 January: James
- 20 January (Martin Luther King Jr. Day): Staff with reqs
- 17 February (Presidents' Day): Staff with reqs
- 9 March (DST+1 day): Staff with reqs
- 24 April (Not-Easter): Staff with reqs
- 25 May (Memorial Day): Staff with reqs
Rotating positions
editTrain
edit- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
- 25 Nov - wmf.8 [Group0 on Tuesday] - Brennen + Mukunda (Thanksgiving)
- 2 Dec - wmf.8 part 2 [Wednesday Group1 + Thursday Group2] - Brennen + Dan
- 9 Dec - wmf.10 - Dan + James
- 16 Dec - wmf.11 - James + Jeena
- 23 Dec - wmf.12 - No Train or any other deploys (Winterval)
- 30 Dec - wmf.13 - No Train or any other deploys (Still Winterval)
- 6 Jan - wmf.14 - Jeena + Lars
- 13 Jan - wmf.15 - Lars + Antoine
SoS
edit- Aug 14 onward: Zeljko 🎸 🎷 \o/
Team Business
editIncoming/Needs attention
edit- New skill matrix: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix
- New workboard for December: https://phabricator.wikimedia.org/project/view/4401/ -- make sure your tasks look right
- Enable API integration tests in CI for MediaWiki core https://phabricator.wikimedia.org/T236680
- Antoine taking this task.
- Add curl support to mwext-node10-rundoc-docker https://phabricator.wikimedia.org/T239246
- Antoine to decide
- Create and maintain somehow a list of repos mastered in GitHub (and in Differential) https://phabricator.wikimedia.org/T237470
- Support MarcoAurelio and make it semi-automated? Halp.
- mobileapps-periodic-test failing since 2019-12-04 01:00 UTC due to failing git fetches https://phabricator.wikimedia.org/T239815
- Broken by phab 1003->1001 migration? Other things also are broken, apparently. :-(
- There is _something_ broken about this repo but I can't make sense of what it is. Shallow clone fails but a normal clone works fine.
- "integration" (CI) WMCS project: jessie usage needs replacing with buster/stretch https://phabricator.wikimedia.org/T236576
- Antoine?
- Antoine to write a doc about everything that has to be done (eg: portals build, wdqs gui build, debian glue, zuul package)
- TODO assign to antoine and comment
- See also https://phabricator.wikimedia.org/project/view/4080/ (continuous integration infrastructure > phase-out-jessie )
- Antoine?
Offsite Actions
edit- 🏂 In progress [thcipriani] figure out what part of team meeting to move to phab
- 🏂 In progress [James + Antoine] draft runbooks listing
- Very initial page at https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Runbooks; more coming today.
- [dan + brennen] explore tools for pairing
- Ž: stumbled upon this recently https://pragprog.com/book/jkrp/remote-pairing
- ✅ Done [thcipriani] add James to train duty rotation
- [Dan + Jeena] add blubber to local dev
- -> Q3 goals?
- [Mukunda] phab to local dev
- -> Q3 goals?
- [thcipriani] lunch and learns
- 🏂 In progress [thcipriani] SPOF Training program
- Idea: assigned pairings for folks
- Things in production that we intend to maintain over the next year + current owners:
- Gerrit: Thcipriani -- two people needed
- Scap: Thcipriani -- two people needed -- Dan + Lars
- Phabricator: Mukunda + designated tribute (antoine: could use training for the basics) (brennen: well, I know PHP...)
- Jenkins/Zuul/CI infra: Antoine + James
- Production config architecture: James + designated tribute
- [Mukunda] Monthly rotating blog post
- [thcipriani/greg] Program/Project managers
- [JDF] highlighted this to Grace, so she expects outreach to understand the role.
Q3 (Jan–Mar 2020) Goal Planning is upon us!
edit- Dan + Lars: Scap
- For us from performance team -- scap work: https://phabricator.wikimedia.org/T99740
- "We are happy to provide help on this task in an advisory role if needed."
- For us from performance team -- scap work: https://phabricator.wikimedia.org/T99740
- Mukunda + James: Automate branchcut
- Lars + Mukunda?: Something something security patches -- tentative
- Antoine: Jessie migration for integration project
- Needs support for blubber. Overlap with Pipeline migrations goal below.
- Needs support for Scap
- Antoine + James: Quibble parsing extension.json for dependencies instead of hard-coded in CI.
- DECISION: Let's not do wikimedia/production.git until we have more clarity on timeline for way forward from SRE.
- Local dev
- [Finish putting TMH in local-charts if not done by then.]
- Land basic local dev into mw/core itself.
- James: Pipeline migrations, cont'd -- supporting teams as they switch [Minimal work from RelEng side; depends on SRE & teams.] Overlap with Jessie migration for integration.
- Pipeline documentation
- Dan + Lars
- [Pending discussion with SRE] New CI
Timespent spreadsheet
edit- For the avoidance of doubt: fill out the sheet week number for the previous week
- https://docs.google.com/spreadsheets/d/1YS_2eUQWUOnygshMfxgGPu93GKGCO5t00yjUREQ5B-I/edit#gid=1441822979
- reminder: your time spent doesn't need to total to 100%
Book club
edit- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
- Happening 2019-12-10
- You should have an invite
- https://google.github.io/eng-practices/review/reviewer/
Monthly reflection on accomplishments - December '19 edition
edit- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- Add as you have them!
- PHP 7.4 testing was available in CI the first "business day" after 7.4.0 was released.
Scrum of Scrums for next week
editInternal team notes, not for pasting into the SoS notes
editIncoming from last week (aka this morning)
edit- Blocked by:
- None known.
- Blocking:
- Wikimedia Deutschland/Wikidata: Setting up Pipeline CI job for wikibase/vuejs-components repository: https://gerrit.wikimedia.org/r/c/integration/config/+/551829
- Updates:
- Train Health
- Last week: 1.35.0-wmf.8 - phab:T233856 - group0 only because of Thanksgiving
- This week: 1.35.0-wmf.8 - phab:T233856 - group1 + group2
- Next week: 1.35.0-wmf.10 - phab:T233858
- Train Health
Callouts
edit- Release Engineering - unusual train schedule:
- This week: 1.35.0-wmf.8 - group1 + group2
- Next week: 1.35.0-wmf.10
- December 23-January 3rd - No deploys (including train), Holiday break
Outgoing next week
edit- Blocked by:
- Blocking:
- Updates:
- Train Health
- Last week: 1.35.0-wmf.8 - phab:T233856 - group1 + group2
- This week: 1.35.0-wmf.10 - phab:T233858
- Next week: 1.35.0-wmf.11 - phab:T233859
- Train Health
Callouts
edit- Release Engineering - December 23-January 3rd - No deploys (including train), Holiday break
Train status and happenings
editStandup!
edit- Make sure your tasks are correct on our kanban board!
Antoine
editLast week
edit- Best thing
- Mukunda empowered Antoine as a Phabricator administrator. \o/
- Started Doxygen Debian packaging backport to fix search
- Jenkins job collapsible sections fixed. Learned more about Jenkins plugins / maven https://phabricator.wikimedia.org/T236222
- Worst thing
- CI debian-glue job does not support pristine-tar delta v3 due to running on Jessie grr
- What I planned vs did
- Did Quibble reviews
- Unplannned
This week
edit- What I plan to do
- Blockers
Other
edit
Brennen
editLast week
edit- Best things
- This Week in Logspam seems to have prompted action \o/
- Got my backpack
- Worst thing
- Was still pretty fried after offsite
- What I planned vs did
- Done dev-images:
- Done Some learning effort for Tuesday's Rust study group meeting
- Unplannned
- Some feedback for JR on WMF-provided equipment
This week
edit- What I plan to do
- Finish deploying 1.35.0-wmf.8
- Update skill matrix
- Read for book club
- Fill out offsite survey
- Keysigning!
- Hack on T238224 Provide docker-compose based development enviornment in mediawiki core
- Blockers
Other
edit
Dan
editLast week
edit- Best thing
- Not working
- Worst thing
- Staying in a household where no one else drinks coffee, thus no coffee being readily available
- 😱 Can we drop-ship you a portable coffee machine? Yes! Next time :) Or I can just buy myself an Aeropress
- Staying in a household where no one else drinks coffee, thus no coffee being readily available
- What I planned vs did
- N/A
- Unplannned
- N/A
This week
edit- What I plan to do
- Come up with questions for SRE re: third-party vs. WMF K8s platform
- Reaquaint myself with scap codebase and look at ways to support PHP-based l10n
- Talk to Brennen about pairing tooling research and experimentation
- PipelineLib user documentation
- PipelineLib git clone improvements (depth and parallel clone support)
- Tooling to simplify easier taskification of daily work
- Taskify the above
- Blockers
- Argo CI platform work blocked on SRE
Other
edit
Greg
editLast week
edit- Best thing
- vacation
- left overs
- Worst thing
- rain
- What I planned vs did
- Unplannned
This week
edit- What I plan to do
- MTP/OKR metrics working group
- leveling/job codes
- review as much of techconf+offsite notes as possible
- all hands team day (mostly done for now, but more coming)
- Blockers
- time
- parents in town
Other
edit
James
editLast week
edit- Best thing
- Finally got auto-built DBlists out of the door. \o/
- [Also, Friendsgiving was nice: https://www.instagram.com/p/B5cLsL-JdW8/ ]
- Worst thing
- Got almost nothing done due to pesky holidays.
- What I planned vs did
- Not much.
- Unplannned
- A few things broke.
This week
edit- What I plan to do
- JDI for CI diff reports of changes, and then? static config in production
- CI/CR metrics doc fiddles.
- Runbooks documentation collation/writing.
- Blockers
- None known.
Other
edit
Jeena
editLast week
edit- Best thing
- Making Tea :D :D :D
- Worst thing
- Food Poisoning :(
- What I planned vs did
- Vacation
- Unplannned
This week
edit- What I plan to do
- Catch up on emails
- Catch up on things that got done while gone
- Do Keysigning
- register for all hands
- Blockers
Other
edit
Lars
editLast week
edit- Best thing
- Getting over jet lag, more or less.
- Worst thing
- The Darkness.
- What I planned vs did
- DoneSet up git repo for PGP public keys on Gerrit, for keysigning.
- Not done Read TechConf and offsite notes, extract any useful bits.
- Not done Ponder SRE input on new CI from TechConf. Discuss with Tyler, Dan.
- Not done Do an Argo test deployment.
- Not done Start work on documenting pipelinelib so it can be re-implemented for new CI.
- Unplanned
- Participated in email discussion about not dropping embargoed security patches.
This week
edit- What I plan to do
- Write and send out howto for signing PGP keys. phab:T239829
- Read TechConf and offsite notes, extract any useful bits.
- Ponder SRE input on new CI from TechConf. Discuss with Tyler, Dan.
- Do an Argo test deployment.
- Start work on documenting pipelinelib so it can be re-implemented for new CI.
- Blockers
- Nope.
Other
edit- SAD is kicking me in the head. Please make the Darkness go away.
- Some shoulder and shoulder blade trouble. Not too bad.
Mukunda
editLast week
edit- Best thing
- Phab migrated to phab1001
- Worst thing
- phab1001 has horrible disk i/o performance. The SATA controller is set to legacy ide mode in bios and it's going to require a reinstall to fix it.
- What I planned vs did
- Done phabricator migration
- Not done phabricator upgrade: still need to merge from upstream/stable && deploy.
- Unplannned
- Phabricator: debian reimage/reinstall tonight
This week
edit- What I plan to do
- Finish my phabricator redundancy OKRs
- Finish reinstalling phab1001
- Test some more failure scenarios.
- Look into open-sourcing phabricator-antivandalism as I finally have the OK from our security team.
- Finish my phabricator redundancy OKRs
- Blockers
- Needing to sleep occasionally.
Other
edit
Tyler
editLast week
edit- Best thing
- Didn't horribly burn myself
- Worst thing
- Holidays/Blazey's family/being sick
- What I planned vs did
- Done Mandatory trainings
- Done 177 résumés Hiring reviews
- In progress Offsite TODO amalgamation
- Unplannned
This week
edit- What I plan to do
- Wrangle hiring loop
- Build SPoF program
- Q3 planning kickoff
- Do keysigning!
- Register for all-hands (everyone!)
- Blockers
Other
edit- Dog reajusting to 3 week schedule change
- I am still sick :(
Zeljko
editLast week
edit- Best thing
- caugh up on sleep 😴
- Worst thing
- safeguard contract 📜
- What I planned vs did
- catch up on gerrit/phabricator/mail ✅
- Selenium documentation updates ❌
- Unplannned
- safeguard contract 📜
- Harassment & Discrimination Prevention 👊
This week
edit- What I plan to do
- work on testing related questions for interviews with developers ❓
- expense report (Coupa)
- prepare to close my company: paperwork, meet with accountant... 👔
- read article for book club (can not attend book club) 📖
- prepare talk about software testing anti patterns for local tech meetup 🎤
- use more emoji 🤠
- Blockers
Other
edit- my phone started behaving strangely recently, had to do factory reset over the weekend, it took a few hours to get back to being functional but looks like problems are solved