Wikimedia Release Engineering Team/Checkin archive/20191204


2019-12-04 edit

Vacations/Important dates edit

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • December 1–2: Jeena
  • December 6: Lars (Finnish Independence Day)
  • December 23: James, Brennen, Greg (need to put it in Namely)
  • December 24–31 (Christmas): Staff with reqs (everyone? (yes))
  • December 25–26: Lars (Christmas)
  • 1 January (New Year's Day): Staff with reqs, Lars
  • 2–3 January: James
  • 20 January (Martin Luther King Jr. Day): Staff with reqs
  • 17 February (Presidents' Day): Staff with reqs
  • 9 March (DST+1 day): Staff with reqs
  • 24 April (Not-Easter): Staff with reqs
  • 25 May (Memorial Day): Staff with reqs

Rotating positions edit

Train edit

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R


  • 25 Nov - wmf.8 [Group0 on Tuesday] - Brennen + Mukunda (Thanksgiving)
  • 2 Dec - wmf.8 part 2 [Wednesday Group1 + Thursday Group2] - Brennen + Dan
  • 9 Dec - wmf.10 - Dan + James
  • 16 Dec - wmf.11 - James + Jeena
  • 23 Dec - wmf.12 - No Train or any other deploys (Winterval)
  • 30 Dec - wmf.13 - No Train or any other deploys (Still Winterval)
  • 6 Jan - wmf.14 - Jeena + Lars
  • 13 Jan - wmf.15 - Lars + Antoine

SoS edit

  • Aug 14 onward: Zeljko 🎸 🎷 \o/

Team Business edit

Incoming/Needs attention edit

Offsite Actions edit

  • 🏂   In progress [thcipriani] SPOF Training program
    • Idea: assigned pairings for folks
    • Things in production that we intend to maintain over the next year + current owners:
      • Gerrit: Thcipriani -- two people needed
      • Scap: Thcipriani -- two people needed -- Dan + Lars
      • Phabricator: Mukunda + designated tribute (antoine: could use training for the basics) (brennen: well, I know PHP...)
      • Jenkins/Zuul/CI infra: Antoine + James
      • Production config architecture: James + designated tribute
  • [Mukunda] Monthly rotating blog post
  • [thcipriani/greg] Program/Project managers
    • [JDF] highlighted this to Grace, so she expects outreach to understand the role.

Q3 (Jan–Mar 2020) Goal Planning is upon us! edit

  • Mukunda + James: Automate branchcut
  • Antoine: Jessie migration for integration project
    • Needs support for blubber. Overlap with Pipeline migrations goal below.
    • Needs support for Scap
  • Antoine + James: Quibble parsing extension.json for dependencies instead of hard-coded in CI.
  • DECISION: Let's not do wikimedia/production.git until we have more clarity on timeline for way forward from SRE.
  • Local dev
    • [Finish putting TMH in local-charts if not done by then.]
    • Land basic local dev into mw/core itself.
  • James: Pipeline migrations, cont'd -- supporting teams as they switch [Minimal work from RelEng side; depends on SRE & teams.] Overlap with Jessie migration for integration.


  • Pipeline documentation
    • Dan + Lars
  • [Pending discussion with SRE] New CI

Timespent spreadsheet edit

For the avoidance of doubt: fill out the sheet week number for the previous week

Book club edit

Monthly reflection on accomplishments - December '19 edition edit

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
Add as you have them!
  • PHP 7.4 testing was available in CI the first "business day" after 7.4.0 was released.

Scrum of Scrums for next week edit

Internal team notes, not for pasting into the SoS notes edit

Incoming from last week (aka this morning) edit

Callouts edit
  • Release Engineering - unusual train schedule:
    • This week: 1.35.0-wmf.8 - group1 + group2
    • Next week: 1.35.0-wmf.10
    • December 23-January 3rd - No deploys (including train), Holiday break

Outgoing next week edit

  • Blocked by:
  • Blocking:
  • Updates:
Callouts edit
  • Release Engineering - December 23-January 3rd - No deploys (including train), Holiday break

Train status and happenings edit

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Standup! edit

Antoine edit

Last week edit

  • Best thing
    • Mukunda empowered Antoine as a Phabricator administrator. \o/
    • Started Doxygen Debian packaging backport to fix search
    • Jenkins job collapsible sections fixed. Learned more about Jenkins plugins / maven https://phabricator.wikimedia.org/T236222
  • Worst thing
    • CI debian-glue job does not support pristine-tar delta v3 due to running on Jessie grr
  • What I planned vs did
    • Did Quibble reviews
  • Unplannned

This week edit

  • What I plan to do
  • Blockers

Other edit


Brennen edit

Last week edit

This week edit

Other edit


Dan edit

Last week edit

  • Best thing
    • Not working
  • Worst thing
    • Staying in a household where no one else drinks coffee, thus no coffee being readily available
      • 😱 Can we drop-ship you a portable coffee machine? Yes! Next time :) Or I can just buy myself an Aeropress
  • What I planned vs did
    • N/A
  • Unplannned
    • N/A

This week edit

  • What I plan to do
    • Come up with questions for SRE re: third-party vs. WMF K8s platform
    • Reaquaint myself with scap codebase and look at ways to support PHP-based l10n
    • Talk to Brennen about pairing tooling research and experimentation
    • PipelineLib user documentation
    • PipelineLib git clone improvements (depth and parallel clone support)
    • Tooling to simplify easier taskification of daily work
    • Taskify the above
  • Blockers
    • Argo CI platform work blocked on SRE

Other edit


Greg edit

Last week edit

  • Best thing
    • vacation
    • left overs
  • Worst thing
    • rain
  • What I planned vs did
  • Unplannned

This week edit

  • What I plan to do
    • MTP/OKR metrics working group
    • leveling/job codes
    • review as much of techconf+offsite notes as possible
    • all hands team day (mostly done for now, but more coming)
  • Blockers
    • time
    • parents in town

Other edit


James edit

Last week edit

  • Best thing
  • Worst thing
    • Got almost nothing done due to pesky holidays.
  • What I planned vs did
    • Not much.
  • Unplannned
    • A few things broke.

This week edit

  • What I plan to do
    • JDI for CI diff reports of changes, and then? static config in production
    • CI/CR metrics doc fiddles.
    • Runbooks documentation collation/writing.
  • Blockers
    • None known.

Other edit


Jeena edit

Last week edit

  • Best thing
    • Making Tea :D :D :D
  • Worst thing
    • Food Poisoning :(
  • What I planned vs did
    • Vacation
  • Unplannned

This week edit

  • What I plan to do
    • Catch up on emails
    • Catch up on things that got done while gone
    • Do Keysigning
    • register for all hands
  • Blockers

Other edit


Lars edit

Last week edit

  • Best thing
    • Getting over jet lag, more or less.
  • Worst thing
    • The Darkness.
  • What I planned vs did
    •   DoneSet up git repo for PGP public keys on Gerrit, for keysigning.
    •  N Not done Read TechConf and offsite notes, extract any useful bits.
    •  N Not done Ponder SRE input on new CI from TechConf. Discuss with Tyler, Dan.
    •  N Not done Do an Argo test deployment.
    •  N Not done Start work on documenting pipelinelib so it can be re-implemented for new CI.
  • Unplanned
    • Participated in email discussion about not dropping embargoed security patches.

This week edit

  • What I plan to do
    • Write and send out howto for signing PGP keys. phab:T239829
    • Read TechConf and offsite notes, extract any useful bits.
    • Ponder SRE input on new CI from TechConf. Discuss with Tyler, Dan.
    • Do an Argo test deployment.
    • Start work on documenting pipelinelib so it can be re-implemented for new CI.
  • Blockers
    • Nope.

Other edit

  • SAD is kicking me in the head. Please make the Darkness go away.
  • Some shoulder and shoulder blade trouble. Not too bad.


Mukunda edit

Last week edit

  • Best thing
    • Phab migrated to phab1001
  • Worst thing
    • phab1001 has horrible disk i/o performance. The SATA controller is set to legacy ide mode in bios and it's going to require a reinstall to fix it.
  • What I planned vs did
    •   Done phabricator migration
    •  N Not done phabricator upgrade: still need to merge from upstream/stable && deploy.
  • Unplannned
    • Phabricator: debian reimage/reinstall tonight

This week edit

  • What I plan to do
    • Finish my phabricator redundancy OKRs
      • Finish reinstalling phab1001
      • Test some more failure scenarios.
    • Look into open-sourcing phabricator-antivandalism as I finally have the OK from our security team.
  • Blockers
    • Needing to sleep occasionally.

Other edit


Tyler edit

Last week edit

  • Best thing
    • Didn't horribly burn myself
  • Worst thing
    • Holidays/Blazey's family/being sick
  • What I planned vs did
    •   Done Mandatory trainings
    •   Done 177 résumés Hiring reviews
    •   In progress Offsite TODO amalgamation
  • Unplannned

This week edit

  • What I plan to do
    • Wrangle hiring loop
    • Build SPoF program
    • Q3 planning kickoff
    • Do keysigning!
    • Register for all-hands (everyone!)
  • Blockers

Other edit

  • Dog reajusting to 3 week schedule change
  • I am still sick :(


Zeljko edit

Last week edit

  • Best thing
    • caugh up on sleep 😴
  • Worst thing
    • safeguard contract 📜
  • What I planned vs did
    • catch up on gerrit/phabricator/mail ✅
    • Selenium documentation updates ❌
  • Unplannned
    • safeguard contract 📜
    • Harassment & Discrimination Prevention 👊

This week edit

  • What I plan to do
    • work on testing related questions for interviews with developers ❓
    • expense report (Coupa)
    • prepare to close my company: paperwork, meet with accountant... 👔
    • read article for book club (can not attend book club) 📖
    • prepare talk about software testing anti patterns for local tech meetup 🎤
    • use more emoji 🤠
  • Blockers

Other edit

  • my phone started behaving strangely recently, had to do factory reset over the weekend, it took a few hours to get back to being functional but looks like problems are solved