Wikimedia Release Engineering Team/Checkin archive/20180430


2018-04-30

edit

Vacations/Important dates

edit
https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • May 1: Željko (Holidays in Croatia - Labor Day / May Day), Antoine ditto
  • May 7-11: Antoine, too many holidays in France that week
  • May 7-14: Dan (Barcelona)
  • May 10-14: Chad (family time)
  • May 15-17: Team offsite in Barcelona
  • May 18-21: Wikimedia Hackathon in Barcelona
  • May 21 (Mon): Tech-Mgt F2F
  • May 28 (Mon): Memorial Day (US Holiday)
  • May 31: Željko (Holidays in Croatia - Corpus Christi)

Rotating positions

edit

Train

edit
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R
  • Apr 23 - 1.32.0-wmf.1 - Chad
  • Apr 30 - wmf.2 - Chad <----
  • May 07 - wmf.3 - Mukunda
  • May 14 - wmf.4 - Mukunda
  • May 21 - wmf.5 - Mukunda
  • May 28 - wmf.6 - Tyler
  • June 04 - wmf.7 - Tyler
  • June 11 - wmf.8 - Chad
  • June 18 - wmf.9 - Chad
  • June 25 - wmf.10 - Mukunda
  • July 02 - wmf.11 - Mukunda


  • Apr 23 - Tyler
  • Apr 30 - Tyler <----
  • May 07 - Chad
  • May 14 - Chad
  • May 21 - Chad
  • May 28 - Mukunda
  • June 04 - Mukunda
  • June 11 - Tyler
  • June 18 - Tyler
  • June 25 - Chad
  • July 02 - Chad

Team Business

edit

Updates

edit

Scrum of Scrums

edit
Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

This week

edit

Release Engineering

edit


Last week

edit

Release Engineering

edit

Train status and happenings

edit
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor


Past week status updates

edit
All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Quaterly Goals for Q4

edit

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

edit
Migrate away from Nodepool - task T190097
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Add Composer support to Blubber - task T186547
Add Python/Tox support to Blubber - task T186545
Add Ruby/Gem/Bundler/Rake support to Blubber - task T188950


Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans

edit
Broad role out of Code Stewardship model.
Update Maintainers/Developers page with currently known Code Stewards.
Use Code Stewardship review process to address gaps.
Deploy dashboard of Code Stewardship Coverage
  • Setup meetings for RelatedSites stewardship kickoff.
  • Reviewed Q4 candidates


Program 3: Outcome2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation

edit
Roll out of technical debt reduction approaches.
Identify early adopter engineering teams to test approaches.
  • Identified Search Platform and Platform as first two "early adopter" teams to engage with.

Program 6: Outcome 2: Objective 2: Prove viability of testing staged service containers alongside MediaWiki extension containers

edit
Add Composer support to Blubber - task T186547
Small, standalone, MediaWiki containers built using Blubber
Limited scope with: Debian Stretch, php7, composer dependencies, Mariadb, Apache (or last two with standalone containers)
Build MW base containers upon branch cut at master branch point from core
    • Messing with Blubber/Composer and MediaWiki core but it's unclear how viable Composer-based dependency installation will be
Build ext specific containers using MW image as base

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Deployment_pipeline/2018-04-26

Quaterly non-goal "Work"

edit

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)

edit
workboard


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

edit

Program 1: Outcome 6: Milestone 1: Maintain Gerrit

edit

Program 1: Outcome 6: Milestone 2: Maintain Phabricator

edit
Streamline logspam workflows by adding some integration with phabricator
Store git-lfs (and other phab uploads) in swift: task T182085


Other work

edit
   *** Incident report: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180229-Train-1.31.0-wmf.27
   *** Meeting notes: https://etherpad.wikimedia.org/p/Post_Mortem-20180329-Train-1.31.0-wmf.27-Blocker
   *** Action item:
        "Look into ways to identify risky commits that are part of the weekly branch cut, either manually or through automated process"
         - https://phabricator.wikimedia.org/T193258
   *** This inspired chad to outline a two-branch model for mediawiki deployments: https://etherpad.wikimedia.org/p/two-branch-merge-model
  • JR
    • Post Mortem: 20180329-Train-1.31.0-wmf.27 Blocker
    • Staging/Beta Cliuster Survey


Standup!

edit

Antoine

edit
    • Most MediaWiki skins moved to Quibble
  • What I plan to do this week
  • What I'm blocked on
  • Other?
    • Considering using utf8mb4 for MySQL, but lot of extensions schema fails (key too long)
    • Will add sql_mode=TRADITIONAL, get MySQL to report errors instead of silently truncating data

Chad

edit



Greg

edit
  • What I plan to do this week
    • Q3 QCI slides
    • barecelona activity/other things with Megan, starting schedule
    • JD for Software Engineer (Dev Prod)
    • email SRE/Services survey text for Beta Cluster
  • What I'm blocked on
  • Other?


Jean-Rene

edit
  • What I plan to do this week
    • Send out Q4 round of stewardship reviews + update of last quarter's review items.
    • Stewardship kickoff meeting for ReleatedSites
    • Q3 QCI Slides
  • What I'm blocked on
  • Other?
    • Staging Survey


Mukunda

edit
  • What I plan to do this week
    • Finish phabricator swift storage engine.
  • What I'm blocked on
  • Other?


Tyler

edit
  • What I plan to do this week
    • Document CI pipeline
    • Document Blubber
    • Maybe scap release?
    • Want to look at skaffold
  • What I'm blocked on
  • Other?


Zeljko

edit

Grooming

edit

Team Kanban Board Review and Triage

edit


Once / month-ish review of backlog(s)

edit


Kanban stats

edit
Burnup chart