Wikimedia Release Engineering Team/Checkin archive/20180430


2018-04-30 edit

Vacations/Important dates edit

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • May 1: Željko (Holidays in Croatia - Labor Day / May Day), Antoine ditto
  • May 7-11: Antoine, too many holidays in France that week
  • May 7-14: Dan (Barcelona)
  • May 10-14: Chad (family time)
  • May 15-17: Team offsite in Barcelona
  • May 18-21: Wikimedia Hackathon in Barcelona
  • May 21 (Mon): Tech-Mgt F2F
  • May 28 (Mon): Memorial Day (US Holiday)
  • May 31: Željko (Holidays in Croatia - Corpus Christi)

Rotating positions edit

Train edit

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R
  • Apr 23 - 1.32.0-wmf.1 - Chad
  • Apr 30 - wmf.2 - Chad <----
  • May 07 - wmf.3 - Mukunda
  • May 14 - wmf.4 - Mukunda
  • May 21 - wmf.5 - Mukunda
  • May 28 - wmf.6 - Tyler
  • June 04 - wmf.7 - Tyler
  • June 11 - wmf.8 - Chad
  • June 18 - wmf.9 - Chad
  • June 25 - wmf.10 - Mukunda
  • July 02 - wmf.11 - Mukunda


SoS edit

  • Apr 23 - Tyler
  • Apr 30 - Tyler <----
  • May 07 - Chad
  • May 14 - Chad
  • May 21 - Chad
  • May 28 - Mukunda
  • June 04 - Mukunda
  • June 11 - Tyler
  • June 18 - Tyler
  • June 25 - Chad
  • July 02 - Chad

Team Business edit

Updates edit

Scrum of Scrums edit

Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

This week edit

Release Engineering edit


Last week edit

Release Engineering edit

Train status and happenings edit

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor


Past week status updates edit

All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Quaterly Goals for Q4 edit

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure edit

Migrate away from Nodepool - task T190097
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Add Composer support to Blubber - task T186547
Add Python/Tox support to Blubber - task T186545
Add Ruby/Gem/Bundler/Rake support to Blubber - task T188950


Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans edit

Broad role out of Code Stewardship model.
Update Maintainers/Developers page with currently known Code Stewards.
Use Code Stewardship review process to address gaps.
Deploy dashboard of Code Stewardship Coverage
  • Setup meetings for RelatedSites stewardship kickoff.
  • Reviewed Q4 candidates


Program 3: Outcome2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation edit

Roll out of technical debt reduction approaches.
Identify early adopter engineering teams to test approaches.
  • Identified Search Platform and Platform as first two "early adopter" teams to engage with.

Program 6: Outcome 2: Objective 2: Prove viability of testing staged service containers alongside MediaWiki extension containers edit

Add Composer support to Blubber - task T186547
Small, standalone, MediaWiki containers built using Blubber
Limited scope with: Debian Stretch, php7, composer dependencies, Mariadb, Apache (or last two with standalone containers)
Build MW base containers upon branch cut at master branch point from core
    • Messing with Blubber/Composer and MediaWiki core but it's unclear how viable Composer-based dependency installation will be
Build ext specific containers using MW image as base

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Deployment_pipeline/2018-04-26

Quaterly non-goal "Work" edit

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2) edit

workboard


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure edit

Program 1: Outcome 6: Milestone 1: Maintain Gerrit edit

Program 1: Outcome 6: Milestone 2: Maintain Phabricator edit

Streamline logspam workflows by adding some integration with phabricator
Store git-lfs (and other phab uploads) in swift: task T182085


Other work edit

   *** Incident report: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180229-Train-1.31.0-wmf.27
   *** Meeting notes: https://etherpad.wikimedia.org/p/Post_Mortem-20180329-Train-1.31.0-wmf.27-Blocker
   *** Action item:
        "Look into ways to identify risky commits that are part of the weekly branch cut, either manually or through automated process"
         - https://phabricator.wikimedia.org/T193258
   *** This inspired chad to outline a two-branch model for mediawiki deployments: https://etherpad.wikimedia.org/p/two-branch-merge-model
  • JR
    • Post Mortem: 20180329-Train-1.31.0-wmf.27 Blocker
    • Staging/Beta Cliuster Survey


Standup! edit

Antoine edit

    • Most MediaWiki skins moved to Quibble
  • What I plan to do this week
  • What I'm blocked on
  • Other?
    • Considering using utf8mb4 for MySQL, but lot of extensions schema fails (key too long)
    • Will add sql_mode=TRADITIONAL, get MySQL to report errors instead of silently truncating data

Chad edit


Dan edit


Greg edit

  • What I plan to do this week
    • Q3 QCI slides
    • barecelona activity/other things with Megan, starting schedule
    • JD for Software Engineer (Dev Prod)
    • email SRE/Services survey text for Beta Cluster
  • What I'm blocked on
  • Other?


Jean-Rene edit

  • What I plan to do this week
    • Send out Q4 round of stewardship reviews + update of last quarter's review items.
    • Stewardship kickoff meeting for ReleatedSites
    • Q3 QCI Slides
  • What I'm blocked on
  • Other?
    • Staging Survey


Mukunda edit

  • What I plan to do this week
    • Finish phabricator swift storage engine.
  • What I'm blocked on
  • Other?


Tyler edit

  • What I plan to do this week
    • Document CI pipeline
    • Document Blubber
    • Maybe scap release?
    • Want to look at skaffold
  • What I'm blocked on
  • Other?


Zeljko edit

Grooming edit

Team Kanban Board Review and Triage edit


Once / month-ish review of backlog(s) edit


Kanban stats edit

Burnup chart