Wikimedia Release Engineering Team/Checkin archive/20180402


2018-04-02Edit

Vacations/Important datesEdit

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • April 2: Željko (Holidays in Croatia - Easter Monday)
  • Apr 3-13: Greg vacation
  • April 16 (Mon): WMF Holiday
  • May 1: Željko (Holidays in Croatia - Labor Day / May Day)
  • May 14-17: Team offsite in Barcelona
  • May 18-21: Wikimedia Hackathon in Barcelona
  • May 21 (Mon): Tech-Mgt F2F
  • May 31: Željko (Holidays in Croatia - Corpus Christi)

Rotating positionsEdit

TrainEdit

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R
  • Feb 19 - wmf.22 - Mukunda
  • Feb 26 - wmf.23 - Tyler
  • Mar 05 - wmf.24 - Tyler
  • Mar 12 - wmf.25 - Chad
  • Mar 19 - wmf.26 - Chad
  • Mar 26 - wmf.27 - Mukunda
  • Apr 02 - wmf.28 - Mukunda <----
  • Apr 09 - wmf.29 - Tyler
  • Apr 16 - wmf.30 - Tyler
  • Apr 23 - 1.32.0-wmf.1 - Chad
  • Apr 30 - wmf.2 - Chad

SoSEdit

  • Feb 19 - Chad
  • Feb 26 - Mukunda
  • Mar 05 - Mukunda
  • Mar 12 - Tyler
  • Mar 19 - Tyler
  • Mar 26 - Chad
  • Apr 02 - Chad <----
  • Apr 09 - Mukunda
  • Apr 16 - Mukunda
  • Apr 23 - Tyler
  • Apr 30 - Tyler

Team BusinessEdit

UpdatesEdit

Staging: https://docs.google.com/document/d/1CT_pKjwiDmFhZZ9LW9mz0z434-wgr3NFdapUPWUvMNA/edit

  • Update from Greg
  • Please comment/let suggestions this week


Scrum of ScrumsEdit

Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

This weekEdit

Release EngineeringEdit

  • Blocking
  • Blocked
  • Updates
    • Train status
    • Pencils down on MW 1.31.0

Last weekEdit

Release EngineeringEdit

  • Blocking
    • Nothing
  • Blocked
    • Nothing
  • Updates

Train status and happeningsEdit

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Past week status updatesEdit

All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Past Quarterly Goals - Final status updateEdit

Program 1: Outcome 5: Milestone 1: Develop and migrate to a JavaScript-based browser testing stackEdit

Due: End of this quarter
What: Specific improvements to the now canonical framework, see: task T182421, notably:
Upgrade webdriverIO to version 4.9
Investigate replacing nodemw with mwbot
Video recording for Selenium tests in Node.js
Task: task T182421
  • T180144: Upgrade WebdriverIO to 4.12.0 - done
  • T181284: Replace nodemw with mwbot - done
  • T179188: Video recording for Selenium tests in Node.js - in progress - almost there, video for each test is recorded, but ffmpeg complains about something :/

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructureEdit

Goals
Draft requirements for a Kubernetes based solution for CI - task T183513
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Will be worked on after the long tail task T187797
Unify production and CI docker image build process - task T177276
  Done 01/15



Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphansEdit

Due: End of quarter
task T174091

Made final edits to Stewardship model and update wiki pages.

Program 3: Outcome 2: Objective 2: Define and implement a process to regularly address technical debt across the FoundationEdit

Due: End of quarter
task T174095

Added:

   *Engagement Model
   *Awareness campaign
   *Tech Debt/Code Reasouces

Program 3: Outcome 2: Objective 3: Promote and surface important technical debt topics at large gatherings of Wikimedia developers (e.g., DevSummit and Hackathon(s))Edit

Due: End of next quarter
task T174096

No activitiy

Program 6: Outcome 2: Objective 2: Set up a continuous integration and deployment pipelineEdit

Due: End of this quarter
Keyword: SSD
phab project: https://phabricator.wikimedia.org/project/view/2453/
Goal:
Verify basic functionality of 'production' deployment and image (initially targeting mathoid):
Functional PoC within integration in the deployment-pipeline
Deploy to isolated k8s
  • Major improvements to Blubber this quarter for more secure permissions/ownership scheme and policies
  • Verified a working PoC of `helm test` against minikube outside of CI but:
  • Still majorly blocked on lack of functional minikube/k8s/helm within CI
  • We are not far off once unblocked


Quaterly Goals for Q4Edit

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructureEdit

Migrate away from Nodepool - task T190097
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Add Composer support to Blubber - task T186547
Add Python/Tox support to Blubber - task T186545
Add Ruby/Gem/Bundler/Rake support to Blubber - task T188950


Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphansEdit

Broad role out of Code Stewardship model.
Update Maintainers/Developers page with currently known Code Stewards.
Use Code Stewardship review process to address gaps.
Deploy dashboard of Code Stewardship Coverage


Updated Developer/Maintainer page with some known code stewards and status for code under review.

Program 3: Outcome2: Objective 2: Define and implement a process to regularly address technical debt across the FoundationEdit

Roll out of technical debt reduction approaches.
Identify early adopter engineering teams to test approaches.


Program 6: Outcome 2: Objective 2: Prove viability of testing staged service containers alongside MediaWiki extension containersEdit

Add Composer support to Blubber - task T186547
Small, standalone, MediaWiki containers built using Blubber
Limited scope with: Debian Stretch, php7, composer dependencies, Mariadb, Apache (or last two with standalone containers)
Build MW base containers upon branch cut at master branch point from core
Build ext specific containers using MW image as base



Quaterly non-goal "Work"Edit

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)Edit

workboard


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructureEdit

Program 1: Outcome 6: Milestone 1: Maintain GerritEdit

Program 1: Outcome 6: Milestone 2: Maintain PhabricatorEdit

Streamline logspam workflows by adding some integration with phabricator
Store git-lfs (and other phab uploads) in swift: task T182085


Other workEdit

Standup!Edit

AntoineEdit

  • What I plan to do this week
  • What I'm blocked on
  • Other?


ChadEdit

  • What I plan to do this week
    • MW security release prep (with Brian W)
      • hopefully really really soon (TM)
    • Helm/Blubber
  • What I'm blocked on
  • Other?
    • Gerrit 2.15.x prep? We should migrate sooner rather than later (2.14.x won't be getting much love, 2.16/3.0 will be huge. So 2.15.x is gonna be our "LTS")


DanEdit

  • What I plan to do this week
  • What I'm blocked on
    • Nada
  • Other?


GregEdit

  • What I plan to do this week
    • !!!!!!!!!!!!!!!!!!
    • Meeting-full day today and prep for leaving for almost 2 weeks
  • What I'm blocked on
  • Other?


Jean-ReneEdit

  • What I plan to do this week
    • Code stewardship reviews
    • Code Stewardship Dashboard
  • What I'm blocked on
  • Other?


MukundaEdit

  • What I plan to do this week
    • Train for 1.31.0-wmf.27 and 1.31.0-wmf.28
    • More git-lfs work in scap and phabricator
  • What I'm blocked on
  • Other?


TylerEdit

  • What I plan to do this week
    • email/catchup
    • applied role::ci::slave::labs::pipelinebuilder to integration-slave-k8s-1013 and it work, so...good...
    • minikube/helm CI work
    • may revisit canary shifting baseline if there's time
  • What I'm blocked on
  • Other?


ZeljkoEdit

  • What I plan to do this week
    • T179188: Video recording for Selenium tests in Node.js
    • T190994 Q4 Selenium framework improvements
  • What I'm blocked on
    • T179188: Video recording for Selenium tests in Node.js - in progress - almost there, video for each test is recorded, but ffmpeg complains about something :/
    • T190269 Warning: Task "stylelint:src" failed due to postcss-less@1.1.4 - 1.1.5 does not fix the problem, I recommend that we stay pinned to 1.1.3
  • Other?

GroomingEdit

Team Kanban Board Review and TriageEdit


Once / month-ish review of backlog(s)Edit


Kanban statsEdit

Burnup chart