MediaWiki

Wikimedia Release Engineering Team/Checkin archive/20180402

< Wikimedia Release Engineering Team‎ | Checkin archive


2018-04-02 edit

Vacations/Important dates edit

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • April 2: Željko (Holidays in Croatia - Easter Monday)
  • Apr 3-13: Greg vacation
  • April 16 (Mon): WMF Holiday
  • May 1: Željko (Holidays in Croatia - Labor Day / May Day)
  • May 14-17: Team offsite in Barcelona
  • May 18-21: Wikimedia Hackathon in Barcelona
  • May 21 (Mon): Tech-Mgt F2F
  • May 31: Željko (Holidays in Croatia - Corpus Christi)

Rotating positions edit

Train edit

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R
  • Feb 19 - wmf.22 - Mukunda
  • Feb 26 - wmf.23 - Tyler
  • Mar 05 - wmf.24 - Tyler
  • Mar 12 - wmf.25 - Chad
  • Mar 19 - wmf.26 - Chad
  • Mar 26 - wmf.27 - Mukunda
  • Apr 02 - wmf.28 - Mukunda <----
  • Apr 09 - wmf.29 - Tyler
  • Apr 16 - wmf.30 - Tyler
  • Apr 23 - 1.32.0-wmf.1 - Chad
  • Apr 30 - wmf.2 - Chad

SoS edit

  • Feb 19 - Chad
  • Feb 26 - Mukunda
  • Mar 05 - Mukunda
  • Mar 12 - Tyler
  • Mar 19 - Tyler
  • Mar 26 - Chad
  • Apr 02 - Chad <----
  • Apr 09 - Mukunda
  • Apr 16 - Mukunda
  • Apr 23 - Tyler
  • Apr 30 - Tyler

Team Business edit

Updates edit

Staging: https://docs.google.com/document/d/1CT_pKjwiDmFhZZ9LW9mz0z434-wgr3NFdapUPWUvMNA/edit

  • Update from Greg
  • Please comment/let suggestions this week


Scrum of Scrums edit

Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

This week edit

Release Engineering edit

  • Blocking
  • Blocked
  • Updates
    • Train status
    • Pencils down on MW 1.31.0

Last week edit

Release Engineering edit

  • Blocking
    • Nothing
  • Blocked
    • Nothing
  • Updates

Train status and happenings edit

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Past week status updates edit

All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Past Quarterly Goals - Final status update edit

Program 1: Outcome 5: Milestone 1: Develop and migrate to a JavaScript-based browser testing stack edit

Due: End of this quarter
What: Specific improvements to the now canonical framework, see: task T182421, notably:
Upgrade webdriverIO to version 4.9
Investigate replacing nodemw with mwbot
Video recording for Selenium tests in Node.js
Task: task T182421
  • T180144: Upgrade WebdriverIO to 4.12.0 - done
  • T181284: Replace nodemw with mwbot - done
  • T179188: Video recording for Selenium tests in Node.js - in progress - almost there, video for each test is recorded, but ffmpeg complains about something :/

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure edit

Goals
Draft requirements for a Kubernetes based solution for CI - task T183513
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Will be worked on after the long tail task T187797
Unify production and CI docker image build process - task T177276
  Done 01/15



Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans edit

Due: End of quarter
task T174091

Made final edits to Stewardship model and update wiki pages.

Program 3: Outcome 2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation edit

Due: End of quarter
task T174095

Added: 

   *Engagement Model
   *Awareness campaign
   *Tech Debt/Code Reasouces

Program 3: Outcome 2: Objective 3: Promote and surface important technical debt topics at large gatherings of Wikimedia developers (e.g., DevSummit and Hackathon(s)) edit

Due: End of next quarter
task T174096

No activitiy

Program 6: Outcome 2: Objective 2: Set up a continuous integration and deployment pipeline edit

Due: End of this quarter
Keyword: SSD
phab project: https://phabricator.wikimedia.org/project/view/2453/
Goal:
Verify basic functionality of 'production' deployment and image (initially targeting mathoid):
Functional PoC within integration in the deployment-pipeline
Deploy to isolated k8s
  • Major improvements to Blubber this quarter for more secure permissions/ownership scheme and policies
  • Verified a working PoC of `helm test` against minikube outside of CI but:
  • Still majorly blocked on lack of functional minikube/k8s/helm within CI
  • We are not far off once unblocked


Quaterly Goals for Q4 edit

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure edit

Migrate away from Nodepool - task T190097
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Add Composer support to Blubber - task T186547
Add Python/Tox support to Blubber - task T186545
Add Ruby/Gem/Bundler/Rake support to Blubber - task T188950


Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans edit

Broad role out of Code Stewardship model.
Update Maintainers/Developers page with currently known Code Stewards.
Use Code Stewardship review process to address gaps.
Deploy dashboard of Code Stewardship Coverage


Updated Developer/Maintainer page with some known code stewards and status for code under review.

Program 3: Outcome2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation edit

Roll out of technical debt reduction approaches.
Identify early adopter engineering teams to test approaches.


Program 6: Outcome 2: Objective 2: Prove viability of testing staged service containers alongside MediaWiki extension containers edit

Add Composer support to Blubber - task T186547
Small, standalone, MediaWiki containers built using Blubber
Limited scope with: Debian Stretch, php7, composer dependencies, Mariadb, Apache (or last two with standalone containers)
Build MW base containers upon branch cut at master branch point from core
Build ext specific containers using MW image as base



Quaterly non-goal "Work" edit

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2) edit

workboard


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure edit

Program 1: Outcome 6: Milestone 1: Maintain Gerrit edit

Program 1: Outcome 6: Milestone 2: Maintain Phabricator edit

Streamline logspam workflows by adding some integration with phabricator
Store git-lfs (and other phab uploads) in swift: task T182085


Other work edit

Standup! edit

Antoine edit

  • What I plan to do this week
  • What I'm blocked on
  • Other?


Chad edit

  • What I plan to do this week
    • MW security release prep (with Brian W)
      • hopefully really really soon (TM)
    • Helm/Blubber
  • What I'm blocked on
  • Other?
    • Gerrit 2.15.x prep? We should migrate sooner rather than later (2.14.x won't be getting much love, 2.16/3.0 will be huge. So 2.15.x is gonna be our "LTS")


Dan edit

  • What I plan to do this week
  • What I'm blocked on
    • Nada
  • Other?


Greg edit

  • What I plan to do this week
    • !!!!!!!!!!!!!!!!!!
    • Meeting-full day today and prep for leaving for almost 2 weeks
  • What I'm blocked on
  • Other?


Jean-Rene edit

  • What I plan to do this week
    • Code stewardship reviews
    • Code Stewardship Dashboard
  • What I'm blocked on
  • Other?


Mukunda edit

  • What I plan to do this week
    • Train for 1.31.0-wmf.27 and 1.31.0-wmf.28
    • More git-lfs work in scap and phabricator
  • What I'm blocked on
  • Other?


Tyler edit

  • What I plan to do this week
    • email/catchup
    • applied role::ci::slave::labs::pipelinebuilder to integration-slave-k8s-1013 and it work, so...good...
    • minikube/helm CI work
    • may revisit canary shifting baseline if there's time
  • What I'm blocked on
  • Other?


Zeljko edit

  • What I plan to do this week
    • T179188: Video recording for Selenium tests in Node.js
    • T190994 Q4 Selenium framework improvements
  • What I'm blocked on
    • T179188: Video recording for Selenium tests in Node.js - in progress - almost there, video for each test is recorded, but ffmpeg complains about something :/
    • T190269 Warning: Task "stylelint:src" failed due to postcss-less@1.1.4 - 1.1.5 does not fix the problem, I recommend that we stay pinned to 1.1.3
  • Other?

Grooming edit

Team Kanban Board Review and Triage edit


Once / month-ish review of backlog(s) edit


Kanban stats edit

Burnup chart
Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Checkin_archive/20180402&oldid=3615609"