MediaWiki

Wikimedia Release Engineering Team/Checkin archive/20180402

< Wikimedia Release Engineering Team | Checkin archive


2018-04-02

edit

Vacations/Important dates

edit
https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • April 2: Željko (Holidays in Croatia - Easter Monday)
  • Apr 3-13: Greg vacation
  • April 16 (Mon): WMF Holiday
  • May 1: Željko (Holidays in Croatia - Labor Day / May Day)
  • May 14-17: Team offsite in Barcelona
  • May 18-21: Wikimedia Hackathon in Barcelona
  • May 21 (Mon): Tech-Mgt F2F
  • May 31: Željko (Holidays in Croatia - Corpus Christi)

Rotating positions

edit

Train

edit
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R
  • Feb 19 - wmf.22 - Mukunda
  • Feb 26 - wmf.23 - Tyler
  • Mar 05 - wmf.24 - Tyler
  • Mar 12 - wmf.25 - Chad
  • Mar 19 - wmf.26 - Chad
  • Mar 26 - wmf.27 - Mukunda
  • Apr 02 - wmf.28 - Mukunda <----
  • Apr 09 - wmf.29 - Tyler
  • Apr 16 - wmf.30 - Tyler
  • Apr 23 - 1.32.0-wmf.1 - Chad
  • Apr 30 - wmf.2 - Chad

SoS

edit
  • Feb 19 - Chad
  • Feb 26 - Mukunda
  • Mar 05 - Mukunda
  • Mar 12 - Tyler
  • Mar 19 - Tyler
  • Mar 26 - Chad
  • Apr 02 - Chad <----
  • Apr 09 - Mukunda
  • Apr 16 - Mukunda
  • Apr 23 - Tyler
  • Apr 30 - Tyler

Team Business

edit

Updates

edit

Staging: https://docs.google.com/document/d/1CT_pKjwiDmFhZZ9LW9mz0z434-wgr3NFdapUPWUvMNA/edit

  • Update from Greg
  • Please comment/let suggestions this week


Scrum of Scrums

edit
Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

This week

edit

Release Engineering

edit
  • Blocking
  • Blocked
  • Updates
    • Train status
    • Pencils down on MW 1.31.0

Last week

edit

Release Engineering

edit
  • Blocking
    • Nothing
  • Blocked
    • Nothing
  • Updates

Train status and happenings

edit
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Past week status updates

edit
All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Past Quarterly Goals - Final status update

edit

Program 1: Outcome 5: Milestone 1: Develop and migrate to a JavaScript-based browser testing stack

edit
Due: End of this quarter
What: Specific improvements to the now canonical framework, see: task T182421, notably:
Upgrade webdriverIO to version 4.9
Investigate replacing nodemw with mwbot
Video recording for Selenium tests in Node.js
Task: task T182421
  • T180144: Upgrade WebdriverIO to 4.12.0 - done
  • T181284: Replace nodemw with mwbot - done
  • T179188: Video recording for Selenium tests in Node.js - in progress - almost there, video for each test is recorded, but ffmpeg complains about something :/

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

edit
Goals
Draft requirements for a Kubernetes based solution for CI - task T183513
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Will be worked on after the long tail task T187797
Unify production and CI docker image build process - task T177276
  Done 01/15



Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans

edit
Due: End of quarter
task T174091

Made final edits to Stewardship model and update wiki pages.

Program 3: Outcome 2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation

edit
Due: End of quarter
task T174095

Added: 

   *Engagement Model
   *Awareness campaign
   *Tech Debt/Code Reasouces

Program 3: Outcome 2: Objective 3: Promote and surface important technical debt topics at large gatherings of Wikimedia developers (e.g., DevSummit and Hackathon(s))

edit
Due: End of next quarter
task T174096

No activitiy

Program 6: Outcome 2: Objective 2: Set up a continuous integration and deployment pipeline

edit
Due: End of this quarter
Keyword: SSD
phab project: https://phabricator.wikimedia.org/project/view/2453/
Goal:
Verify basic functionality of 'production' deployment and image (initially targeting mathoid):
Functional PoC within integration in the deployment-pipeline
Deploy to isolated k8s
  • Major improvements to Blubber this quarter for more secure permissions/ownership scheme and policies
  • Verified a working PoC of `helm test` against minikube outside of CI but:
  • Still majorly blocked on lack of functional minikube/k8s/helm within CI
  • We are not far off once unblocked


Quaterly Goals for Q4

edit

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

edit
Migrate away from Nodepool - task T190097
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Add Composer support to Blubber - task T186547
Add Python/Tox support to Blubber - task T186545
Add Ruby/Gem/Bundler/Rake support to Blubber - task T188950


Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans

edit
Broad role out of Code Stewardship model.
Update Maintainers/Developers page with currently known Code Stewards.
Use Code Stewardship review process to address gaps.
Deploy dashboard of Code Stewardship Coverage


Updated Developer/Maintainer page with some known code stewards and status for code under review.

Program 3: Outcome2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation

edit
Roll out of technical debt reduction approaches.
Identify early adopter engineering teams to test approaches.


Program 6: Outcome 2: Objective 2: Prove viability of testing staged service containers alongside MediaWiki extension containers

edit
Add Composer support to Blubber - task T186547
Small, standalone, MediaWiki containers built using Blubber
Limited scope with: Debian Stretch, php7, composer dependencies, Mariadb, Apache (or last two with standalone containers)
Build MW base containers upon branch cut at master branch point from core
Build ext specific containers using MW image as base



Quaterly non-goal "Work"

edit

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)

edit
workboard


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

edit

Program 1: Outcome 6: Milestone 1: Maintain Gerrit

edit

Program 1: Outcome 6: Milestone 2: Maintain Phabricator

edit
Streamline logspam workflows by adding some integration with phabricator
Store git-lfs (and other phab uploads) in swift: task T182085


Other work

edit

Standup!

edit

Antoine

edit
  • What I plan to do this week
  • What I'm blocked on
  • Other?


Chad

edit
  • What I plan to do this week
    • MW security release prep (with Brian W)
      • hopefully really really soon (TM)
    • Helm/Blubber
  • What I'm blocked on
  • Other?
    • Gerrit 2.15.x prep? We should migrate sooner rather than later (2.14.x won't be getting much love, 2.16/3.0 will be huge. So 2.15.x is gonna be our "LTS")


Dan

edit
  • What I plan to do this week
  • What I'm blocked on
    • Nada
  • Other?


Greg

edit
  • What I plan to do this week
    • !!!!!!!!!!!!!!!!!!
    • Meeting-full day today and prep for leaving for almost 2 weeks
  • What I'm blocked on
  • Other?


Jean-Rene

edit
  • What I plan to do this week
    • Code stewardship reviews
    • Code Stewardship Dashboard
  • What I'm blocked on
  • Other?


Mukunda

edit
  • What I plan to do this week
    • Train for 1.31.0-wmf.27 and 1.31.0-wmf.28
    • More git-lfs work in scap and phabricator
  • What I'm blocked on
  • Other?


Tyler

edit
  • What I plan to do this week
    • email/catchup
    • applied role::ci::slave::labs::pipelinebuilder to integration-slave-k8s-1013 and it work, so...good...
    • minikube/helm CI work
    • may revisit canary shifting baseline if there's time
  • What I'm blocked on
  • Other?


Zeljko

edit
  • What I plan to do this week
    • T179188: Video recording for Selenium tests in Node.js
    • T190994 Q4 Selenium framework improvements
  • What I'm blocked on
    • T179188: Video recording for Selenium tests in Node.js - in progress - almost there, video for each test is recorded, but ffmpeg complains about something :/
    • T190269 Warning: Task "stylelint:src" failed due to postcss-less@1.1.4 - 1.1.5 does not fix the problem, I recommend that we stay pinned to 1.1.3
  • Other?

Grooming

edit

Team Kanban Board Review and Triage

edit


Once / month-ish review of backlog(s)

edit


Kanban stats

edit
Burnup chart
Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Checkin_archive/20180402&oldid=3615609"