Wikimedia Release Engineering Team/Checkin archive/20190401


2019-04-01

edit

Vacations/Important dates

edit
https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • March 29–April 1: James out (New Hampshire)
  • March 31: DST switchover in .eu, elsewhere ish.
  • April 9-12: Greg at tech-mgt F2F in Portland
  • April 11: Dan out
  • April 17-19 (Wednesday - Friday) - Željko vacation
  • April 18-19 (Thursday, Friday) - Lars on vacation in Chicago
  • April 22 (WMF Holiday) - US Staff
  • April 22-27: Team offsite in Chicago
  • April 29: Moved WMF Holiday for US staff at offsite
  • May 1st - Lars, Antoine and Željko, Labor Day / May Day
  • May 8th - Antoine, 1945 victory
  • May 15 (Wednesday) - Željko vacation
  • May 16-20 - Wikimedia Hackathon 2019 (Prague, Czechia)
    • Attending: Greg, JR, Zeljko, James, and Jeena
  • May 30th-31th - Antoine, Feast of the Ascension
  • June 10th - Antoine, Pentecost -- see https://en.wikipedia.org/wiki/Eastertide for Antoine/France Easter holidays
  • May 27 (Memorial Day) - US Staff
  • June 6-7 - Brennen, Apogaea
  • June 19 (Juneteenth) - US Staff
  • July 22 - August 9 - Željko vacation
  • August 25 - September 4 - Brennen vacation

Rotating positions

edit

Train

edit
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
  • Jan 07 - wmf.12 - Dan
  • Jan 14 - wmf.13 - Dan
  • Jan 21 - wmf.14 - Mukunda
  • Jan 28 - wmf.15 - No Train (All Hands)
  • Feb 04 - wmf.16 - Mukunda
  • Feb 11 - wmf.17 - Tyler
  • Feb 18 - wmf.18 - Tyler
  • Feb 25 - wmf.19 - Antoine
  • Mar 04 - wmf.20 - Antoine
  • Mar 11 - wmf.21 - Zeljko 🐌
  • Mar 18 - wmf.22 - Zeljko 💣
  • Mar 25 - wmf.23 - Dan
  • Apr 01 - wmf.24 - Dan
  • Apr 08 - wmf.25 - Mukunda
  • Apr 15 - 1.34.0-wmf.1 - Mukunda
  • Apr 22 - wmf.2 - NO TRAIN, team offsite
  • Apr 29 - wmf.3 - Tyler
  • May 06 - wmf.4 - Tyler
  • May 13 - wmf.5 - Antoine
  • May 20 - wmf.6 - Antoine
  • May 27 - wmf.7 - Zeljko
  • June 03 - wmf.8 - Zeljko
  • Zeljko 4eva! :)

Team Business

edit

Book club

edit


Spring Offsite

edit


Monthly reflection on accomplishments - April '19 edition

edit
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
Add as you have them!



Annual Planning

edit


Incoming/Needs attention

edit

[Task] Add Scribunto to extension-gate in CI

edit


Scrum of Scrums

edit

Incoming from last week

edit
  • Blocking:


Outgoing this week (wrong section heading is on purpose for copy/pasting into Scrum of Scrums etherpad

edit

Release Engineering

edit

Callouts

edit
  • Release Engineering


Train status and happenings

edit
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor



Quarterly Goals for Q4

edit

https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2018-19_Q4

TEC1 (Maint): Outcome 1 / Output 1.1

edit
GOAL: Undeploy the CodeReview extension.
WHO: James, need help from CPT


TEC1 (Maint): Outcome 1 / Output 1.1

edit
GOAL: Setup 1-3 of the CI WG options (Zuul v3, Argo, GitLab)
WHO:
  • Focus on a couple noteworthy repos: e.g.,
    • core
    • extensions
    • ops/puppet
  • Maybe setup in serial, i.e., a week per evaluation
  • Questions:
    • RelEng/Extended working group?
      • At least in the WG eval it was good to have non-familiar people
      • But maybe with the setup of options it might be beneficial to have experienced with current setup people.
      • Folks outside the original working group to join-in to setup options; people TBD
    • Do we need a rubric before we do this prototyping? (yes)
      • TODO lars to work on rubric week of 2019-04-01

TEC3 (Pipeline): Outcome 1 / Output 1.2

edit
GOAL: Instrument Quibble for data collection
WHO: Mukunda, Antoine
  • Still no progress / nowhere to store this data and other tasks taking priority


TEC3 (Pipeline): Outcome 1 / Output 1.2

edit
GOAL: Create a graph where time is spent and make a prioritized list for improvements.
WHO: Mukunda, Antoine


TEC3 (Pipeline): Outcome 1 / Output 1.2

edit
GOAL: Prepare the Deployment Pipeline for changes to our CI tooling.
WHO: Lars, ???
  • Blocked by not having new CI tooling yet


TEC3 (Pipeline): Outcome 3 / Output 3.1

edit
GOAL: Create a .pipeline/config.yaml standard to give users more control over how their tests are run in the pipeline and allow the easy saving of artifacts at pipeline completion. (RelEng)
WHO: Dan, Tyler, ???


TEC3 (Pipeline): Outcome 3 / Output 3.1

edit
GOALS:
Adopt more services into Deployment pipeline - task T212801
Wikidata Termbox SSR, Kask for Session Storage Service, cpjobqueue (stretch), ORES (stretch)
WHO: Dan, Tyler, Lars
  •   Done cxserver
  • changeprop


  • Wikidata Termbox SSR


  • Kask for Session Storage Service


  • cpjobqueue (stretch)


TEC12 (DevProd): Outcome 1 / Output 1.1

edit
GOAL: Provide an "Official" Docker base image for local development of MediaWiki based on the production tooling.
WHO: Jeena, Brennen



TEC13 (Code Health): Outcome 1 / Outcome 3

edit
GOALs: Presentation/session(s) at the Wikimedia Hackathon on the current state of Code Health projects (technical debt and code stewardship)
WHO: JR


TEC13 (Code Health): Outcome 1 / Output 1.1

edit
GOAL:
Publish a re-imagination of the Review Queue process.
Develop and implement metrics around task and code-review responsiveness
WHO: Greg, JR (and Andre)


TEC13 (Code Health): Outcome 4 / Output 4.2

edit
GOALs:
Expand SonarQube reporting into CI infrastructure
Perform SonarQube analysis on all extensions
Engage user communities in direct feedback solicitation
WHO: JR, Zeljko, Code Health Metrics



Other non-goal work

edit

Selenium

edit
  • T213268 Upgrade webdriverio to version 5
    • Might fix T210506 `npm install` fails for mediawiki/core with EPEERINVALID when running on Node 11
    • Blocked on T199116 Quibble should run `npm install` and `npm run selenium-test` for each extension/skin that has Selenium tests

Gerrit

edit


Phabricator

edit

Jenkins

edit

QA/Code Health

edit
  • T219156 Generate baseline analysis of all extensions - script ready, will be run today/tomorrow


SCAP

edit

Standup!

edit

Antoine

edit
  • What I plan to do this week
    • Still dealing with aftermath of Debian removing jessie-backports component. That introduced breakage all other the place due to outdated or now missing packages. Already burned 3 days on that
    • Quibble upgrade for parallelism. docker-pkg was broken, quibble 0.0.30 is missing some data file due to an old setuptools (see above)
    • Hopefully some Zuul repackaging :-/
  • What I'm blocked on
    • Change Gerrit owners from Administrators > Gerrit Managers
      • Haven't looked into it E_NO_TIME
    • Have a look at Zuul upgrade that Paladox worked on. E_NO_TIME :(
  • Other?
    • Overall, trying to focus but the regular maintenance of Docker images is killing me.
    • TLDR: do not ever use Debian *-backports component.

Brennen

edit
  • What I plan to do this week
    • local-charts
      • blubber.yaml / docker-pkg for MediaWiki
      • Installation script tweaks
    • Follow up with Eric Gardner on documentation
    • Continue learning about Gerrit (thcipriani: if you want to pair on upgrade, might be...fun(?)) (ack)
    • Read book
  • What I'm blocked on
    • Nothing
  • Other?
    • Avoid most of the internet all day today.



Greg

edit
  • What I plan to do this week
    • Brain dumping on annual plan etherpads
    • reviewing the perf team phab process, starting to write some ideas down there
    • Read the book chapters
  • What I'm blocked on
    • MTP reveal :)
    • TOO MANY EMAILS
  • Other?

James

edit
  • What I plan to do this week
  • What I'm blocked on
  • Other?


Jean-Rene

edit
  • What I plan to do this week
  • What I'm blocked on
  • Other?


Jeena

edit
  • What I plan to do this week
    • Add to the planning documents
    • Read book
    • Figure out how to use X-debug in local-charts
    • Merge Mac OS install script in local-charts
    • sshfs script for local-charts volume sharing
    • Add goals/intentions of local-charts description to README
  • What I'm blocked on
  • Other?


Lars

edit
  • What I plan to do this week
    • read CD book, participate in book club
    •   Done reinstall Debian on work laptop to fix various breakages (e.g., Docker/minikube no worky)
    • improve my essay on production-like based on feedback, further thinking
    • annual planning
  • What I'm blocked on
  • Other?
    • various illnesses


Mukunda

edit
  • What I plan to do this week
    • Read a book
    • Fix phabricator search
    • Refine the vandalism rollback tool
    • Help Tyler with Gerrit upgrade and whatever else he needs
  • What I'm blocked on
    • Time.
  • Other?


Tyler

edit
  • What I plan to do this week
    • Gerrit
    • Meetings
    • Code review when I have time
    • Read book (sooo far behind :(( )
  • What I'm blocked on
  • Other?


Zeljko

edit
  • What I plan to do this week
    • T219156 Generate baseline analysis of all extensions
    • T219437 Add MacOS installation Documentation and Install Script for local-charts repo
    • T219132 European Mid-day SWAT
  • What I'm blocked on
  • T213268 Upgrade webdriverio to version 5
    • Might fix T210506 `npm install` fails for mediawiki/core with EPEERINVALID when running on Node 11
    • Blocked on T199116 Quibble should run `npm install` and `npm run selenium-test` for each extension/skin that has Selenium tests
  • Other?
    • Already read the book! (Well, chapters for book club.)


Grooming

edit

Team Kanban Board Review and Triage

edit


Once / month-ish review of backlog(s)

edit


Kanban stats

edit
Burnup chart