Wikimedia Release Engineering Team/Checkin archive/20171211

2017-12-11Edit

Vacations/Important datesEdit

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • December Fridays - Greg is taking off
  • December 20-22: Dan - holiday
  • December 25 (Monday): Željko - holiday (Christmas Day)
  • December 26 (Tuesday): Željko - holiday (St Stephen's Day)
  • Dec 25-Jan 1 - End of year/new year holidays
  • January 1 (Monday): Željko - holiday (New Year's Day)

Team BusinessEdit

Rotating positions and absencesEdit

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R

Dec 4 and Dec 11Edit

  • Train: Chad
  • SoS: Mukunda
  • Out
    • Dec 4th (Monday): Antoine

Dec 18 and Dec 25Edit

  • Train: NO ONE!
  • SoS: Chad
  • Out:
    • Dec 25-Jan 1 - End of year/new year holidays
    • December 25 (Monday): Željko - holiday (Christmas Day)
    • December 26 (Tuesday): Željko - holiday (St Stephen's Day)
    • Antoine - not sure yet of the exact dates


Jan 1 and Jan 8Edit

  • Train: Mukunda
  • SoS: Tyler
  • Out:
    • January 1 (Monday): Holiday, everyone

Actions from last meetingEdit

Scrum of ScrumsEdit

This weekEdit

Release EngineeringEdit

  • Blocking
  • Blocked
  • Updates
    • [MW Train] Reminder! This is your last week of deployments for the year/quarter! No non-emergency deploys starts the week of December 18th.
    • [Meta] Q3 goal planning
    • [Security/Ruby] T180878 Upgrade RuboCop and Rubyzip (Ruby)
      • All done except for Minerva (needs a +2) and mediawiki/debian (unsure if needed).
    • [Security/Jenkins] Upgraded a bunch of Jenkins plugins Monday morning EU time (after a bunch of security releases).
    • [Phabricator] Exploring the use of Selenium tests for search quality regressions
    • [TechDebt] Getting further on the definition of “steward”. We will be talking with Victoria and Toby “soon”.
    • [SSD] One more merge (https://gerrit.wikimedia.org/r/#/c/395570/) and our quarterly goals are complete.
    • [PostMortem] ORES post-mortem completed last week: https://etherpad.wikimedia.org/p/Post-Mortem-T181006


Last weekEdit

  • Blocking
  • Blocked
  • Updates
    • [MW Train] Reminder! This is your last few weeks of deployments for the year/quarter! No non-emergency deploys starts the week of December 18th. [wiki][email]
    • [MW Train] The post mortem for T181006 (Watchlist and RecentChanges failure due to ORES on frwiki and ruwiki) is scheduled for December 7th.
    • #mw-1.30-release MediaWiki 1.30 is about to be released in the next few days, so last call for any blockers people might have...you know...forgotten


Puppet SWATEdit

list of patches you want to submit to Puppet SWAT


Logspam \ Last week's train updatesEdit

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Other Team BusinessEdit

Q3 goals! :) :)Edit

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q2
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q3


Program 1: webdriver.ioEdit
https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Technology#Program_1:_Availability.2C_performance.2C_and_maintenance
  • T182421 Selenium framework improvements
    • Things to do in the next quarter.
Program 3: Tech DebtEdit
https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Technology#Program_3:_Addressing_technical_debt

Outcome 1

  • Objective 2: Identify and find stewards for high-priority/high use code segment orphans - task T174091
  • Objective 3: Define and steward a light-weight process for adopting or orphaning/sunsetting products and infrastructure.
    • This is done by the Sunsetting working group

Outcome 2

  • Objective 2: Define and implement a process to regularly address technical debt across the Foundation
  • Objective 3: Promote and surface important technical debt topics at large gatherings of Wikimedia developers (e.g., DevSummit and Hackathon(s))


Program 6: SSDEdit
https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/2017-2018/Final/Programs/Technology#Program_6._Streamlined_service_delivery
  • Pre-Dependency on Ops:
    • CI k8s cluster for the Verify pipeline stage


OtherEdit
Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2) =Edit
workboard


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure =Edit
Goal: A generalized POC for a docker-based CI.
https://phabricator.wikimedia.org/project/view/3008/ (shipyard workboard)
  • Draft requirements for a CI k8s cluster in preparation for Ops to create it in the following quarter(ish)
  • Nodepool deprecation: npm and php jobs, but there will be a long tail of corner case jobs
Program 1: Outcome 5: Objective 1: MW Nightlies serverEdit
  • chad point on this, bulk of time
  • Sam Reed and Chad will work on setting it up this week


Q2 goal/project check-inEdit

All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q2

Quarterly GoalsEdit

Program 1: Outcome 5: Milestone 1: Migrate majority of developers to JavaScript based browser test framework (webdriver.io)Edit

Due: End of this quarter
Quarter Goal Task: Port Selenium tests from Ruby to Node.js - task T139740


  • T139740 Port Selenium tests from Ruby to Node.js
    • Progress. Flow deleted tests. :|
  • T180777 Move portal deployment artifacts into their own repo
    • wikimedia/portals/deploy has Selenium tests!
  • T182160 Develop tests for phabricator search to detect regressions / search quality issues
    • Selenium tests for Phabricator search
RubyEdit


Program 3: Outcome 1: Objective 1: Define a set of code stewardship levels (from high to low expectations)Edit

Due: End of this quarter
Quatertly Goal task: - task T174090
  • Had additional discussions regarding the definition of stewards vs owners.
    • Final updates will be complete this week.
  • Worked on discussion points for meeting with Toby and Victoria
    • Path to completion is review with Toby and Victoria and then broader discussion with engineering managers and leagues.

Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphansEdit

Due: End of next quarter
Quaterly Goal task - task T174091
  • no progress this past week.

Program 3: Outcome 2: Objective 1: Define a “Technical Debt Project Manager” role that regularly communicates with all Foundation engineering teams regarding their technical debtEdit

Due: End of this quarter
  • done


Program 3: Outcome 2: Objective 2: Define and implement a process to regularly address technical debt across the FoundationEdit

Due: End of next quarter
  • behind on the blog post completion. Finishing up with week.


Program 6: Outcome 2: Objective 2: Set up a continuous integration and deployment pipeline to publish new versions of an application to production via testing and staging environments that reliably reproduce productionEdit

Due: End of this quarter
Keyword: SSD
Complete build phase of release pipeline
    • Build test variant
    • Run test entrypoint w/developer feedback - services dependency
    • Build production variant w/developer feedback - services dependency
    • Tag production container
    • Push to production docker registry - ops dependency - staging namespace
Tracking: https://phabricator.wikimedia.org/T157469
current status: https://phabricator.wikimedia.org/project/view/2453/

Quaterly non-goal "Work"Edit

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)Edit

workboard


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructureEdit

Goal: A generalized POC for a docker-based CI.
https://phabricator.wikimedia.org/project/view/3008/ (shipyard workboard)
  • Upgraded a bunch of Jenkins plugins (security updates)


Program 1: Outcome 6: Milestone 1: Maintain GerritEdit

Program 1: Outcome 6: Milestone 2: Maintain PhabricatorEdit

Program 1: Outcome 5: Objective 1: MW Nightlies serverEdit

Other workEdit


GroomingEdit

Team Kanban Board Review and TriageEdit


Once / month-ish review of backlog(s)Edit


Kanban statsEdit

Burnup chart