Wikimedia Release Engineering Team/Checkin archive/20180430
2018-04-30
editVacations/Important dates
edit- May 1: Željko (Holidays in Croatia - Labor Day / May Day), Antoine ditto
- May 7-11: Antoine, too many holidays in France that week
- May 7-14: Dan (Barcelona)
- May 10-14: Chad (family time)
- May 15-17: Team offsite in Barcelona
- May 18-21: Wikimedia Hackathon in Barcelona
- May 21 (Mon): Tech-Mgt F2F
- May 28 (Mon): Memorial Day (US Holiday)
- May 31: Željko (Holidays in Croatia - Corpus Christi)
Rotating positions
editTrain
edit- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R
- Apr 23 - 1.32.0-wmf.1 - Chad
- Apr 30 - wmf.2 - Chad <----
- May 07 - wmf.3 - Mukunda
- May 14 - wmf.4 - Mukunda
- May 21 - wmf.5 - Mukunda
- May 28 - wmf.6 - Tyler
- June 04 - wmf.7 - Tyler
- June 11 - wmf.8 - Chad
- June 18 - wmf.9 - Chad
- June 25 - wmf.10 - Mukunda
- July 02 - wmf.11 - Mukunda
SoS
edit- Apr 23 - Tyler
- Apr 30 - Tyler <----
- May 07 - Chad
- May 14 - Chad
- May 21 - Chad
- May 28 - Mukunda
- June 04 - Mukunda
- June 11 - Tyler
- June 18 - Tyler
- June 25 - Chad
- July 02 - Chad
Team Business
editUpdates
edit- Q3 quarterly checkin slides: https://docs.google.com/presentation/d/1wZ10iUwquwQ93zUDF3DYoEcwKVG6GQ1A2sBWs0q6tng/edit#slide=id.g1651e065b0_0_555
- I need a volunteer to be prepared for this in June:
- rename wikimediafoundation.org wiki to foundation.wikimedia.org: https://phabricator.wikimedia.org/T188776
- Activity in Barcelona!
- https://docs.google.com/spreadsheets/d/1qVmJ47UYatbjpwOvCgLgBKsp3Ntv0gZv1-NuhiDnjFM/edit?ts=5ad72c5e&pli=1#gid=0
- A cooking class and La Sagrada Familia are tied
Scrum of Scrums
edit- Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums
This week
editRelease Engineering
edit- Blocking
- Blocked
- Updates
- Announcing Quibble! https://phabricator.wikimedia.org/phame/post/view/99/introducing_quibble/
Last week
editRelease Engineering
edit- Blocking
- Blocked
- Updates
- HEADS UP: localization update rebuilds are taking a long time during full scaps. See: https://phabricator.wikimedia.org/T191921
Train status and happenings
edit
Past week status updates
edit- All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4
Quaterly Goals for Q4
editProgram 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure
edit- Migrate away from Nodepool - task T190097
- Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
- Add Composer support to Blubber - task T186547
- Add Python/Tox support to Blubber - task T186545
- Add Ruby/Gem/Bundler/Rake support to Blubber - task T188950
Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans
edit- Broad role out of Code Stewardship model.
- Update Maintainers/Developers page with currently known Code Stewards.
- Use Code Stewardship review process to address gaps.
- Deploy dashboard of Code Stewardship Coverage
- Setup meetings for RelatedSites stewardship kickoff.
- Reviewed Q4 candidates
Program 3: Outcome2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation
edit- Roll out of technical debt reduction approaches.
- Identify early adopter engineering teams to test approaches.
- Identified Search Platform and Platform as first two "early adopter" teams to engage with.
Program 6: Outcome 2: Objective 2: Prove viability of testing staged service containers alongside MediaWiki extension containers
edit- Add Composer support to Blubber - task T186547
- Small, standalone, MediaWiki containers built using Blubber
- Limited scope with: Debian Stretch, php7, composer dependencies, Mariadb, Apache (or last two with standalone containers)
- Build MW base containers upon branch cut at master branch point from core
- Messing with Blubber/Composer and MediaWiki core but it's unclear how viable Composer-based dependency installation will be
- Build ext specific containers using MW image as base
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Deployment_pipeline/2018-04-26
Quaterly non-goal "Work"
editProgram 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)
edit
Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure
editProgram 1: Outcome 6: Milestone 1: Maintain Gerrit
editProgram 1: Outcome 6: Milestone 2: Maintain Phabricator
edit- Streamline logspam workflows by adding some integration with phabricator
- Store git-lfs (and other phab uploads) in swift: task T182085
Other work
edit- Mukunda
- Worked with Stas on wdqsguibuilder CI job - https://phabricator.wikimedia.org/T189811
- Postmortem for 1.31.0-wmf.27:
*** Incident report: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180229-Train-1.31.0-wmf.27 *** Meeting notes: https://etherpad.wikimedia.org/p/Post_Mortem-20180329-Train-1.31.0-wmf.27-Blocker *** Action item: "Look into ways to identify risky commits that are part of the weekly branch cut, either manually or through automated process" - https://phabricator.wikimedia.org/T193258 *** This inspired chad to outline a two-branch model for mediawiki deployments: https://etherpad.wikimedia.org/p/two-branch-merge-model
- JR
- Post Mortem: 20180329-Train-1.31.0-wmf.27 Blocker
- Staging/Beta Cliuster Survey
Standup!
editAntoine
edit- Most MediaWiki skins moved to Quibble
- What I plan to do this week
- Left over skins and some extensions. Epic: https://phabricator.wikimedia.org/T183512
- Doc with Zeljko
- Analyze failures of mediawiki extensions
- What I'm blocked on
- Other?
- Considering using utf8mb4 for MySQL, but lot of extensions schema fails (key too long)
- Will add sql_mode=TRADITIONAL, get MySQL to report errors instead of silently truncating data
Chad
edit- What I plan to do this week
- Train, MW 1.31.0 work
- What I'm blocked on
- Bugs for 1.31.0 :(
- Other?
Dan
edit- What I plan to do this week
- https://phabricator.wikimedia.org/T188935 modify service-pipeline to include helm install/helm test Normal Open
- https://phabricator.wikimedia.org/T186547 Blubber should support php/composer Normal Open
- What I'm blocked on
- Futzing with Composer and MediaWiki core? Let's pair!
- [Chad]: lets do it
- Futzing with Composer and MediaWiki core? Let's pair!
- Other?
Greg
edit- What I plan to do this week
- Q3 QCI slides
- barecelona activity/other things with Megan, starting schedule
- JD for Software Engineer (Dev Prod)
- email SRE/Services survey text for Beta Cluster
- What I'm blocked on
- Other?
Jean-Rene
edit- What I plan to do this week
- Send out Q4 round of stewardship reviews + update of last quarter's review items.
- Stewardship kickoff meeting for ReleatedSites
- Q3 QCI Slides
- What I'm blocked on
- Other?
- Staging Survey
Mukunda
edit- What I plan to do this week
- Finish phabricator swift storage engine.
- What I'm blocked on
- Other?
Tyler
edit- What I plan to do this week
- Document CI pipeline
- Document Blubber
- Maybe scap release?
- Want to look at skaffold
- What I'm blocked on
- Other?
- if anyone has any thoughts: https://phabricator.wikimedia.org/T193311
Zeljko
edit- What I plan to do this week
- T179188 Video recording for Selenium tests in Node.js
- T179190 Run Selenium Cucumber tests in CI
- T193244 selenium-CirrusSearch-jessie does not run any tests
- T191537 MediaWiki core's selenium tests flaky when run as part of mwext-mw-selenium-node-composer-jessie job
- What I'm blocked on
- T193164 document quibble cache / src reuse for local installation - see draft blog post for details https://phabricator.wikimedia.org/phame/post/view/100
- Other?
- Somebody I know applied for a job at WMF and pretty much crickets...
- Helping with Bosnian, Croatian, and Serbo-Croatian Analyzer Analysis https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Bosnian,_Croatian,_and_Serbo-Croatian_Analyzer_Analysis
- Reaching level 4 in Yousician for ukulele https://yousician.com/
Grooming
editTeam Kanban Board Review and Triage
edit- closed and touched in the 7 days
- No update for 4 weeks
- No update for 3 weeks
- No update for 2 weeks
- No update for 1 week
- All Open
- Review To Triage column of #releng
Once / month-ish review of backlog(s)
edit- releng Review To Triage column of #releng
- releng-kanban Review unassigned in kanban
- releng-kanban Review 'backlog' colum of -kanban
- releng-next - Review for things we need to put on our kanban backlog
- releng-backlog - oh my, the huge backlog of things...