Wikimedia Release Engineering Team/Checkin archive/20191016
2019-10-16
editVacations/Important dates
edit- October 8: Željko holiday (Independence Day)
- October 11: Željko conference (https://2019.webcampzg.org/ )
- October 14 (Indigenous Peoples' Day): US Staff
- October 24–27: James at WikidataCon 2019 in Berlin
- November 1 (All Saints' Day): Željko holiday
- November 8–10: WikiCon North America (James)
- November 11 (Veterans' Day): US Staff
- November 12–15: TechConf19
- November 16–20: Offsite
- November 21-30: Jeena
- November 25-29: Dan
- November 28–29 (Thanksgiving): US Staff
- December 1-2: Jeena
- December 6: Lars (Finnish Independence Day)
- December 25–31 (Christmas): US Staff
- December 25–26: Lars, Željko, Christmas
- 1 January (New Year's Day): US Staff, Lars, Željko
- 20 January (Martin Luther King Jr. Day): US Staff
Rotating positions
editTrain
edit- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
- Jun 24 - wmf.11 - Jeena (with Mukunda)
- Jul 1 - wmf.12 - No Train (Fourth of July)
- Jul 8 - wmf.13 - Jeena
- Jul 15 - wmf.14 - Lars (with Antoine)
- Jul 22 - wmf.15 - Lars
- Jul 29 - wmf.16 - Brennen (with Tyler)
- Aug 5 - wmf.17 - Brennen
- Aug 12 - wmf.18 - No Train (Wikimania)
- Aug 19 - wmf.19 - Zeljko 😱
- Aug 26 - wmf.20 - Zeljko 😭
- Sep 2 - wmf.21 - Antoine
- Sep 9 - wmf.22 - Antoine
- Sep 16 - wmf.23 - Mukunda
- Sep 23 - wmf.24 - Mukunda
- Sep 30 - wmf.25 - Tyler Dan
- 7 Oct - 1.35.0-wmf.1 - Tyler Dan
- 14 Oct - wmf.2 - Jeena + Lars
- 21 Oct - wmf.3 - Lars + Brennen
- 28 Oct - wmf.4 - Brennen + Mukunda
- 4 Nov - wmf.5 - Mukunda + Antoine
- 11 Nov - wmf.6 - No Train (Tech conf)
- 18 Nov - wmf.7 - No Train (Off site)
- 25 Nov - wmf.8 - Antoine + Jeena (Thanksgiving)
- 2 Dec - wmf.9 -
- 9 Dec - wmf.10 -
- 16 Dec - wmf.11 -
- 23 Dec - wmf.12 - No Train (Winterval)
- 30 Dec - wmf.13 - No Train (Still Winterval)
- 6 Jan - wmf.14 -
- 13 Jan - wmf.15 -
SoS
edit- Aug 14 onward: Zeljko
Team Business
editTimespent spreadsheet
edit- For the avoidance of doubt: fill out the sheet week number for the previous week
- spreadsheet for week 41 (2019-10-02): https://docs.google.com/spreadsheets/d/1YS_2eUQWUOnygshMfxgGPu93GKGCO5t00yjUREQ5B-I/edit#gid=1568068962
- reminder: your time spent doesn't need to total to 100%
Clinic Duty Proposal
editNovember Offsite/Summit
edit- TechConf19: November 12–15
- Offsite: November 16–20
- Arrive the 15th
- 16th is our fun day/outing
- 17–20 are working days
- 21st fly home
- https://etherpad.wikimedia.org/p/EngProdTeam-Offsite-2019-11-planning
Book club
edit- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
- Good discussion! https://etherpad.wikimedia.org/p/releng-book-club
Monthly reflection on accomplishments - September '19 edition
edit- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- Add as you have them!
October
edit- Dev images are now automatically created as part of postmerge via the pipeline for:
- Parsoid
- Soon: RestBASE
- Selenium documentation updated https://www.mediawiki.org/wiki/Selenium/Node.js
- Quibble 0.0.36 released https://lists.wikimedia.org/pipermail/wikitech-l/2019-October/092658.html
- Quibble 0.0.37 released https://lists.wikimedia.org/pipermail/wikitech-l/2019-October/092660.html
- Quibble 0.0.38 released
- Introducing Phatality - Streamlined error reporting from Kibana to Phabricator https://phabricator.wikimedia.org/phame/post/view/177/introducing_phatality/
- HHVM removed from CI and MediaWiki.
Incoming/Needs attention
edit- Decision on FR-Tech code freeze – they say it's our call, not theirs?!
Strine: Decision is with RelEng now Strine doesn't think that anyone is blocked from deploying Erika: No code freeze on anything but payment processor & Central Notice — code freeze for FR Tech Peter: informal suggestions, don't make massive changes to Mediawiki TODO: Check with RelEng - so far, only between Dec 25 - Jan 1 ACTION: Tyler to send note to wikitech-l.
Scrum of Scrums for next week
editInternal team notes, not for pasting into the SoS notes
editIncoming from last week (aka this morning)
editOutgoing next week
edit- Blocked:
- Blocking:
- Updates:
- v3 of CI arch document for new CI wants review and feedback https://www.mediawiki.org/wiki/User:LarsWirzenius/NewCI
- Train Health
- Last week: 1.35.0-wmf.2 - phab:T233850
- This week: 1.35.0-wmf.3 - phab:T233851
- Next week: 1.35.0-wmf.4 - phab:T233852
Callouts
editTrain status and happenings
editOKRs, Goals, Betterworks, Oh my!
edit<3 everyone! Pulled out ones that had dates for this quarter: https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2019-20_Q2#Release_Engineering
Standup!
edit- Make sure your tasks are correct on our kanban board!
Antoine
edit- What I planned vs did last week
- Biterg.io bot back in action, might load Gerrit master. Replica does not offer "gerrit query" command :/
- Jenkins CI plugins cleanup
- Prepared TechConf
- Distracted by too many things :-\ --redacted--
- What I plan to do this week
- (LATE) More extraction of Selenium to standalone jobs ( https://phabricator.wikimedia.org/T232759 )
- What I'm blocked on
- (E_OVERFLOW) Need full integration test for Quibble (namely actually run it on each patchset proposals)
- Stretch VM are slower than the Jessie ones https://phabricator.wikimedia.org/T232706
- Some cloudvirt are too slow (T225713 / T223971), needs BIOS change.
- For Gerrit we need a JMX Prometheus exporter to monitor the JVM https://phabricator.wikimedia.org/T184086
- thcipriani: has been on my backlog a long time :( -- this is something for after gerrit1001 migration
- Other?
- Logstash on beta is still broken https://phabricator.wikimedia.org/T233134
- contint1001 has lot of dangling Docker images. Cleaned 47GBytes of them today (Oct 9th)
Brennen
edit- What I planned vs did last week
- Done OKRs / Betterworks
- Not done (but soon!) GPG
- In progress Dev environment hackery
- Done Input/voting on tech conf sessions
- Done A massive distraction: Bought a house
- Unplanned:
- TimedMediaHandler scoping conversation - we're gonna do that by end-of-year
- Read over Seakeeper proposal doc
- Upgraded to Debian Buster
- Harrassment training
- What I plan to do this week
- Dev environment hackery
- Make sure local-charts install script works from scratch on buster
- Further TechConf input, CI session planning
- Steel myself for next week's train
- What I'm blocked on
- Other?
Dan
edit- What I planned vs did last week
- Done (planned) Deploy 1.35.0-wmf.1
- In progress (planned) Work on Seakeeper doc
- Done (unplanned) Investigate and help with Kartotherian pipeline issues
- .pipeline/config.yaml issues were solved but this repo is bananas so I gave up trying to better their blubber.yaml
- Not sure to what extend we'll have to support edge cases like these
- What I plan to do this week
- Finish Seakeeper doc
- Needs resource estimates and breakdown of K8s namespaces
- Review Mukunda's branch.py patch
- Finish Seakeeper doc
- What I'm blocked on
- Other?
Greg
edit- What I planned vs did last week
- What I plan to do this week
- What I'm blocked on
- Other?
James
edit- What I planned vs did last week
- Partially done More static configuration progress; delayed. Will talk with Krinkle in person next week.
- Done PHP72 / PHPUnit8 work continued; MW now actually enforces 7.2+.
- Done 1.34.0-rc.0 support.
- Done TechConf session scope/direction input.
- Done UBNs as they arise.
- What I plan to do this week
- OOUI migration to node 10 / PHP72
- Fundraising Tech CRM image to PHP70 (could do with input from Antoine) https://gerrit.wikimedia.org/r/c/integration/config/+/540683 for https://phabricator.wikimedia.org/T230446
- More static configuration work, a bit delayed.
- More TechConf thinking/planning.
- UBNs as they arise.
- What I'm blocked on
- Concerns from Krinkle re. static config work.
- Other?
- I'm flying to London this weekend and will be working from there for Mon–Weds, if you need me.
- Thu–Sun, will be at WikiDataCon 2019 in Berlin.
Jean-Rene
edit- What I planned vs did last week
- OKRs completed for me and Quality and Test Engineering team
- What I plan to do this week
- Quality and Test Engineering team roadmaping/learning.
- Code Review WG - setting up engineering team interviews
- Code Health Metrics WG - setting up feedback sessions
- What I'm blocked on
- Other?
Jeena
edit- What I planned vs did last week
- Done meetings
- ((not done}} timespent spreadsheet
- Done Explore what's needed for new php parsoid service in terms of local-charts/deployment-charts
- Done OKRs
- Not done work with zeljko on getting local-charts running
- Done book club
- Done tech conf voting
- Not done look at seakeeper proposal
- Not done work on some other local dev poc
- start updating restrouter deployment-charts config for dev purposes
- What I plan to do this week
- timespent spreadsheet
- work with zeljko on getting local-charts running - Željko: feel free to pospond until you're done with train
- look at seakeeper proposal
- train
- update restrouter deployment-charts config for dev purposes
- What I'm blocked on
- Other?
Lars
edit- What I planned vs did last week
- In progress Seek feedback on v3 of CI arch doc, after minor updates.
- Not done Set up Argo in a K8s cluster somewhere.
- Not done Update engprod list on PGP keysigning at offsite.
- Done Book club.
- In progress Talk with people going to TechConf about new CI.
- What I plan to do this week
- Help Jeena with train.
- Seek feedback on v3 of CI arch doc, after minor updates.
- Set up Argo in a K8s cluster somewhere.
- Update engprod list on PGP keysigning at offsite.
- What I'm blocked on
- Lack of sunlight
- Other?
Mukunda
edit- What I planned vs did last week
- Not done Phatality Deployment, not really urgent but I need to do it to confirm that all the deployment issues are resolved.
- sort-of Done Phabricator Deployment - used the deployment window to get `phab1001` set up and deployed with scap
- Done Work on Phabricator migrations and disaster recovery stuff
- Done Come up with some 1 topic for the focused patch triage (action item for code review working group)
- Unplanned
- Random tech support for phabricator and gerrit stuff
- Started trying to learn emacs + org mode. So far I'm completely lost. (thcipriani: feel free to reach out about this one -- <3 org-mode)
- What I plan to do this week
- Finish getting branch.py ready for the wmf production branching (WIP: https://gerrit.wikimedia.org/r/#/c/mediawiki/tools/release/+/543248/ )
- Try to build some tests for branch.py
- More work on phabricator high-availability & disaster recovery planning.
- phab1001 should be ready to become the primary server now.
- Test out phabricator's built-in search engine with an eye toward dropping elasticsearch if the integrated search performs as well.
- Finish getting branch.py ready for the wmf production branching (WIP: https://gerrit.wikimedia.org/r/#/c/mediawiki/tools/release/+/543248/ )
- What I'm blocked on
- Other?
Tyler
edit- What I planned vs did last week
- Done (ish) connect with SRE re New CI
- Done Set date for Gerrit move to new server
- Done OKR...fiddling https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2019-20_Q2#Release_Engineering
- What I plan to do this week
- connect with SRE re New CI (again)
- Reach out to folks about being on Sr. SWE interview loop
- announce dec code freeze
- tuning session prep
- What I'm blocked on
- Other?
Zeljko
edit- What I planned vs did last week
- Done Stare at SafeGuard Letter. For hours. Then, sign it.
- In progress T199113 All repositories with Selenium tests should use wdio-mediawiki
- In progress T234610 ERROR webdriver: Request failed due to Error: session not created: Chrome version must be between 70 and 73
- Not done T232638 Add accessibility check for Homepage
- Done T234085 WMTC19: Themes/Focus Areas Proposals
- Done T234088 Theme: Testing
- Done T234635 Wikimedia Technical Conference 2019 Session: System level testing: patterns and anti-patterns with Selenium
- Done T234088 Theme: Testing
- not planned
- WebCamp conferece
- What I plan to do this week
- T234610 ERROR webdriver: Request failed due to Error: session not created: Chrome version must be between 70 and 73
- T199113 All repositories with Selenium tests should use wdio-mediawiki
- What I'm blocked on
- Other?
- Survived half marathon! 🏃♂️
- Got bass guitar for birthday! 🎸
- Installed macos 10.15 on a laptop, fun times with zsh