Wikimedia Release Engineering Team/Checkin archive/20151109

2015-11-09

Vacations/Confs/etc

How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• Nov 25: Greg - Half day (working that morning)
• Nov 26: US HOLIDAY - Thanksgiving
• Nov 27: US HOLIDAY - Day after Thanksgiving
• Dec 2?-Jan 0x - Antoine, no clue yet
• Dec 4th: Greg - disconnected, leaving Thursday evening, returning Sunday :)
• Dec 21-Jan 1: Greg - vacation, at least (maybe part of the week before)
• Dec 22-29: Chad - Christmas
• Dec 24-Jan 3: Dan - Holidays (probably)
• Dec 25: US HOLIDAY - Christmas Day - December 25
• Jan 1: US HOLIDAY - New Year's Day
• Jan 4 - 8: WikiDev16 + All Hands
• Jan 16-18: Chad - another music festival
• Jan 18: US HOLIDAY - Martin Luther King Day
• Feb 15: US HOLIDAY - President's Day
• May 30: US HOLIDAY - Memorial Day
• June-ish: Chad - EDC
• August: France holiday - because french. :)

Team Business

Actions from last meeting

• DONE - EVERYONE: please review Antoine's caching proposal! https://lists.wikimedia.org/pipermail/qa/2015-October/002414.html
  • Antoine gave an update. Following discussion with Greg and Zeljo: will just do it based on rsync and a central server. Quick and dirty with race conditions but we can follow up later.
• DONE - Mukunda: Get bd808+legoktm on Differential - https://phabricator.wikimedia.org/T117293
• IN PROGRESS - Chad: re 1.26 release: "Going to push on all the assigned ones and find assignees for the remainder this week."
  • Dan to continue to bring up in SoS
• TODO - Greg: re KPIs, do mw core gate-processing time for this quarter, reassess for next quarter if needed
• TODO - No One Yet: investigate carbon aggregation of stats >1 month old behavior
  • ACTION: Antoine to create a task

WIkiDev16

• Code Review RFC - https://phabricator.wikimedia.org/T114320
• Scap3 - https://phabricator.wikimedia.org/T114045
  • Moved to "on-track" (thanks Dan!) https://phabricator.wikimedia.org/T114045

Other

• Any vetoes to spending an extra half week in SF after all-hands?
  • Specifically: Mukunda, Zeljko (already said OK), and Tyler (Antoine's

  not coming at all :-( :-(  )

• • ACTION: Chad to investigate some place to hack other than the WMF office

• Hate to say it: time to talk Q3 ;)
  • https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201516Q3

Staging

• Let's not do this
• Explore the idea: https://phabricator.wikimedia.org/T115497 Survey on needs related to Beta Cluster/Staging
• Roll the ideas from staging into beta? Auto-provisioning, recent distros, puppet cleanup, etc?
• End goal: make sure problems in production are reproducible

• Moving target trying to keep up with ops
  • ACTION: schedule time with ops to discuss dedicated opsen to help plan/review/merge
    • Promote shared ownership of ops/puppet related to BC/Prod
    • Talk about practices around puppet manifests (improvements in envirinment neutrality, taking care of existing debt)

• Differential
  • Rfc on track for end of Q2/Dev Summit
  • Q3 will likely be spent responding to concerns, defining workflows, planning for migration
  • Will not be rolling out or performing any substantial migration

• QA Health Dashboard
  • What is the scope/purpose of this project?
    • One possibility is to show (us?) which projects are using which libraries/versions, data on unit/integration tests, coverage, etc.
    • API for querying this data would allow for ad hoc, more team specific dashboards

Example: https://www.mediawiki.org/wiki/User:Legoktm/ci http://raita.wmflabs.org/ ?

New vs Maint time spent

• https://docs.google.com/a/wikimedia.org/spreadsheets/d/1FI90AefwdLHGzVVdrLS6AxcTcJtLFyX0aQTQfyc88s4/edit

#together

• Team workboard: to triage: https://phabricator.wikimedia.org/project/board/20/query/TRiVy4zOMdR./
• Team workboard: only-in-#releng(ish): https://phabricator.wikimedia.org/project/sprint/board/20/query/g2T5.QSLJVRQ/

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

Project Updates

CI Scaling

https://phabricator.wikimedia.org/project/board/1010/

Quarterly Goal: "CI cluster responds to spike in queued builds by starting and registering additional jenkins slaves" - https://phabricator.wikimedia.org/T111106

• package cache, see above: Antoine to do a dirty rsync based system. Codename: CACHETTE
• Antoine 11/11th Jenkins security upgrade ... Need first ot upgrade our Jenkins to latest LTS. Then watch ann

Deployment Cabal

Main: https://phabricator.wikimedia.org/project/board/349/

Scap3: https://phabricator.wikimedia.org/project/board/1449/

Quarterly Goal: "Migrate all Service team owned services and MW deploys to scap3" - https://phabricator.wikimedia.org/T109926

• New documentation has been merging:
  • https://phabricator.wikimedia.org/D31
  • https://phabricator.wikimedia.org/D32
  • https://phabricator.wikimedia.org/D35
• Updates to doc-publishing in the absence of zuul
  • https://phabricator.wikimedia.org/T117770
  • up-to-date now: https://doc.wikimedia.org/mw-tools-scap/

Diff[usion|erential] migration

https://etherpad.wikimedia.org/p/diffuerential-weekly

Gitblit-Deprecate: https://phabricator.wikimedia.org/project/board/46/

Quarterly Goal: https://phabricator.wikimedia.org/T111465

Gerrit-Migration: https://phabricator.wikimedia.org/project/board/9/

(Greg can create some tasks for these if/as needed)

• Antoine + Mukunda should sit down and talk CI/Harbormaster/Nodepool
• Find some Differential Ambassadors for each vertical
  • bd808 for Reading

Release MediaWiki 1.26

https://phabricator.wikimedia.org/project/board/1177/

Beta Cluster

https://phabricator.wikimedia.org/project/board/497/?order=priority