Wikimedia Release Engineering Team/Checkin archive/20151109





How to do it:

  • Nov 25: Greg - Half day (working that morning)
  • Nov 26: US HOLIDAY - Thanksgiving
  • Nov 27: US HOLIDAY - Day after Thanksgiving
  • Dec 2?-Jan 0x - Antoine, no clue yet
  • Dec 4th: Greg - disconnected, leaving Thursday evening, returning Sunday :)
  • Dec 21-Jan 1: Greg - vacation, at least (maybe part of the week before)
  • Dec 22-29: Chad - Christmas
  • Dec 24-Jan 3: Dan - Holidays (probably)
  • Dec 25: US HOLIDAY - Christmas Day - December 25
  • Jan 1: US HOLIDAY - New Year's Day
  • Jan 4 - 8: WikiDev16 + All Hands
  • Jan 16-18: Chad - another music festival
  • Jan 18: US HOLIDAY - Martin Luther King Day
  • Feb 15: US HOLIDAY - President's Day
  • May 30: US HOLIDAY - Memorial Day
  • June-ish: Chad - EDC
  • August: France holiday - because french. :)

Team Business


Actions from last meeting

  • DONE - EVERYONE: please review Antoine's caching proposal!
    • Antoine gave an update. Following discussion with Greg and Zeljo: will just do it based on rsync and a central server. Quick and dirty with race conditions but we can follow up later.
  • DONE - Mukunda: Get bd808+legoktm on Differential -
  • IN PROGRESS - Chad: re 1.26 release: "Going to push on all the assigned ones and find assignees for the remainder this week."
    • Dan to continue to bring up in SoS
  • TODO - Greg: re KPIs, do mw core gate-processing time for this quarter, reassess for next quarter if needed
  • TODO - No One Yet: investigate carbon aggregation of stats >1 month old behavior
    • ACTION: Antoine to create a task




  • Any vetoes to spending an extra half week in SF after all-hands?
    • Specifically: Mukunda, Zeljko (already said OK), and Tyler (Antoine's
  not coming at all :-( :-(  )
    • ACTION: Chad to investigate some place to hack other than the WMF office
  • Let's not do this
  • Explore the idea: Survey on needs related to Beta Cluster/Staging
  • Roll the ideas from staging into beta? Auto-provisioning, recent distros, puppet cleanup, etc?
  • End goal: make sure problems in production are reproducible
  • Moving target trying to keep up with ops
    • ACTION: schedule time with ops to discuss dedicated opsen to help plan/review/merge
      • Promote shared ownership of ops/puppet related to BC/Prod
      • Talk about practices around puppet manifests (improvements in envirinment neutrality, taking care of existing debt)
  • Differential
    • Rfc on track for end of Q2/Dev Summit
    • Q3 will likely be spent responding to concerns, defining workflows, planning for migration
    • Will not be rolling out or performing any substantial migration
  • QA Health Dashboard
    • What is the scope/purpose of this project?
      • One possibility is to show (us?) which projects are using which libraries/versions, data on unit/integration tests, coverage, etc.
      • API for querying this data would allow for ad hoc, more team specific dashboards

Example: ?

New vs Maint time spent




Scrum of Scrums

Blocked on us:

Project Updates


CI Scaling

Quarterly Goal: "CI cluster responds to spike in queued builds by starting and registering additional jenkins slaves" -
  • package cache, see above: Antoine to do a dirty rsync based system. Codename: CACHETTE
  • Antoine 11/11th Jenkins security upgrade ... Need first ot upgrade our Jenkins to latest LTS. Then watch ann

Deployment Cabal

Quarterly Goal: "Migrate all Service team owned services and MW deploys to scap3" -

Diff[usion|erential] migration

Quarterly Goal:

(Greg can create some tasks for these if/as needed)

  • Antoine + Mukunda should sit down and talk CI/Harbormaster/Nodepool
  • Find some Differential Ambassadors for each vertical
    • bd808 for Reading

Release MediaWiki 1.26


Developer Tooling (MW-Vagrant, MW-Selenium, etc.)


Beta Cluster


Other Work