Wikimedia Release Engineering Team/Checkin archive/20151221

2015-12-21

Vacations/Confs/etc

How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• Dec 14-Jan 1: Greg - vacation (3 weeks, will be checking email)
• Dec 14: Mukunda sick
• Dec 22-29: Chad - Christmas (will be reachable by e-mail, will have laptop in case of emergencies)
• Dec 23–25, 28: Tyler — Hopeful, probable, Christmas in Kansas!
• Dec 24-Jan 3: Dan - Holidays
• Dec 24-30: Antoine - Holidays (bringing laptop - ring phone as needed)
• Dec 24: mukunda - holiday
• Dec 25: US HOLIDAY - Christmas Day - December 25
• Dec 28: mukunda - holiday
• Dec 31: mukunda - holiday
• Dec 24-25: Željko - holidays
• Dec 31-Jan 1: Željko - holidays
• Jan 1: US HOLIDAY - New Year's Day
• Jan 4 - 8: WikiDev16 + All Hands
• Jan 16-18: Chad - another music festival
• Jan 18: US HOLIDAY - Martin Luther King Day
• Feb 15: US HOLIDAY - President's Day
• May 17-(?): Dan - paternity leave :D
  • PO Box for pastries? - Antoine
• May 30: US HOLIDAY - Memorial Day
• June-ish: Chad - EDC
• August: France holiday - because french. :)

Team Business

Actions from last meeting

• TODO - No One Yet: investigate carbon aggregation of stats >1 month old behavior
  • ACTION: Antoine to create a task
    • • Overdue

WIkiDev16

• Code Review RFC - https://phabricator.wikimedia.org/T114320
• Scap3 - https://phabricator.wikimedia.org/T114045 :(
  • to discuss with individuals, rather than broadly

Q3 Goals

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201516Q3

• Goals timeline:
  • December 3: Group goal scoped and drafted on mediawiki.org for Technology team.
  • December 10: Group goal + all individual team *drafts completed* on mediawiki.org; discuss at Infra+Tech group and identify dependencies.
  • December 17: individual team goals + group goal *finalized* on mediawiki.org; discuss at Monthly Eng Staff.

• "Migrate Jenkins to Jessie"
  • Needs a task for it (please add to the wiki page)
  • commitment from those in our team who will help

• Dan will be in the Technology Group meetings and can communicate anything needed to/from them re-goals (or anything else)
  • Concerns/questions:
    • Are Technology Group meetings transparent? Can they be?

KPIs

https://grafana.wikimedia.org/dashboard/db/releng-kpis

• • Tyler to check on production errors and filing a task for investigating rise in averages over the past 3 or so days

New vs Maint time spent

• https://docs.google.com/a/wikimedia.org/spreadsheets/d/1FI90AefwdLHGzVVdrLS6AxcTcJtLFyX0aQTQfyc88s4/edit

#together

• Team workboard: to triage: https://phabricator.wikimedia.org/project/board/20/query/TRiVy4zOMdR./
• Team workboard: only-in-#releng(ish): https://phabricator.wikimedia.org/project/sprint/board/20/query/g2T5.QSLJVRQ/

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

Project Updates

CI Scaling

https://phabricator.wikimedia.org/project/board/1010/

Quarterly Goal: "CI cluster responds to spike in queued builds by starting and registering additional jenkins slaves" - https://phabricator.wikimedia.org/T111106

• TMPDIR can not be deleted by jenkins-deploy user because they are owned by www-data
  • Fix/workaround implemented (delete TMPDIR contents instead of directory during cleanup; maintains jenkins ownership)
  • Should be fixed by leaving the dir behind and only deleting files. This way dir still owned by jenkins-deploy ( https://phabricator.wikimedia.org/T120824 )
• Precise to be phased out. Need to migrate everything off of gallium (Zuul scheduler, Jenkins master which need puppetization, doc.wm.o ...)
• npm migration to Nodepool not going to happen this quarter. Antoine spend too much time on maintenance tasks / other stuff.

• Zelko finished migration to mediawiki_selenium to 1.6.x. Pending merges / CirrusSearch.

Deployment Tooling / Scap3

Main: https://phabricator.wikimedia.org/project/board/349/

Scap3: https://phabricator.wikimedia.org/project/board/1449/

Quarterly Goal: "Migrate all Service team owned services and MW deploys to scap3" - https://phabricator.wikimedia.org/T109926

• Event bus being deployed to production using scap3(!)
• New command for checking whether security patches are applied
  • based on git apply-patch—reverse
• Pybal/conftool/etcd work for beta cluster
• Puppet resource for scap

Diff[usion|erential] migration

https://etherpad.wikimedia.org/p/diffuerential-weekly

Gitblit-Deprecate: https://phabricator.wikimedia.org/project/board/46/

Quarterly Goal: https://phabricator.wikimedia.org/T111465

Gerrit-Migration: https://phabricator.wikimedia.org/project/board/9/

• Redirect work continuing
  • Biggest challenge ATM is to map Gerrit project name to Diff callsign

Other Work

• Zeljko finished migrating browser-test projects to MW-Selenium 1.x!!!!