Wikimedia Release Engineering Team/Checkin archive/20160314

2016-03-14

Vacations/Important dates

How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• March 11th - draft Q4 (April 1st - June 30th) goals due
• March 11th - Željko - conference
• March 14th - Antoine can't make it to weekly team meeting
• March 21st - All staff day off (thanks T&C!)
• March 25th Friday - Tyler
• March 28th - Antoine && Željko - local holiday (Easter Monday)
• March 31st - April 3rd : Hackathon in Israel
• April 1st - Q4 goals published
• April - Antoine: holidays one of the two first weeks
• May 6th Friday - Antoine
• May 9-Mid June-ish?: Greg - paternity leave - exact dates TBD
• May 17-(?): Dan - paternity leave :D
• Late May - draft Q1 (July 1st - Sept 30th) due
• May 30: US HOLIDAY - Memorial Day
• June 15-24: Chad - Vegas/EDC
• June 22nd - 28th : Wikimania in Italy
• July 1st - Q1 goals published
• July 1st – Annual Plan, Budget, Risks Document and FAQ are posted
• August: Antoine - France holiday - because french. :)
• January 2017 : Dev Summit + All Hands (presumably)

Team Business

Rotating positions

Train conductor

Week of ...

• Mar 14: Mukunda
• Mar 21: Tyler - Code freeze, due to the eqiad -> codfw switch over (announcement: Chad sending today)
  • So we need to make sure Mar 14th week is super stable.
• Mar 28: Tyler

Scrum of Scrums representative

(bad time for EU folks) Dan, Tyler, Chad, Mukunda Week of ...

• Mar 14: Chad
• Mar 21: Mukunda
• Mar 28: Mukunda

= CI point person

• reassess later

New vs Maint time spent

• Q3: https://docs.google.com/spreadsheets/d/1LJDc5W2Mlpzc0L1i7WyPwWU8AgWMn0fXRuNEEmg1EMU/edit#gid=0

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

• Puppet changes we need merged:
  • fix beta-mediawiki-config-update-eqiad - https://phabricator.wikimedia.org/T129427 - https://gerrit.wikimedia.org/r/#/c/276397/
  • fix intermittent MW job failure - https://phabricator.wikimedia.org/T126699 - https://gerrit.wikimedia.org/r/#/c/204528/
• Call out scap migration

Other Team Business

Other

• "Setup code review office hours" - https://phabricator.wikimedia.org/T128371
• Mukunda has office hours for phabricator on wednesday evening: https://calendar.google.com/calendar/selfsched?sstoken=UVB4N0h1QzhCbzJafGRlZmF1bHR8YmZmMWJkN2Y1MmUyMDNhMTc0YzJlMjE5OTk5ZWU2M2U

Q4 Goals

Moved to: https://etherpad.wikimedia.org/p/RelEng-1516Q4goals

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201516Q4

Q3 goal/project check-in

Reduce CI Wait time

KPI: https://grafana.wikimedia.org/dashboard/db/releng-kpis?panelId=2&fullscreen

• Migrate remaining CI jobs to Nodepool - task T119138

• php composer (Zend and HHVM) - task T119139
• as many miscellaneous jobs as possible - task T119140

• Migrate Jenkins to Jessie - task T124121

• Guillaume Lederrey (Discovery ops) introduced to Antoine https://en.wikipedia.org/wiki/SonarQube
  • He has setup a poc:http://sonarqube-poc.wmflabs.org/
  • Guillaume knows core developers
  • Antoine: that looks great, we wil inject some data to it. It has an ElasticSearch backend, maybe that can replace raita?

• Talked with ops Emanuele Rocca and Brandon Black about CI of the Varnish VCL
  • Sprinted a lame ruby/rake test wrapper https://gerrit.wikimedia.org/r/#/c/276733/ (far from ready)
  • Will probably need help from our favorite rubyists :-}

• Paladox is mass migrating extensions to npm entry points. Easy reviews!

Consolidate deploy tools

Migrate MediaWiki to scap3 - task T114313

Q2 Quarterly Goal hold over: Migrate all Service team owned services and MW deploys to scap3 - https://phabricator.wikimedia.org/T109926

• Basic git-fat support!
  • yay can move java crap now
• Bugs filed for all services
• Deprecration email sent (thanks chad!)
• Citoid patch (yay, thanks marko)
• still needed: timeline then figuring out where our pressue points will be along the way
• Officially add the suggested migration plan to the documentation (from Tyler's reply to Faidon on the librenms task)

T128892 Move scap3 service restart to it's own stage

Differential Migration

https://etherpad.wikimedia.org/p/diffuerential-weekly

Integrate Differential with our Continuous Integration infrastructure - task T31

Shepherd the RFC - task T119908

Garner early adopter projects (goal: 1 project per WMF "team")

• Improved Gerrit change-id field for diffusion: https://phabricator.wikimedia.org/T89939
• Git-only workflow now closer, but requires a local patch we need to maintain
• amending another person's diff without comandeering it (ie: mimicking how it happens in Gerrit)
  • just requires a one-line change in arc (so people need to clone from our arc repo to get it)
  • https://secure.phabricator.com/T10584
  • epriestley says "I filed T10584 to discuss this since I have some thoughts that aren't related to the technical approach. To briefly summarize the relevant bit from there, I don't want to add an option for this, but I don't have any technical objection to turning it into a prompt in all cases."

Other Work

Freaking job queue

• If you haven't gotten involved, don't touch this :P
  • It's a rabbit hole of pain

Browser tests

• Clean up of red tests:
  • https://integration.wikimedia.org/ci/view/BrowserTests/view/-Dashboard/
  • https://phabricator.wikimedia.org/T94150
  • VE-language screenshots job spamming right now, will get better
• self-serve CI config for jenkins jobs for browser tests: https://phabricator.wikimedia.org/T128190
  • just needs the initial job setup by us for each repo, then it's self-serve

Beta Cluster

• Krenair and SSL

For 3/22

• https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix  :)