Wikimedia Release Engineering Team/Checkin archive/20170123

2017-01-23

Vacations/Important dates

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List

How to do it

• Jan 26-27: Chad, maybe
• February 20: President's Day
• March 13: Monthly day off
• April 14: Monthly day off

Team Business

Time spent spreadsheet

• week 3: https://docs.google.com/spreadsheets/d/1OZzvtlc116UIsFFbic1zX34LXgAJddPTXMGVE6uMsJw/edit#gid=255161607

Rotating positions and absences

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Jan 23 and Jan 30

• Train: Mukunda
  • wmf.9
  • wmf.10
• SoS: Dan
• Out:
  • Chad: 1/26-27, maybe

Feb 6 and Feb 13

• Train: Tyler
  • wmf.11
  • wmf.12
• SoS: Chad
• Out:
  • ...

Actions from last meeting

• Greg: reply to martin

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

• Blocking
• Blocked
• Updates
  • scap 3.5 planned for this week

Last week

• Blocking
• Blocked
• Updates
  • Train/deploys back to normal

Other Team Business

Volunteer deployers ?

• Add more Volunteers? Is there any specific policy. Directed one at Greg.
  • https://wikitech.wikimedia.org/wiki/SWAT_deploys#New_SWAT_Team_member_check-list
    • Need trust, technical endorsement (eg approve kabal of deployers). Directed to Greg for questions.
• Greg hasn't responded yet :/
• TODO: Greg to email Martin

Mid-year check-in

• Next week...

Quarterly Review

• Friday at 8am... ugh. Greg'll go. No one else needs to.
• https://docs.google.com/presentation/d/1V6H_ebe0WTQey4AsivgF7j7BrsEnX6ystKgSa7wO_eA/edit#slide=id.g1b66bc6307_0_90

Annual Planning

• https://etherpad.wikimedia.org/p/releng-annual-intention-fy1718
• From Marko: https://docs.google.com/a/wikimedia.org/document/d/1aa6uO9uqEhe5lNetmluIgBDh3JVAQ4GTbw-jOc-qu9M/edit?usp=sharing

Q3 goal/project check-in

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201617Q3

Continuous Integration Infrastructure modernization

Gather requirements for new CI system - task T153270

• Tyler will schedule stalk people
  • Status?

• Want a preliminary meeting with dan/hashar to get on same page before bringing in others (had a brief one with dan)
  • Tuesday 9am-9:30am pst?
• ^ works for marko and giuseppe (other folks targetted for meeting); cuts it close for hashar
• purpose: preliminary requirements, scope, initial POC targets
• short: 30mins
• There is a workboard now: https://phabricator.wikimedia.org/project/view/2453/
  • Just getting started

Migrate MediaWiki deploys to scap3 (part 2 — This time, it's personal; A.K.A Scappy Strikes Back)

Build fanout support in scap3

https://phabricator.wikimedia.org/T121276

3.5.0 -- this week! On beta

Changelog

MediaWiki

• sync-dir and sync-file are now the same command
  • sync-dir is deprecated
• l10n-purge is no longer a command
• Flatten the deployment directory into a single git repository (prep for git sync)
  • /srv/mediawiki-staging is many git repos
  • /srv/medaiwiki is one git repo
• Canaries now use explicit service for logstash_checker.py (checks fatals too)
• old proxies and canaries (not in mw-installation) ignored
• Fix for git-cache-info (sha1 regex)

Services/Scap3

• (no message) -> (no justification)
• Improved rollback behavior
  • all groups rolled back
  • per group and global failure limit
  • skip rollback where host failed due to ssh

General/Fun

• optional fancy progress bar
• improved cowsay compatibility for scap say

Phabricator

Re-evaluate and improve search functionality in Phabricator - task T146843

• Making good progress on ElasticSearch query optimization. I have a working prototype and I hope to deploy that this week for testing.

Non-Quarterly goal work

Browser tests

• T155640 selenium-Core Jenkins job failing
  • fixed
• T155794 Browser test Jenkins videos are corrupt
  • low prio
• T139740 Port Selenium tests from Ruby to Node.js
  • looked into credential storage libraries

People status updates

Antoine

Last week

• rspec puppet polish up
• run qunit/phpunit for MediaWiki release tarballs (WIP) https://integration.wikimedia.org/ci/job/mediawiki-releases/
  • + related mw ext fix
• clean up of Gerrit changes

This week

• contint2001
• doc for rspec puppet
• finish MediaWiki (tarball) releases test job https://integration.wikimedia.org/ci/job/mediawiki-releases/
• get a bump of Nodepool pool

Chad

Last week

Train, multiversion cleanups, scap, gerrit

JR

Last week

QA Interview prep (question, people), Incident Review, Wramp-up cont...

This week

Identify first pass interviewees and schedule interviews, build knowledge re CI now and future, build knowledge of current QA/Test processes.

Mukunda

Last week

• Phabricator Phabricator Phabricator
• Optimized Phabricator's ElasticSearch query builder.

This week

• Deployment train, 1.29.0-wmf.9 / T154683
• Deploy ~2 months worth of phabricator updates.

Tyler

Last week

• Scap 3.5.0
• Setup some kind of requirements gather meeting for CI thangs.

This week

• scap 3.5.0
• Future of CI prep stuffs
• Git fat deployment?
• would like to poke at some puppet updates: scap/ci-staging

Željko

Last week

• jet lag
• T155640 selenium-Core Jenkins job failing
• T155794 Browser test Jenkins videos are corrupt

This week

• T139740 Port Selenium tests from Ruby to Node.js
• T152963 Increase in failures caused by Saucelabs
• T152432 Make it possible to execute tests as a specific (new) MediaWiki user on beta cluster