Wikimedia Release Engineering Team/Checkin archive/20170410

2017-04-10

Vacations/Important dates

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List

How to do it

• April 10-13: Dan out
• April 14: Monthly day off
• April 13 and April 16th: Antoine travel - work on Friday 14th
• April 17: Željko local holiday (Easter Monday)
• April 19-21: Željko vacation
• April 27-29th: Antoine in Amsterdam (unreacheable)
• May 15-18: Team Offsite in Vienna
• May 19-21: EU Hackathon
• July 10-14th: Tyler adventure time

Team Business

Time spent spreadsheet

• week 14: https://docs.google.com/spreadsheets/d/1OZzvtlc116UIsFFbic1zX34LXgAJddPTXMGVE6uMsJw/edit#gid=1831444635

Rotating positions and absences

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Mar 20 and Mar 27

• Train: Tyler (plus Chad for goup2 on March 30th)
  • wmf.17
  • wmf.18
• SoS: Chad
• Out:
  • March 23-28: Chad in Miami
  • March 30, 31: Tyler in Wichita
  • Thu March 30 - Mon Apr 3: Greg in Berlin (Wikimedia Conference)

Apr 3 and Apr 10

• Train: Chad
  • wmf.19
  • wmf.20
• SoS: JR
• Out:
  • April 10-17: Dan
  • April 13 and April 16th: Antoine travel
  • April 14 (Friday): US Staff holiday

April 17 and Apr 24

• Train: Mukunda
  • [ wmf.21]
  • [ wmf.22]
• SoS: Tyler
• Out:

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

• Blocking
• Blocked
• Updates

Last week

• Blocking
• Blocked
  • May need Ops help deploying 3d2png via scap3 (worked on Beta Cluster), need some +2 in puppet
• Updates

Other Team Business

Annual Planning

https://office.wikimedia.org/wiki/User:Kbrown_%28WMF%29/Programs/Technology

Logspam

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

• Email from Jon R

Q4 goal/project check-in

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201617Q4

Streamlined Services Delivery

Build a runnable image from tested and confirmed code that is suitable for promotion.

define 'tested and confirmed' / determine the entry-point for building a container

generate or consume a docker file for building

build image, upload and tag it in docker registry

• Tyler to make some tasks in the workboard
• Shared cross-team meeting, goal is still to push to the shared registry
• JR talking with Marko and Alex re requirements: https://docs.google.com/spreadsheets/d/1igbl7X-u0joRwwTBHwrBcX1mRtLYr3yJ8XoD7Zv_PKQ/edit?ts=58e51f2c#gid=0

Train 2.0

Move MW+Extension deploys to scap3 - task T114313 (part 3)

Integrate scap with etcd/pybal to automatically depool and repool servers - task T104352

Release MediaWiki 1.29

A quality MediaWiki 1.29 is successfully released - task T153271

Non-Quarterly goal work

Phabricator

• Phabricator search now highlights results
  • Announcement to wikitech-l: https://lists.wikimedia.org/pipermail/wikitech-l/2017-April/087905.html

Browser tests

• T139740 Port Selenium tests from Ruby to Node.js
  • Jenkins jobs for mediawiki/core ready to be merged and deployed https://gerrit.wikimedia.org/r/#/c/324719/

• Math and mobile web teams interested, patches are being created
  • T162256 Port Selenium tests from Ruby to Node.js on Reading Web extensions
  • T162455 WebdriverIO tests for Math

• a volunteer wants to help out (an outreach project?)
  • T69141 audit/update headers in files
  • T94001 Ruby gem documentation should state license

• Somebody asked for another run of language screenshots, some problems, should be easy to fix
  • T162454 LanguageScreenshotBot fails with `Error: timeout of 40000ms exceeded. Ensure the done() callback is being called in this test.`

People status updates

Antoine

Last week

• Schedule Jenkins upgrade early next week during European morning
• CI instances out of RAM when running Wikibase
  • TLDR: https://phabricator.wikimedia.org/T125050#3153282 PHPUnit uses ~2GB ram and fork() fails due to not enough memory (instance only has 1.5G free and linux refuses to fork)
    • Fixed via Kernel setting vm.overcommit_memory=1
• merge some jobs (eg for extensions: composer test + phpunit -- qunit + npm)
• cache npm install

This week

• Redis "could not connect" log spam with Elukey
• POC for caching npm install
• hide chocolates in garden

Chad

Last week

• scap
• train
• security release

Dan

Last week

• Take a closer look at build config specification
  • Possibly start building PoC command-line tool that converts to Dockerfile

This week

• Time off

JR

Last week

• quality interview
  • Talking to a couple for folks this week
  • writing up report out.
• bug/defect data wrangling
• test results data wrangling
• CI Pipeline requirements
  • Consolidating Ops/RelEng/Services requirements

This week

• quality interview
  • complete write up
• CI Pipeline requirements
  • roll in Ops req
  • start review with team
• bug/defect data wrangling

Mukunda

Last week

• Deploy snippets / highlighting
  • Done
• Further work upstream
• Polish `scap tag` for creating template-based phabricator milestones from the CLI
  • This is working well now
• Evaluate the contributed "Release" app for phabricator (this is a thing that might replace Releeph, for cutting release branches in phabricator...)
  • This didn't happen
  • This is a series of patches from https://secure.phabricator.com/p/avivey/ which is mostly finished but not really well integrated yet
  • I got some tips from avivey about how to try it out locally
  • The patches:
    • https://secure.phabricator.com/D16981
    • https://secure.phabricator.com/D17020
    • https://secure.phabricator.com/D17004

This week

• Fix bugs
• Help chad with pybal stuff?
• From last week
  • Evaluate the contributed "Release" app for phabricator (this is a thing that might replace Releeph, for cutting release branches in phabricator...)
• Maybe work on more custom search results UI... maybe
• ????
• Profit

Tyler

Last week

• 3d2png helping
• RESTBase helping
• Push built images to ci-staging docker registry
• wrap service-runner docker generation in groovy? Maybe...will look

This week

• Datacenter switchover scap deployment host -- need to make sure it's global only
• Push built images to ci-staging
• php55 lint -> docker (maybe)

Željko

Last week

• T69141 audit/update headers in files
• T94001 Ruby gem documentation should state license
• T161603 Provisioning MediaWiki Vagrant VisualEditor role does not result in working VisualEditor
• T162454 LanguageScreenshotBot fails with `Error: timeout of 40000ms exceeded. Ensure the done() callback is being called in this test.`
• T162455 WebdriverIO tests for Math
• T139740 Port Selenium tests from Ruby to Node.js

This week

• T139740 Port Selenium tests from Ruby to Node.js
• T162256 Port Selenium tests from Ruby to Node.js on Reading Web extensions
• T162454 LanguageScreenshotBot fails with `Error: timeout of 40000ms exceeded. Ensure the done() callback is being called in this test.`