Wikimedia Release Engineering Team/Checkin archive/20161121

2016-11-21

Vacations/Important dates

How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

• November 24+25: US Holiday (Thanksgiving)
• Nov 30: Tyler: eye appointment 1:45pm -- may be useless afterwords (antoine: eyes are definitely useful, keep them)
• Dec ~23 - ~ Jan 03: Antoine (yearly trip around the country for familly events)
• December 26: Željko Holiday (St Stephen's Day)
• December 26-30: XMas Holiday
• January 2nd: New Year's Day (observed)
• January 6: Željko Holiday (Epiphany)
• January 9-11: Dev Summit
• January 12-13: All Hands
• January 16: MLK Jr Day
• February 20: President's Day
• March 13: New day off for some reason
• April 14: New day off for some reason

Team Business

Time spent spreadsheet

• week 46: https://docs.google.com/spreadsheets/d/1YMflnOBggixLV-Ra0L6P7vxgUkR6sFik6Aas1y3Zsxg/edit#gid=2089891014

Rotating positions and absences

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Oct 31 and Nov 7

• Train: Mukunda
  • wmf.1
    • Tues:Tyler, Wed/Thurs:Mukunda
  • wmf.2
    • just Mukunda
• SoS: Dan
  • https://phabricator.wikimedia.org/E155/29
  • https://phabricator.wikimedia.org/E155/30
• Out:
  • October 31: Mukunda + Antoine
  • November 1: Antoine (France holiday: all-saints)
  • November 4: Mukunda
  • November 11: Antoine

Nov 14 and Nov 21

• Train: Tyler
  • wmf.3
  • no wmf.4 this week, Thanksgiving
• SoS: Mukunda
  • https://phabricator.wikimedia.org/E155/34
  • https://phabricator.wikimedia.org/E155/35
• Out:
• November 18: Greg in Seattle at RELENG Conference/workshop - http://releng.polymtl.ca/RELENG2016/html/index.html
• November 24+25: US Holiday (Thanksgiving)
  • Antoine working as usual

Nov 28 and Dec 5

• Train: Chad
  • [ wmf.4]
  • [ wmf.5]
• SoS: Tyler
  • https://phabricator.wikimedia.org/E155/33
  • https://phabricator.wikimedia.org/E155/34
• Out:
  • none

Dec 12 and Dec 19

• Train: Mukunda
  • [ wmf.6]
  • no train/deploys week of Dec 19
• SoS: Chad
  • https://phabricator.wikimedia.org/E155/35
  • https://phabricator.wikimedia.org/E155/36
• Out:
  • none?

Dec 26 and Jan 2

• Train:
  • No train/deploys week of Dec 26
  • [ wmf.7]
• SoS:
  • https://phabricator.wikimedia.org/E155/37
  • https://phabricator.wikimedia.org/E155/38
• Out:
  • Week of Dec 26th: Everyone
  • Jan 2nd: New Year's Day observed

Actions from last meeting

• [Who?] Audit if any other projects than MW+Ext use gating
  • https://phabricator.wikimedia.org/T150701
• Greg needs to make a timeline for some of the action items

Scrum of Scrums

https://phabricator.wikimedia.org/project/board/64/

Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

• Blocking
• Blocked
• Updates
  • 1.28 this week!

Last week

• Blocking
• Blocked
• Updates
  • 1.28 rc.1 this week (for realz)
  • Phabricator update this week (Wednesday) with Calendar improvements (in support of DevSummit)

Other Team Business

QA Hire

• continuing to do HM screens
• setting up interviews with the rest of the loop

Offsite

• Greg needs to make a timeline for some of the action items

Q2 goal/project check-in

Future of CI plan

Determine future composition of the CI infrastructure with a plan on how to get there without disrupting expected services and performance.

• Meeting scheduled with Mark, Faidon, Chase, Antione, Dan, Tyler, and Greg for December 8th.

• Tangentially related: CI staging + contint2001 are things
  • Would like to spend some time this week getting CI-Staging project setup -- allows me (tyler) to help with contint2001 more

• Experimental Docker based instance up and running
  • Need help on figuring out NPM (and other package) caching

Migrate MediaWiki deploys to scap3 (part 1)

Use a unified git repo for MW deploys

• Bug with scap 3.3.1 (old unused feature) found in beta.
• Will probably land fixes, bump version, and finally get a new version (3.4.0 -- as antoine pointed out)
• Want to land Flatten MedaWiki deploy into a single git repo this week
  • Watch on beta cluster over the holiday
  • cut new release and push to production after

Assess new directory structure and how it will interplay with MW

Interplay with MW should be minimal at this point.

When we move to either:

• git transport
• rsync of the .git directory

Space becomes a concern; however, git already optimizes for this use-case; it would take a lot of changes before the space impact becomes untenable.

History outweighs the benefits.

Stretch goal: Replace rsync with git syncing

Nope. not this quarter.

Release MediaWiki 1.28

• almost....

Non-Quarterly goal work

Browser tests

• Announced new Selenium documentation (https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/087051.html)
• Contiuing work on the documentation and example code

Phabricator

• Upgrade finally happened. Lots of bugs got fixed, new ones introduced, then hotfixed.

DB Inconsistencies

https://phabricator.wikimedia.org/T132416 and https://phabricator.wikimedia.org/T104459 (see also: https://www.mediawiki.org/wiki/Development_policy#Database_patches )

People status updates

Antoine

Last week

• Ploticus/EasyTimeline log spam + font not showing on ZH wiki
  • Patches prepared/tested to be deployed
• Nodepool quota bump to happen (hopefully) + move PHP jobs to it
  • Agreed. Have to push the button
• Jenkins 2.x testing??
  • New production Jenkins
  • Staging platform in labs
• Assist Docker experiment
• Clone mw/core for the job running against operations/mediawiki-config (for dcausse/Erik B)

This week

• (week-end project) ElasticSearch/Kibana on CI for build logs
• Ploticus/EasyTimeline this weeek
• Nodepool quota to be bumped early this week. Labs needed clarifications.
• Clone mw/core for the job running against operations/mediawiki-config (for dcausse/Erik B)

Chad

Last week

• More security mess
• rc.1

This week

• 1.28!

Dan

Last week

• Continue hacking on proof of concept integration/docker instance(?)
• Improve scap target failure tolerance

Mukunda

Last week

• Phabricator update introduced several new bugs which I had to spend a lot of time hotfixing
• Quick UI demo of what I've been working on for scap: https://asciinema.org/a/93543
• Privilege separation ( https://phabricator.wikimedia.org/T146055 ) turned out to be a big pain, as security often is.
  • Caused various problems, such as:
  • https://phabricator.wikimedia.org/T151148
  • https://phabricator.wikimedia.org/T151059

This week

• Continue working on phabricator privilege separation: https://phabricator.wikimedia.org/T146055
• Help with scap release as needed
• Scrum of scrums
• eat food with family
• sleep?

Tyler

Last week

• Scap 3.3.1-1 out the door
• Train
• assemble 3.4.0

This week

• Line up next 2 scap releases
• CI staging

Željko

Last week

• T108108 Improve documentation around running/writing (with lots of examples) browser tests
• pairing with Rummana on Node.js+Selenium tests for VisualEditor
• pairing with Elena on Ruby+Rspec tests for Echo API
• Senior QA Analyst hiring

This week

• T108108 Improve documentation around running/writing (with lots of examples) browser tests
• pairing with Rummana on Node.js+Selenium tests for VisualEditor
• pairing with Elena on Ruby+Rspec tests for Echo API
• Senior QA Analyst hiring