Scrum of scrums/2016-05-04

2016-05-04

Technology

Release Engineering

For all:

• T128190 - Migration of browser tests Jenkins jobs to selenium jobs

• • The migration of browsertests* to selenium* is almost complete, however, Željko needs people to claim their failing browser tests. See the task for more information.
    • The task has a table, but it's not clear what you want people to do (are you just asking about the rows with missing "contact from browsertests.yaml" fields)?

For operations:

• T126594 - Disable HHVM fcgi server on CI slaves
• Need help from ops to review and merge these two patches (we dont need HHVM running as a daemon on CI boxes):
  • https://gerrit.wikimedia.org/r/#/c/269946/
  • https://gerrit.wikimedia.org/r/#/c/269947/

• https://phabricator.wikimedia.org/T133911 - Bump quota of Nodepool instances (contintcloud tenant)
  • More instances needed. Clarified with Chase last week: pending Andrew. No urgency.

• Two related tasks, each have patches that are needed to streamline the scap3 migration:
  • T133211 - Automate the generation deployment keys (keyholder-managed ssh keys)
    • https://gerrit.wikimedia.org/r/#/c/284418/
  • T132747 - scap::target shouldn't allow users to redefine the user's key
    • https://gerrit.wikimedia.org/r/#/c/285519/

Security

• Reviews:
  • json-schema done, AuthManger done (no more comments, a few minor things before all patches are +1'ed)
  • Starting on T129584 this week
• Starting work on AuthService next week (heads up to Services, we'll probably be scheduling a few meetings with you) (Marko: ack && yay!)
• Ops: ping again on T128819

Services

(Marko cannot attend today, sorry)

• RESTBase
  • working on storing all auth checks locally (now we are calling the MW API every time)
• EventBus / Change propagation
  • started using it in production for the summary endpoint today
  • more dependency updates to follow soon
• Cassandra move to 2.2.6 soon
  • first up: maps cluster
• use Scap3 - https://lists.wikimedia.org/pipermail/wikitech-l/2016-April/085299.html

Technical Operations

• Blocking:
  • none
• Blocked:
  • none
• Updates:
  • May 15 (Chrome SPDY removal deadline). Getting HTTP/2 working fully deployed till then
  • started using letsencrypt for various small services

Product

Reading

• Most of Reading engineering is at an offsite today, I believe.

Reading Infrastructure

• AuthManager core patches are just waiting for security +1s. Work is ongoing on extensions; CentralAuth, LdapAuthentication, ConfirmEdit could use reviews if anyone is interested.

Editing

Collaboration

• Blocking:
  • External store work. External Store deployed everywhere on Beta with no complications. Work on this continues. We now need to set up a second External Store on Beta for Flow, to test the migration.
• Blocked:
  • Work on Flow dumps continuing on the ops side. https://phabricator.wikimedia.org/T119511 and https://phabricator.wikimedia.org/T89398 .
• Updates:
  • Continuing notification work on:
    • Cross-wiki notifications coming by default on May 12th!
    • Echo email formatter
    • Work continues on the new Echo MVC architecture

Parsing

• We got our first visual diff test run comparing Tidy with HTML5depurate. Results @ http://mw-expt-tests.wmflabs.org/ ... Making notes @ https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy ... We will use this as the basis for figuring out what things might break if we replace Tidy today and what needs fixing and where.
• Scott has been working with Ops to get OCG kinks ironed out.

Language

• Blocking:
  • Apertium->Jessie. Yet to finalize plan and proceed.
• Blocked:
• Updates:
  • cxserver service will be migrated to scap3 deployment soon.
  • Translate (twn, meta,..) now using Apertium MT from cxserver.

Discovery

• Blocking: none
• Blocked: none
• Preparing for ElasticSearch 2.0 migration
• Results for A/B test on portal language link location published: https://commons.wikimedia.org/wiki/File:Wikipedia_Portal_Test_of_Language_Detection_and_Primary_Link_Resorting.pdf
• TextCat A/B test launching soon
• Portal A/B test adding descriptions to project links to start this week
• WDQS redeployed, some performance issues
• Graphs have ability to use WDQS directly now
• Search Team offsite in 2 weeks (17-21)

Analytics

• Scaling of pageview API , more work than anticipated
• Working new domain analytics.wikimedia.org, wikistats 2.0 migration, meeting with research to map early states of project
• Still trouble with jenkins

Fundraising Tech

• coding new PayPal integration
• pulling in lots of CiviCRM upstream changes
• making CentralNotice fail gracefully in odd cache edge cases
• Casey hanging out with reading offsite
• more work towards replacing ActiveMQ