Scrum of scrums/2016-03-09



Community TechEdit


Discovery EngineeringEdit



  • Blocking:
    • External Store - Continuing work
  • Blocked:
    • No new blockers. Matthias put up an XSD for the Flow dumps.
  • Updates:
    • Rolling out cross-wiki notifications beta feature to all wikis tomorrow
    • There have been some issues with duplicate thank-you notifications (for edit milestones, e.g. 100th edit), which are being worked on.
    • Also working on some Echo bundling i18n issues and enhancements to the Notifications special page

Fundraising TechEdit

  • No blockers
  • preparing real donor test of backup worldwide credit card processor
  • Working out final details of Latin American payment processing expansion
  • Steady stream of CiviCRM enhancements for us and upstream
  • More experiments in fraud monitoring and blocking
  • Investigating firewall rules for PCI scan
  • Investigating possibility of using current PHP/MW
  • Replaced dying drive in ActiveMQ box, cursed SPOF



  • Updates:
    • 2.1.142 beta publishing very soon.
    • Reading list endpoint needs - depending on timing/approach may need security review



  • Blocking:
    • ???
  • Blocked:
  • Updates:
    • Hopefully lazy loaded images we will begin rolling out week commencing 14th [Dependency: performance team]

Reading InfrastructureEdit



  • Blocking:
    • Hadoop issues with encoding have been fixed, querying is totally ok now, data has been back-filled and has been ready for re-computation since earlier this week
  • Blocked: (none)
  • Updates:
    • Working on goals for next quarter, currenlty mostly revolving around transitioning Erik Zachte's work to Wikistats 2.0
    • If you're using UDFs in Hive, you need to add their jars explicitly now, but this gives more flexibility to test changes to UDFs
    • Bots following the user agent policy are now detected correctly in our pageview data pipeline
    • data on unique devices estimated by the last access cookie is now publicly available, but please let us announce it first on analytics-l before spreading word of its existence (we want to make sure people know what this is)
    • The "-" article should no longer show up in the "top articles" endpoint of the pageview API, starting with today's data

Release EngineeringEdit

  • Blocking:
    • Are we doing deployments week of Jerusalem Hackathon? [Sync with ops and will announce]
  • Blocked:
    • None
  • Updates:
    • Reminder: code freeze week of 3/21 for codfw fallover. E-mail/tech news forthcoming as well.
    • Notice: Expect an e-mail shortly, but trebuchet is now deprecated for all new service deployments going forward. New services should use scap3.


Research and DataEdit


  • Blocking:
    • AuthManger?
    • SVG sanitizer - is this blocking a quarterly goal?
  • Blocked:
    • ???
  • Updates:
    • password hash format updated
    • Lots of security patches deployed - releng, release soon (T124940)?
    • AuthManger review starting


  • Blocking:
    • none
  • Blocked:
    • none
  • Updates:
    • morelike API live -
      • Reading: Android wants 320px thmubs, is the rest of Reading OK with it?
    • RB cluster expansion continuing
    • Cassandra
      • switched to 2.1.13, soon testing of 2.2.5
      • start of Brotli compression in staging imminent
    • rate limiting in service-runner
      • RB endpoints - now only logging excesses, soon will start enforcing them
    • API: removing some listing endpoints

Technical OperationsEdit

  • Blocking:
    • ORES - moving into a python wheel repo structure
  • Blocked:
    • None
  • Updates:
    • moved ocg to use a replicated redis
    • redis replicated and encrypted on the sessions
    • got <40 precise machines now
    • Please delete unwanted labs instances