Scrum of scrums/2017-12-13

2017-12-13 edit

Callouts edit

  • s8 database master switchover scheduled for 9th January https://phabricator.wikimedia.org/T181645 [please keep in callouts until Jan 9th]
  • LDAP update for user thiemowmde needed: https://phabricator.wikimedia.org/T181130
  • Kafka jumbo cluster (eqiad) ready for testing connections via TLS. This new version of kafka enables consumption via given timestamp - Discovery will use it for wdqs. Aiming to switch some of our clients this week.

Audiences edit

Readers edit

iOS native app edit

Android native app edit

  • Blocked by:
  • Blocking:
  • Updates:
    • Released 2.7.221 to production
      • fully configurable feed, On This Day cards in feed, new Randomizer, new Black theme.
    • Continuing to work on performance improvements with large numbers of reading list pages.

Reading Web edit

  • Blocked by:
  • Blocking:
  • Updates:
  • Still working on chromium service. Almost finished performance testing.
  • Re-enabling page previews A/B test to collect data to influence a decision on performance.

Reading Infrastructure edit

  • Blocked by:
  • Blocking:
  • Updates:
    • Reading lists is in production
    • will look at patrolling support for WP0 piracy next
    • Media endpoint pretty getting ready to be exposed
    • Finalizing touches for summary endpoint (in Beta Cluster) but may need more adjustments for when to return 204 (No Content).
    • Getting close for references endpoint

Multimedia edit

  • Blocked by: N/A
  • Blocking: N/A
  • Updates
    • 3D: A few changes to be made, on track to deploy sometime soon after the holidays.
    • MediaInfo: Prototyping and wireframing currently underway for first features.

Discovery edit

Maps edit

Contributors edit

Editing edit

  • Blocked by:
  • Blocking:
  • Updates:

Parsing edit

  • Blocked by:
  • Blocking:
  • Updates:

Global Collaboration edit

  • Blocked by: Security on re-review of https://phabricator.wikimedia.org/T144467
  • Blocking: Ops on Flow dumps still; Matt comes back on Monday and he's the expert
  • Updates:
    • Nothing of note, mostly been fixing regressions recently
    • Matt comes back on Monday (Dec 18)

Contributors Design edit

  • Blocked by:
  • Blocking:
  • Updates:


UI Standardization edit

    • No OOUI release this and upcoming weeks till January
  • Ongoing:

Community Tech edit

  • Wrapping up our survey, tightening loose ends from this year.


Technology edit

Analytics edit

  • Blocked by:
  • Blocking:
  • Updates:
    • Load testing druid prior to launch of wikistats 2.0 - It provides good enough concurrentcy and response times. Last snapshot of data for wikistats2 is of the quality we like. Aiming to announce launch this Thursday: https://stats.wikimedia.org/v2/#/bm.wikipedia.org
    • Working on new set of APIs to power map visualizations, pageviews per country monthly
    • Kafka jumbo cluster ready for testing connections via TLS, this new version of kafka enables consumption via given timestamp. Discovery will use it for wdqs. Aiming to switch some of our clients this week
    • Notebook1002 got recommissined as a kafka host - Almost there (hard drives issues)
    • Superset is productionized - We are testing it internally in the teasm and will anounce soon

Cloud Services edit

  • Blocked by:
  • Blocking:
  • Updates:

Fundraising Tech edit

  • Blocked by: nothing
  • Blocking: nothing
  • Updates:
    • Fundraiser going pretty smoothly (knock wood)
    • Trawling logs for errors to fix
    • Investigating potential banner impression shortfall for WMDE
    • Getting some civi stuff merged upstream
    • fixes & enhancements to internal dashboard

MediaWiki Platform edit

  • Blocked by:
  • Blocking:
  • Updates:
    • MediaWiki 1.30 Released
    • code review:
    • Actor table patches are almost ready to merge
    • script to clean up imported usernames ran on a limited set of wikis with no errors so will be run on all wikis
    • PSR-4 autoloading support merged
    • namespacization and firejail work continues
    • went through some bug backlogs including incident response, submitted some small changes
    • two meetings with representatives of Gamepedia (owned by AWS/twitch.tv/curse)
    • Tim: will go to TechCom meetings on Wednesday afternoon, then on vacation after that until January 1

Performance edit

  • Blocked by: n/a
  • Blocking: n/a
  • Updates:
    • NavTiming extension updates should be going out quite soon. Don't expect any impact on other teams.
    • ChronoogyProtector caused problems last week, esp. for Wikidata. Fix is in place, many thanks to the folks who jumped in to help out with that.
    • mcrouter puppet config waiting on additional code review. May need some additional review cycles from TechOps.
    • ProxySQL SSL termination - may need more time from Jaime, not yet sure.
    • Series of blog posts on Thumbor migration published to the main WMF blog
    • WebPageReplay now working with Firefox.

Release Engineering edit

  • Blocked by: n/a
  • Blocking: n/a
    • Blocking ORES with some scap issues.
  • Updates:
    • [MW Train] Reminder! This is your last week of deployments for the year/quarter! No non-emergency deploys starts the week of December 18th.
    • [Meta] Q3 goal planning
    • [Security/Ruby] T180878 Upgrade RuboCop and Rubyzip (Ruby)
      • All done except for Minerva (needs a +2) and mediawiki/debian (unsure if needed).
    • [Security/Jenkins] Upgraded a bunch of Jenkins plugins Monday morning EU time (after a bunch of security releases).
    • [Phabricator] Exploring the use of Selenium tests for search quality regressions
    • [TechDebt] Getting further on the definition of “steward”. We will be talking with Victoria and Toby “soon”.
    • [SSD] One more merge (https://gerrit.wikimedia.org/r/#/c/395570/) and our quarterly goals are complete.
    • [PostMortem] ORES post-mortem completed last week: https://etherpad.wikimedia.org/p/Post-Mortem-T181006

Research edit

  • Blocked by:
  • Blocking:
  • Updates:

Scoring Platform edit

  • Blocked by:
    • Blocked on releng, by scap issues. We're getting lots of help. Unfortunately, this is affecting Q2 goal of ours (deploying to new ORES cluster).
  • Blocking:
  • Updates:


Search Platform edit

Security edit

  • Blocked by:
  • Blocking:
  • Updates:
  • Security plugin for phan has been announced and published (yay!)
    • Reviews:
      • Google MT
      • mediawiki-services-chromium-render
      • stacktraces on wikis
      • git mirroring to diffusion

Services edit

  • Blocked by: none
  • Blocking: none
  • Updates:
    • Parsoid storage for wikipedias moved to Cassandra 3. Please report anything weird you notice with VE
    • Parsoid and MCS content-type bumped
    • HTMLCacheUpdate for all non-wikipedia projects processed on Kafka

Technical Operations edit

  • Blocked by:
  • Blocking:
  • Updates:
    • Asia DC (eqsin) on site installation complete
    • Monitoring of production k8s cluster setup
    • More work on porting system metrics to Prometheus
    • HHVM on API appservers occasionally gets stuck - investigation in https://phabricator.wikimedia.org/T182568

Wikidata edit

German Technical Wishlist edit

  • Blocked by:
  • Blocking:
  • Updates:

SoS Meeting Bookkeeping edit

  • Updates:
    • Sending out a survey to determine whether the meeting time is ideal or should be changed.