Scrum of scrums/2017-12-20

2017-12-20 edit

Callouts edit

  • Reminder: Failover for wikidata (new s8 shard) arranged for 9th Jan - T181645
  • Would like somebody from performance/MediaWiki team to look at: https://phabricator.wikimedia.org/T183101 we’ve got some fails on LinksUpdate which blocked search index update which makes Wikidata items invisible in search (~50 items)

Audiences edit

Readers edit

iOS native app edit

  • Blocked by: none
  • Blocking: none
  • Updates:
    • 5.7.3 with faster article loading, pure black mode for OLED releasing this week

Android native app edit

  • Blocked by:
  • Blocking:
  • Updates:

Reading Web edit

  • Blocked by:
  • Blocking:
  • Updates:

Reading Infrastructure edit

Multimedia edit

  • Blocked by:
  • Blocking:
  • Updates: 3D deployment pushed to January, MediaInfo work is unblocked and progressing, and very little else is happening


Maps edit
  • Blocked by: service-runner build failures
  • Blocking: N/A
  • Updates:

Contributors edit

Editing edit

  • Blocked by:
  • Blocking:
  • Updates:

Parsing edit

  • Blocked by:
  • Blocking:
  • Updates:

Global Collaboration edit

  • Blocked by:
  • Blocking: Flow dump performance improvement is blocking ops and in progress. I'm resuming this now.
  • Updates:
    • RCFilters
      • Bug fixes, especially regarding RecentChangesLinked page; also, LiveUpdate
    • Ruby browser tests
      • We're removing most of our Ruby browser tests, since we decided the value doesn't justify the time investment of converting them to node.js, and Ruby support is being removed completely.
  • Ongoing work on Flow frontend experimentation; mostly consolidated on a plan for this.

UI Standardization edit

    • Special OOUI v0.24.4 release coming today with some backports to address issues uncovered in v0.24.3
      • 2 deprecating changes, icons 'bellOn' of 'alerts' pack, 'quotesAdd' & 'redirect' of 'editing-advanced' have been identified to be unused nor won't be used in future.

Will be removed in v0.26.0

Community Tech edit

  • Finally received green light with our core refactoring for GlobalPreferences. Otherwise, wrapping up this year's stuff. New wishes in the new year, whee!


Technology edit

Analytics edit

  • Blocked by:
  • Blocking:
  • Updates:
    • Announced alpha release of wikistats: https://stats.wikimedia.org/v2/ (Working on UI bugs filed by users, we love our users for caring and filing them)
    • Blogposts on the way for wikistats, on both the back-end and front-end work
    • Working on new public apis to power map data, pageviews-per-country
    • Some performance issues with druid private cluster, resolved (some tricky interaction with OS Page Cache)
    • New kafka jumbo cluster work progressing, at the request of Brandon we are going to take a second look at supported ciphers for TLS
    • Updated dashiki dashboards with a CC0 license link, see, for example: https://edit-analysis.wmflabs.org/multimedia-health/

Cloud Services edit

  • Blocked by:
  • Blocking:
  • Updates:
    • All puppetmasters now running 4.x puppet
      • Agent upgrade pending Trusty agent packages
    • All Wiki Replica usage now on the "new" cluster. <https://wikitech.wikimedia.org/wiki/Wiki_Replica_c1_and_c3_shutdown>
      • labsdb1001 & labsdb1003 can be decommissioned on or after 2018-01-03
    • Some things a bit blocked by the broken puppet compiler (at least as of Friday)

Fundraising Tech edit

  • Blocked by: nothing
  • Blocking: nothing
  • Updates:
    • Fundraiser still going really smoothly, showing very few banners
    • Investigating some low-level errors
    • Getting some civi stuff merged upstream
    • fixes & enhancements to internal dashboard and grafana stats

MediaWiki Platform edit

  • Blocked by: N/A
  • Blocking: N/A
  • Updates:
    • Q3/Dev Summit/Audiences Technology Working Group planning
    • Multi-content revisions
      • Actor table patch being rebased after merge of some Revision table patches
      • Code review
      • Reviewing development needs
    • Comment table schema change continuing to be applied
    • cleanupUsersWithNoId script has been run on most wikis
    • Helping GCI students with their tasks
    • Prepping the next MediaWiki-CodeSniffer release
    • Socializing and publishing https://www.mediawiki.org/wiki/Best_practices_for_extensions page since people are starting to comment on it

Performance edit

  • Blocked by: N/A
  • Blocking: N/A
  • Updates:
    • Q3 goals posted
    • Intro to Performance measurement posted: https://wikitech.wikimedia.org/wiki/Measure_Performance -- training based on this to come in Q3
    • WebPageReplay variability reduced to ~2%, well positioned for Q3
    • Improved Varnish slow log landed on Vagrant, will be hitting prod right after the holidays
    • mcrouter configuration will be hitting prod right after the holidays, for testing

Release Engineering edit

Release Engineering edit

  • Blocking
  • Blocked
    • Teams that did not port Selenium tests from Ruby to Node.js (T139740): No team (1), Editing (1), Fundraising Tech (1), Global Collaboration (4), Multimedia (1), Reading Web (3), WMDE Engineering (5)
  • Updates
    • REMINDER: No deploys this week and next (18th and 25th). Take a break! [wiki][email]
      • We’re (Chad) going to spend some time this week cleaning up log-spam.
    • Our Q3 goals posted
    • Completed the security upgrade of RuboCop and Rubyzip
    • Our Q2 “SSD” (Program 6) goals are now all complete [wiki][email]
    • Antoine is migrating the CI docker image build process to using docker-pkg (from Giuseppe)
    • Follow-up continues on the ORES post-mortem follow-ups

Research edit

  • Blocked by:
  • Blocking:
  • Updates:

Scoring Platform edit

  • Blocked by:
  • Blocking:
  • Updates:

Search Platform edit

Security edit

  • Blocked by:
  • Blocking:
  • Updates:
    • Reviews:
      • Google MT reviewed, with more notes coming
      • mo
      • mediawiki-services-chromium-render
      • stacktraces on wikis
      • git mirroring to diffusion

Services edit

  • Blocked by:
  • Blocking:
  • Updates:

Technical Operations edit

  • Blocked by:
    • Usual issue about Flow dumps, global collaboration, Ops welcomes Matt back :-)
  • Blocking:
    • None
  • Updates:
    • Reminder: Failover for wikidata (new s8 shard) arranged for 9th Jan - T181645
    • Ganglia is finally dead!
    • Mysterious crashes of HHVM on api still ongoing, with low frequency. Investigating in the background.
    • Goals posted

Wikidata edit

  • With many people on vacation, we started a small "cleanup/pet project" sprint over the holidays.
  • Re-introducing PSR-4 in all Wikibase code bases.
  • Good progress on statement editing on sub-entities, namely Form entities in the Lexeme extension.

German Technical Wishlist edit

  • Blocked by:
  • Blocking:
  • Updates:

SoS Meeting Bookkeeping edit

  • Updates: