Scrum of scrums/2017-12-20

2017-12-20

Callouts

• Reminder: Failover for wikidata (new s8 shard) arranged for 9th Jan - T181645
• Would like somebody from performance/MediaWiki team to look at: https://phabricator.wikimedia.org/T183101 we’ve got some fails on LinksUpdate which blocked search index update which makes Wikidata items invisible in search (~50 items)

Audiences

Readers

iOS native app

• Blocked by: none
• Blocking: none
• Updates:
  • 5.7.3 with faster article loading, pure black mode for OLED releasing this week

Android native app

• Blocked by:
• Blocking:
• Updates:

Reading Web

• Blocked by:
• Blocking:
• Updates:

Reading Infrastructure

• Blocked by: Ops on puppet code review:
  • https://gerrit.wikimedia.org/r/#/c/397623/
  • https://gerrit.wikimedia.org/r/#/c/395694/
• Blocking:
• Updates:

Multimedia

• Blocked by:
• Blocking:
• Updates: 3D deployment pushed to January, MediaInfo work is unblocked and progressing, and very little else is happening

Maps

• Blocked by: service-runner build failures
• Blocking: N/A
• Updates:

Contributors

Editing

• Blocked by:
• Blocking:
• Updates:

Parsing

• Blocked by:
• Blocking:
• Updates:

Global Collaboration

• Blocked by:
• Blocking: Flow dump performance improvement is blocking ops and in progress. I'm resuming this now.
• Updates:
  • RCFilters
    • Bug fixes, especially regarding RecentChangesLinked page; also, LiveUpdate
  • Ruby browser tests
    • We're removing most of our Ruby browser tests, since we decided the value doesn't justify the time investment of converting them to node.js, and Ruby support is being removed completely.
• Ongoing work on Flow frontend experimentation; mostly consolidated on a plan for this.

UI Standardization

• • Special OOUI v0.24.4 release coming today with some backports to address issues uncovered in v0.24.3
    • 2 deprecating changes, icons 'bellOn' of 'alerts' pack, 'quotesAdd' & 'redirect' of 'editing-advanced' have been identified to be unused nor won't be used in future.

Will be removed in v0.26.0

• • • Add 'lightbulb' icon to 'interactions' pack
    • Also introduce OO.ui.getDefaultOverlay function that provides a more solid default OOUI overlay handling within other core theme elements (Bartosz Dziewoński)
• Ongoing:
  • OOUI & based products:
    • icons: Finalizing work on icon set to be more harmonious and align to WikimediaUI Style Guide https://phabricator.wikimedia.org/T177432 – currently addressing remaining RTL issues
  • Unify SVG markup across Foundation products https://phabricator.wikimedia.org/T178867
    • All products aligned
    • Introducing per-project proof SVGO optimization for future SVG additions, see also https://www.mediawiki.org/wiki/Manual:Coding_conventions/SVG

Community Tech

• Finally received green light with our core refactoring for GlobalPreferences. Otherwise, wrapping up this year's stuff. New wishes in the new year, whee!

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • Announced alpha release of wikistats: https://stats.wikimedia.org/v2/ (Working on UI bugs filed by users, we love our users for caring and filing them)
  • Blogposts on the way for wikistats, on both the back-end and front-end work
  • Working on new public apis to power map data, pageviews-per-country
  • Some performance issues with druid private cluster, resolved (some tricky interaction with OS Page Cache)
  • New kafka jumbo cluster work progressing, at the request of Brandon we are going to take a second look at supported ciphers for TLS
  • Updated dashiki dashboards with a CC0 license link, see, for example: https://edit-analysis.wmflabs.org/multimedia-health/

Cloud Services

• Blocked by:
• Blocking:
• Updates:
  • All puppetmasters now running 4.x puppet
    • Agent upgrade pending Trusty agent packages
  • All Wiki Replica usage now on the "new" cluster. <https://wikitech.wikimedia.org/wiki/Wiki_Replica_c1_and_c3_shutdown>
    • labsdb1001 & labsdb1003 can be decommissioned on or after 2018-01-03
  • Some things a bit blocked by the broken puppet compiler (at least as of Friday)

Fundraising Tech

• Blocked by: nothing
• Blocking: nothing
• Updates:
  • Fundraiser still going really smoothly, showing very few banners
  • Investigating some low-level errors
  • Getting some civi stuff merged upstream
  • fixes & enhancements to internal dashboard and grafana stats

MediaWiki Platform

• Blocked by: N/A
• Blocking: N/A
• Updates:
  • Q3/Dev Summit/Audiences Technology Working Group planning
  • Multi-content revisions
    • Actor table patch being rebased after merge of some Revision table patches
    • Code review
    • Reviewing development needs
  • Comment table schema change continuing to be applied
  • cleanupUsersWithNoId script has been run on most wikis
  • Helping GCI students with their tasks
  • Prepping the next MediaWiki-CodeSniffer release
  • Socializing and publishing https://www.mediawiki.org/wiki/Best_practices_for_extensions page since people are starting to comment on it

Performance

• Blocked by: N/A
• Blocking: N/A
• Updates:
  • Q3 goals posted
  • Intro to Performance measurement posted: https://wikitech.wikimedia.org/wiki/Measure_Performance -- training based on this to come in Q3
  • WebPageReplay variability reduced to ~2%, well positioned for Q3
  • Improved Varnish slow log landed on Vagrant, will be hitting prod right after the holidays
  • mcrouter configuration will be hitting prod right after the holidays, for testing

Release Engineering

• Blocking
• Blocked
  • Teams that did not port Selenium tests from Ruby to Node.js (T139740): No team (1), Editing (1), Fundraising Tech (1), Global Collaboration (4), Multimedia (1), Reading Web (3), WMDE Engineering (5)
• Updates
  • REMINDER: No deploys this week and next (18th and 25th). Take a break! [wiki][email]
    • We’re (Chad) going to spend some time this week cleaning up log-spam.
  • Our Q3 goals posted
  • Completed the security upgrade of RuboCop and Rubyzip
  • Our Q2 “SSD” (Program 6) goals are now all complete [wiki][email]
  • Antoine is migrating the CI docker image build process to using docker-pkg (from Giuseppe)
  • Follow-up continues on the ORES post-mortem follow-ups

Research

• Blocked by:
• Blocking:
• Updates:

Scoring Platform

• Blocked by:
• Blocking:
• Updates:

Search Platform

• Blocked by:
• Blocking:
• Updates:
• Would like somebody from performance team to look at: https://phabricator.wikimedia.org/T183101 we’ve got some fails on LinksUpdate which blocked search index update which makes Wikidata items invisible in search (~50 items)
• Working on fixes for completion suggester & redirects namespaces
• Working on Wikidata search fixes for delay & space handling
• Working on refactoring search profiles to make them more config-like https://phabricator.wikimedia.org/T183279
• Wikidata fulltext search prototype published and collecting feedback: https://www.wikidata.org/wiki/Wikidata:Project_chat#Wikidata_fulltext_search_prototype

Security

• Blocked by:
• Blocking:
• Updates:
  • Reviews:
    • Google MT reviewed, with more notes coming
    • mo
    • mediawiki-services-chromium-render
    • stacktraces on wikis
    • git mirroring to diffusion

Services

• Blocked by:
• Blocking:
• Updates:

Technical Operations

• Blocked by:
  • Usual issue about Flow dumps, global collaboration, Ops welcomes Matt back :-)
• Blocking:
  • None
• Updates:
  • Reminder: Failover for wikidata (new s8 shard) arranged for 9th Jan - T181645
  • Ganglia is finally dead!
  • Mysterious crashes of HHVM on api still ongoing, with low frequency. Investigating in the background.
  • Goals posted

Wikidata

• With many people on vacation, we started a small "cleanup/pet project" sprint over the holidays.
• Re-introducing PSR-4 in all Wikibase code bases.
• Good progress on statement editing on sub-entities, namely Form entities in the Lexeme extension.

German Technical Wishlist

• Blocked by:
• Blocking:
• Updates:

SoS Meeting Bookkeeping

• Updates: