Scrum of scrums/2017-12-06

2017-12-06 edit

Callouts edit

Audiences edit

Readers edit

iOS native app edit

Android native app edit

  • Blocked by:
  • Blocking:
  • Updates: Releasing beta 2.6.207

Reading Web edit

  • Blocked by:
  • Blocking:
  • Updates:

Reading Infrastructure edit

  • Blocked by:
  • Blocking:
  • Updates:
    • ReadingLists performance improvements
    • Wrapping up media + summary endpoints
    • References needs a bit more design work

Multimedia edit

  • Blocked by: N/A
  • Blocking: N/A
  • Updates: 3D nearly ready to go, probably before holidays, else shortly thereafter. Also working on prototyping for first feature of Structured Data on Commons.

Discovery edit

  • Blocked by:
  • Blocking:
  • Updates:
Maps edit

Community Tech edit

  • Blocked by:
  • Blocking:
  • Updates:

Contributors edit

Editing edit

  • Blocked by:
  • Blocking:
  • Updates:

Parsing edit

  • Blocked by: Services (because of Cassandra3 migration) on deployment of HTML version bump (for section, figure-inline, html5-id, interwiki-link changes). This is just an FYI since Services & us have already synced up about this.
  • Blocking: Reading Infra on section tag markup
  • Updates:
    • itwiki, dewiki, and 170 small wikis got switched from Tidy to RemexHtml yesterday - itwiki have flagged a bunch of new issues that hadn't been caught by linting so far. Investigation ongoing and might introduce one or two newer categories to aid editors -- we expect these categories to be sparsely populated
    • Templatedata related fixes being deployed today -- For pre-existing transclusions, this will prevent Parsoid from normalizing parameter order to templatedata format

Global Collaboration edit

UI Standardization edit

Technology edit

Analytics edit

  • Blocked by:
  • Blocking:
  • Updates:
    • The prometheus druid exporter (to report druid metrics to graphana via prometheus) got some attention and others (outside WMF) will be using it
    • First productionized version of EventLogging backend on hadoop launched this week. This means SQL-friendly tables on hadoop with eventlogging data, and for the first time, ability to join to all mediawiki databases in one query
    • Wikistats 2 APIs (like Pageview API, but for edit data), alpha launch: https://wikitech.wikimedia.org/wiki/Analytics/AQS/Wikistats
    • Wikistats 2 UI, alpha launch: https://stats.wikimedia.org/v2/
    • Decommissioning old DB hosts for EventLogging done, remember that eventlogging DB is now only on analytics-slave, not on analytics-store anymore
    • Work on kafka jumbo cluster
    • Rebooting one druid host for maintenance brought up unexpected issues with druid and zookeeper, working on that

Cloud Services edit

  • Blocked by:
  • Blocking:
  • Updates:
    • Annual Toolforge survey closed. 141 responses received (11% response rate).
    • Team in Austin this week doing an offsite + attending KubeCon conference
    • Will upgrade labpuppetmaster* to v4 puppet packages after the offsite
      • Presuming everything in eqiad goes well next week

Fundraising Tech edit

  • Blocked by: None
  • Blocking: None
  • Updates:
    • New CiviCRM Import tool for Major Gifts
    • Paying down some tech debt in Central Notice
    • Fixes for fundraising vagrant role
    • Continued improvements to Fundraising Dashboard
    • Continuing to support FR-non-tech during the fundraiser

MediaWiki Platform edit

  • Blocked by: N/A
  • Blocking: Global Collaboration for code review on https://gerrit.wikimedia.org/r/#/c/392990/ and surrounding stack of commits
  • Updates:
    • MediaWiki 1.30 Release Candidate 0 released
    • MCR and Actor table reviews ongoing
    • Comment table: Tried to enable WRITE_BOTH mode on testwikis, but had to revert because it broke CentralAuth and ForeignDBViaLBRepo.
      • Will likely wait until the schema change is done everywhere before we move anything to WRITE_BOTH.
    • TemplateStyles: ParserOutput stateless transforms got merged. Some Wikibase issues that are being dealt with.
    • Firejail: will be deployed for Score
    • New PSR-4 autoloader patchset https://gerrit.wikimedia.org/r/373626 ready for review
    • PoolCounter for ORES client https://gerrit.wikimedia.org/r/394407 ready for testing
    • MP3 transcoding deployment
    • Discussions with third party MediaWiki developers regarding extension deployment/dependency management (composer)

Performance edit

  • Blocked by: N/A
  • Blocking: N/A
  • Updates:
    • Significant new performance testing documentation in progress (aimed at developers), expected to be delivered before end of 2017
    • New varnish slow log configuration in final testing
    • perf testing of cross-data center database writes
    • Q3 Goals planning: if you think you might need anything from the perf team, hit me up.
    • docker-based MW dev environment (in collab with WMDE)

Release Engineering edit

  • Blocking:
  • Blocked by:
    • none
  • Updates:
    • [MW Train] Reminder! This is your last few weeks of deployments for the year/quarter! No non-emergency deploys starts the week of December 18th.
    • #mw-1.30-release MediaWiki 1.30 is about to be released in the next few days, so last call for any blockers people might have...you know...forgotten

Research edit

  • Blocked by:
  • Blocking:
  • Updates:

Scoring Platform edit

  • Blocked by:
  • Blocking:
  • Updates:
    • Outage on Nov 28, incident report is going out today.
    • SimpleWiki deployed to ORES
      • FYI: Global Collab, please announce and update RC Filters. The extension is only configured on the beta cluster.
    • testwiki (RevIdScorer) includes thresholds now, which makes extension development easier, against the real server or in either of our vagrant roles.
    • ORES Ext. Refactoring
    • Incoming basic support of Icelandic (No RC Filters yet)

Search Platform edit

  • Blocked by:
  • Blocking:
  • Updates:
  • Working on improvements to LTR training
  • Reindexed wikis to enable improved katakana/hiragana mapping https://phabricator.wikimedia.org/T179945
  • Improving completion suggester interaction with namespaced prefix search https://phabricator.wikimedia.org/T178474
  • Wikidata descriptions indexed, working on fulltext search
  • Working on porting Selenium tests from Ruby to JS
  • Logstash upgrade to ElasticSearch 5.5 on Thu, completing the 5.5 upgrade

Security edit

  • Blocked by:
  • Blocking:
  • Updates:
    • Lots of development on Phan security plugin by Bawolff
    • Maintanenace work on security alert configuration (Github, NSP)
    • Reviews:
      • Ex:WikipediaExtracts
      • Next set of security reviews will be scheduled this week

Services edit

  • Blocked by: none
  • Blocking: Parsing till early next week
  • Updates:
    • Round of Cassandra 3 bootstraps is complete
    • htmlCacheUpdate for wiktionaries are on kafka queue

Technical Operations edit

  • Blocked by:
  • Blocking:
    • None
  • Updates:
    • Q3 goal planning started, if teams have dependencies on Ops for next quarter, reach out
    • Part of DC ops in Singapore for eqsin (new caching DC's name) rollout
    • s8 (wikidata) work ongoing, work ontrack.
    • Operations DBAs s8 master switchover programmed for 9th January

Wikidata edit

German Technical Wishlist edit

  • Blocked by:
  • Blocking:
  • Updates: