Scrum of scrums/2015-11-18

2015-11-18

edit

Reading

edit
  • ReadMore works on mobile beta
    • Upcoming deployment ^ (Security review, etc.) soon. Only enabled in mobile web beta.
  • EventLogging for ReadMore
  • ReadMore supports CirrusSearch suggestions
  • QuickSurveys will be deployed on Tuesday with first survey (rollout to enwiki Thursday)
    • QuickSurvey disabled on Monday 16th Nov. Enough data.
    • Planning to maybe run another before December freeze.

Android

edit
  • New v2.1.134 beta and prod published. Lots of crash fixes.
  • New donation campaign.
  • Many hygiene patches focused around our tests.
  • Bug fixes for unusual (flaky) but popular devices as identified by HockeyApp.
edit
  • apple-apps-site-association file deployed on Monday, shouldn't be in use or affecting sites yet
  • next step is conditional markup rendering in (mobile?) web

Content Services

edit
  • Thank you for srcset in Parsoid output. :)
  • The routes have changed, new ones have been added, the mobile-html route has been removed. https://phabricator.wikimedia.org/T117429.
  • Wanted to pass Accept-Language headers to backend-requests but that wouldn't work. https://phabricator.wikimedia.org/T118882. It comes with all sort of issues (Parsoid doesn't handle it, cache/storage fragmentation of various Accept-Language header values.) Waiting for discussion at Dev Summit how to deal with language variants. For now, to work around this issue, the Android app is going to avoid using the RESTBase API for zhwiki (https://phabricator.wikimedia.org/T118905).
  • Working on offloading more DOM transformations from client to service.

Reading Infrastructure

edit


Infrastructure

edit

Services

edit
  • High-traffic REST API
  • EventBus
  • RESTBase
  • better schema validation of requests
  • better support for definining spec-only modules
  • AQS live and announced!
  • new version of MobileApps in production


Release Engineering

edit

Technical Operations

edit
  • Blocking: none
  • Blocked by: none
  • Updates:
    • EncryptAlltheThings goes better (MariaDB woes with OpenSSL, will encrypt traffic from varnish to apaches)
    • varnish level rate-limiting deployed
    • puppet swat way too successful (no backlog, we might consider scaling it down a bit)


Security

edit
  • Reviews: session/aphlict done, review of AuthManager/Sessions scheduled this week
  • Flow security patch released, other secuity patches on the cluster
  • opsec talk soon

Fundraising Tech

edit
  • Code mostly frozen for December
  • Fixing some bugs from the civicrm upgrade
  • Several minor, final pre-December updates to CentralNotice deployed last week
  • Completed migration of near-realtime banner impressions stats to Kafkatee
  • Diverse improvements in systems handling payment processors and e-mails, as usual
  • Upcoming: more of the preceeding point, looking into some bugs

Analytics

edit
  • Pageview API released publicly ::song, dance:: :)
  • EventBus work ongoing, prototype eventlogging service going through code review now
  • Wikimetrics work to support program evaluation


Editing

edit

Parsing

edit
  • Parsoid output now provides srcset attribute in images (live as of last Wed)
  • A bunch of performance bugs fixed -- should reduce the # of pages that timeout
  • Parsoid native extension registration work begun (Arlo)
  • Plans to start working on improving multimedia support in Parsoid (audio / video) (Scott)
  • Tim has worked on a much improved visual-diff algorithm as a replacement for the resemble.js-based image comparson that we used so far
    • this new version can detect moves in an image and help accurately quantify rendering diffs => it can be used in mass testing of visual diffs where the numeric diff metric can be used to identify the most important diffs to address.
    • will be useful in comparing parsoid and php rendering, as well as for testing Tidy replacement with a HTML5 parser.

Collaboration

edit
  • External store patch still needs to be coordinated with Jaime: https://gerrit.wikimedia.org/r/#/c/226544/
  • Phase 1 of artificial primary key is done. Next we'll run the script.
  • Dump work almost done.
  • Still have some followup for ptwikibooks.
  • Cross-DC preparation work has been successful so far. We are doing okay with the cache under reduced use, using slave queries instead.
  • Cross-wiki Echo notification work is progressing well.
  • We're working on Flow anti-spam integration, particulary Nuke.

Discovery

edit
  • Portal deployed now via gerrit
  • Targeting to deploy quick survey on 19th

Not blocking or blocked.

Trinkets

edit

Research

edit
  • reader research QuickSurvey
    • ran a small survey on enwiki ondesktop last week
    • running another small survey on enwiki on mobile this week
  • Deployment for ORES
    • 13 wikis supported: dewiki, enwiki, eswiki, fawiki, frwiki, hewiki, idwiki, itwiki, nlwiki, plwiki, trwiki, viwiki, wikidatawiki
    • Backpressure system deployed that prevents overloading of our cluster
    • Still working on feedback from security review (security -- not blocked)
  • referrer policy cleared by Security and CE