Scrum of scrums/2017-08-09

2017-08-09

Callouts

• Ops: Readers eng need a user account for uploading zim collections to beta/prod Swift (https://phabricator.wikimedia.org/T172735 )

Audiences

Readers

iOS native app

• Blocked by: none
• Blocking: none
• Updates: Releasing 5.6.0 ( Reading themes, on this day https://phabricator.wikimedia.org/project/view/2701/ ), Starting work on 5.6.1 ( minor bug fixes, any crash fixes https://phabricator.wikimedia.org/project/view/2898/ )

Android native app

• Blocked by: Ops: need a user account for uploading zim collections to beta/prod Swift (https://phabricator.wikimedia.org/T172735 )
• Blocking: n/a
• Updates:
  • Cookie beta release occurred! https://phabricator.wikimedia.org/project/view/2763/ Hopefully this release will resolve the issues people are reporting with offline saved pages.
  • Offline compilations client-side work is nearly complete, only minor onboarding/branding updates needed – https://phabricator.wikimedia.org/project/view/2833/
    • Work on offline compilation file generation and storage is underway (https://phabricator.wikimedia.org/T170843 )
  • Two new app engineers starting Monday 8/21!

Reading Infrastructure

• Blocked by:
• Blocking:
• Updates:
  • Gergo on vacation until Wikimania
  • Bernd on vacation until next week

Multimedia

• Hiring: Progressing well, should have full capacity relatively soon
• Next week offsite (hopefully with entire team)
• 3D work is nearly done from the technical side, pending design and legal review we'll start pushing out soon.
• Wikilegal posting for 3D files is out - https://meta.wikimedia.org/wiki/Wikilegal/3D_files_and_3D_printing
• MP3 discussion on Commons also coming up soon - draft at https://commons.wikimedia.org/wiki/User:CKoerner_(WMF)/MP3_patrol_discussion

Web

Same as usual:

• Preparation work for new page summary API
• MCS is no longer using MobileView API (but still needs to be deployed)
• Desktop print styles
• Deploying Page previews to all projects but enwiki and dewiki (likely to be stalled until post Wikimania)

Discovery

• working on AB test to add thumbnails to search results https://phabricator.wikimedia.org/T149811

Community Tech

• Deployed CodeMirror, then undeployed. Problems resolved, will try again soon.
• LoginNotify coming next week.
• Work continues on ArticleCreationWorkflow and GlobalPreferences

Search Platform

• Blocked by: none
• Blocking: none
• Updates:
  • Continuing work on ML-assisted ranking
  • Enabled A/B test with interleaving search results (https://phabricator.wikimedia.org/T150032 )
  • Running human graded relevancy test (https://phabricator.wikimedia.org/T171740 )
  • Vietnamese analyzer plugin test round 2 finished, getting better but still not ready (https://phabricator.wikimedia.org/T170423#3502328 )
  • WDQS now has per-client request throttling

Contributors

Global Collaboration

Collaboration

• Blocking - WIP on Flow fix needed by dumps team
• Updates
• RCFilters - Various updates, especially regarding Live Update.
  • Bring back old vs new marker in live update
  • RCFilters: Show "from" link when live update is not available
  • Allow non-sticky filters to be excluded from saved queries
  • Correct label for "View newest changes" button
  • RCFilters: Remove new changes visual cue for Live Update feature
  • Fix overzealous addQuotes for rc_source field in rebuildrecentchanges.php
  • RCFilters: Prevent live update fetch if model is in conflict
  • RCFilters: Adjust styling of 'other review tools' button
  • RCFilters: Normalize 'limit' to minimum 0, like the backend does
  • RCFilters: Adjust server default variable names for limit/days
  • RCFilters: Normalize user-generated default values
  • RCFilters: set live update button title
  • RCFilters: Add vendor prefixes to loading animation
  • RCFilters: Add 'enhanced' view (Group by pages)
  • RCFilters: Normalize arbitrary values before adding them
  • RCFilters: Don't reload results for redundant requests
  • RCFilters: Add 'advanced filters' label to the view selection
  • RCFilters: Unsticky the 'limit' preference temporarily
  • RCFilters: Trim results to allow searching for spaces after trigger
  • RCFilters: Scroll widget to top when switching view
  • RCFilters: Pluralize 'show last X changes' message

Technology

Services

• Blockers: none
• Updates:
  • Alpha version of recommendation API deployed https://en.wikipedia.org/api/rest_v1/#!/Recommendation/get_data_recommendation_translation_from_lang_seed_article
    • Wikidata query service is contacted in codfw and some testing Discovery is doing makes it timeout
  • Job event production rolled out on group0, group1 today
  • Use cases for delayed jobs. Please help to discover them
    • https://phabricator.wikimedia.org/T172832

Analytics

• snapshots 2017-07 of the mediawiki_history table is ready, and includes all wikis. This is the first time we have all wikis in this fully publicly shareable denormalized history of all edit metadata.
• Ongoing work to rebuild kafka cluster, just upgraded varnishkafka to be able to use TLS
• Found a small issue with the way kafka2sse (EventStreams) uses librdkafka, working on deploying now to scb. Until then, we may be losing one or two events there due to an interaction between varnishkafka and librdkafka
• Still one person short due to paternity leave
• Added continous integration to wikistats 2.0 UI, still evaluating usage of diffusion/differential over gerrit
• Eventlogging purging ongoing, really slow on one of the slaves, we need to free disk space faster to not run into disk issues so older eventlogging schemas with loads of data not frequently used will be archived in hadoop. For example: https://phabricator.wikimedia.org/T170720
• Waiting for reading Data analyst to vet family wide (*.wikipedia.org) unique devices metric.
• Upgraded Druid storage to 0.9.2 to be able to test metric calculation for edit metrics using data from Edit Data Lake, performance of groupBy is much better