Scrum of scrums/2017-11-01

2017-11-01

Callouts:

• If you notice anything weird with VE, let Services know, they are messing with Parsoid storage

Audiences

Readers

Multimedia

• Blocking: None
• Blocked by: None
• Updates: MediaInfo/Wikibase on Commons work is continuing, https://phabricator.wikimedia.org/T177022
• UploadWizard changes for 3D legal considerations, https://phabricator.wikimedia.org/T178513
• and discussions about MP3.
• Heads up: Mark on vacation until Thursday next week - will respond but may be AFK

iOS native app

• Blocked by:
• Blocking:
• Updates:
  • 5.7.0 released ( https://phabricator.wikimedia.org/project/view/2899/ ) - Visual updates to onboarding, iOS 11 support, iPhone X support
  • Starting work on 5.7.1 -https://phabricator.wikimedia.org/project/view/3047/ (bug fixes) and 5.8 - https://phabricator.wikimedia.org/project/view/2913/ (faster article loads, synced reading lists)

Discovery

• Blocked by:
• Blocking:
• Updates:
  • Lots up SVG related patch to wikipedia portal
    • https://gerrit.wikimedia.org/r/#/q/topic:new-svg-sprites+(status:open+OR+status:merged)

Maps

• Blocked by: N/A
• Blocking: N/A
• Updates:
  • People are back from SOTM US
  • Lots of relevant conversations relevant to our maps at SOTM US

Reading Infrastructure

• Blocked by:
• Blocking:
• Updates:
  • MCS getting ready for Parsoid section tags (in mobile-sections and Wiktionary definitions). Discussions about wrapping the sections content in a <div> on https://phabricator.wikimedia.org/T176959.
  • MCS adding more title related properties to summary own implementation and mobile-sections lead portion.
  • Continuing work on making Reading Lists production-ready

Services

• Blockers: none
• Updates:
  • Testing switching Parsoid to new storage in labs and production
  • Summary will be served from new storage only starting tomorrow

Contributors

Global Collaboration

• Blocked by: none
• Blocking: none
• Updates:
  • Team offsite in Bangalore last week, not everyone's back yet
  • Actually deployed Compact Language Links to dewiki last week (2017-10-25); was canceled the week before

Parsing

• Updates:
  • Updating section wrapping code to not add the div wrapper around section content as per discussion in https://phabricator.wikimedia.org/T176959
  • Barring no other unforeseen issues, might be able to deploy this patch next week along with a couple other changes: (a) html5 section ids to match core changes (b) wrapping inline images using figure-inline tag; We'll bump our HTML version number at that time

Community Tech

• New wishlist survey starts next week
• Global Preferences RFC will be discussed today
• Deployed Unicode sections to Russian projects, addressing issues

Fundraising Tech

• Tweaks to CiviCRM reports, searches, and contact views
• Deployed various minor CentralNotice code changes: https://gerrit.wikimedia.org/r/387627
• Backup card processor: still fixing Safari cookie issue, also adding retry on failure to certain API calls
• Refactoring initial prometheus stats collector, adding more measurements

Search Platform

• Blocked by: none
• Blocking: none
• Updates:
• Finished evaluating MLR training resource usage, updated docs: https://github.com/wikimedia/search-MjoLniR/blob/master/docs/running-in-analytics.rst
• Fixed search matches within section titles (https://phabricator.wikimedia.org/T178522)
• Fixing issues between completion suggester and multi-ns searches on some wikis (https://phabricator.wikimedia.org/T178474)
• Enabled ElasticSearch prefix search on Wikidata, dealing with some special case regressions
• Looking at top abandoned queries (https://phabricator.wikimedia.org/T176997)
• Working on porting Selenium tests from Ruby to JS
• Working on upgrade to Elastic 5.5
• Added indexing Wikidata statements for P31 and P279
• Working on indexing Wikidata descriptions and adding them to fulltext search

Scoring Platform

• Blocked by:
• Blocking:
• Updates:
  • Shiny new FAQ!
    • https://www.mediawiki.org/wiki/ORES/FAQ
  • Converted our tests from nosetests to pytest (Anyone else making the transition?)
    • nosetests is under-maintained
    • python community is moving towards pytest
    • converting our repos was pretty straightforward

Release Engineering

• Blocking: None
• Blocked: None
• Updates:
  • We had to pause the MediaWiki train last week due to a hard to diagnose issue in production: https://phabricator.wikimedia.org/T179156
  • T171852 Tech talk: Selenium tests in Node.js https://phabricator.wikimedia.org/phame/post/view/78/tech_talk_selenium_tests_in_node.js/
  • T173488 Selenium Ruby framework deprecated https://phabricator.wikimedia.org/phame/post/view/79/selenium_ruby_framework_deprecation_october/
  • CI: Antoine was sick last week. But, he setup a simple package manager caching system for the docker based CI (a port of “castor” in our nodepool based CI). He will migrate some of the CI config related tox jobs to it.

Security

• Blocking: all who are waiting for security reviews
• Blocked: none
• Updates:
  • Reviews
    • BeautifulSoup
    • mediawiki-services-chromium-render
    • Marvin
    • Ex:FIleImporter
    • Ex:WikipediaExtracts
    • Onboarding Erika Bjune to team

Analytics

• new host replaces db1047, EventLogging breathes a sigh of relief
• continuing work on jumbo kafka cluster, EventLogging refine, mediawiki history final data vetting, Wikistats 2 alpha release