Scrum of scrums/2018-03-28

2018-03-28

Callouts

• Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar - next up: Netherlands 2018-04-03 through 2018-05-01
• Language blocked on Research: Recommendation API fails with internal error if the optional seed_article param is missing (T190266)
• English Wikipedia is rolling out local Wikidata description overrides, which are available via a different API. All on-wiki functionality should be updated to use prop=description instead of prop=pageterms. Affected teams will be contacted by Lani over the coming week; if we forget about you, please reach out. (T184000)
• OOUI's default font size has changed from 12.8px to 14px https://phabricator.wikimedia.org/T97631 , and the icons were resized and redesigned https://phabricator.wikimedia.org/T177432 . If you have code using OOUI, you may need to update it after these changes.

Audiences

Readers

iOS native app

• Blocked by: -
• Blocking: -
• Updates:
  • Stil working on Reading Lists (current release board: https://phabricator.wikimedia.org/tag/ios-app-v5.8.0-manatee-on-a-skateboard/), planning to do user testing early this week (details about what we'll be covering: https://phabricator.wikimedia.org/T188962)
  • Senior iOS Software Engineer job ad posted (https://boards.greenhouse.io/wikimedia/jobs/1072152?gh_src=q87rx4bt1#.Wrjw-maZPUI), we're preparing hiring materials (tech questions, tech task)

Android native app

• Blocked by:
• Blocking:
• Updates:
  • Reading list syncing rolled out to 100% of Beta audience (~250K users)
  • Will start rolling out to production in ~1-2 more weeks, while we gather feedback from beta users.

Readers Web

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Increase learning by lowering the cost of exploration
    • Reading Web/Performance

• • Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web: Tech Ops/RelEng

Readers Infrastructure

• Blocked by:
• Blocking:
• Updates:
  • enabled Wikidata description override for enwiki on Wednesday (T184000)
  • enabled TemplateStyles for wikivoyages on Wednesday (T189834)

Maps

• Blocked by: Ops creating a schema on maps test server (https://phabricator.wikimedia.org/T190238)
• Blocking:
• Updates:
  • Working with collab
  • Making progress towards new style deployment

Multimedia

• Updates
  • Search for MediaInfo: Patch merged, follow-up work progressing - thanks to the Search and WMDE teams for being helpful there
  • Multi-lingual captions in UploadWizard: Work progressing, thanks to WMDE for being helpful there
  • File page display/editing of MediaInfo data: Patch up, working now, thanks especially to Thiemo (WMDE) for walking through stuff when needed
  • Quarterly goal dependency update:
    • Prepare backend infrastructure for structured data search: Nearly done
      • SDC: Search PF/Multimedia/Wikidata
    • Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure: Nearly done
      • SDC: Research/Multimedia
    • Prepare backend infrastructure for structured data search: Nearly done
      • SDC: Search PF/Multimedia/Wikidata

Contributors

Community Tech

• Blocked by:
• Blocking:
• Updates:
  • Resolving issues uncovered by GlobalPreferences test deployment last week

Anti-Harassment Tools

• Blocked by: None
• Blocking: None that we know of
• Updates:
  • Bug Fixes completed for Interaction Timeline
  • Continue work on Blocking Tool improvlements
  • Continue research on Reporting Tool

Editing

• Blocked by: None
• Blocking: None
  • Updates: OOUI font size fixes

Parsing

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing:Mediawiki PF/Services

Collaboration

• Blocked by:
• Blocking:
• Updates:
  • OOUI font size update on the train this week, lots of tweaks to deal with that
  • Got maps service working in labs and pointed beta wikis to it. Need to migrate to a new VM though, due to OpenStack issues
  • Localized maps labels expected in beta labs end of this week / early next

Language

• Blocked by:
  • Research: Recommendation API fails with internal error if the optional seed_article param is missing (T190266)

• Blocking:
• Updates:
  • Work on CX2 continue, except tools column.

Audiences Design

• Blocked by:
• Blocking:
• Updates:

UI Standardization

• Blocked by:
• Blocking:
• Updates:
  • OOUI – v0.26.1 released https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.26.1
    • In-time release before MW core cut to address findings from icons/font-size rollout in v0.26.0 on two main tasks below
    • WikimediaUI theme's new icon set in place https://phabricator.wikimedia.org/T177432 !
    • Unified VE in Vector/WikimediaUI interface base font-size to usage of OOUI in core/extensions elsewhere https://phabricator.wikimedia.org/T97631 !
  • Style Guide
    • Continued work on v1 goals https://phabricator.wikimedia.org/tag/wikimediaui_style_guide/

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:
  • Jupyter notebooks hardware has been refreshed and updated software.
  • Working with audiences on rolling out the popups feature (desktop previews of pages) to all wikipedias. Not yet enabled on enwiki or dewiki
  • responsive Wikistats work is ongoing
  • Geowiki dashboard from hadoop data should be finished this week
  • Google Summer of Code (improvements to Wikistats 2 UI) - We are currently in the process of chosing among two participants
• Quarterly goal dependency update:
  • Improve, adjust, or create features geared at the needs identified in New Editors research project.
    • New Editors Experience:Analytics

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by:
• Blocking:
• Updates:
  • Drupal security release dropping today.
  • More work on recurring charges with our new payment processor integration.
  • Second round of unintended recurring charge cancelations and refunds.
  • More work on using EventLogging to get banner impression and fundraiser landing page stats

MediaWiki Platform

• Blocked by:
• Blocking:
• Updates:
  • Announced April 16 as the "pencils down" date for MW 1.31
  • Met with SRE to discuss multi-DC planning
  • Actively participated in Enterprise MediaWiki Conference (EMWCon) (https://www.mediawiki.org/wiki/EMWCon_Spring_2018)
    • Cindy presented "Toward a MediaWiki Roadmap" and was a panelist on "MediaWiki Best Practices" panel
    • Celebrated MediaWiki's 15th birthday (https://twitter.com/CindyCicalese/status/976862020925566976)
    • Toured NASA Johnson Space Center to get first-hand view of the use of their wikis (https://twitter.com/CindyCicalese/status/976517916488323072)
  • Finished extension updates related to Actor table
  • MCR code review and development for API updates for query modules
  • Comment table follow up schema change still in progress
  • Improving test coverage for API modules
  • Usual code review and bug fixes
• Quarterly goal dependency update:
  • Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing:Mediawiki PF/Services
    • Platform Evolution CDP planning in progress
• Reduce product and technical debt to modernise our tools and technologies, and to make future changes more effective and efficient
  • • Parsing/Mediawiki PF
    • Platform Evolution CDP planning in progress
  • 1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages.
    • SDC: Mediawiki PF/Wikidata
    • MCR development in progress

Performance

• Blocked by:
  • None
• Blocking:
  • None
• Updates:
  • eqsin live, working with Traffic to monitor/evaluate performance impact. (So far: really good!)
  • Continuing to have issues with coal, hoping that a new version that went out just now will work
  • Prepping a survey-based study on performance perception, using the QuickSurveys extension
  • Patch expected today for the ResourceLoader parts of getting Safe Mode working with VisualEditor
  • Dynomite option didn't work for multi-DC WANObjectCache, going back to mcrouter. Got some traction with the team at Facebook that maintains that code base, so that's good. (Thanks to Giuseppe from SRE)

Release Engineering

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web: Tech Ops/RelEng
  • Update:

Research

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Wikimedia Technology/Goals/2017-18 Q3#Segment 2: Search integration and exposure
    • SDC: Research/Multimedia
  • Update:

Scoring Platform

• Blocked by: RelEng on git lfs
• Blocking: None
• Updates:
  • ores-support-checklist is almost ready. It's live: http://tools.wmflabs.org/ores-support-checklist
  • Will announce it soon

Search Platform

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Prepare backend infrastructure for structured data search
    • SDC: Search PF/Multimedia/Wikidata- Lexeme in progress
  • Update:
    • Wikidata fulltext search - new code enabled with today's train
    • Evaluating feature generation by `query_explorer` functionality of LTR plugin: https://phabricator.wikimedia.org/T187148
    • Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
    • Working Slovak analysis: https://phabricator.wikimedia.org/T178929
    • Working on Lexeme completion search: https://phabricator.wikimedia.org/T189745

Security

• Blocked by:
• Blocking:
• Updates:

Services

• Blocked by: none
• Blocking: none
• Updates:
  • New REST endpoints with Reading Infrastructure
    • Page Metadata https://en.wikipedia.org/api/rest_v1/#!/Page_content/get_page_metadata_title_revision
    • Page References https://en.wikipedia.org/api/rest_v1/#!/Page_content/get_page_references_title_revision
  • Fixed the issue with jobqueue -> mysql connection spikiness
  • Cirrus search jobs transfer started. Switched to kafka for test wikis

Site Reliability Engineering

• Blocked by:
  • None
• Blocking:
  • None
• Updates:
  • Singapore is already serving live traffic, enabling more countries every week
  • Backups goal completed successfully
  • PuppetDB upgraded, puppetmasters upgraded, debian stretch upgrades (goal) completed successfully
  • hardware refreshing last steps being finished (goal)
  • Mathoid 100% served from the kubernetes cluster, migration successful
• Quarterly goal dependency update:
  • Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web: Tech Ops/RelEng
  • Update: Postponed for early next quarter
• • Audiences DesignStandardise our user interfaces to match user expectation of quality from our products
    • Audiences Design: Ops
  • Update: AFAIK this is done

Wikidata

• Blocked by:
  • None
• Blocking:
• Updates:
  • Continuing to work on better Lua functions
  • Continue work on release for Lexeme, probably at the end of April
• Quarterly goal dependency update:
  • 1.1 It is possible to store structured data within wiki pages, in particular on media file pages on Commons. We will enable the MediaWiki storage layer to correctly store and process structured data elements within wiki pages.
    • SDC: Mediawiki PF/Wikidata
  • Update:
• • Prepare backend infrastructure for structured data search
    • SDC: Search PF/Multimedia/Wikidata
  • Update:

German Technical Wishlist

• Blocked by:
  • Wikidiff2 review (still the same as the weeks before): https://gerrit.wikimedia.org/r/404293
• Blocking:
• Updates:
  • Shaping AdvancedSearch extension for Beta phase: https://phabricator.wikimedia.org/T187436
  • Making sure FileImporter works with AbuseFilter as expected: https://phabricator.wikimedia.org/T160540
  • Documenting technical control and data flow of FileImporter before deployment: https://phabricator.wikimedia.org/T190716