Scrum of scrums/2018-04-25

2018-04-25

Callouts

Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar - next up: Netherlands 2018-04-03 through 2018-05-01
RelEng could use some help to get rebuildLocalisationCache.php back up-to-normal speed -- if you have experience with hhvm internals/cli-options: https://phabricator.wikimedia.org/T191921

Audiences

Readers

iOS native app

Blocked by:
Blocking:
Updates:
- Released 5.8 with Reading Lists, now working on a point release (https://phabricator.wikimedia.org/tag/ios-app-v5.8.1-manatee-on-a-scootscoot/)
- Joe to return next week (4/30)

Android native app

Blocked by:
Blocking:
Updates:
- Released Reading list syncing!

Readers Web

Blocked by:
Blocking:
Updates:
- Page previews enwiki launch
- Post-launch page preview bug fixes and clean up https://phabricator.wikimedia.org/T192622
- Starting page issues work https://phabricator.wikimedia.org/T159262
- Planning for MobileFrontend & MinervaNeue frontend architecture improvements https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFrontend_%26_MinervaNeue_frontend_architecture
- Fixing mobile watchlist bugs https://phabricator.wikimedia.org/T191454
Quarterly goal dependency update:
- Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079
  - Reading Web depends on SRE, RelEng, Reading Infra

Readers Infrastructure

Blocked by:
Blocking:
Updates:
- CSS endpoints rolled out (https://en.wikipedia.org/api/rest_v1/#!/Mobile/get_data_css_mobile_site)
- Added Bosnian Wikipedia to supported wikis for featured article, In-the-news, and On-This-Day
- Working on simplistic browser extension to add the current page to the default reading list (for logged in users)
Quarterly goal dependency update:
- Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079
  - Reading Web depends on SRE, RelEng, Reading Infra
- Increase code sharing of client apps by coalescing and moving more logic to the server
  - Reading Infra depends on Parsing, Services

Maps

Blocked by: None
Blocking: None
Updates:
- Work being done by collab team
- Paul is out next scrum of scrums

Multimedia

Updates
- Wikibase patches for file page prototype going through
- Search work continuing for 'depicts'
- File captions - currently working through changing the name of the field for MediaInfo
Quarterly goal dependency update:
- Objective 3.1 Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
  - SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- Objective 2.1 Integrate structured file captions into search
  - SDC depends on Search Platform, Multimedia
- Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
  - Research depends on Multimedia

Contributors

Community Tech

Blocked by:
Blocking:
Updates:
- Just like last week: GlobalPreferences, CodeMirror, TemplateWizard

Anti-Harassment Tools

Blocked by:
Blocking: None
Updates: None
- Updating Block Notices on Mobile https://phabricator.wikimedia.org/T165535
- Adding Cookie Blocking to IP Users https://phabricator.wikimedia.org/T152462

Editing

Blocked by:
Blocking:
- Updates:

Parsing

Blocked by:
Blocking:
Updates:
- We are considering removing newline stripping in image captions. See https://gerrit.wikimedia.org/r/#/c/425726/
- In https://phabricator.wikimedia.org/T192037 we are beginning to make wikitext handling a bit more uniform across extensions and outside extensions, so there are fewer surprises / edge cases. That is yet to be flushed out, but is an advance heads up.
- Tidy removal is going apace -- another 40+ wikis will switch next week.

Quarterly goal dependency update:
- Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
  - Parsing depends on MediaWiki Platform, Services
- Increase code sharing of client apps by coalescing and moving more logic to the server

Increase code sharing of client apps by coalescing and moving more logic to the server.

- - Reading Infra depends on Parsing, Services

Outcome 2: Objective 1: Revision storage scaling phab task ?

- - Services depends on SRE, Parsing

Collaboration

Blocked by:
Blocking:
Updates:
- Localized maps deployed on testwiki and test2wiki, announcement coming soon
  - Test page: https://test2.wikipedia.org/wiki/Map_internationalization_examples
- Going to deploy <mapframe> to English Wikipedia on April 30th https://phabricator.wikimedia.org/T191584

Language

Blocked by: None
Blocking: None
Updates:
Quarterly goal dependency update:
- Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
  - Language depends on Editing

Audiences Design

UI Standardization

Blocked by:
Blocking:
Updates:
- OOUI – v0.26.5 released: https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.26.5
  - 5 style changes, 5 code improvements. Among those
    - De-emphasize toolgroup borders in order to visually de-clutter VE toolbar
    - PopupTool: Set active state depending on whether popup is open, again a change with visual impact, providing better user-friendliness
    - Toolbar: Put all popups (from PopupToolGroup and PopupTool) into an overlay. https://phabricator.wikimedia.org/T192505
- DateTimeInputWidget has been aligned to other WikimediaUI widgets https://phabricator.wikimedia.org/T189352
- Style Guide technical and content improvements ongoing with 6 open PRs currently
- Transparency Report now fully conformant to WCAG 2.0 level AA

Technology

Analytics

Blocked by:
Blocking:
Updates:
- Wikistats outage: bad data load led to a couple of days of unstable data, found the problems and rolled back, will update again soon, numbers are good now but missing 2018-03
- Wikistats is a little more mobile touch friendly, hover interaction a little better in general
- Wikistats titles and meta tags are now more SEO-friendly
- Spark 2 is now the default spark experience on the cluster
- lots of prep work for the Kafka cluster upgrade, already started updating some of the machines, monitoring, etc.
- page preview aggregate data is available now in a Hive table
- fixed wmf.mediawiki_user_history and wmf.mediawiki_page_history tables (they had bad column names which led to null values)
- fixed pagecounts-ez and mediacounts datasets outage problem

Cloud Services

Blocked by:
Blocking:
Updates:

Fundraising Tech

Blocked by:
Blocking:
Updates:
- DonationInterface: new recurring contribution API for main card processor
- CiviCRM: Debugging nasty transaction handling failures
- Working on getting landing page and banner impression EventLogging data into payments cluster DBs

MediaWiki Platform

Blocked by:
Blocking:
Updates:
Quarterly goal dependency update:
- Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
  - Parsing depends on MediaWiki Platform, Services
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) phab task ?
  - SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- Objective 1.1 Assist with deploying MultiContent Revisions on Commons

T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043 Deploy Multi-Content Revisions

- - SDC depends on MediaWiki Platform, WMDE

Performance

Blocked by:
- None
Blocking:
- None
Updates:
- Good progress consolidating our tools, getting them out of puppet
- Rolling out a tool called PerformanceInspector over the next couple of weeks -- will allow community members to get a bunch of performance data about pages on the wikis
- Doing some optimizations of ResourceLoader
- Making some fixes to MW Core to prep for PHP7
- Refactoring Varnish logging stuff to use mtail instead of a couple of deprecated varnish tools
- mcrouter is now being used in deployment-prep
- WebPageTest fully migrated over to Linux hosts

Release Engineering

Blocked by:
- rebuildLocalisationCache.php/localization update rebuilds are taking 40 minutes for full scaps (used to take 8minutes)
  - See: https://phabricator.wikimedia.org/T191921 if you have hhvm internals help to give :)
Blocking:
- none?
Updates:
- 1.32.0-wmf.1 is going out this week, wmf.30 was finally completed Monday
- Scap MediaWiki canary changes using service-check (hopefully live Soon™, working in beta)
Quarterly goal dependency update:
- No updates from us (if something specific needed from us, ping us!) Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079
  - Reading Web depends on SRE, RelEng, Reading Infra

Research

Blocked by: None
Blocking: None
Updates:
Quarterly goal dependency update:
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) phab task ?
  - SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
  - Research depends on Multimedia
- Most of the teams is at the Web Conference https://www2018.thewebconf.org/

Scoring Platform

Blocked by:
Blocking:
Updates:

Search Platform

Blocked by:
Blocking:
Updates:
- New analysis plugin deployed: https://phabricator.wikimedia.org/T189239 enabling Serbian and in the future other stemmers
- Slovak stemmer added, deploy & reindexing next: https://phabricator.wikimedia.org/T190815
- Some fixes for deep category search: https://phabricator.wikimedia.org/T192270, https://phabricator.wikimedia.org/T188350
- Wikibase Lexeme search patches merged
- Internal WDQS cluster installed, switching traffic to it soon: https://phabricator.wikimedia.org/T192942
- Working on indexing external IDs and string properties for Wikibase: https://phabricator.wikimedia.org/T99899
- Evaluating feature generation by `query_explorer` functionality of LTR plugin: https://phabricator.wikimedia.org/T187148
- Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
- WDQS GUI automatic build moving along, thanks RelEng: https://phabricator.wikimedia.org/T189811
Quarterly goal dependency update:
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) phab task ?
  - SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- *Objective 2.1 Integrate structured file captions into search
  - SDC depends on Search Platform, Multimedia

Security

Blocked by:
Blocking:
Updates:
Quarterly goal dependency update:
- Goal 3.6: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
  - Parsing depends on MediaWiki Platform, Services

Services

Blocked by: Several job serialization tasks, will talk to owners of the said jobs
Blocking: none
Updates:
- Enabled support for EventBus and kafka job queue for private wikis
- Replaced SSDs on restbase1010, rebootstrapped cassandra there
- CSS endpoint for reading infra deployed
Quarterly goal dependency update:
- Increase code sharing of client apps by coalescing and moving more logic to the server.
  - Reading Infra/Parsing, Services
- Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
  - Parsing depends on MediaWiki Platform, Services

Outcome 2: Objective 1: Revision storage scaling phab task ?

- - Services depends on SRE, Parsing

Site Reliability Engineering

Blocked by:
- None
Blocking:
- None
Updates:
- Have a look at https://blog.wikimedia.org/2018/04/24/new-data-center-singapore/
- Work on getting proton up (QR goal for Reading Web) and running started https://phabricator.wikimedia.org/T192983
Quarterly goal dependency update:
- Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079
  - Reading Web depends on SRE, RelEng, Reading Infra
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
  - SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research

Outcome 2: Objective 1: Revision storage scaling phab task ?

- - Services depends on SRE, Parsing

Wikidata

Blocked by:
Blocking:
Updates:
Quarterly goal dependency update:
- Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) phab task ?
  - SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
- Objective 1.1 Assist with deploying MultiContent Revisions on Commons

T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revisions

- - SDC depends on MediaWiki Platform, WMDE

German Technical Wishlist

Blocked by:
Blocking:
Updates:
- ICU 57 migration done
- Appservers are being reimaged to Debian Stretch

SoS Meeting Bookkeeping

Updates:
- Request from SRE: Please either add phab tasks to all goals so that work can be tracked and updates can be made in a meaningful way even across large and diverse teams, or let's just drop the quarterly goal dependency updates.