Scrum of scrums/2018-06-20

Callouts

• Security: Security review for Wikidata queries data release proposal https://phabricator.wikimedia.org/T190875
• MCR: a couple huge patches related to page editing and revision read/write have been merged and are on group0 for testing, keep an eye out for strange behavior ( https://gerrit.wikimedia.org/r/c/mediawiki/core/+/405015 https://gerrit.wikimedia.org/r/c/mediawiki/core/+/406595 https://gerrit.wikimedia.org/r/c/mediawiki/core/+/416465)

Audiences

Readers

iOS native app

• Blocked by:
• Blocking:
• Updates:
  • 5.8.2 w/ event logging analytics and bug fixes released ( https://phabricator.wikimedia.org/project/view/3358/ )
  • Continuing work on next major release, 6.0 - Feed customization and design updates ( https://phabricator.wikimedia.org/project/view/3238/ )

Android native app

• Blocked by:
• Blocking:
• Updates:

Readers Web

• Blocked by:
  • Ruby to JS Cucumber refactor needs help from the RelEng team to fix our flaky Ruby tests: https://phabricator.wikimedia.org/T190710
• Blocking:
• Updates:
  • Mobile web (MobileFrontend) page issues
    • A/B testing framework merged T193584
    • UI in progress T191303
  • Mobile web (MobileFrontend / MinervaNeue) bug fixes and improvements T189225 T194544 T196758 T156186 T196802 T190549 T161399 T193517 T197627 T192725 T195371
  • Add WikidataPageBanner per skin config flag to allow subtitles to render above the banner T113642
  • Page previews (Popups) post-en/dewiki launch clean up T191888 T192627 T191646 T192928 T193522 T196952 T193519 T193792
  • PDF rendering service (Proton) T178665 T186748 T189307
  • Mobile web in-article navigation user testing and design T193772
  • Wrapping up annual planning
• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra

Readers Infrastructure

• Blocked by:
• Blocking:
• Updates:
  • Safari Reading List extension: still waiting on QA to finish
  • MCS: Working on using clients' Accept-Language header value for MCS's MW API calls, too.
  • PCS: Working on content-html endpoint.
• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra
  • Increase code sharing of client apps by coalescing and moving more logic to the server
    • Reading Infra depends on Parsing, Services

Maps

• Blocked by:
• Blocking:
• Updates:
  • New style and borders work deploy cancelled indefinately

Multimedia

• Work on search prototypes for depicts statements is underway - getting a head start on next quarter
• Further search work continues on various indexing patches
• OOUI migration for Wikibase is stalled mostly due to Mark being interrupted every five minutes or so
• Quarterly goal dependency update
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki Platform, Research
    • Work continues here, MCR schedule is known, OOUI migration is underway (but slow) - upload integration mostly complete
    • Goal will bleed slightly into next quarter especially with regard to OOUI migration for Wikibase
  • Integrate structured file captions into search
    • SDC depends on Search Platform, Multimedia
    • Mostly complete
  • Develop a better understanding of existing needs for Structured Commons- T171252
    • Research depends on Multimedia
    • AFAIK still complete/underway and no engineering resources needed

Contributors

Community Tech

• Blocked by:
• Blocking:
• Updates:
  • CodeMirror is out of beta
  • Final fixes for GlobalPreferences
  • Still working on adding Draft: namespace to PageTriage

Anti-Harassment Tools

• Blocked by:
• Blocking:
• Updates:

Editing

• Blocked by:
• Blocking:
  • Updates:

Parsing

• Blocked by:
• Blocking:
• Updates:
  • Language variants endpoint now live in Beta Cluster. Plan to deploy to production on Monday pending all tests okay.
  • Tidy to Remex switch over nearly complete
  • We are planning to do the final switch from Tidy -> RemexHtml for all wikis on the wikimedia cluster on July 5th

• Quarterly goal dependency update:
  • Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services
  • Increase code sharing of client apps by coalescing and moving more logic to the server

Increase code sharing of client apps by coalescing and moving more logic to the server.

• • • Reading Infra depends on Parsing, Services

Outcome 2: Objective 1: Revision storage scaling

• • • Services depends on SRE, Parsing

Collaboration

• Blocked by:
• Blocking:
• Updates:

Language

• Blocked by:
• Blocking:
• Updates:
  • ContentTranslation 2 work continue: MT Options, Title error fixes.
  • Purge script and Apertium (apy, fra-cat) updates likely to be unblocked next week.
• Quarterly goal dependency update:
  • Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
    • Language depends on Editing

Audiences Design

• Blocked by:
• Blocking:
• Updates:

UI Standardization

• Blocked by:
• Blocking:
• Updates:

Technology

Analytics

• Blocked by:
• Blocking:
• Updates:

Cloud Services

• Blocked by:
• Blocking:
• Updates:

Fundraising Tech

• Blocked by: -
• Blocking: -
• Updates:
  • Normal maintenance on payment processor integrations, especially Ingenico.
  • Moving pages in the Fundraising workflow currently on Foundation Wiki to Donate Wiki.
  • Export and deletion features in CiviCRM (system for donor data).
  • Continuing work on data pipeline for sampled banner and landing page data.

MediaWiki Platform

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Objective 1.1 Assist with deploying MultiContent Revisions on Commons

T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revisions

• • • SDC depends on MediaWiki Platform, WMDE

Performance

• Blocked by:
• Blocking:
• Updates:

Release Engineering

• Blocked by:
  • None
• Blocking:
  • Working on https://phabricator.wikimedia.org/T190710 for Readers
• Updates:
  • wmf.999 is running on group0 wikis for testing MCR related changes, see https://phabricator.wikimedia.org/T196585
  • thanks to those that participated in the Beta Cluster survey!
• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra

Research

• Blocked by: None
• Blocking: None
• Updates:
  • Finished adding UI translations (all 5 languages) to the Gapfinder tools project.: http://gapfinder-tools.wmflabs.org/
  • Script to train models based on Wikidata sitelink count is done. The next step is to add one more feature: https://github.com/wikimedia/research-translation-recommendation-models/
  • We'll be modifying the Unsourced Statements Wikilabels campaign and re-run it soon.
• Quarterly goal dependency update:
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
    • Research depends on Multimedia

Scoring Platform

• Blocked by: None
• Blocking: None
• Updates:
  • wp10 model deployed - also available in MediaWiki database
    • Call out Community Tech & Growth
  • JADE scalability discussion continues https://phabricator.wikimedia.org/T196547

Search Platform

• Blocked by:
  • Security: Security review for Wikidata queries data release proposal https://phabricator.wikimedia.org/T190875
• Blocking:
• Updates:
  • Reindexed Serbian, Croatian, Serbo-Croatian and Bosnian Wikis to make use of new analyzers
  • Fixed regex timeout handling in Elasticsearch: https://phabricator.wikimedia.org/T195491
  • Ideas on using NLP is search: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Potential_Applications_of_Natural_Language_Processing_to_On-Wiki_Search
  • Reviewed applying Indonesian analysis chain to Malay: https://phabricator.wikimedia.org/T196780
  • Reviewing Esperanto morphological libraries: https://phabricator.wikimedia.org/T197240
  • Working on Lexeme fulltext search: https://phabricator.wikimedia.org/T196188
  • Working on fixing Geodata issues: https://phabricator.wikimedia.org/T196526
  • Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
• Quarterly goal dependency update:
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • *Objective 2.1 Integrate structured file captions into search
    • SDC depends on Search Platform, Multimedia

Security

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Goal 3.6: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services

Services

• Blocked by: none
• Blocking: none?
• Updates:
  • REST API Language variants support for HTML is live on beta for some wikis
• Quarterly goal dependency update:
  • Increase code sharing of client apps by coalescing and moving more logic to the server.
    • Reading Infra/Parsing, Services
  • Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
    • Parsing depends on MediaWiki Platform, Services

Outcome 2: Objective 1: Revision storage scaling

• • • Services depends on SRE, Parsing

Site Reliability Engineering

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
    • Reading Web depends on SRE, RelEng, Reading Infra
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research

Outcome 2: Objective 1: Revision storage scaling

• • • Services depends on SRE, Parsing

Wikidata

• Blocked by:
• Blocking:
• Updates:
• Quarterly goal dependency update:
  • Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
    • SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
  • Objective 1.1 Assist with deploying MultiContent Revisions on Commons

T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revisions

• • • SDC depends on MediaWiki Platform, WMDE

German Technical Wishlist

• Blocked by:
• Blocking:
• Updates:

SoS Meeting Bookkeeping

• Updates: