Scrum of scrums/2017-10-04

2017-10-04

contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering

Callouts

• Language: Need help to debug: https://phabricator.wikimedia.org/T173801 further
• 3D deployed to testwiki, feel free to upload STL files to test it out
• Mobile web disabling OCG [cc Operations] ( https://phabricator.wikimedia.org/T150871 )
• Need Ops review of patches for https://phabricator.wikimedia.org/T146381#3447319

Audiences

Readers

iOS native app

• Blocked by: none
• Blocking: none
• Updates:
  • 5.6.1 release went well ( https://phabricator.wikimedia.org/project/view/2898/ ) - crash rate is low, 5 star rating
  • Continuing work on 5.7.0 ( https://phabricator.wikimedia.org/project/view/2899/ ) - Onboarding updates, Improved analytics, iOS 11 support, iPhone X support. Public beta this week.

Android native app

• Blocked by: Reading List API/service
• Blocking: none
• Updates:
  • Preparing for maintenance release with design updates / bug fixes for language variant issues.
  • This is planned to be the last release that supports earlier Android versions than KitKat (<4.4).

Multimedia

• 3D deployed to testwiki, feel free to upload STL files to test it out
• Next up: Work on MediaInfo, an extension for Wikibase, which will be central to our work on SDoC
  • Adding API module to shortcut wbgetentities via filenames (instead of querying for the page ID, then the entity)
  • Adding page_props entries for uploaded files to point to the relevant MediaInfo entity

Web

• Disabling OCG [cc Operations]
• Investigating ChromeDriver as an alternative.

Discovery

• Working on creating a Labs Tool to automate portal builds

Maps

- Fixing release practices - Preparing to update versions in production

Reading Infrastructure

• finishing ReadingList proxy
• MCS: adding fundraising announcement for France

Contributors

UI Standardization

• Blocked by Design: `font` specifics upstream to WikimediaUI Base https://phabricator.wikimedia.org/T175877
• Updates (last week update was missing, due to meeting conflict, including important here):
  • TransparencyReport made fully accessible – https://transparency.wikimedia.org/ https://phabricator.wikimedia.org/T173629
  • OOUI v0.23.2 (last week) & v0.23.3 released, among changes:
    • UI design
      • WikimediaUI theme: 10+ changes on toolbar code & design, most importantly unifying positioning and sizing of tools, toolgroups and menus (Volker E.)
        • https://phabricator.wikimedia.org/T176106 & https://phabricator.wikimedia.org/T177234
      • Apex theme: Begin killing `constructive` flag & streamline demo (James D. Forrester) – https://doc.wikimedia.org/oojs-ui/master/demos/
    • Accessibility
      • WindowManager: Set `aria-hidden` by default and change toggleAriaIsolation behavior (Prateek Saxena)
• Ongoing:
  • OOUI icons: Work on icon set to be more harmonious and align to WikimediaUI Style Guide's guidelines

Collaboration

• Releasing RCFilters as default experience to all wikis (except some FlaggedRevs ones) probably tomorrow (Oct 5)
• We (WMF) need to get serious about Wikidata-triggered watchlist problems (https://phabricator.wikimedia.org/T171027 ), Roan is going to dive into that and propose action

Language

• Blocked: See callout (https://phabricator.wikimedia.org/T173801 )
• Blocking: None, but https://phabricator.wikimedia.org/T107914 is holding due to infrequent cxserver updates.
• Updates:
  • CX-VE: Template adaptation, publishing and error handling work in progress

Parsing

• Nothing significant to update

Community Tech

• Not blocked
• Not blocking
• Nothing new, continuing work on GlobalPreferences

Technology

Analytics

• New kafka cluster (kafka-jumbo) is using prometheus for metrics.
• Working on Druid configuration so we have 2 clusters: public data and private data cluster. The public one will serve the wikistats 2.0 backend.
• Issues with disk space on databases (db1002), trying to free up, have moved some tables to Hadoop, more info here: https://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging#Hadoop._Archived_Data
• Working with legal to perserve data for litigation purposes.
• Finished auditing of users and data access, carrying goals for next quarter: purging of eventlogging data and wikistats 2.0 alpha release
• Gave talk at Strata about analytics in wikipedia in conjunction with Druid folks. Slides: https://www.google.com/url?q=https://docs.google.com/a/wikimedia.org/presentation/d/1WwwytWLvbfq5Hq-qyN5FlC7innRf9iCatKB6qBrWz1o/edit?usp%3Ddrive_web&sa=D&ust=1507050585421000&usg=AFQjCNHcAjhuM3xLIgBEfQMrc6OA9zV3wA

Scoring Platform

• Blocked by:
• Blocking:
  • About to unblock the new ORES cluster. Need one more iteration of stress testing.
• Updates:
  • Created a list of c. 50 community stakeholders, and will use that to communicate and get feedback on initial work on JADE:
    • https://www.mediawiki.org/w/index.php?title=User:Keegan_(WMF)/sandbox
    • https://www.mediawiki.org/wiki/JADE
  • Preparing a new major version release for revscoring 2.0, which we hope is seamless but may involve some turbulence for ORES consumers. The thresholds API has a breaking change. Planned deployment date is c. Oct 18th.

Search Platform

• Blocked by: none
• Blocking: none
• Updates:
• Added more namespaces to default searches, per community requests (https://phabricator.wikimedia.org/T170473)
• Working on porting Selenium tests from Ruby to JS
• Working on upgrade to Elastic 5.5
• Working on indexing Wikidata descriptions

Fundraising Tech

• Looking into possible issues with Kafkatee not getting us all the web logs we need: https://phabricator.wikimedia.org/T177331
• dealing with Safari's new privacy settings
• Adding lots of metrics to https://grafana.wikimedia.org/dashboard/db/fundraising-overview?refresh=1m&orgId=1
• Fixing issues with CiviCRM's de-duplication UI
• Dealing with outgoing mail issue caused by PHPMailer security fix

Technical Operations

• Blocked by: none
• Blocking: none
• Updates:
  • Goals completed: Streamline Service Delivery / Remove salt from our infrastructure / Prepare for puppet 4 / Improve database backups' coverage
  • Asia DC unblocked, moving along with procurement

RelEng

This week

• Blocking
• Blocked
  • Need Ops review of patches for https://phabricator.wikimedia.org/T146381#3447319
• Updates
  • Mukunda taking over for 1.31.0-wmf.2 for the rest of this week

Security

• Reviews:
  • Ex:FileImporter (T160982)
  • Ex:WikipediaExtracts (T149424)
  • pdfrw