Scrum of scrums/2016-09-07

2016-09-07

Product

Reading

Q2 FY 2016-2017 (October - December 2016) goals drafted:

   https://www.mediawiki.org/wiki/Wikimedia_Engineering/2016-17_Q2_Goals#Reading

Reading Web

Current sprint:

   * Lazy loaded images fixes
   * Related pages improvements
   * Shipping wikidata descriptions in mobile web to some wikis
   * Disabled lazy loaded references, plan to analyze data

Mobile Content Service

• Services team added ChangeProp for Wikidata descriptions to mobile-sections endpoint in addition to the /page/summary endpoint. :)

Android native app

Current sprint: https://phabricator.wikimedia.org/project/view/2178/ Next sprint: to be created

   * Navigation overhaul continues

iOS native app

Current release board: https://phabricator.wikimedia.org/project/view/1736/ Next release board: https://phabricator.wikimedia.org/project/view/2150/

• 5.1 was released (iPad explore & article layout, find in page), as was 5.1.1 with crash fixes
• Working on 5.2 (iOS 10 Today Widgets - Top Read & Continue Reading) - Released to beta, target to be released with iOS 10

Reading Infrastructure

• blocked: waiting on Security to validate the approach in https://gerrit.wikimedia.org/r/#/c/306133/
  • AB emailed bawolff during today's SoS, CC'ing dpatrick, anomie, tgr
• blocking: none

Community Tech

• Numeric sorting has been deployed to English Wikipedia, investigating other languages
• PageAssessments has been deployed to English Wikivoyage, will do a functional roll-out this afternoon
• Working on cross-wiki watchlist backend
• No blockers

Security

• Darian on PTO Sept. 6-9
  • E-mail security@wikimedia.org for urgent issues
  • E-mail security-team@wikimedia.org for non-urgent issues
• Security reviews outstanding for this week:
  • Youdao MT (Brian is handling)

Analytics

• Andrew demoing Event Bus events flowing through kasocki (kafka -> socket.io interface) in the CREDIT showcase, after this meeting
• Luca put up https://yarn.wikimedia.org which allows all folks with LDAP to access yarn logs for hadoop jobs
• some problems loading pageview data left a couple of days behind, Joseph reran those jobs and that data is now loaded
• rotating scrum of scrums participation from now on: Nuria, Dan, Marcel, Joseph
• tentative: the new AQS cluster ready by next week
• tentative: edit history reconstructed by next week, Erik Z will vet it but if others are interested, let us know
  • as a reminder, this is all data collected in mediawiki databases, reconstructed as an append-only event store
  • logging table was mined for page deletes and moves, user deletes, renames, rights changes, and blocks
  • archive table and revision table were merged and their user and page fields historified (values at the time of the event were reconstructed)
  • everything is written under a single denormalized schema of the form {metadata, data that was modified (page|user|revision)}

Services

• New format for the section transform API
  • https://en.wikipedia.org/api/rest_v1/#!/Transforms/post_transform_section_changes_to_wikitext_title_revision
• Change-Prop processing transclusions now
• Wikidata description added to summary endpoint
• Some optimisations in feeds endpoint
• Config deploys with scap3 under way

Editing

Language

• Blocked: Waiting for updates on security review of Youdao MT.
• Blocking: None.
• Updates:

   ** Work on ContentTranslation (template handling) continue.
   ** Kartik fixing last bits in Apertium packaging.

Parsing (No one around to attend meeting, update below)

• Waiting on feedback from VE team for the Parsoid's native implementation of the <gallery> extension ( https://gerrit.wikimedia.org/r/#/c/264026/ )
• Work ongoing to support language variants for read view in Parsoid.
• Work ongoing with the refactoring of parser tests framework (merging the php unit and parser tests scripts)
• Patch implementing magic-word based opt-out of global user pages awaiting review ( https://gerrit.wikimedia.org/r/#/c/303912/ )

Collaboration

• Blocking:
  • Continuing work on Flow caching rewrite for multi-DC. This is being reviewed now both within-team and by Aaron.
• 'Blocked:
• Updates:
  • Continuing work on MessagePoster.

RelEng

• Blocking
  • Add section for long-running tasks on the Deployment page (specially for database maintenance)
    • greg had to take a half day yesterday, will catch up on it today
    • https://phabricator.wikimedia.org/T144661
• Blocked
  • Move contint1001 to production network with public IP - https://phabricator.wikimedia.org/T140257
    • Public IP is Blocked on ops

Technical Operations

• Blocked
  • None
• Blocking
  • None
• Updates
  • varnish 4 upgrade process ongoing
  • labsdbs will probably be reimaged and the entire service restructured in the next Quarter

ArchCom

• Full status: https://www.mediawiki.org/wiki/ArchComStatus
• Last week: Phab:E266
• This week Phab:E269
  • Ad hoc ArchCom office hour
    • Briefly touching on Shadow Namespaces (Phab:T91162)
    • (last minute addition) Phab:T141938: Wikimedia Developer Summit Program

Fundraising Tech

• Switched over four queues from ActiveMQ to Redis
• monitoring for hiccups, working on switching remaining three
• pushing more code into library that doesn't depend on MediaWIki or Drupal/CiviCRM
• fixing a couple GeoIP issues in CentralNotice
• more polishing for CiviCRM batch de-duplication

=== Discovery ===

• No blockers
• BM25 A/B test is on
• Working on multiwiki indexes
• Turned off "did you mean" on wikidata due to it not being very useful
• SPARQL Workshop on September 8th: https://office.wikimedia.org/wiki/SPARQL_workshop
• Discernatron & BM25 demo / luncheon on Sept 13th (remote-friendly, except food)
• CREDIT demos today

Interactive team

• <maplink> is now available on all wikis
• maps got WDQS support (Demoing https://www.mediawiki.org/wiki/User:Smalyshev_(WMF)/Govmap at CREDIT)