Scrum of scrums/2019-11-20

2019-11-20

Callouts

• • SRE:
    • DBAS [general update] Upcoming s1 (enwiki) database master switch 14 Nov: phab:T234800 [will imply a small read only window]
    • Requesting follow-up from Scoring team phab:T233448#5638765
    • Requesting follow-up from Releng team gerrit:479139
  • Release Engineering: no train because of team offsite

Product

iOS native app

• Blocked by:
  • Core Platform
    • release wikidiff2 to get section titles from compare endpoint
    • counts endpoint limit increases
    • minor count endpoint failing (https://en.wikipedia.org/w/rest.php/v1/page/Barack_Obama/history/counts/minor)
• Updates:
  • 6.5 wrapping up bugs/development - phab:project/view/4245
    • aiming to be in public beta Friday (11/22)

Android native app

• Updates:
  • Our major release is all set to go out the door.: phab:project/view/4123
    • Fundraising banner is ready and in review.
    • We have re-started work on integration with mobile-html endpoint.

Product Infrastructure

• Updates:
• Patches for client-side error logging and EventLogging client improvements
• Security review followups for MachineVision
• Reviewing MCS overhaul patches
• Wikifeeds
  • Removed frwiki from supported TFA wikis due to phab:T237790
  • Patch in review for upgrading to Node 10 -- just need confirmation from CPT that this won’t cause any problems

Structured Data

• Blocked by:
  • WMDE/Wikidata: review of gerrit:548734 (phab:T222497)
• Blocking:
  • Search Platform: Data dumps for SDC: phab:T221917

Parsing

• Blocked by:
  • deployment recipe issues need resolving before we do additional live traffic deploys (phab:T238685 and phab:T238748)
  • (soft blocker) still working to get all parsoid clients tested against parsoid/php (Content translation and flow)
• Updates:
  • parsoid/php is on testwiki -- see wikitech-l mail from y'day

Inuka

• Updates:
  • PageViews instrumentation: phab:T238029

Technology

Fundraising Tech

• Updates:
  • CiviCRM
    • More tweaks to how we import data from our bulk mailing provider
    • Changes to our custom drupal code to accommodate using a read-only database connection for some requests.
    • Still working on button to send end-of-year summary receipt on demand phab:T221271
  • CentralNotice
    • Trying to understand a few more oddities in the new EventLogging data pipeline. For example, how are we getting client-side FundraiserLandingPage events without corresponding server-log pageviews? phab:T236835#5670862 ...see the section "Explaining orphaned events in new logs"
    • Finishing up initally-contractor-written feature to extend geotargeting to regions smaller than countries. phab:T226438

Core Platform

• Blocking:
  • Potentially Wikidata/WMDE: Mentioned 2 times in SoS already with no result: In the Data Bridge work (editing Wikidata items from Wikipedia) we have encountered problems with Special:EntityData serving stale (old) data. The problem is quite old: phab:T128486. We are looking for a team/person with whom we could get some clarity on the current state of the cache solutions on WMF cluster, and figure out how to get phab:T128486 unstuck.
  • iOS
    • release wikidiff2 to get section titles from compare endpoint
    • counts endpoint limit increases
    • minor count endpoint failing (https://en.wikipedia.org/w/rest.php/v1/page/Barack_Obama/history/counts/minor)
• Updates:
  • REST API extension interface documentation API:REST_API/Extensions

Engineering Productivity

Release Engineering

• Blocking:
  • SRE: Requesting follow-up from Releng team gerrit:479139
• Updates:
  • Train Health
    • Last week: no train because of Wikimedia Technical Conference
    • This week: no train because of team offsite
    • Next week: 1.35.0-wmf.8 phab:T233856

Scoring Platform

• Blocking:
  • SRE: Requesting follow-up from Scoring team phab:T233448#5638765
• Updates:
  • Team back from offsite in Austin
  • We got a laptop to Uganda via DHL in a reasonable amount of time.

Search Platform

• Blocked by:
  • Structured Data: Data dumps for SDC: phab:T221917
• Blocking:
  • WMDE/Wikidata: Not critically blocked by, but pinging the team to have a look at phab:T234431.
• Updates:
  • New elasticsearch servers configured and in production (elastic10[53-67].eqiad.wmnet) - phab:T230746
  • Refactor Puppet WDQS module to make it usable for WDQS and CQS phab:T232297
  • Metrics from the WDQS updater are no longer collected phab:T238408

Site Reliability Engineering

• Blocked by:
  • Scoring Platform team:
    • Requesting follow-up from Scoring team phab:T233448#5638765
  • Releng:
    • Requesting follow-up from Releng team gerrit:479139
• Updates:
  • [general update] Upcoming s1 (enwiki) database master switch 14 Nov: phab:T234800 [will imply a small read only window]

Wikimedia DE

Wikidata

• Blocked by:
  • Search Platform: Not critically blocked by, but pinging the team to have a look at phab:T234431.
  • Not sure who, Core Platform? Mentioned 2 times in SoS already with no result: In the Data Bridge work (editing Wikidata items from Wikipedia) we have encountered problems with Special:EntityData serving stale (old) data. The problem is quite old: phab:T128486. We are looking for a team/person with whom we could get some clarity on the current state of the cache solutions on WMF cluster, and figure out how to get phab:T128486 unstuck.
• Blocking:
  • Structured Data: review of gerrit:548734 (phab:T222497)