Scrum of scrums/2016-06-01




Reading InfrastructureEdit




  • Working on new feed UI

Mobile Content ServiceEdit

  • Adding first couple of new feed endpoints this week (enwiki featured article, most read articles, aggregated endpoint for previous and future feed microservices)

Community TechEdit




  • Blocked: New repository request for FileAnnotations so we can experiment and do design/code review on Mark's crappy prototype
  • Updates
    • ImageTweaks waiting on Thumbor and a few other things, no news there AFAIK
    • Gallery slideshow core work coming along, no huge updates from prtksxna
    • UW fatals rate waaaay down since last year, thanks Sentry people for helping us track it


  • Tidy replacement: With latest HTML5Depurate and visual diff test run, ~93.4% of test pages render with pixel perfect accuracy. Working through remaining diff scenarios (a lot of the diffs are harmless minor pixel shifts) to identify real issues and having wikitext be fixed or fix core parser as required.
    • Tim working on a HTML5 parser to fix some core parser issues around doBlockLevels.
  • Will attempt switching Parsoid to service-runner sometime next week (Arlo & Services)
  • Arlo close to getting html2html endpoint done (last remaining blocker to enable Parsoid new HTML version with separate data-mw)
    • VE & CX: Please start planning how to handle this new version.
  • Kunal working on using the new Linker code for files/images.


  • Blocked - None
  • Blocking - No change
  • Updates
    • Working on Echo special page, for both JS and no-JS users
    • Schema changes we requested are done, we now need to backfill and use the new schema


  • Blocking: none
  • Blocked: none
  • Tomasz last day at WMF was on Friday, Katie Horn leading Discovery now
  • ElasticSearch 2.3 upgrade in progress:
  • TextCat A/B test for english wiki started
  • Updated Portal language stats.

Fundraising TechEdit

  • Fixed CentralNotice tests, now enforcing ES3
  • More work to get off ActiveMQ, remove SPOF
  • Testing new processor in Israel, Japan and Ukraine
    • We quit messing with language fallback and just got the last few missing messages translated to Ukrainian
  • Ready to test new PayPal integration method
  • Enhancing fraud & dos mitigation measures



  • RESTBase
    • enforcing rate limits as of today
      • pageview: 10 req/s
      • transforms: 5 req/s
  • Change Propagation
    • now handles summary and MCS updates as well as purges
    • partially moved RestbaseUpdateJobs from job runners to it
      • still missing transclusions
  • MathML enabled by default across all projects

Technical OperationsEdit

  • Blocking: none
  • Blocked: none
  • Updates:
    • libicu update successful
    • Started preliminary work on migrating appservers to jessie
    • Last day of Riccardo
    • Getting graphite into better shape


  • Loaded 3 months of pageview data into Druid and querying it is very fast
  • Cleaning up limn-flow-data, limn-edit-data, and limn-languge-data a little bit, deploying today
  • Working on processing data from the mediawiki databases and turning it into an analytics-friendly schema (one example is slowly changing dimensions such as page_title recorded as (page_id, page_title, valid_from, valid_to))
  • pageview requests that miss the cache are rate-limited to 10 req/s. More req/s than that will throw 429


  • Two-factor usability surveying prep continues
  • Reviews: Ex:DoubleWiki, Ex:TemplateStyles, Use of wheels for deployment by Analytics

Release EngineeringEdit

  • Blocking: None
  • Blocked: Nada
  • Update:
    • Auth Manager rolling out *soon*