Scrum of scrums/2015-09-09

2015-09-09

Reading

Android

• Production release (v2.0.110-r-2015-08-31) with link previews expected Thursday. Increased textextracts usage (about 100x more as compared to beta).
• CI tests are up! Lots of help from hashar (Antoine Musso) and thcipriani (Tyler Cipriani).
• Work continues on preparing page loading via the mobileapps content service

iOS

• Ramping up to beta, but not estimating to release until at least October
  • If current UX stays, we'll be using TextExtracts on top of search generators. Will start discussions as app solidifies.
• Beginining brainstorming/discussions around providing structured access to Main Page content

Reading Infrastructure

• https://phabricator.wikimedia.org/T91148 is still blocked on whoever owns oojs-ui
• Not blocked on https://phabricator.wikimedia.org/T95864 (Ops?) or https://phabricator.wikimedia.org/T110274 (CI) yet, but it's on the horizon
• (Sorry about 2 weeks ago. Google Hangouts sometimes loses audio for me, so I never heard the meeting start)

Editing

Parsing

• Nothing really significant to report.
  • Tidy replacement continues to be WIP while we figure out if there is anything significant that might break.

Collaboration

• Finishing up a schema change (https://phabricator.wikimedia.org/T111084); ops is aware of this.
• Flow opt in feature is in production, but not yet turned on.
• Will be adding Flow dumps soon.
• Continuing OO UI work

Language

• Blocked: Ops/DB: T111317: Waiting for Suggestion tables to be finished.

Discovery

• Wikidata Query Service - http://query.wikidata.org/ - announced!
  • Dashboard http://searchdata.wmflabs.org/wdqs/
• Planning for maps announcement
• Started A/B test on suggester
• More research on language detection and cross-wiki search ( https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Language_Detection_Evaluation )
• Updating search cluster documentation
• https://phabricator.wikimedia.org/T76497 - enabled per-IP rate limiting for CirrusSearch
• Blocked: none
• Blocking: https://phabricator.wikimedia.org/T92796 - proposal approved, will work on finalizing the fix
• Team offsite 30 Sep - 2 Oct

Security

• Reviews: avro/kafka done, QuickSurveys next, then RevScoring
• Working with Analytics on T109724
• Services: T100031 (Marko: just posted a reply)

Infrastructure

Release Engineering

• Blocking: (none)
• Blocked by: Technical Operations
  • Need feedback on which ops/puppet modules should be excluded from Rubocop linting
    • https://phabricator.wikimedia.org/T102020
  • Backporting ElasticSearch 1.7 to Precise (Done; Thanks!)
    • https://phabricator.wikimedia.org/T111781
• Updates:
  • Deployment tooling implementation continues
    • https://phabricator.wikimedia.org/project/view/1449/
    • Implementing output/logging features and rollback this week
  • Progress on Isolated CI project
    • Base images successfully building using parts of ops/puppet
    • Will continue work to include all of mediawiki::packages and other contint::packages

Technical Operations

• Blocking: https://phabricator.wikimedia.org/T102020 (rubocop linting), https://phabricator.wikimedia.org/T84956 (sentry)
• Blocked by: none
• Updates:
  • codfw live as Tier-2, slowly adding locations
  • mailman done today
  • schema changes policy change imminent

Research

• Blocking: none
• Blocked by: none
• Updates:
  • Some downtime for ORES yesterday during a deploy. See https://wikitech.wikimedia.org/wiki/Incident_documentation/20150908-ores

Services

• No blocke(e|r)s
• Code review of the Maps service in progress - https://phabricator.wikimedia.org/T109021
• RESTBase: support for private wikis in testing, should be in prod by the end of the week

Community Tech

• Working on fixing broken database reports on en.wiki
• Working on fixing Citation bot
• Working on building parity between Hovercards and Navigation pop-ups
• Preparing community satisfaction survey

Analytics

• Pageview API general approach decided and agreed upon, work ongoing to merge the puppetization of the new 3-server RESTBase cluster
• Event Logging on Kafka is nearly done, deployment is happening in phases right now
• Ongoing work: estimated unique device counts, bot vs. spider identification in request logs, and dashiki improvements
• (looking at security bug, Chris)

Advancement

Fundraising Tech

• Big CentralNotice deploy was a success
  • Does seem to have improved performance
  • More performance improvements in the works, including some contributions from outside of the FR team (yay!)
  • More work on Resource Loader-based banner and campaign functionality
• Continuing work on Amazon Payments and Worldpay integration changes
• No blockers