Scrum of scrums/2015-09-16

2015-09-16

Reading

Android

• Production release (v2.0.110-r-2015-08-31) with link previews published September 10th.
• Android is switching to HockeyApp crash reporting.
• Final planned legacy device release in progress.
• We plan to introduce link preview content loading via the mobileapps service for 5% of users in a near-future beta release.

iOS

• Will be following up with Analytics to adopt pageview/preload/preview header "schema" similar to Android
• Conversation w/ Apple regarding iOS 9 "Universal Links" still ongoing, nothing to report

Reading Infrastructure

• https://phabricator.wikimedia.org/T91148 is still blocked on whoever owns oojs-ui
• Not blocked on https://phabricator.wikimedia.org/T95864 (Ops?) or https://phabricator.wikimedia.org/T110274 (CI) yet, but it's on the horizon

Editing

Parsing

• Deployments on track.
• Performance: Work onging to enable the Parsoid Batching API in production (testing and bug fixes going on right now)
• Testing: Visual diffing tool now usable in more contexts besides comparing Parsoid and PHP parser HTML output (email sent out on wikitech-l and engineering lists)
  • Helped identify bug in the Parsoid Batching API code.
  • Will be used to compare Tidy output vs. output of a non-Tidy HTML5 parser (T89331)
  • Repo @ https://github.com/subbuss/parsoid_visual_diffs

Language

• No blocker/blocking.
• CX reached 20K articles mark
• Suggestions getting deploy tomorrow;

Collaboration

• Finishing up the separate references links table issue. There was an outage due a DB index issue, but that's resolved.
• Continuing prep work for Flow dumps.
• Working on some bugs related to Flow history
• Doing planning for how to deal with Flow issues with the planned switch to multiple data centers, specifically in regard to indices.
• Working on performance issues relating to Echo flyout change (which also changed it to use OO UI).

Infrastructure

Release Engineering

• Blocking: (none)
• Blocked by: (none)
  • Thanks to Technical Operations for unblocking! https://phabricator.wikimedia.org/T102020
• Updates:
  • Deployment tooling implementation continues
    • https://phabricator.wikimedia.org/project/view/1449/
    • Merged improvements to config deployment
    • Accurate output/logging and rollback almost complete (patches up for review today)
  • Slew of MW-Vagrant patches need review (later this week)

Technical Operations

• Blocking: none
• Blocked by: none
• Updates:
  • Juniper bug, codfw drained
  • mailman migration failed, second try this week
  • Schema policy change proposal: https://wikitech.wikimedia.org/wiki/Schema_changes/Coordination_proposal

Services

• Working on Cassandra multi-DC setup (in collaboration with Ops)
• RESTBase private-wiki support is in prod
• https://phabricator.wikimedia.org/T100031 should be done a couple of hours from now

Research

• Blocking: none
• Blocked by:
  • Analytics (otto) -- https://phabricator.wikimedia.org/T112770 (Install snzip on stat1002 and stat1003)
• Updates:
  • Switched ORES away from python pip. Debian package repos mostly done. Timeouts and instability issues seem to be resolved.

Analytics

• blocked by tech ops. on naming and adding the 3 new analytics restbase nodes to a VLAN
• bug in Event Logging caused inconsistent client IP hashing (same IP was hashed 12 different ways on the separate parallel processors). Mentioned on the list yesterday, fixed now. This applies to data collected through Event Logging from September 10, 2015 until September 16, 2015 (fix deployed around 16:38)

Discovery

• Suggester tests underway
  • Some sampling/bucketing issues, fixed now
  • Will restart the test with new bucketing scheme
• Working on other ways to reduce zero results, such as relaxing constraints on common words
• Blocking:
  • https://phabricator.wikimedia.org/T92796 - still in progress
• Blocked:
  • https://phabricator.wikimedia.org/T112349 turned out to be much bigger than expected, will need to discuss with i18n team probably

Fundraising Tech

• Central Notice: performance tweaks, bug fixes, campaign logic mixins
  • This EventLogging patch might help with banner history logging: https://gerrit.wikimedia.org/r/238623
• Wrapping up work on new ways of integrating with Amazon and Worldpay

Community Tech

• Wrapping up work on broken database reports on en.wiki
• Working on fixing Citation bot
• Preparing community satisfaction survey

Security

• Yuri, ping - T98313, or is there someone else I should coordinate with?
• Reviews: less library for perf this week
• Please get reviews for next quarter in Phab now!
• https://gerrit.wikimedia.org/r/#/c/233091/ anomie
• T109724 will still need Analytics / research input as soon as we figure out next step :)
• Patch process: RelEng, your driving that?