Scrum of scrums/2017-09-20
2017-09-20
editcontact: https://www.mediawiki.org/wiki/Wikimedia_Engineering
callouts
edit- Ops => Collaboration. Flow dumps speed issue still https://phabricator.wikimedia.org/T172025 and (T164262)
Audiences
editReaders
editReading Web
edit- Actively working on OCG replacement
- Refactoring & adding electron support to Collection extension
- Working on Marvin
- Got a green light to enable Popups on en wiki
Multimedia
edit- Pushing 3D to Test/Test2 sometime next week barring any further blockers
- Would still like feedback from Performance on https://phabricator.wikimedia.org/T166699 but since we asked and didn't get any last week, I no longer consider it a blocker
Discovery
edit- Blocked by: none
- Blocking: none
- Updates:
- (Maps) Reimaged test-servers, updating to Node 6.11
- (Maps) enwiki looking at maps
- (Front-end) Mirgating CirrusSearch Selenium tests from Ruby to Node
- (Front-end) Running AB test on Special:Search
iOS native app
edit- Blocked by: none
- Blocking: none
- Updates:
- Still releasing 5.6.1 with minor bug fixes ( https://phabricator.wikimedia.org/project/view/2898/ )
- Continuing work on 5.7.0 ( https://phabricator.wikimedia.org/project/view/2899/ ) - Onboarding updates, Improved analytics
Reading Infrastructure
edit- Blocked by: Security (ReadingLists review https://phabricator.wikimedia.org/T174126 )
- Blocking:
- Updates:
- fixed some bugs with Electron multipage rendering, testing again this week
- continuing work on reading lists
- MCS/PCS: Reverted to old sectioning code
- PCS: Comparison tables of old and new implementation of text extracts for various languages
Community Tech
edit- Blocked by: none
- Blocking: none
- Updates:
- ACTRIAL started
- Getting database population script for range contributions fixed
- Working on GlobalPreferences
Technology
editAnalytics
edit- Blocked by:
- Blocking:
- Updates:
- Working on Wikistats2 back-end: loading easy-to-query data into Druid, implementing AQS endpoints, vetting metrics data
- adding proxy to Druid cluster for authentication
- Working on Wikistats2 front-end: UI improvements, bug fixes
- Ongoing EL purging: improvement to script, that now works fine, not sure if the purging will finish before end of quarter
Fundraising Tech
edit- Blocked by:
- Blocking:
- Updates:
- Mostly freaking out about our database replication lag
- Can once again A/B test payments form variations with query string parameters
- More work on new API integration for main CC processor
- Fixing CN bug where campaigns that haven't started yet can still pre-empt existing campaigns: https://phabricator.wikimedia.org/T175358
Release Engineering
edit- Blocked by:
- Blocking:
- Updates:
- it's happening: All trebuchet-deployed services have been ported to scap. https://phabricator.wikimedia.org/T129290
Search Platform
edit- Blocked by: none
- Blocking: none
- Updates:
- Machine-learning driven ranking is deployed as ranking algorithm on enwiki: https://phabricator.wikimedia.org/T175772
- Running A/B test for machine-learning driven ranking on 18 other wikis: https://phabricator.wikimedia.org/T175771
- Running A/B test on displaying other language links under search result: https://phabricator.wikimedia.org/T175647
- Analyzed language fallback usage in Mediawiki search: https://phabricator.wikimedia.org/T147959
- Conclusion: a lot of misuse, needs work to clear it up
- Published blog post by Trey explaining human-graded relevance test: https://blog.wikimedia.org/2017/09/19/search-relevance-survey/
- Categories are now exported into RDF: https://lists.wikimedia.org/pipermail/wikitech-l/2017-September/088799.html
- Weekly for now, daily updates coming soon
- New logstash servers set up: https://phabricator.wikimedia.org/T175045
- New stats dashboard: How long Wikipedia searchers stay on the search result pages: https://discovery.wmflabs.org/metrics/#spr_surv
- Results of A/B test swapping 2nd and 3rd search result analyzed: https://commons.wikimedia.org/wiki/File:Swap2and3_Search_Test_Analysis.pdf
Security
edit- Blocked by:
- Blocking:
- Updates:
- Reviews:
- ReadingLists
- vue.js (sorry for the delay)
- wikiba.se
- Reviews:
Services
edit- Blocked by: none
- Blocking: none
- Updates:
- Cassandra 3 and new storage model rollout to production is happening right now
- Beginning with mobile tables at first, but still in test mode, serving from old storage
- EventBus based job queue double-processes the first job successfully
- Cassandra 3 and new storage model rollout to production is happening right now
Technical Operations
edit- Apologies, Alex/Fillippo won't be able to make it today. Riccardo will attend
- Blocked by:
- Collab Team on Flow dumps speed issue still T172025 and T164262
- Blocking:
- None
- Updates:
- We had some spikes of 503s at the cache layer, under control now, see T175803, T174932 and T145661 if interested
- luasandbox 2.0.14 rollout completed
- New appservers will be put in production in the next days
- Reminder: Salt (the foundation upon Trebuchet was built) will be removed before the end of next week, replaced by Cumin. All projects that were deployed with Trebuchet, have already been migrated to scap3 or Debian packages.
Contributors
editGlobal Collaboration
editLanguage
edit- Blocked: none
- Blocking: none
- Updates:
- cxserver deployment is unblocked; Registry refactoring targetted in next deployment. Request for review: https://gerrit.wikimedia.org/r/#/c/377713/
- CX2 is in progress. Lots of work done here.
Collaboration
edit- Updates
- RCFilters - Rolled out new Recent Changes Filters to be on by default for all users on he.wiki, ca.wiki, fr.wiki, but you can opt out. Watchlist Filters are now part of the Beta feature. Various new features and bug fixes.
- git #85df9a3a - Move New Filters opt-out preference to own section (task T175765)
- git #ceb02fbf - RCFilters: make live update part of the beta feature (task T175766)
- git #004b72e3 - RCFilters: Add an initialization hook
- git #f5d587d3 - Hide RC/WL related preferences as appropriate (task T175611)
- git #210946c3 - (GuidedTour) Allow directly launching tour from server without ?tour= or cookies (task T167262)
- RCFilters - Rolled out new Recent Changes Filters to be on by default for all users on he.wiki, ca.wiki, fr.wiki, but you can opt out. Watchlist Filters are now part of the Beta feature. Various new features and bug fixes.
UI Standardization
edit- Blocked: none / none
- Updates:
- Working on extending WikimediaUI Base to include vars already needed in Marvin, especially `font` specifics
- OOUI v0.23.1 released
- Code hygiene fixes and icon deprecation
- Ongoing:
- OOUI:
- preparation work on responsive toolbars design part
- icons: Work on icon set to be more harmonious and align to WikimediaUI Style Guide's guidelines
- Continuation on WikimediaUI Style Guide, continuing updating imagery on color section https://wikimedia.github.io/WikimediaUI-Style-Guide/visual-style_colors.html
- Aligning arbitrary, historically grown colors to WikimediaUI color palette https://phabricator.wikimedia.org/T148708 – now for the remaining blues
- Make TransparencyReport fully accessible – https://gerrit.wikimedia.org/r/#/c/376875/ merged, now for the build update
- OOUI:
Parsing
edit- Blocked by: https://gerrit.wikimedia.org/r/378774 (html5 ids in Cite extension)
- Blocking:
- Updates:
- C.Scott is porting over the html5 section id support into Parsoid (Parsoid had html5 section ids till last year - switched to html4 ids last year to match core -- now updating to html5 with legacy support again)
- Requires some fixes to Cite and LanguageConverter :(
- Kunal (legoktm) is running a script to lint all pages on all wikis so that linter errors are initialized on all wikis to get baseline information in place
- Last week, we switched MediaWiki and TestWiki to use Remex instead of Tidy.
- Individual wikis can file subtasks of https://phabricator.wikimedia.org/T175706 to switch their wikis over.
- Heads up for Parsoid clients (VE, CX, Flow, MCS)
- <section> wrapping code is now out of WIP and in review ( https://gerrit.wikimedia.org/r/#/c/364933/ ) -- please test your code to make sure you can handle <section> wrappers. If necessary, you can pre-process the DOM to strip out <section> tags. Parsoid's output is guaranteed to preserve template wrapping semantics with / without <section> tags. Parsoid can also accept DOMs with / without <section> tags (for serializing back to wikitext).
- We plan to switch Parsoid DOM output to use <figure-inline> tags instead of <span> for inline images ( https://gerrit.wikimedia.org/r/#/c/370227/ ) -- please test your code to make sure you can handle the new markup. VE can handle this.
- C.Scott is porting over the html5 section id support into Parsoid (Parsoid had html5 section ids till last year - switched to html4 ids last year to match core -- now updating to html5 with legacy support again)