Scrum of scrums/2018-08-01
2018-08-01
editCallouts
edit- SREs say FYI:
- Switchover tentative timeline announced. Please take a look and voice concerns if any
Switchover:
Services: Tuesday, September 11th 2018 14:30 UTC Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC Traffic: Tuesday, September 11th 2018 19:00 UTC Mediawiki: Wednesday, September 12th 2018: 14:00 UTC
Switchback:
Traffic: Tuesday, October 9th 2018 19:00 UTC (and maybe some prep work on Monday) Mediawiki: Wednesday, October 10th 2018: 14:00 UTC Services: Thursday, October 11th 2018 14:30 UTC Media storage/Swift: Thursday, October 11th 2018 15:00 UTC
- MCR Schema migrations are happening
- Beta is set to write both / read new with no problems identified
- Production set to write both / read old this week
- Starting with migration scripts to copy data from old schema to new one
Audiences
editReaders
editiOS native app
edit- Blocked by: -
- Blocking: -
- Updates:
- 6.0 in beta (https://phabricator.wikimedia.org/tag/ios-app-v6.0-walrus-on-a-unicycle/), expected to push another beta this week
Android native app
edit- Blocked by:
- Blocking:
- Updates:
- Maintenance update released to Beta, will go to production tomorrow (Thurs)
- User testing of navigation design prototypes will commence shortly.
Readers Web
edit- Blocked by:
- Blocking:
- Updates:
- RFC: Modernise our JavaScript with the goal that the startup module and mediawiki object should not depend on jQuery https://phabricator.wikimedia.org/T200868
- Mobile website (MinervaNeue / MobileFrontend):
- Page issues UI and instrumentation: T191532 T191303 T197932 T197931 T200867
- Invest in the MobileFrontend & MinervaNeue frontend architecture: T188261 T197133 T197639
- Other fixes and hygiene T193172 T200491 T186823 T199282 T199000 T199066 T197110 T198151
- Product and design are collating research and interviews from Wikimania and working on advanced contributions
Readers Infrastructure
edit- Blocked by:
- Blocking:
- Updates:
- mobile-html exposed but needs fixes for CSP header and a URL to CSS. Won't run CollapseTable transform on server for the time being.
- Maps:
- New tile regeneration cron job for low-zoom vector tiles https://phabricator.wikimedia.org/T194787
- Snapshot low DPI bug is waiting for a pull request review from upstream on third party library https://phabricator.wikimedia.org/T152196
- Working on migrating test servers to Cloud VPS
- Working with SRE (Gehel) on migrating all servers to Debian Stretch
Multimedia
edit- No representative today - two team members on vacation and Mark has a conflicting meeting
- Updates
- Breaking change in MediaWiki Core OOUI widget nearly caught us out - luckily something else broke in the meantime so the related fatal never occurred because of another fatal. Both fixed now.
- Search for SDC coming along slowly with various people on vacation.
- Next up: OOUI rendering for SDC first feature (captions), coming down the pipeline soon™
- MCR rollout plan basically set, we'll need some time to sort out our integration, but should all work out well.
Contributors
editCommunity Tech
edit- Blocked by:
- Blocking:
- Updates:
Anti-Harassment Tools
edit- Blocked by:
- Blocking:
- Updates:
Editing
edit- Blocked by: None
- Blocking: None
- Updates:
- Unblocked languages on previous issues.
Parsing
edit- Blocked by:
- Blocking:
- Updates:
Growth
edit- Blocked by:
- Blocking:
- Updates:
Language
edit- Blocked by:
- CX patches still blocked from merging due to test failures occuring in Wikibase Lexeme
- Thanks to everyone who helped/are helping to solve issues (4 separate ones) that prevent merging patches to CX&Translate
- Blocking:
- Providing guidance on https://phabricator.wikimedia.org/T195910 (ios app language selection related issue)
- Updates:
- Grant Metrics enabled for translation in translatewiki.net
- Niklas will work on https://phabricator.wikimedia.org/T195293 (follow-ups to an issue causing an outage a while ago)
Audiences Design
editUI Standardization
edit- Blocked by:
- Blocking:
- Updates:
- Preparation of OOUI v0.27.6
Technology
editAnalytics
edit- Blocked by:
- Blocking:
- Outage in Eventlogging
- Updates:
- Added data quality checks in mediawiki history and mediawiki history reduced datasets
- Cleaning of user directories in hadoop
- Improved data sanitization in Eventlogging (salt creation/rotation)
- Improved partition cleaning in hive
Cloud Services
edit- Blocked by:
- Blocking:
- Updates:
Fundraising Tech
edit- Blocked by:
- Blocking:
- Updates:
- Making our exchange rates available on a WMF-visible spreadsheet for travel reimbursement
- Work continues on the ingress scripts for EventLogging data from banner and landing page impressions
- Experimenting with different ways to let donors from certain countries opt in to emails
- CiviCRM: new search filters, looking at mailing house data import bug and data erasure requests
- Reviewing CiviCRM core team code for contact view editor
- More error-handling work prompted by full-scale tests of card processor's new API
MediaWiki Core Platform
edit- Blocked by:
- Blocking:
- Updates:
- Cherry-picked API statsd improvement into production. Updated API dashboard in Grafana.
- Platform Evolution kick-offs and TechConf prep are ongoing
- Language variants for summary REST API deployed - Page Previews will now show your preferred variant
- Only serbian language is supported now, but more will be added as Parsoid supports more conversions
- Memory issues with EventStreams service in codfw affected other services, now resolved.
Multi-Content Revisions
edit- Blocked by:
- Blocking:
- Updates:
- MCR Schema migrations are happening
- Beta is set to write both / read new with no problems identified
- Production set to write both / read old this week
- Starting with migration scripts to copy data from old schema to new one
- Discussion on-going on whether a production test wiki is necessary in addition to a test wiki on beta: https://phabricator.wikimedia.org/T197616
- Requires Wikibase change propagation
- Development and code review continues
- MCR Schema migrations are happening
Performance
edit- Blocked by:
- Blocking:
- Updates:
Release Engineering
edit- Blocked by:
- Related to 1.32.0-wmf.14 train https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train#Actionables
- Feedback needed from Wikidata team on how T200340 (Wikibase\DataModel\Entity\EntityIdParsingException $serialization must not be an empty string) could be prevented.
- Feedback needed from Readers/Performance team(s) on how T200346 (wmf.14 failing to execute ThumbnailRender jobs "error: ThumbnailRenderJob::run: HTTP request failure") could be prevented.
- Feedback needed from ORES/Wikidata team(s) on how T200412 (PageTriage requires ORES to be installed) could be prevented.
- Feedback needed from Wikidata team on how T200420 (Wikidata dispatching stuck (not releasing lockmanager locks)) could be prevented.
- Feedback needed from Readers team on how T200456 (MapCacheLRU::has called with invalid key. Must be string or integer) could be prevented.
- Related to 1.32.0-wmf.14 train https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train#Actionables
- Blocking:
- Updates:
- Moved the beta deployment server to deployment-deploy01, yell if anything seems amiss there
Research
edit- Blocked by: None
- Blocking: None
- Updates:
- We've been analyzing the Citation usage data and improving the schema.
https://phabricator.wikimedia.org/T199457
- Working on recommending missing articles based on translation pageview predictions.
- Have been interviewing candidates for a research position.
Scoring Platform
edit- Blocked by:
- Waiting for a TechCom review of JADE proposal for deployment.
- Trying to get Global Collaboration's attention about this.
- "Everything is a wiki page", yet we're not allowed to deploy an extension that might increase the number of wiki pages... Who will be blocked next?
- Waiting for a TechCom review of JADE proposal for deployment.
- Blocking:
- Updates:
- GSoC project by Saurabh Batra to identify donations fraud has resulted in a successful model! We're beginning integration work now.
Search Platform
edit- Blocked by:
- Blocking:
- Updates:
- Lexeme fulltext search merged: https://phabricator.wikimedia.org/T196188
- Started collecting click stats for Wikidata completion search: https://phabricator.wikimedia.org/T196186
- Quality constraints violations are now in WDQS: https://phabricator.wikimedia.org/T172380
- Fixed intitle search not matching stopwords: https://phabricator.wikimedia.org/T68969
- Fixed problems in completion search on shard failure: https://phabricator.wikimedia.org/T180807
- Added task to purge query click data according to privacy policy: https://phabricator.wikimedia.org/T189845
- Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654
- Working on ES 6.3 upgrade: https://phabricator.wikimedia.org/T197960
- Working on Esperanto analyzer: https://phabricator.wikimedia.org/T200099
- Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
Security
edit- Blocked by:
- Blocking:
- Updates:
Site Reliability Engineering
edit- Blocked by:
- None
- Blocking:
- None
- Updates:
- eqiad row B and C upgrades went quite fine with some minor hiccups
- work on the switchover preparation ongoing. Tentative timeline posted. Take a look at calls out section
Wikidata
edit- Blocked by:
- Blocking:
- ContentTranslation CI red because of failing Wikidata-related tests: https://phabricator.wikimedia.org/T200693
- working on understanding and fixing failures
- ContentTranslation CI red because of failing Wikidata-related tests: https://phabricator.wikimedia.org/T200693
- Updates:
- Work in Lexicographical data continues:
- adding senses
- improving the editor workflow
- https://phabricator.wikimedia.org/project/view/2292/
- Work in Lexicographical data continues:
German Technical Wishlist
edit- Blocked by:
- Blocking:
- Updates:
SoS Meeting Bookkeeping
edit- Updates:
- move the meeting to 2 hours earlier as soon as week of 2018-08-06- look for new invite!
- some changes to the notes template
- keep the meeting as is- a forum for teams to share updates and ask for help and keep the notes as useful as possible
- decision to handle goals dependencies outside this meeting