Scrum of scrums/2016-11-23
2016-11-23
editTechnology
editAnalytics
edit- Blockers: none
- on track for quaterly goals
- main project about edit data (mediawiki edit history reconstruction) progressing,
- we are now calculating standard edit metrics for all wikis since the beginning of time using denormalized edit history: https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Denormalized_edit_history experimental dataset on pivot
- working on productionizing infrasructure for event streams
- waiting for hardware for pageview API
- owning now statsv together with ops (utility that can consume kafka data and report to graphana)
- Thanking discovery for contributing to our metric reporting tools
Upcoming:
- Start design work to revamp information architecture of http://stats.wikimedia.org
Performance
editNot blocking, not blocked
- thanks everyone who attended the active/active DC meeting after I flagged it here, it has helped getting the ball rolling on two blockers
- hidden tabs confirmed as messing with timing data, now excluded from perf metrics
- investigating little-known legacy features in mediawiki thumbnailing to decide whether we continue supporting them on Thumbor (302 redirects)
- second view tests added for firefox and IE in WebPageTest (was previously only looking at Chrome)
- still active on thumbnail URL/API RFC discussion
- briefly discussed witth multimedia team setting up Thumbor for them to leverage in their ImageTweaks extension
Security
edit- Security Reviews
- Linter review complete
- LoginNotify schedule for this week
- Continuing work on wiki account compromise remediation (T150554)
- Assistance needed -- e-mail to engineering@ is forthcoming with request
Services
edit- Blockers: none
- Updates:
- PDF render service deployed in codfw, eqiad and public exposure next week
- New version of service-template-node: ES6 and ESLint are coming
Technical Operations
edit- Blockers
- IOS native app
- Requesting timeline for Wikipedia iOS app requesting 0px thumbs: https://phabricator.wikimedia.org/T147648 https://phabricator.wikimedia.org/T151078
- iOS 5.3.0 was shipped last week
- Performance ?
- MW fix to return 400 on 0px thumbs https://phabricator.wikimedia.org/T147784
- IOS native app
- Blocking
- None
- Updates
- jobqueue woes https://phabricator.wikimedia.org/T151196
- kubernetes/calico work ongoing, goal on track
- dropping varnish 3 compatibility code from our puppet repos
- labsdb goals on track as well
Release Engineering
edit- Blocking
- Blocked
- Updates
- Mediawiki 1.28 tarball release this week!
Product
editReading
editMobile Content Service (MCS)
edit- Board: https://phabricator.wikimedia.org/tag/mobile-content-service/
- Added announcements feed endpoint (public now). More info and request URL at https://www.mediawiki.org/wiki/Wikimedia_Apps/Team/RESTBase_services_for_apps#....2Ffeed.2Fannouncements:
Android native app
edit- Last week:
- Continuing Q2 goals for Wikidata descriptions
- New fundraising announcement explore feed card in progress
- Now building against Android Nougat 7.1 API 25
- Fixing login and editing issues
- Lots of unit tests
- Next week (https://phabricator.wikimedia.org/project/view/2352/):
- More Q2 goals for Wikidata descriptions (tutorial and polish)
iOS Native App
edit- Last Week:
- Shipped 5.3.0 (In the news notifications & feed content, MCS backed feed, language variant support, other bug fixes and enhancements) https://phabricator.wikimedia.org/project/view/2220/
- Added announcement card to the feed (for user research and fundraising)
- Started update of data layer to fix issue with data access & modification from widgets and notifications
- Started dynamic font size updates to the app
- This week: https://phabricator.wikimedia.org/project/view/2357/
- Finishing data layer update
- Continuing dynamic font size updates
- Other minor bug fixes for 5.3.1
Web
edit- Current sprint:https://phabricator.wikimedia.org/tag/reading-web-sprint-86-
- Stopping HoverCards A/B tests from Russian and Italian wikis
- New readers work
- Make PageImages return the image in the lead section
- MobileFrontend tech debt
- Trending service
- Hovercards rewrite
- Next week: probably the same stuff as the current week.
Reading Infrastructure
edit- not blocking
- Still looking for reviews on the API error/warning i18n patches
- https://gerrit.wikimedia.org/r/#/c/321402/ - Improve handling of Message objects as Message parameters
- https://gerrit.wikimedia.org/r/#/c/321404/ - Add Message::listParam()
- https://gerrit.wikimedia.org/r/#/c/321405/ - Fix MediaTransformError message handling
- https://gerrit.wikimedia.org/r/#/c/321406/ - API: i18n for warnings and errors
- The extension patches depended on by that change are next in importance. These are for OAuth, TitleBlacklist, GlobalBlocking, Translate, and ConfirmEdit.
- All other WMF-deployed extensions affected by this change have patches too, see https://gerrit.wikimedia.org/r/#/q/topic:api-error-i18n/T47843. Non-WMF-deployed extensions are (mostly) not touched at this time, the worst that should happen to them is wfDeprecated warnings eventually.
- https://gerrit.wikimedia.org/r/#/c/312865/ is blocked on review by Security
Community Tech
edit- Not blocking
- Blocker: Need a security review for https://phabricator.wikimedia.org/T150832 to proceed with exposing a couple of table views on tool labs db
- Community Wishlist survey proposal phase over. https://meta.wikimedia.org/wiki/2016_Community_Wishlist_Survey
- Did bug-fixing for Copypatrol (plagiarism detection tool) and launched French version: https://tools.wmflabs.org/copypatrol/fr
- Ongoing RfC about changing default collation on Meta: https://meta.wikimedia.org/wiki/Requests_for_comment/Switch_default_category_collation_to_UCA_collation_with_numeric_sorting
- Ongoing RfC about abandoned labs tools takeover: https://meta.wikimedia.org/wiki/Requests_for_comment/Abandoned_Labs_tools
- Ongoing work with programs dashboard
Discovery
edit- BM25 scoring enabled on 10 larges wikis
- Discovery mission & roadmap presentation: https://docs.google.com/presentation/d/1ctlqdLA__0OxDuO7mJEIDLP-xt9a7E4jv4INMlZAHdQ
- Load-testing crosswiki searching backend code
- Portal updates per-language article count stats, dewiki joins the lucrative 2M+ club :)
Editing
editLanguage
edit- Blocked: T150512: WikiBase Repo tests failing with UsageException
- This is making it difficult to merge Translate patches. Issue seems to be in database clearing in tests. QA/RelEng?
Collaboration
edit- Blocked: None
- Blocking: None
- Updates
- No deployments this week. Ongoing work on:
- Mobile support for left nav of Special:Notifications
- RecentChanges filters and filter framework for Edit Review Improvements
- No deployments this week. Ongoing work on:
Fundraising Tech
edit- Big English fundraiser starts next week!
- repeating Greg's emailed plea: https://lists.wikimedia.org/pipermail/engineering/2016-November/000331.html
- Stuff that could impact the fundraiser: GeoIP, ResourceLoader, MessageCache, EventLogging, Hive webrequest tables
- CentralNotice: reviewing Aaron Schultz's latest MessageCache patch: https://gerrit.wikimedia.org/r/#/c/318489
- We want to understand it really well before we deploy anything that could affect banners
- If anyone with deep knowledge of MessageCache (Aaron, Gilles?) has time for a quick video chat, Andrew Green has a few questions
- As always, more scrutiny and comments are welcome.
- Deployed Nirzar's mobile CSS fixes, looking great so far
- Minor caching optimizations for CiviCRM jobs