Wikimedia Platform Engineering/MediaWiki Core Team/Check-ins/20140218
who: Chad, Brad, Bryan, Ori, Aaron, RobLa, Greg out today: Tim, Chris S, Antoine
Liaisons with other teams
edite.g. Flow, Wikidata, etc
HHVM
edit- (Re)-Kick off on Monday - if you want an invite and didn’t get one just ask.
- Use Phabricator’s kanban board?
- Need to triage/assign/estimate: 1) intl extension (facebook is working full steam ahead on this, I’ve made specific requests for things we’re missing), 2) igbinary (aaron?), 3) luasandbox (tim), 4) wmferrors (brad?), 5) puppetization/packaging (ori), 7) fast string search (might be able to live without?)
Performance
edit- Eliminate /geoiplookup requests! Gerrit #Ic4d2fc Gerrit #I26af69
- VE perf graphs! http://gdash.wikimedia.org/dashboards/ve/
- Moar frontend perf graphs! http://gdash.wikimedia.org/dashboards/frontend/
- mwgrep tool to grep site JS/CSS code on MediaWiki: NS, using elastic. (wooo! thanks nik & chad)
- Escalation: gitblit performance: https://code.google.com/p/gitblit/issues/detail?id=274#c9 (comments 9 & 10)
- Requirement in a nutshell: Gerrit plug-in that runs on merge and PURGEs affected views
- Would allow us to serve vast majority of reqs out of Varnish
- Chad will look & get back to Ori this week
- In progress: analysis of impact of ULSFO rollout on page load time (w/Nuria / analytics)
- Swift auth and container stat caching fixes (aaron)
- External links API query improvement suggestions
Search
edit- We’ve almost entirely cleared the backlog of Lucene bugs, either closing them or moving into Cirrus.
- We need more hardware -- mostly disk space (4 promised boxes in row D won’t be enough)
- Looking to possibly rebalance some lsearchd and steal stuff: https://wikitech.wikimedia.org/wiki/Search/lsearchd_inventory
- Will probably start poking Elasticsearch 1.0.0 later this week or early next week
- See ops-l post about this for more timeline
- Want more traffic as primary
- Should we do this before 1.0.0?
- Nik is descending into Lucene land, trying to find ways to save us space without sacrificing features
Deploy Tooling
edit- Chipping away at scap refactor/python port
- Gerrit change 113652 add detailed duration timing for scap & scap-1
- Gerrit change 113996 remove external script dependencies from scap-1
- Add bootstrap initialization for l10n update in new branches https://gerrit.wikimedia.org/r/#/c/113260/
- Working on using ssh directly (bypasing dsh) to get better reporting/logging
- Will be used for Bug 59922
- Requests:
- Change wikiversions.dat to wikiversions.json (that is, update the PHP multiversion code to work with a JSON file rather than a custom .dat file format)
- Drop now-unused ext: field from CDB
Beta/CI
editAntoine (not here, copy/paste from RelEng/QA weekly):
- Status: In progress Complete integration of browsertests for VisualEditor
- One build worked and triggered two successful scenario!!
- Status: In progress Train Zeljkof on Jenkins Job Builder script
- Zeljkof started on it. Will pair with him to finish up.
- Status: In progress Help migrating Cloudbees Jenkins template to JJB YAML templates
- Zeljkof started on it. Will pair with him to finish up.
See also: Bug escalation below.
Security
edit- Password hashing and expiry patch review (aaron)
- Review token timing attack fix (aaron) (https://bugzilla.wikimedia.org/show_bug.cgi?id=61346)
- https://bugzilla.wikimedia.org/show_bug.cgi?id=61362
Bug escalation
edit- https://bugzilla.wikimedia.org/show_bug.cgi?id=61491 - “no WikiEditor edit controls on any page in beta labs”
- https://bugzilla.wikimedia.org/show_bug.cgi?id=54193 - “Recursion detected in RequestContext::getLanguage” still out there waiting for an awesome fix (51422 times in the last 7 days)