Wikimedia Platform Engineering/MediaWiki Core Team/Check-ins/20140317

who: Brad, Bryan, Tim, Dan, Greg, Chad, Chris, Ori, RobLa, Nik, NIk, Antoine, Aaron

Bugs we should look at

• https://bugzilla.wikimedia.org/show_bug.cgi?id=32551 “Descriptionless files” still…
  • Highest/Critical?

Budget stuff

Overall narrative of what we do: https://office.wikimedia.org/wiki/User:Tbayer/coredoc

Quarterly Review

Spreadsheet of DOOM! https://docs.google.com/a/wikimedia.org/spreadsheet/ccc?key=0Agte_lJNpi-OdEZzMm5EMmVaZTVwZl9Hb1RKQnlZN3c&usp=drive_web#gid=0

Performance

• Fixed problem with Set-Cookie: GeoIP=... ; redeployed to labs.
• Met with Nik and Chad about collecting CirrusSearch RUM; have a patch almost ready.
• Getting pulled to talk VE performance with Kenan and Roan (right after this meeting)
• Migrating noc.wikimedia.org/cgi-bin/report.py from fenari to tungsten.
• Removed WikimediaShopLink JS module!
• Have a patch for enabling SVG gzipping in Varnish, got Brandon's commitment to work with me on it.
• Reconfigure ResourceLoader to bind jQuery and $ to module-local copies so we can track DOM operations by module.
• https://gerrit.wikimedia.org/r/117916 (TMH deadlocks)
• https://gerrit.wikimedia.org/r/118819 (large PDF thumbnails and pool counter)

HHVM

• Hourly builds against hhvm master available for use: http://hhvm-build.wmflabs.org/
  • YMMV: They’re built against 12.04 and labs. Basically useless outside of labs.
• Tim submitted pull requests upstream, waiting for merge
• Aaron wants to run size comparisons with igbinary
• For now: disable igbinary serialization on beta; make igbinary compatibility be a reach rather than a hard commitment for the end of March.
• Test Max’s patch for Wikidiff2
• ███████ █████████ ██████ launch codes ████████ and the ███████.
  • And don’t forget to █████████ the █████████ before █████ █████’s

Deployment tooling / RelEng

• Converted sync-wikiversions to python
• Added PurgeL10nCache to scap tooling (and it worked!)
• Fixed file permissions for /srv/scap in puppet (ori)
• Created salt/puppet master instance in deployment-prep project for trebuchet testing (ryan)
  • Docs at https://wikitech.wikimedia.org/wiki/Trebuchet#Using_Trebuchet_in_Labs
• Still working on getting a scap-style deploy setup for beta
  • This is a lot more work than Bryan expected. Labs has been troublesome and the Puppet code needs a lot of work. It will happen though!
• ☗ SWAT ☗ (⌐■_■) deploy this morning went well. More scheduled for tonight and tomorrow.

Search

• Performance increases coming a 1-2 weeks (so much stuff in Elasticsearch 1.1)
  • Has some nice features developed upstream and some from me too
• Starting work on a highlighter - medium priority - somewhat
• Talking with OPS about budget for servers
  • Your napkin spreadsheet was based on 8 cores, right? In talking to RobH it sounds like 12 would be the norm now.
    • No. 12 because that is what the elastic1001-1016 are.
      • Maybe he said 16 would be fine then? I’ll follow up. I reread your e-mail, you did say 12. 16 must’ve been what RobH told me.

SecurePoll

• HTMLForm patches are in Gerrit, awaiting review (aaron/chris)
• Working on using the new HTMLForm types to implement the poll creation screen

ContactForm for trademark

• Dan to catch up with Rob

Security

• Trainings 3/21 & 3/28
• 1.19.13 release by MyM 3/11; patch for 62497 on the cluster
• Auth Systems:
  • Have some updates from legal re privacy policy: 62686, 62687, 62688