Wikimedia Release Engineering Team/Checkin archive/20150324



Team Business

  • Deployment discussions happening
    • Streamline our service development and deployment process
      • Gabriel Wicke contacted Antoine about using Docker to provision/deploy services and wondering whether we could use it for CI. Seems to overlap Vagrant, would be nice if Dan could figure out with Gabriel :-)

(antoine summarized)

Team Quarterly Goals


Scrum of Scrums

Blocked on us:

Isolated CI instances

Quarterly Priority: Disposable VMs -
  • Procurement for 2 servers in labs subnet with Jessie:
  • Zuul packaged for Precise and apparently working \o/
  • Have to rebase Trusty then work on a Jessie package with OpenStack folks / Debian python teams.
  • Started Nodepool packaging targetting Jessie (way easier)
  • Will need puppet work with Zeljkof.

Beta Cluster stability

Quarterly Priority: Green nightly builds on staging:
Quarterly Priority: Stable uptime metrics of the Staging cluster:
  • l10nupdate is broken, the log file says it is out of disk space (no task filled) /var/log/l10nupdate/l10nupdate.log
  • beta-scap-eqiad always rebuild l10n cache since March 17th causing build to take more than 10 minutes.
  • chad working on finalizing staging-tin
  • I'm digging into swift stuff...confused...but progress
 - possibly need additional volumes mounted on backend (see what we do with Elastic?)
  • aside from parsoid, most are mw app servers remaining, i.e. need staging-tin

Test history

Quarterly Priority: By team test history:
  • Spiking on Elasticsearch + custom dashboard this week
    • if it's too difficult/expensive will implement Jenkins dashboards next
  • Jenkins upgraded to latest LTS yesterday at 11pm UTC (security update)
  • Some Jenkins plugins upgraded (some we dont want to upgrade like git* and ansicolor)
  • Gallium/Lanthanum filling disk due to mediawiki/core cloned in each job.
  • In Zuul, most repos share the same gate-and-submit queue because they now share common jobs.
    • Would need to patch Zuul server to change the behavior.

MediaWiki Releases

Quarterly Priority: Release MediaWiki 1.25:
Branching at wmf26 (aka on April 8th)

Other Work





  • Dan in France the week before offsite (May 11-15)
  • Week before hackathon: Team offsite in France -
  • May: Hackathon in Lyon, France
  • Chad vacation after offsite (maybe, dubious now)
  • Elena on vacation May26-June07
  • Antoine: observing french holidays: Mon April 6th, Fri May 1, Fri May 8, Thurs May 14