Wikimedia Release Engineering Team/Checkin archive/20160926


Vacations/Important datesEdit

How to do it:

Team BusinessEdit

Time spent spreadsheetEdit

Rotating positions and absencesEdit

Maniphest query for deployment blocker tasks:

weeks of Sep 19 and Sep 26Edit

weeks of Oct 03 and Oct 10Edit

Oct 17 and Oct 24Edit

  • Train
    • none on Oct 17

Actions from last meetingEdit

TODO: Antoine write a migration plan for gallium

  • lIn my head only. Been busy with wmf.19 explosion / random Zend 5.5 segfault etc.
    • Still to do, went syphoned in jobrunner issue / lack of monitoring / bunch of reviews etc
  • Do this week

TODO: Talk about release process/strategy first week of Q2 (Oct 3) with Ops (Brandon)

Scrum of ScrumsEdit
Blocked on us:

This weekEdit

  • Blocking
  • Blocked
  • Updates
    • New scap (3.3.0)
      • scap caches local config for it's deployment (machines don't have to reach back to tin)

Last weekEdit

Other Team BusinessEdit

  • Contint root proposal
    • Can we just have an ops person?
  • do we know if vendors (Antoine and Željko) are coming to all hands?
    • TLDR: yes
  • Short term contractors budget
    • explicit list, obvs
    • time it takes to onboard
    • teams need to make this an explicit goal themselves


Q1 goal/project check-inEdit

Phase out Ubuntu PreciseEdit

Replace primary production Continuous Integration host (gallium) - task T95757Edit

  • Huge delay on figuring out a network lan to host the new machine
  • Puppet refactoring mostly done
  • Need a migration plan then schedule the switch

Upgrade Phabricator database servers to Maria10/Jessie - task T138460Edit

  •   Done

Upgrade Beta Cluster database servers to Maria10/Jessie - task T138778Edit

  •   Done
  • Gotta shutdown then drop the old instances?

Move Gerrit off of ytterbium - task T125018Edit

  •   Done

Reduce Technical DebtEdit

Perform a technical debt analysis of software and services maintained by WMF Release Engineering - task T138225

  •   Done

Streamline deployments (long-lived branches)Edit

keyresult task:

  • Convert our production deployment strategy to use long-lived branches - task T89945

project view:

Non-Quarterly goal workEdit

CI Scaling/NodepoolEdit

Browser testsEdit

- mediawiki_selenium feature to show/capture Selenium WebDriver requests to remote browser T94577 - Firefox v47 breaks mediawiki_selenium T137561 - Update mediawiki_selenium to use Marionette T137540

-> need geckodriver to be packaged (tis a rust app :() or drop Firefox?

Beta ClusterEdit

  • MW apps reimaged to Jessie with ops leading
  • web servers (deployment-mediawiki*)
  • deployment servers (deployment-mira is primary, deployment-tin02 backup
  • jobrunner02 done
  • tmh to be done later


DB InconsistenciesEdit and (see also: )

People status updatesEdit


Last weekEdit

  • Help on wmf.19 issue has I can
  • Gallium migration plan
    • Overdue :(
  • Nodepool upgrade hopefully
  • Migrate some jobs hopefully

This weekEdit

  • Gallium migration plan


Last weekEdit

  • Learn to play the ukelele
  • Finally looping back on DB consistencies since I have free cycles this week (what I have what?!)
  • Wrap up some logging-related cleanups I've been poking
  • Yell at Timo re: static files.

This weekEdit


Last weekEdit

  • Beta DBs

This weekEdit


Last weekEdit

This weekEdit

  • Finish getting scap swat and cli stuff merged
  • Talk with Greg about the automation of deployment blockers, release milestones/tasks, etc.


Last weekEdit

  • wmf.19
  • scap3 updates (blocking things)
  • Code review for llb

This weekEdit


Last weekEdit

  • T94577 mediawiki_selenium feature to show/capture Selenium WebDriver requests to remote browser.
  • T137561 Firefox v47 breaks mediawiki_selenium
  • T137540 Update mediawiki_selenium to use Marionette
  • T145718 CentralNotice: Intermittent unexplained browser test failures
  • conference

This weekEdit

  • MEDIAWIKI_URL may be set to incorrect value in mwext-mw-selenium job T144912
  • mediawiki_selenium feature to show/capture Selenium WebDriver requests to remote browser T94577
  • Improve documentation around running/writing (with lots of examples) browser tests T108108