Wikimedia Release Engineering Team/SSD Sync Up/2019-07-16

2019-07-16

edit

Last Time: 2019-07-02 Goals: https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2019-20_Q1#Release_Engineering

Deployment Pipeline

edit

Workboard

GOALS

edit
  • Migrate restrouter
    • https://phabricator.wikimedia.org/T223953
    • (Stretch): MobileContentService
    • (Stretch): Preparatory MediaWiki config clean-up & static loading work 
      • Moving configuration to static configuration (e.g., json files rather than a bunch of PHP)

TODOs from Last Time

edit

Other Work

edit

New CI

edit

GOALS

edit
  • POCs of GitLab and Zuul3 systems; evaluate options
  • Document an implementable architecture for what we want in new CI

TODOs from Last Time

edit
  • TODO Talk to SRE about Zuul v3 needs
    • Needed: conversation about phasing out Zuulv2
      • Meeting for zuulv2 thursday, TODO ping greg about antoine going
    • Lots of ansible to setup Zuulv3
    • 'TODO Discuss with SRE Thursday

Other Work

edit
  • Lars is hacking up new components around GitLab (mostly independent of what CI engine we choose, GitLab is just the first one to be tried)
    • going slowly this week, due to train
    • All but one component done (the controller)
    • other components tested manually
    • prototype: http://git.liw.fi/wmf-ci-arch/tree/
      • gitlab-ci uploads build artifacts to the artifact store
      • Testing with http://git.liw.fi/heippa/tree/.gitlab-ci.yml -- simulates the commit stage
      • uses the ick artifact store
      • VCS Worker and Deployment Worker in api.py
      • Deployment via ansible currently (git clone)
      • Aim: get controller working, then get a volunteer -- i.e., build blubber for a prototype

Local Development

edit

GOALS

edit
  • Migrate local-charts to deployment-charts
  • Instantiate testing and linting of helm charts
  • Preliminary work on a CLI for setup/management

TODOs from Last Time

edit
  • mediawiki/core blubber: Jam a shell script into the builder?
    • TODO: the actual jamming of shell script
      • Haven't been able to make that work
      • Job to run docker-pkg nightly to make up-to-date dev image
      • thcipriani/brennen pair Friday on working on this

Other Work

edit