Wikimedia Release Engineering Team/Deployment pipeline/2019-10-30
2019-10-30
editLast Time
edit
General
editTODOs from last time
edit- In progress TODO: support documention like the one tyler did for the portal and pipeline/helmfile and deployment
- thcipriani started a thing: https://wikitech.wikimedia.org/wiki/Deployment_pipeline
- Could still use work: https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration
- TODO make a task to jenkins-ify updating deployment-charts
- There is CI for this now
- Not producing artifacts
- Running two helm commands and pushing artifact: how? dunno yet
RelEng
editServiceops
edit- Have an OKR with helping CPT moving changeprop, cp-jobqueue to the pipeline
- running on Jessie machines
- Marko and Peiter have done a lot of work -- images generated
- needs verifcation and deployment to k8s
- Pipeline being able to power multiple services from the same repo
- There are some docs, but need improvement, fleshing out, especially higher level documentation
- https://doc.wikimedia.org/pipelinelib/
- https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components#PipelineLib
- TODO Lars & Dan pairing on pipelinelib docs!
- There are some docs, but need improvement, fleshing out, especially higher level documentation
CPT
edit- NSFWoid -- image classification model in a flask/python app
- helps volunteers find vandalism
- Pipeline python support
- Update open_nsfw-- for Wikimedia production deployment