Wikimedia Release Engineering Team/Deployment pipeline/2020-09-30
2020-09-30
editAlways
edit- [1]
- Archive
- Task tree: https://phabricator.wikimedia.org/T198901
TODOs from last time
edit- Jeena to open task for docker registry specifically for development images
- There is a specific use case already for a team (task?) wanting to build and store a development image for their service, but this leads to a more general question about how and where to store images used only for development purposes (storage requirements being a concern, etc.)
- Differences of opinion around rebuilding dev images locally vs. having a central repository for pre-built images
General
edit- Call with Fandom last week
- Nice job Alex!
- Hope for further collaboration...how will this work? :)
- Mw on k8s
- This is now a project on phabricator: https://phabricator.wikimedia.org/project/board/4946/
Q2?
edit- End of Q1 OKRs
- RelEng: https://app.betterworks.com/app/#/goal/9585657
- Q2:
- Static config and CD of blubber
- L10n as a compile step
- Experimenting with image build pipeline for MediaWiki -- prove/disprove viability
- Q2:
- SRE: https://app.betterworks.com/app/#/goals?goal_name=9541457¤tView=goals&panelMode=COMMENT
- Q2: deploy part
- will images be ginormous?
- team discussion on Monday
- One of our fears is saturation (registry/network)
- Experiments for deployment
- Upgrades for self-service: networking (LVS is point of friction), k8s upgrade
- Apertium + recommendation APIs
- More definite next week
- Q2: deploy part
- CPT: https://app.betterworks.com/app/#/goal/9547288
- RelEng: https://app.betterworks.com/app/#/goal/9585657
- End of Q1 OKRs
RelEng
editJeena implmented automatic updates of deployment charts by CI: https://phabricator.wikimedia.org/phame/post/view/208/ci_now_updates_your_deployment-charts/
No feedback onLots of back-and-forth on https://phabricator.wikimedia.org/T259817#6395133
Serviceops
edit- Fandom presentation with Giuseppe
- push-notifications is fully deployed \o/
- Switched over to TLS and services proxy the last stragglers
- We are starting OKRs for next quarter
- 21 services on k8s -- 30-33k rps
CPT
editConfiguration management created this https://phabricator.wikimedia.org/T263166 the next steps are trying to break out some of the existing configuration into the categories here, thoughts on how to break this up? The initial plan was to get feedback by 9/29. But with current workload I think that will need to be extended. Will get back when I get a more feasible date fr