Wikimedia Release Engineering Team/Deployment pipeline/2018-07-05

2018-07-05 edit

Last Time edit

General edit

RelEng edit

  • Been working on integration/pipelinelib
    • Shared Groovy library
    • Move logic from buried in integration/config jjb -> shared library loaded as part of the job
  • Test-only portion of pipeline
    • For things not being deployed, frex: pipelinelib
    • Might help evangelize pipeline a bit
  • 2018/2019 - Q1
    • 2018-2019: Moving *all* services
    • Move verify stage from Minikube to CI k8s namespace in production context
      • TODO list (pulled from deploy1001) -- some are done; some don't need done; some have important pieces missing (probably); some are probably no longer used
        • 3d2png/deploy
        • mobileapps/deploy
        • iegreview/iegreview
        • relforge/mjolnir
        • dumps/dumps
        • debmonitor/deploy
        • restbase/deploy
        • citoid/deploy
        • docker-pkg/deploy
        • wdqs/wdqs
        • netbox/deploy
        • servermon/servermon
        • cp-jobqueue/cp-jobqueue
        • wikimedia/discovery/analytics
        • scholarships/scholarships
        • puppetboard/deploy
        • prometheus/jmx_exporter
        • prometheus/jmx_exporter
        • eventlogging/eventbus
        • eventlogging/analytics
        • librenms/librenms
        • graphoid/deploy
        • jobrunner/jobrunner
        • cxserver/deploy
        • gerrit/gerrit
        • cpjobqueue/deploy
        • striker/deploy
        • zotero/translation-server
        • zotero/translators
        • ores/deploy
        • electron-render/deploy
        • search/mjolnir/deploy
        • parsoid/deploy
        • changeprop/deploy
        • recommendation-api/deploy
        • horizon/deploy
        • performance/coal
        • performance/navtiming
        • eventstreams/deploy
        • trending-edits/deploy
        • phabricator/deployment
        • proton/deploy
        • statsv/statsv
        • analytics/turnilo/deploy
        • analytics/refinery
        • analytics/aqs/deploy
        • analytics/superset/deploy
        • analytics/pivot/deploy
        •   Done mathoid/deploy
        • cassandra/logstash-logback-encoder
        • cassandra/metrics-collector
        • cassandra/twcs
        • logstash/plugins
        • jobrunner.old/jobrunner
        • tilerator/deploy
        • kartotherian/deploy

SREs edit

  • Upgrade of the staging cluster to 1.8.14 kubernetes done today
  • Upgrade of the production clusters to happen next week
  • Starting to look into kubernetes 1.9

Services edit

As Always edit