Wikimedia Release Engineering Team/Group -1/Progress reports/2024-10-03

← week ending 2024-09-26

Group -1 progress reports week ending 2024-10-03

week ending 2024-10-10 →

Report on activities in the Group -1 project for the week ending 2024-10-03.

[WE6.2.1] Publish pre-train single version containers

Tracked in Phabricator
Task T369115

If we publish a versioned build of MediaWiki, extensions, skins, and Wikimedia configuration at least once per day we will uncover new constraints and establish a baseline of wallclock time needed to perform a build.

Progress update

Stage: Engineering/Development
Dan keeps getting closer to a working build at https://releases-jenkins.wikimedia.org/job/MediaWiki%20publish%20WMF%20single-version%20image/. The newest failure is related to JSON localization data generation that we can omit for a container only deployment. MR!461 feature flags that build step and disables it for the Kubernetes build.
Using the latest scap build in production uncovered T376023: Not all users with deployer rights are in the docker group. This error was caused by last week's work to replace execution of mwscript and php with a container runtime. That change has now been reverted. The team will examine options for re-enabling the Docker usage in a way that will avoid user permissions problems next week when Dan has returned from PTO.

Any new metrics related to the hypothesis

None

Any emerging blockers or risks

None

Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need? Are you on the hook to give another team something you aren’t able to give right now?

Not yet

Have there been any new lessons from the hypothesis?

Runtime permissions differences for scap in various environments (local development, releases-jenkins, deployment.eqiad.wmnet, etc) and with various calling users complicates feature development. These complications are not insurmountable, but they do add some amount of uncertainty to feature delivery schedules as new code propagates from one environment to the next.

Have there been any changes to the hypothesis scope or timeline?

The hoped for completion in the first week of October will be missed. Completion of the hypothesis before the end of October still seems likely.