Skip to content

Cache CI container dependency layers in GHCR. - #1046

Closed
gerrod3 wants to merge 3 commits into
pulp:mainfrom
gerrod3:cr/docker-build-cache
Closed

Cache CI container dependency layers in GHCR.#1046
gerrod3 wants to merge 3 commits into
pulp:mainfrom
gerrod3:cr/docker-build-cache

Conversation

@gerrod3

@gerrod3 gerrod3 commented Aug 14, 2026

Copy link
Copy Markdown
Contributor

Split the image build so third-party deps can be reused across runs, and have nightly push the cache for PR jobs to pull.

https://redhat.atlassian.net/browse/PULP-2237

📜 Checklist

  • Commits are cleanly separated with meaningful messages (simple features and bug fixes should be squashed to one commit)
  • A changelog entry or entries has been added for any significant changes
  • Follows the Pulp policy on AI Usage
  • (For new features) - User documentation and test coverage has been added

See: Pull Request Walkthrough

@gerrod3
gerrod3 force-pushed the cr/docker-build-cache branch 2 times, most recently from 929e26e to 03bfe4d Compare August 21, 2026 01:56
Split the image build so third-party deps can be reused across runs, and have nightly push the cache for PR jobs to pull.

Co-authored-by: Cursor <cursoragent@cursor.com>
@gerrod3
gerrod3 force-pushed the cr/docker-build-cache branch from 03bfe4d to 6750d6f Compare August 21, 2026 02:01
gerrod3 and others added 2 commits August 20, 2026 22:50
@gerrod3

gerrod3 commented Aug 21, 2026

Copy link
Copy Markdown
Contributor Author

This approach did not work. The uv pip install is already a magnitude faster than the FROM base-image step that caching the dependencies gives no real speedup, just a lot more complexity in the CI.

Future things to look into:

  • S3 runner's custom botocore dependency is a one line change, that can probably just be a sed call so that uv doesn't have to slow down to fetch the github repo.
  • S3 also installs ansible.aws which is slow. Look into just creating the minio bucket with shell commands.
  • Speed up the one-in-all container startup scripts.
  • Reduce the sleep duration in between startup polling.

@gerrod3 gerrod3 closed this Aug 21, 2026
@gerrod3
gerrod3 deleted the cr/docker-build-cache branch August 21, 2026 18:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant