Skip to content

feat: support rechunking using Chunkah#790

Merged
gmpinder merged 1 commit into
blue-build:mainfrom
HastD:chunkah
Jun 30, 2026
Merged

feat: support rechunking using Chunkah#790
gmpinder merged 1 commit into
blue-build:mainfrom
HastD:chunkah

Conversation

@HastD

@HastD HastD commented Jun 1, 2026

Copy link
Copy Markdown
Collaborator

Add a --chunkah option to bluebuild build that rechunks the image using Chunkah, a more modern, content-agnostic rechunker that's actively maintained and should offer various improvements over build-chunked-oci and the legacy rechunker.

This is implemented using a fairly generic "post-build hook" mechanism that allows a post-processing step (such as rechunking) to be applied after building the image but before tagging and pushing.

@HastD HastD force-pushed the chunkah branch 3 times, most recently from 0e92302 to 65e3900 Compare June 8, 2026 16:48
@HastD HastD marked this pull request as ready for review June 8, 2026 16:48
@HastD HastD requested a review from gmpinder as a code owner June 8, 2026 16:48
Comment thread process/drivers/skopeo_driver.rs Outdated
Comment thread process/drivers/opts/image_storage.rs Outdated
Comment thread process/drivers/buildah_driver.rs Outdated
@gmpinder

Copy link
Copy Markdown
Member

The cargo test job appears to be failing from some compilation error with OCI client

@gmpinder

Copy link
Copy Markdown
Member

I'm seeing an error for the container chunkah build:

[21:25:50 TRACE blue_build_process_management::drivers::skopeo_driver:15] => SkopeoDriver::copy_oci(CopyOciOpts { src_ref: OciDir("/tmp/bluebuild-tmp-izCTpT3KHP/oci-out"), dest_ref: LocalStorage(Reference { registry: "localhost", mirror_registry: None, repository: "cli/test-chunkah", tag: Some("latest_linux_amd64"), digest: None }), privileged: false, retry_count: 0, podman_unshare: true })
[21:25:50 TRACE blue_build_process_management::drivers::skopeo_driver:29] => "podman" "unshare" "skopeo" "copy" "--all" "--" "oci:/tmp/bluebuild-tmp-izCTpT3KHP/oci-out" "containers-storage:localhost/cli/test-chunkah:latest_linux_amd64"
[21:25:50 containers-storage:localhost/cli/test-chunkah] => Error: please use unshare with rootless
[21:25:50 ERROR blue_build::commands:33] => Failed:
  × Failed to copy oci:/tmp/bluebuild-tmp-izCTpT3KHP/oci-out to containers-storage:localhost/cli/test-chunkah:latest_linux_amd64

Add a `--chunkah` option to `bluebuild build` that rechunks the image
using [Chunkah](https://github.com/coreos/chunkah), a more modern,
content-agnostic rechunker that's actively maintained and should offer
various improvements over build-chunked-oci and the legacy rechunker.

This is implemented using a fairly generic "post-build hook" mechanism
that allows a post-processing step (such as rechunking) to be applied
after building the image but before tagging and pushing.
@HastD

HastD commented Jun 30, 2026

Copy link
Copy Markdown
Collaborator Author

@gmpinder I think it should be fixed now, but CI is failing due to network errors so I'm not 100% sure.

@gmpinder gmpinder left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just waiting on some builds to pass

@gmpinder gmpinder merged commit 83d869a into blue-build:main Jun 30, 2026
104 of 130 checks passed
@HastD HastD deleted the chunkah branch June 30, 2026 16:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants