Skip to content

Use cached Docker images for Linux CI builds#653

Open
MohamedM216 wants to merge 2 commits into
G-Research:masterfrom
MohamedM216:cached_docker_images
Open

Use cached Docker images for Linux CI builds#653
MohamedM216 wants to merge 2 commits into
G-Research:masterfrom
MohamedM216:cached_docker_images

Conversation

@MohamedM216
Copy link
Copy Markdown
Contributor

issue: #649

Currently, every Linux CI build compiles bison 3.8.2 from source inside a manylinux2014 container. This PR introduces a pre-built Docker image (ghcr.io/g-research/parquetsharp/linux-ci) based on manylinux2014 with bison and the full build toolchain baked in, published to GHCR via a new build-docker.yml workflow. The image is rebuilt automatically when the Dockerfile changes, weekly to pick up upstream updates, or on manual dispatch. Both amd64 and arm64 variants are built natively and combined into a multi-arch manifest. ci.yml is updated to pull this image instead of installing dependencies inline.

For more info see https://github.com/MohamedM216/ParquetSharp/actions/runs/25957299701
https://github.com/MohamedM216/ParquetSharp/actions/runs/25958080170
https://github.com/MohamedM216/ParquetSharp/actions/runs/25957406698
https://github.com/MohamedM216/ParquetSharp/pkgs/container/parquetsharp%2Flinux-ci

@MohamedM216
Copy link
Copy Markdown
Contributor Author

Regarding the failing tests, we must run Build Linux CI Docker image workflow first, then trigger CI to run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant