Skip to content

Ci sequential and cache#1075

Draft
tengomucho wants to merge 14 commits intomainfrom
ci-sequential-and-cache
Draft

Ci sequential and cache#1075
tengomucho wants to merge 14 commits intomainfrom
ci-sequential-and-cache

Conversation

@tengomucho
Copy link
Collaborator

@tengomucho tengomucho commented Feb 4, 2026

What does this PR do?

This addresses two problems with the CI:

  1. All workflows that run on inf2 are run at the same time. This is very resource consuming, since we only have a limited number of runners available.
  2. All workflows spend some time installing the same python dependencies.

For 1, a new sanity check workflow is added, checking the basic installation, and that will trigger the other workflows. The path filtering logic is adapted to this solution.

For 2, the simple solution is to use uv and the mounted cache as common local cache (on setups that do not have a shared cache such as ubuntu-22.04 containers, the same location will be used even if there will be no cache).

tengomucho and others added 14 commits February 4, 2026 16:33
apt-show will report the version of the available package, installed or
not.
Uv now will take care of venv creation and installation. A local cache
is used, so in setups that share the mount point /mnt/hf_cache (inf2
and trn1) the packages are downloaded only once.
Since these steps use setup_venv, that will install uv, there is no need
to install python anymore.
This runs on inf2, builds the package and installs it. It will be run
before any other test.
Add composite action to centralize sanity check and path filtering logic.
Takes path patterns as input and outputs whether the test job should run.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
- Change trigger to workflow_run (after sanity check completes)
- Add check-and-gate job using reusable action on ubuntu-22.04
- Only allocate inf2 runner if sanity passed and relevant paths changed

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
- Change trigger to workflow_run (after sanity check completes)
- Add check-and-gate job using reusable action on ubuntu-22.04
- Only allocate inf2 runner if sanity passed and relevant paths changed
- Includes LLM-specific path patterns for all decoder models

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
- Change trigger to workflow_run (after sanity check completes)
- Add check-and-gate job using reusable action on ubuntu-22.04
- Only allocate inf2 runner if sanity passed and relevant paths changed
- Includes vLLM-specific paths and Docker build files

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
- Change trigger to workflow_run (after sanity check completes)
- Add check-and-gate job using reusable action on ubuntu-22.04
- Only allocate inf2 runner if sanity passed and relevant paths changed
- Includes diffusers-specific paths and pipeline files

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
- Change trigger to workflow_run (after sanity check completes)
- Add check-and-gate job using reusable action on ubuntu-22.04
- Only allocate inf2 runner if sanity passed and relevant paths changed
- Includes transformers-specific model paths (bert, clip, t5, whisper, yolos)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
- Change trigger to workflow_run (after sanity check completes)
- Add check-and-gate job using reusable action on ubuntu-22.04
- Only allocate inf2 runner if sanity passed and relevant paths changed
- Includes seq2seq-specific model paths (T5)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
- Change trigger to workflow_run (after sanity check completes)
- Preserve schedule trigger for daily runs
- Add check-and-gate job using reusable action on ubuntu-22.04
- Only allocate inf2 runner if sanity passed and relevant paths changed
- Includes transformers-specific model paths (bert, clip, t5, whisper, yolos)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants