Skip to content

Adds Kaggle testing to CI workflow#189

Merged
copybara-service[bot] merged 1 commit intodevfrom
pculliton-kaggle-ci
May 21, 2024
Merged

Adds Kaggle testing to CI workflow#189
copybara-service[bot] merged 1 commit intodevfrom
pculliton-kaggle-ci

Conversation

@pculliton
Copy link
Collaborator

@pculliton pculliton commented May 17, 2024

Using a restricted Kaggle account, this code:

  • Adds an Ubuntu 20.04 build (required for glibc compat with Kaggle infra)
  • Uploads the ubuntu-20.04 build and supporting library to a Kaggle dataset using a fork of push-kaggle-dataset
  • Creates a new version of a Kaggle notebook that loads artifacts from the Kaggle Model Hub, along with the newly updated dataset, and validates a 2b-it-sfp model.
  • Runs the notebook using an updated / owned fork of kaggle-action and throws an error if the process does not complete, raises an exception, or produces an invalid response.

Todo: add tests / capabilities to the smoke tests used by the notebook.

Using a restricted Kaggle account, this code:
- Adds an Ubuntu 20.04 build (required for glibc compat with Kaggle infra)
- Uploads the ubuntu-20.04 build and supporting library to a Kaggle dataset using a fork of `push-kaggle-dataset`
- Creates a new version of a Kaggle notebook that loads artifacts from the Kaggle Model Hub, along with the newly updated dataset, and validates a 2b-it-sfp model.
- Runs the notebook and throws an error if the process does not complete, raises an exception, or produces an invalid response.

Todo: add tests / capabilities to the smoke tests used by the notebook.
@jan-wassenberg jan-wassenberg added the copybara-import Trigger Copybara for merging pull requests label May 21, 2024
@copybara-service copybara-service bot merged commit 59a1f87 into dev May 21, 2024
@jan-wassenberg jan-wassenberg deleted the pculliton-kaggle-ci branch July 22, 2025 10:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

copybara-import Trigger Copybara for merging pull requests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants