chore(tracking): Test demos on nightly versions for 24.11 #658
Description
Pre-Release Demo Testing on Nightly
Part of #647
This is testing:
- The demos documented in nightly (with the updated product versions) still work.
- That the operators can be upgraded from the current release to the nightly release and do not negatively impact the products.
Note
Record any issues or anomalies during the process in a comment on this issue.
Eg:
:green_circle: **airflow-scheduled-job**
The CRD had been updated and I needed to change the following in the manifest:
...
Replace the items in the task lists below with the applicable Pull Requests (if any).
### Testing Demos on Nightly
- [ ] https://github.com/stackabletech/demos/pull/119
- [x] [airflow-scheduled-job](https://docs.stackable.tech/home/nightly/demos/airflow-scheduled-job) @xeniape
- [ ] https://github.com/stackabletech/demos/pull/127
- [ ] https://github.com/stackabletech/demos/pull/128
- [ ] https://github.com/stackabletech/hive-operator/pull/539
- [ ] https://github.com/stackabletech/demos/pull/129
- [x] [jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data](https://docs.stackable.tech/home/nightly/demos/jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data) @adwk67
- [x] [logging](https://docs.stackable.tech/home/nightly/demos/logging) @Techassi
- [x] https://github.com/stackabletech/demos/pull/124
- [ ] https://github.com/stackabletech/demos/pull/126
- [x] [signal-processing](https://docs.stackable.tech/home/nightly/demos/signal-processing) @Techassi
- [x] [spark-k8s-anomaly-detection-taxi-data](https://docs.stackable.tech/home/nightly/demos/spark-k8s-anomaly-detection-taxi-data) @adwk67
- [x] [trino-iceberg](https://docs.stackable.tech/home/nightly/demos/trino-iceberg) @adwk67
- [x] [trino-taxi-data](https://docs.stackable.tech/home/nightly/demos/trino-taxi-data) @labrenbe
- [x] Update this template with hints for upgrading helm charts easily (@Techassi)
- [ ] https://github.com/stackabletech/demos/pull/120
- [ ] https://github.com/stackabletech/demos/pull/121
- [ ] https://github.com/stackabletech/demos/pull/130
- [x] After all demo PRs are merged, quickly render the nightly docs to check for any `adoc` formatting issues. @NickLarsenNZ
Instructions
These instructions are for deploying the nightly demo, as well as upgrading the operators and CRDS.
# Install demo (stable operators) for the previous release (24.7)
# For now, we have to deploy from the release branch, otherwise we get new changes.
# Stackablectl doesn't yet support deploying a demo from a branch
git checkout release-24.7
git pull
stackablectl --stack-file=stacks/stacks-v2.yaml --demo-file=demos/demos-v2.yaml demo install <DEMO_NAME>
# --- IMPORTANT ---
# Run through the nightly demo instructions (refer to the tasklist below).
# Get a list of installed operators
stackablectl operator installed --output=plain
# --- OPTIONAL ---
# Sometimes it is necessary to upgrade Helm charts. Look for other Helm Charts
# which might need updating.
# First, see which charts are installed. You can ignore the stackable-operator
# charts, or anything that might have been installed outside of this demo.
helm list
# Next, add the applicable Helm Chart repositories. For example:
helm repo add minio https://charts.min.io/
helm repo add bitnami https://charts.bitnami.com/bitnami
# Finally, upgrade the Charts to what is defined in `main`.
# These are being done in https://github.com/stackabletech/demos/pull/119
# For example:
helm upgrade minio minio/minio --version x.x.x
helm upgrade postgresql-hive bitnami/postgresql --version x.x.x
# --- OPTIONAL END ---
# Uninstall operators
stackablectl release uninstall 24.7
# Update CRDs to nightly version (on main)
# Repeat this for every operator used by the demo (use the list from the earlier step before deleting the operators)
kubectl replace -f https://raw.githubusercontent.com/stackabletech/commons-operator/main/deploy/helm/commons-operator/crds/crds.yaml
kubectl replace -f https://raw.githubusercontent.com/stackabletech/...-operator/main/deploy/helm/...-operator/crds/crds.yaml
# Install nightly version of operators (use the list from the earlier step before deleting the operators)
stackablectl operator install commons ...
# Optionally update the product versions in the CRDs (to the latest non-experimental version for the new release), e.g.:
kubectl patch hbaseclusters/hbase --type='json' -p='[{"op": "replace", "path": "/spec/image/productVersion", "value":"x.x.x"}]' # changed