Skip to content

Update products for 24.11 #626

New issue
New issue
Closed
Closed
Update products for 24.11#626
Assignees
NickLarsenNZ
Labels
release/24.11.0
@NickLarsenNZ

Description

@NickLarsenNZ
NickLarsenNZ
opened on Aug 6, 2024

This issue has moved to stackabletech/docker-images#831

The description below will no longer be updated with progress.

Caution

Please raise DEMO PRs against the next branch so that demos aren't broken (resolved in future by stackabletech/stackable-cockpit#310).

This issue tracks the product versions and the changes we need to do to them in our SDP release 24.11.

The single source of truth for this data is a spreadsheet we filled colaboratively in a planning meeting.

Acceptance

These high level tasks need to be completed.

Important

At the end, these should be checked based on the more granular criterea for each product/image below.

  • Bump UBI Image releases.
  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Update product version references in getting_started docs, kuttl tests
  • Update product version references in demos, raise PRs against the next branch for now.
  • Update the Stackable DB.

Base images

Tip

The Rust upgrades should be done as and when needed by developers, rather than being tied to the product selection for a release.
Also, ensure make run-dev works before bumping the Rust version across the operators.

UBI8 Rust Builder

ubi8-rust-builder

  • Update UBI version hash in the Dockerfile (FROM)
  • Update RUST_DEFAULT_TOOLCHAIN_VERSION
  • Update CARGO_CYCLONEDX_CRATE_VERSION
  • Update CARGO_AUDITABLE_CRATE_VERSION
  • Update PROTOC_VERSION
### Related Pull Requests
- [ ] https://github.com/stackabletech/docker-images/pull/794
- [ ] https://github.com/stackabletech/docker-images/pull/807

UBI9 Rust Builder

ubi9-rust-builder

  • Update UBI version hash in the Dockerfile (FROM)
  • Update RUST_DEFAULT_TOOLCHAIN_VERSION
  • Update CARGO_CYCLONEDX_CRATE_VERSION
  • Update CARGO_AUDITABLE_CRATE_VERSION
  • Update PROTOC_VERSION
### Related Pull Requests
- [ ] https://github.com/stackabletech/docker-images/pull/794
- [ ] https://github.com/stackabletech/operator-rs/pull/827
- [ ] https://github.com/stackabletech/operator-templating/pull/416
- [ ] https://github.com/stackabletech/operator-templating/issues/415
- [ ] https://github.com/stackabletech/docker-images/pull/807

Vector

Caution

Any additions to the versions need to be there before updating the java-base.

Used as a base for java-base.

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
### Related Pull Requests
- [ ] https://github.com/stackabletech/docker-images/pull/815
- [ ] https://github.com/stackabletech/druid-operator/pull/613 todo: bump to 0.40.1
- [ ] https://github.com/stackabletech/hbase-operator/pull/546 todo: bump to 0.40.1
- [ ] https://github.com/stackabletech/hdfs-operator/pull/572 todo: bump to 0.40.1
- [ ] https://github.com/stackabletech/hive-operator/pull/503 todo: bump to 0.40.1
- [ ] https://github.com/stackabletech/kafka-operator/pull/748 todo: bump to 0.40.1
- [ ] https://github.com/stackabletech/nifi-operator/pull/661 todo: bump to 0.40.1
- [ ] https://github.com/stackabletech/opa-operator/pull/618 todo: bump to 0.40.1
- [ ] https://github.com/stackabletech/spark-k8s-operator/pull/448 todo: bump to 0.40.1
- [ ] https://github.com/stackabletech/superset-operator/pull/526 todo: bump to 0.40.1
- [ ] https://github.com/stackabletech/zookeeper-operator/pull/851 todo: bump to 0.40.1
- [ ] https://github.com/stackabletech/demos/pull/87 todo: bump to 0.40.1

Java Base and Devel

Caution

Any additions to the java-base or java-devel versions need to be there before updating Java based products.

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
### Related Pull Requests
- [ ] _Link to PR_

Stackable Base

stackable-base

  • Update UBI version hash in the Dockerfile (FROM)
  • Update RUST_DEFAULT_TOOLCHAIN_VERSION
  • Update CARGO_CYCLONEDX_CRATE_VERSION
  • Update CARGO_AUDITABLE_CRATE_VERSION
  • Update PROTOC_VERSION
  • Update CONFIG_UTILS_VERSION
### Related Pull Requests
- [ ] https://github.com/stackabletech/docker-images/pull/807

Product Images

  • Make sure to also check any other dependencies we might use in a Docker image! (e.g. git sync, prometheus exporter etc.)

Airflow

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
### Related Pull Requests
- [ ] https://github.com/stackabletech/docker-images/pull/809
- [ ] https://github.com/stackabletech/airflow-operator/pull/494
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] https://github.com/stackabletech/demos/pull/90

Druid

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Update versions.py to the latest supported version of JVM (base and devel).
  • Update the druid-opa-authorizer with the new set of versions.
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
### Related Pull Requests
- [ ] _Link to PR_
- [ ] _Link to operator PR (getting_started / kuttl)_
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] _Link to demo PR (Do not merge until demos are released)_
- [ ] _Link to [druid-opa-authorizer](https://github.com/stackabletech/druid-opa-authorizer/) PR_

HBase, Phoenix, Omid

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Update versions.py to the latest supported version of JVM (base and devel).
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
  • Update Omid.
  • Update Phoenix.
### Related Pull Requests
- [ ] _Link to PR_
- [ ] _Link to operator PR (getting_started / kuttl)_
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] _Link to demo PR (Do not merge until demos are released)_

HDFS

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Update versions.py to the latest supported version of JVM (base and devel).
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
  • Check Authorizer (unknown procedure)
  • Check Group Mapper (unknown procedure)
  • Check Rack Awareness (unknown procedure)
### Related Pull Requests
- [ ] _Link to PR_
- [ ] _Link to operator PR (getting_started / kuttl)_
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] _Link to demo PR (Do not merge until demos are released)_

Hive

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Update versions.py to the latest supported version of JVM (base and devel).
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
### Related Pull Requests
- [ ] https://github.com/stackabletech/docker-images/pull/818
- [ ] https://github.com/stackabletech/hive-operator/pull/508
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] _Link to demo PR (Do not merge until demos are released)_

Kafka

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Update versions.py to the latest supported version of JVM (base and devel).
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
### Related Pull Requests
- [ ] https://github.com/stackabletech/docker-images/pull/813
- [ ] https://github.com/stackabletech/kafka-operator/pull/753
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] _Link to demo PR (Do not merge until demos are released)_ - **no change to LTS version**

NiFi

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Update versions.py to the latest supported version of JVM (base and devel).
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
### Related Pull Requests
- [ ] _Link to PR_
- [ ] _Link to operator PR (getting_started / kuttl)_
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] _Link to demo PR (Do not merge until demos are released)_

OpenPolicyAgent (OPA)

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
### Related Pull Requests
- [ ] https://github.com/stackabletech/docker-images/pull/797
- [ ] https://github.com/stackabletech/opa-operator/pull/616
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] https://github.com/stackabletech/demos/pull/85

Spark

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
  • Update versions.py to the latest supported version of JVM (base and devel).
### Related Pull Requests
- [ ] _Link to PR_
- [ ] _Link to operator PR (getting_started / kuttl)_
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] _Link to demo PR (Do not merge until demos are released)_

Superset

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
### Related Pull Requests
- [ ] _Link to PR_
- [ ] _Link to operator PR (getting_started / kuttl)_
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] _Link to demo PR (Do not merge until demos are released)_

Trino

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Update trino-cli.
### Related Pull Requests
- [ ] https://github.com/stackabletech/docker-images/pull/822
- [ ] https://github.com/stackabletech/trino-operator/pull/638/
- [ ] https://github.com/stackabletech/demos/pull/93

ZooKeeper

Actions to take:

  • Update versions.py to reflect the agreed upon versions in the spreadsheet.
  • Update versions.py to the latest supported version of JVM (base and devel).
  • Check other operators (getting_started / kuttl) for usage of the versions. Add the PR to the list below.
### Related Pull Requests
- [ ] _Link to PR_
- [ ] _Link to operator PR (getting_started / kuttl)_
- [ ] _Link to other operator PRs (getting_started / kuttl)_
- [ ] _Link to demo PR (Do not merge until demos are released)_

Metadata

Metadata

Assignees

Labels

release/24.11.0

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions