The following are required to build images and deploy them:
-
docker (ideally, configured to run rootless):
docker --version -
docker compose:
docker compose version
First, clone the feldera repository and navigate into it.
All commands below should be run from the root directory of the repository.
-
Latest release (same as Quickstart):
docker compose -f deploy/docker-compose.yml up
-
Built using local sources: this can take a while as it both builds the pipeline manager and performs pre-compilation.
docker compose -f deploy/docker-compose.yml \ -f deploy/docker-compose-dev.yml \ up --buildAs this section is for development, below we specify
-devconfiguration file each time. To use only the releases, remove the-f ...-dev.ymlarguments. -
Change logging level:
RUST_LOG=debug docker compose -f deploy/docker-compose.yml \ -f deploy/docker-compose-dev.yml \ up --build -
Monitoring with Prometheus and Grafana:
docker compose -f deploy/docker-compose.yml \ -f deploy/docker-compose-dev.yml \ --profile grafana up --build... after which you can view Prometheus at http://localhost:9090 and Grafana at http://localhost:3000
-
Demo:
docker compose -f deploy/docker-compose.yml \ -f deploy/docker-compose-dev.yml \ -f deploy/docker-compose-extra.yml \ -f deploy/docker-compose-demo.yml \ --profile demo-debezium-mysql up --buildThe demo profiles can be found within:
deploy/docker-compose-demo.yml -
Redpanda:
docker compose -f deploy/docker-compose.yml \ -f deploy/docker-compose-dev.yml \ --profile redpanda up --build -
Kafka Connect:
docker compose -f deploy/docker-compose.yml \ -f deploy/docker-compose-dev.yml \ -f deploy/docker-compose-extra.yml \ --profile kafka-connect up --build -
Kafka Connect with MySQL:
docker compose -f deploy/docker-compose.yml \ -f deploy/docker-compose-dev.yml \ -f deploy/docker-compose-extra.yml \ --profile mysql --profile kafka-connect up --build -
Kafka Connect with Postgres:
docker compose -f deploy/docker-compose.yml \ -f deploy/docker-compose-dev.yml \ -f deploy/docker-compose-extra.yml \ --profile postgres --profile kafka-connect up --build