Skip to content
This repository was archived by the owner on Feb 16, 2024. It is now read-only.

Commit 008965d

Browse files
sbernauersbernauer
committed
Implement stacks and services commands (#36)
This PR adds two new subcommands: * Stacks to install ready-to-use product sets * Services which allows users to list and access the running services (#10) The structure of the `stacks.yaml` still needs to be discussed with @lfrancke and might be adopted to the porter.yaml style. Listing of services is a mechanism i came up with, so is ready to review as is :) To test the stack command run ``` cargo r --additional-stack-files stacks.yaml stack install druid-superset-s3 -k ``` To test the listing of services (this command was run after installing the stack `druid-superset-s3` and a bunch of other products) ``` cargo r -- services ls Finished dev [unoptimized + debuginfo] target(s) in 0.05s Running `target/debug/stackablectl services ls` PRODUCT NAME NAMESPACE ENDPOINTS EXTRA INFOS airflow airflow default webserver-airflow: http://172.18.0.4:31206 Admin user: airflow, password: airflow druid druid default router-http: http://172.18.0.4:32126 coordinator-http: http://172.18.0.4:30347 hbase simple-hbase default regionserver: 172.18.0.4:32413 ui: http://172.18.0.4:32051 metrics: 172.18.0.4:30504 hdfs simple-hdfs default datanode-default-0-metrics: 172.18.0.4:32607 datanode-default-0-data: 172.18.0.4:30655 datanode-default-0-http: http://172.18.0.4:32340 datanode-default-0-ipc: 172.18.0.4:31295 namenode-default-0-metrics: 172.18.0.3:31541 namenode-default-0-http: http://172.18.0.3:31669 namenode-default-0-rpc: 172.18.0.3:32286 journalnode-default-0-metrics: 172.18.0.5:30631 journalnode-default-0-http: http://172.18.0.5:31961 journalnode-default-0-https: https://172.18.0.5:30133 journalnode-default-0-rpc: 172.18.0.5:31222 hive simple-hive-derby default hive: 172.18.0.4:30560 metrics: 172.18.0.4:31796 superset superset default external-superset: http://172.18.0.3:30067 Admin user: admin, password: admin trino simple-trino default coordinator-http: http://172.18.0.5:31395 coordinator-metrics: 172.18.0.5:32214 zookeeper druid-zookeeper default zk: 172.18.0.3:32220 zookeeper simple-zk default zk: 172.18.0.5:32548 minio minio-druid default http: http://172.18.0.5:30054 Third party service console-http: http://172.18.0.5:31771 Admin user: root, password: rootroot ```
1 parent 2f3ae9b commit 008965d

40 files changed

+2902
-448
lines changed

‎.github/workflows/build.yml‎

Lines changed: 21 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -179,17 +179,35 @@ jobs:
179179
- uses: actions/checkout@v3
180180
- uses: actions/setup-go@v3
181181
with:
182-
go-version: '^1.18.1'
182+
go-version: '^1.18.3'
183183
- uses: actions-rs/toolchain@v1
184184
with:
185185
profile: minimal
186186
toolchain: stable
187187
target: ${{ matrix.target }}
188188
override: true
189-
- uses: Swatinem/rust-cache@cb2cf0cc7c5198d3364b9630e2c3d457f160790c # tag=v1.4.0
189+
- uses: Swatinem/rust-cache@v1
190190
with:
191191
key: build-${{ matrix.target }}
192-
- uses: actions-rs/cargo@v1
192+
- name: Prepare Ubuntu env
193+
if: matrix.os == 'ubuntu-latest'
194+
run: sudo apt install -y musl-tools
195+
- name: Prepare Windows env
196+
if: matrix.os == 'windows-latest'
197+
uses: msys2/setup-msys2@v2
198+
with:
199+
msystem: MINGW64
200+
update: true
201+
install: base-devel mingw-w64-x86_64-go mingw-w64-x86_64-rust
202+
- name: Build for non-Windows
203+
if: matrix.os != 'windows-latest'
204+
uses: actions-rs/cargo@v1
193205
with:
194206
command: build
195207
args: --target=${{ matrix.target }}
208+
- name: Build for Windows
209+
if: matrix.os == 'windows-latest'
210+
run: |
211+
echo 'Running in MSYS2!'
212+
cargo build --target=${{ matrix.target }}
213+
shell: msys2 {0}

‎.github/workflows/release.yml‎

Lines changed: 22 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -29,20 +29,38 @@ jobs:
2929
- uses: actions/checkout@2541b1294d2704b0964813337f33b291d3f8596b # tag=v3
3030
- uses: actions/setup-go@84cbf8094393cdc5fe1fe1671ff2647332956b1a # tag=v3
3131
with:
32-
go-version: '^1.18.1'
33-
- uses: actions-rs/toolchain@16499b5e05bf2e26879000db0c1d13f7e13fa3af # tag=v1
32+
go-version: '^1.18.3'
33+
- uses: actions-rs/toolchain@v1
3434
with:
3535
profile: minimal
3636
toolchain: stable
3737
target: ${{ matrix.target }}
3838
override: true
39-
- uses: actions-rs/cargo@844f36862e911db73fe0815f00a4a2602c279505 # tag=v1
39+
- name: Prepare Ubuntu env
40+
if: matrix.os == 'ubuntu-latest'
41+
run: sudo apt install -y musl-tools
42+
- name: Prepare Windows env
43+
if: matrix.os == 'windows-latest'
44+
uses: msys2/setup-msys2@v2
45+
with:
46+
msystem: MINGW64
47+
update: true
48+
install: base-devel mingw-w64-x86_64-go mingw-w64-x86_64-rust
49+
- name: Build for non-Windows
50+
if: matrix.os != 'windows-latest'
51+
uses: actions-rs/cargo@v1
4052
with:
4153
command: build
4254
args: --release --target=${{ matrix.target }}
55+
- name: Build for Windows
56+
if: matrix.os == 'windows-latest'
57+
run: |
58+
echo 'Running in MSYS2!'
59+
cargo build --release --target=${{ matrix.target }}
60+
shell: msys2 {0}
4361
- name: Rename binary file
4462
run: mv target/${{ matrix.target }}/release/stackablectl${{ matrix.file-suffix }} stackablectl-${{ matrix.target }}${{ matrix.file-suffix }}
4563
- name: Upload Release binaries
46-
uses: softprops/action-gh-release@1e07f4398721186383de40550babbdf2b84acfc5 # tag=v1
64+
uses: softprops/action-gh-release@v1
4765
with:
4866
files: stackablectl-${{ matrix.target }}${{ matrix.file-suffix }}

‎CHANGELOG.md‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,8 @@
44

55
### Added
66

7+
- Support stacks, which are a collection of ready-to-use Stackable data products as well as required third-party services like Postgresql or MinIO ([#36](https://github.com/stackabletech/stackablectl/pull/36))
8+
- Add `services list` command to list the running Stackable services ([#36](https://github.com/stackabletech/stackablectl/pull/36))
79
- Support generation of shell completions ([#54](https://github.com/stackabletech/stackablectl/pull/54))
810

911
### Changed

0 commit comments

Comments
 (0)