Skip to content

Commit 109815b

Browse files
aajisakapan3793
authored andcommitted
[KYUUBI #7251] Use RustFS instead of MinIO in Playground
### Why are the changes needed? Playground fails to launch because Minio Docker image is no longer available. Close #7251 ### How was this patch tested? Ran `docker-compose up -d` to launch Playground and ran the following commands in the readme to create test data: ``` docker exec -it kyuubi /opt/kyuubi/bin/beeline -u 'jdbc:hive2://0.0.0.0:10009/' -f /opt/load_data/load-dataset-tpcds-tiny.sql docker exec -it kyuubi /opt/kyuubi/bin/beeline -u 'jdbc:hive2://0.0.0.0:10009/' -f /opt/load_data/load-dataset-tpch-tiny.sql ``` ### Was this patch authored or co-authored using generative AI tooling? No Closes #7252 from aajisaka/fix-playground. Closes #7251 9dca056 [Akira Ajisaka] Add credentials info for RustFS Web UI e5f1899 [Akira Ajisaka] [KYUUBI #7251] Use RustFS instead of MinIO in Playground Authored-by: Akira Ajisaka <[email protected]> Signed-off-by: Cheng Pan <[email protected]>
1 parent 5887e76 commit 109815b

File tree

3 files changed

+30
-12
lines changed

3 files changed

+30
-12
lines changed

docker/playground/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ Kyuubi supply some built-in dataset, after Kyuubi started, you can run the follo
3131

3232
### Access Service
3333

34-
- MinIO: http://localhost:9001
34+
- RustFS: http://localhost:9001 (account: rustfsadmin, key: rustfsadmin)
3535
- PostgreSQL localhost:5432 (username: postgres, password: postgres)
3636
- Spark UI: http://localhost:4040 (available after Spark application launching by Kyuubi, port may be 4041, 4042... if you launch more than one Spark applications)
3737
- Prometheus: http://localhost:9090

docker/playground/compose.yml

Lines changed: 26 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -16,17 +16,35 @@
1616
#
1717

1818
services:
19-
minio:
20-
image: bitnami/minio:2023-debian-11
19+
rustfs:
20+
image: rustfs/rustfs:latest
2121
environment:
22-
MINIO_ROOT_USER: minio
23-
MINIO_ROOT_PASSWORD: minio_minio
24-
MINIO_DEFAULT_BUCKETS: spark-bucket
25-
container_name: minio
26-
hostname: minio
22+
RUSTFS_ACCESS_KEY: rustfsadmin
23+
RUSTFS_SECRET_KEY: rustfsadmin
24+
RUSTFS_ADDRESS: 0.0.0.0:9000
25+
RUSTFS_CONSOLE_ACCESS: 0.0.0.0:9001
26+
hostname: rustfs
2727
ports:
2828
- 9000
2929
- 9001:9001
30+
healthcheck:
31+
test: ["CMD", "curl", "-f", "http://localhost:9000/health"]
32+
interval: 30s
33+
timeout: 10s
34+
retries: 5
35+
start_period: 20s
36+
37+
rustfs-init:
38+
image: amazon/aws-cli:latest
39+
depends_on:
40+
rustfs:
41+
condition: service_healthy
42+
environment:
43+
AWS_ACCESS_KEY_ID: rustfsadmin
44+
AWS_SECRET_ACCESS_KEY: rustfsadmin
45+
AWS_REGION: us-east-1
46+
entrypoint: /bin/sh
47+
command: -c "aws --endpoint-url http://rustfs:9000 s3api create-bucket --bucket spark-bucket"
3048

3149
postgres:
3250
image: postgres:${POSTGRES_VERSION}
@@ -79,7 +97,7 @@ services:
7997
- ./script/load-dataset-tpch-tiny.sql:/opt/load_data/load-dataset-tpch-tiny.sql
8098
depends_on:
8199
- metastore
82-
- minio
100+
- rustfs
83101
- zookeeper
84102

85103
prometheus:

docker/playground/conf/core-site.xml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -19,11 +19,11 @@
1919
<configuration>
2020
<property>
2121
<name>fs.s3a.access.key</name>
22-
<value>minio</value>
22+
<value>rustfsadmin</value>
2323
</property>
2424
<property>
2525
<name>fs.s3a.secret.key</name>
26-
<value>minio_minio</value>
26+
<value>rustfsadmin</value>
2727
</property>
2828
<property>
2929
<name>fs.s3a.connection.ssl.enabled</name>
@@ -35,7 +35,7 @@
3535
</property>
3636
<property>
3737
<name>fs.s3a.endpoint</name>
38-
<value>http://minio:9000</value>
38+
<value>http://rustfs:9000</value>
3939
</property>
4040
<property>
4141
<name>fs.s3a.committer.name</name>

0 commit comments

Comments
 (0)