Deploy Databend With AWS S3
tip
Expected deployment time: 5 minutes ⏱
This guideline will deploy Databend(standalone) with AWS S3 step by step.
1. Download
You can find the latest binaries on the github release page or build from source.
mkdir databend && cd databend
- Linux
curl -LJO https://github.com/datafuselabs/databend/releases/download/${version}/databend-${version}-x86_64-unknown-linux-musl.tar.gz
- Linux
tar xzvf databend-${version}-x86_64-unknown-linux-musl.tar.gz
2. Deploy databend-meta (Standalone)
databend-meta is a global service for the meta data(such as user, table schema etc.).
2.1 Create databend-meta.toml
databend-meta.toml
dir = "metadata/_logs"
admin_api_address = "127.0.0.1:8101"
grpc_api_address = "127.0.0.1:9101"
[raft_config]
id = 1
single = true
raft_dir = "metadata/datas"
2.2 Start the databend-meta
./databend-meta -c ./databend-meta.toml > meta.log 2>&1 &
2.3 Check databend-meta
curl -I http://127.0.0.1:8101/v1/health
Check the response is HTTP/1.1 200 OK
.
3. Deploy databend-query (Standalone)
3.1 Create databend-query.toml
databend-query.toml
[log]
level = "INFO"
dir = "benddata/_logs"
[query]
# For admin RESET API.
admin_api_address = "127.0.0.1:8001"
# Metrics.
metric_api_address = "127.0.0.1:7071"
# Cluster flight RPC.
flight_api_address = "127.0.0.1:9091"
# Query MySQL Handler.
mysql_handler_host = "127.0.0.1"
mysql_handler_port = 3307
# Query ClickHouse Handler.
clickhouse_handler_host = "127.0.0.1"
clickhouse_handler_port = 9001
# Query ClickHouse HTTP Handler.
clickhouse_http_handler_host = "127.0.0.1"
clickhouse_http_handler_port = 8125
# Query HTTP Handler.
http_handler_host = "127.0.0.1"
http_handler_port = 8081
tenant_id = "tenant1"
cluster_id = "cluster1"
[meta]
address = "127.0.0.1:9101"
username = "root"
password = "root"
[storage]
# s3
type = "s3"
[storage.s3]
bucket = "databend"
endpoint_url = "https://s3.amazonaws.com"
access_key_id = "<your-key-id>"
secret_access_key = "<your-access-key>"
3.2 Start databend-query
./databend-query -c ./databend-query.toml > query.log 2>&1 &
3.3 Check databend-query
curl -I http://127.0.0.1:8001/v1/health
Check the response is HTTP/1.1 200 OK
.
4. Play
mysql -h127.0.0.1 -uroot -P3307
CREATE TABLE t1(a INT);
INSERT INTO t1 VALUES(1), (2);
SELECT * FROM t1;
+------+
| a |
+------+
| 1 |
| 2 |
+------+