Skip to content

soumilshah1995/duckdb-on-lambda

Repository files navigation

duckdb-on-lambda

duckdb-on-lambda image

Blogs

https://www.linkedin.com/pulse/fast-cost-effective-querying-duckdb-aws-lambda-docker-soumil-shah-omhke/?trackingId=4dj0%2Fqy%2BSPuT6Kp%2FFoekCw%3D%3D

Steps to test it locally

bash /Users/soumilshah/IdeaProjects/clickhoue-examples/duckdb/duckdb-lambdas/upload_data.sh

docker build -t duckdb-lambda .

docker run -p 9000:8080 \
    -v ~/.aws:/root/.aws:ro \
    duckdb-lambda

python3 test_duckdb_lambda.py

Sample test Commands


curl -s -X POST http://localhost:9000/2015-03-31/functions/function/invocations \
-H "Content-Type: application/json" \
-d '{
  "query": "SELECT avg(c_acctbal) FROM read_parquet(\"s3://XX/datalake/parquet/customer.parquet\")",
  "extensions": []
}' | jq .


curl -s -X POST http://localhost:9000/2015-03-31/functions/function/invocations \
-H "Content-Type: application/json" \
-d '{
  "query": "SELECT count(*) FROM delta_scan(\"s3://XX/datalake/delta/\")",
  "extensions": ["delta", "aws", "httpfs"]
}' | jq .

About

duckdb-on-lambda

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published