-
Notifications
You must be signed in to change notification settings - Fork 244
Add Sirius #711
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Add Sirius #711
Conversation
|
@Yifei-yang7 Thanks - looking forward to merging this. Before doing so, I had a question. Basically all ClickBench submissions are tested on AWS EC2 instances. This submission uses lambda.ai. Running Sirius on EC2 would make it easier to compare against other databases (also, my EC2 account is covered by my company whereas lambda.ai asks me for my credit card). Would you consider submitting results for a EC2 instance? They provide various P* boxes with Nvidia GPUs. Perhaps the compilation script needs some changes as well. |
|
@rschu1ze Thanks for your quick response! |
|
@Yifei-yang7 For sure, however long/mid-term I think that AWS will offer GH200 instances as well. What about this: you test that script runs on EC2 as well (H100) and we submit both entries - this will be more future-proof going forward. |
|
@rschu1ze I just tried to launch an H100 instance on EC2 but kept getting "insufficient capacity". It seems to be much harder to reserve an instance than Lambda. |
|
@rschu1ze I managed to reserve a p5.4xlarge instance on EC2 and confirmed that the benchmark script runs correctly there. I’ve added the new results to this PR. Let me know if there’s anything else you’d like me to update. Thanks. |
This PR adds Sirius, a GPU-native SQL engine which can provide drop-in acceleration for DuckDB.
The structure and files are similar to DuckDB, and the changes are mainly results and benchmarking script. The script is tested on the lambda-GH200 instance.
Please let me know if you need any adjustments or additional artifacts. Thanks!