-
Notifications
You must be signed in to change notification settings - Fork 61
Enable FP8 concat_xpu and where_xpu #2152
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR enables FP8 (float8) dtype support for the concat_xpu and where_xpu operations by updating the kernel dispatchers and adding comprehensive regression tests.
- Updates
where_kernelto useAT_DISPATCH_V2macro with FP8 dtype support - Adds FP8 dtype support to
cat_out_kerneldispatcher - Adds regression tests for
torch.where()andtorch.cat()with FP8 dtypes
Reviewed Changes
Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
| src/ATen/native/xpu/sycl/TensorCompareKernels.cpp | Updates where_kernel to use AT_DISPATCH_V2 macro and adds FP8 dtype support |
| src/ATen/native/xpu/sycl/Shape.cpp | Adds FP8 dtype support to cat_out_kernel dispatcher |
| test/regressions/test_where.py | Adds comprehensive regression tests for torch.where() with FP8 dtypes |
| test/regressions/test_cat.py | Adds regression tests for torch.cat() with FP8 dtypes |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Co-authored-by: Copilot <[email protected]>
CuiYifeng
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The main part of this PR looks good to me.
To solve #2207 This PR adds FP8 data types support for `torch.cat` and `torch.where` on XPU backend. --------- Co-authored-by: Cui, Yifeng <[email protected]> Co-authored-by: Copilot <[email protected]>
To solve #2207 This PR adds FP8 data types support for `torch.cat` and `torch.where` on XPU backend. --------- Co-authored-by: Cui, Yifeng <[email protected]> Co-authored-by: Copilot <[email protected]>
To solve #2207
This PR adds FP8 data types support for
torch.catandtorch.whereon XPU backend.