[Bug]: Automatic Prefix Caching doesn't support Nvidia Turing Arch.

[esmeetu]

🐛 Describe the bug

triton==2.1.0 doesn't support Turing arch, and has been fixed in triton-lang/triton#2364
Upgrade to triton==2.2.0 will resolve this issue.

Perhaps this could be planned after #3442.

[matthieu637]

Don't you have the #2729 error even with triton 2.2.0?

[esmeetu]

Don't you have the #2729 error even with triton 2.2.0?

No. And current latest version has updated torch to 2.2.1 with triton 2.2.0 support, this issue was resolved.