We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 5984499 commit 47de882Copy full SHA for 47de882
vllm/v1/core/kv_cache_utils.py
@@ -11,8 +11,10 @@
11
12
class BlockHashType(NamedTuple):
13
"""Hash value of a block (int), the token IDs in the block, and extra keys.
14
- The reason we keep a tuple of token IDs and extra keys is to make sure
15
- no hash collision happens when the hash value is the same.
+ We keep a tuple of token IDs and extra keys to reduce the likelihood of
+ hash collisions when the hash value is the same. But please note that
16
+ hash collisions can still theoretically occur, albeit with an extremely
17
+ low probability.
18
"""
19
# Hash value of the block in an integer.
20
hash_value: int
0 commit comments