Skip to content

Commit 3c5a3e1

Browse files
committed
Fix attachments counting to be closer to how they are handled in llama-stack
1 parent cd5bb03 commit 3c5a3e1

File tree

1 file changed

+3
-5
lines changed

1 file changed

+3
-5
lines changed

src/utils/token_counter.py

Lines changed: 3 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -109,13 +109,11 @@ def count_turn_tokens(
109109
input_messages.append(
110110
SystemMessage(role="system", content=str(system_prompt))
111111
)
112-
input_messages.append(UserMessage(role="user", content=query_request.query))
113-
112+
input_content = query_request.query
114113
if query_request.attachments:
115114
for attachment in query_request.attachments:
116-
input_messages.append(
117-
UserMessage(role="user", content=attachment.content)
118-
)
115+
input_content += "\n" + attachment.content
116+
input_messages.append(UserMessage(role="user", content=input_content))
119117

120118
input_tokens = self.count_message_tokens(input_messages)
121119
output_tokens = self.count_tokens(response)

0 commit comments

Comments
 (0)