Skip to content
This repository was archived by the owner on Jun 5, 2025. It is now read-only.

Conversation

@aponcedeleonch
Copy link
Member

Closes: #419

Before we could use the chat_id at the output messages as means to group the messages into conversations. This logic is not working anymore.

The new logic takes into account the user messages provided as input to the LLM to map the messages into conversations. Usually LLMs receive all last user messages. Example:

req1 = {messages:[{"role": "user", "content": "hello"}]}
req2 = {messages:[{"role": "user", "content": "hello"}, {"role": "user", "content": "how are you?}]}

In this last example, req1 and req2 should be mapped together to form a conversation

Closes: #419

Before we could use the `chat_id` at the output messages as means
to group the messages into conversations. This logic is not working
anymore.

The new logic takes into account the user messages provided as
input to the LLM to map the messages into conversations. Usually LLMs
receive all last user messages. Example:
```
req1 = {messages:[{"role": "user", "content": "hello"}]}
req2 = {messages:[{"role": "user", "content": "hello"}, {"role": "user", "content": "how are you?}]}
```

In this last example, `req1` and `req2` should be mapped together to
form a conversation
@aponcedeleonch aponcedeleonch requested a review from yrobla January 10, 2025 16:06
@lukehinds lukehinds merged commit c48969c into main Jan 13, 2025
2 checks passed
@lukehinds lukehinds deleted the issue-419 branch January 13, 2025 06:18
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Prompts should be grouped

3 participants