You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I reviewed the Discussions, and have a new bug or useful enhancement to share.
Feature Description
What the title is saying: add a command, for example Ctrl+R to clear the current context so that the next User input will an empty context instead of the current one.
Motivation
This will be more convenient when chatting and exceeding the current context limit or just wanting to start a new conversation from a clean state.
Possible Implementation
Add a Ctrl+R (to reset / clear) the current context.
The text was updated successfully, but these errors were encountered:
@KerfuffleV2 now I am reading your comment here #2593 (comment)
Would it be possible to add such a command to your simple-inference for interactive mode? :)
Yes it wouldn't be too hard, but someone else would have to add the feature. Basically just add a command that clears the KV cache for a sequence and resets the history vector of tokens for that sequence in the state.
Prerequisites
Please answer the following questions for yourself before submitting an issue.
Feature Description
What the title is saying: add a command, for example Ctrl+R to clear the current context so that the next User input will an empty context instead of the current one.
Motivation
This will be more convenient when chatting and exceeding the current context limit or just wanting to start a new conversation from a clean state.
Possible Implementation
Add a Ctrl+R (to reset / clear) the current context.
The text was updated successfully, but these errors were encountered: