Skip to content

Conversation

@csauper
Copy link
Contributor

@csauper csauper commented Sep 17, 2024

Summary: previously first character was stripped as SOS token, but that doesn't actually seem to be the case with current LLMs. Keep all tokens.

Differential Revision: D62775617

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D62775617

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D62775617

csauper added a commit to csauper/captum that referenced this pull request Sep 17, 2024
Summary:
Pull Request resolved: meta-pytorch#1351

previously first character was stripped as SOS token, but that doesn't actually seem to be the case with current LLMs. Keep all tokens.

Differential Revision: D62775617
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D62775617

csauper added a commit to csauper/captum that referenced this pull request Sep 17, 2024
Summary:
Pull Request resolved: meta-pytorch#1351

previously first character was stripped as SOS token, but that doesn't actually seem to be the case with current LLMs. Keep all tokens.

Differential Revision: D62775617
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D62775617

csauper added a commit to csauper/captum that referenced this pull request Sep 18, 2024
Summary:
Pull Request resolved: meta-pytorch#1351

previously first character was stripped as SOS token, but that doesn't actually seem to be the case with current LLMs. Keep all tokens.

Differential Revision: D62775617
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D62775617

csauper added a commit to csauper/captum that referenced this pull request Sep 18, 2024
Summary:
Pull Request resolved: meta-pytorch#1351

previously first character was stripped as SOS token, but that doesn't actually seem to be the case with current LLMs. Keep all tokens.

Differential Revision: D62775617
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D62775617

csauper added a commit to csauper/captum that referenced this pull request Sep 19, 2024
Summary:
Pull Request resolved: meta-pytorch#1351

previously first character was stripped as SOS token, but that doesn't actually seem to be the case with current LLMs. Keep all tokens.

Differential Revision: D62775617
Summary:
Pull Request resolved: meta-pytorch#1351

previously first character was stripped as SOS token, but that doesn't actually seem to be the case with current LLMs. Keep all tokens.

Differential Revision: D62775617
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D62775617

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 7b80c5b.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants