Skip to content

Debug intermediate layers of tensor compute values #3325

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
nlpcat opened this issue Sep 24, 2023 · 3 comments
Closed

Debug intermediate layers of tensor compute values #3325

nlpcat opened this issue Sep 24, 2023 · 3 comments
Labels
stale

Comments

@nlpcat
Copy link

nlpcat commented Sep 24, 2023

How can we print out intermediate layers of tensor compute value for debugging and development purpose? Thanks.
@github-actions github-actions bot added the stale label Mar 20, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Apr 3, 2024

This issue was closed because it has been inactive for 14 days since being marked as stale.

@github-actions github-actions bot closed this as completed Apr 3, 2024
@thiswillbeyourgithub
Copy link

thiswillbeyourgithub commented May 13, 2025 •
edited
Loading

I too am interested by this. This would be nice for interpretability works (see repeng)

Also related to #2047 and #4224

@slaren
Copy link
Member

slaren commented May 14, 2025

The eval-callback example shows how to obtain the intermediate values of the computation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
stale
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@slaren @thiswillbeyourgithub @nlpcat