Skip to content

[Request Help] I would like to ask, does ExecuTorch have plans to support EAGLE-1/EAGLE-2/EAGLE-3? #9032

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
liye0626 opened this issue Mar 7, 2025 · 3 comments
Closed

[Request Help] I would like to ask, does ExecuTorch have plans to support EAGLE-1/EAGLE-2/EAGLE-3? #9032

liye0626 opened this issue Mar 7, 2025 · 3 comments
Labels
module: llm Issues related to LLM examples and apps, and to the extensions/llm/ code triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module

Comments

@liye0626
Copy link

liye0626 commented Mar 7, 2025 •
edited by pytorch-bot bot
Loading

As the title says, does ExecuTorch have plans to support EAGLE, or other Speculative Decoding methods?

cc @mergennachin @cccclai @helunwencser @jackzhxng
@iseeyuan
Copy link
Contributor

iseeyuan commented Mar 7, 2025

@liye0626 Spec Dec is in our backlog, but currently no one is working on that afaik. Are you interested to contribute to it?

@iseeyuan iseeyuan added triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module module: llm Issues related to LLM examples and apps, and to the extensions/llm/ code labels Mar 7, 2025
@github-project-automation github-project-automation bot moved this to To triage in ExecuTorch Core Mar 7, 2025
@liye0626
Copy link
Author

liye0626 commented Mar 7, 2025

@iseeyuan Thanks for your reply. I am trying to support EAGLE, but due to the lack of ExecuTorch knowledge background, I am still struggling to do this.

@iseeyuan
Copy link
Contributor

iseeyuan commented Mar 7, 2025

@liye0626 Thanks for trying that! Please refer to the documentation in https://pytorch.org/executorch/main/index.html. If you have any specific questions, please feel free to create issue here!

@liye0626 liye0626 closed this as completed Mar 8, 2025
@github-project-automation github-project-automation bot moved this from To triage to Done in ExecuTorch Core Mar 8, 2025
@github-actions github-actions bot mentioned this issue Mar 10, 2025
Open
This was referenced Mar 17, 2025
Open
Open
@github-actions github-actions bot mentioned this issue Mar 31, 2025
Open
@github-actions github-actions bot mentioned this issue Apr 7, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
module: llm Issues related to LLM examples and apps, and to the extensions/llm/ code triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
Projects
ExecuTorch Core
Status: Done
Milestone
No milestone
Development

No branches or pull requests
2 participants
@iseeyuan @liye0626