Skip to content

Conversation

@giladgd
Copy link
Member

@giladgd giladgd commented Oct 8, 2023

Description of change

  • Adapted to new llama.cpp interface
  • Added support for repeat penalty
  • Improved grammar support
  • Added build toolchains for cross-compilation
  • Moved context and evaluation options to LlamaContext, LlamaContext's evaluate function, and LlamaChatSession's prompt function while supporting the existing interface. This way the API is better aligned with llama.cpp while preserving compatibility with existing projects that use the old interface.

Fixes #57

Pull-Request Checklist

  • Code is up-to-date with the master branch
  • npm run format to apply eslint formatting
  • npm run test passes with this change
  • This pull request links relevant issues as Fixes #0000
  • There are new or updated unit tests validating the change
  • Documentation has been updated to reflect this change
  • The new commits and pull request title follow conventions explained in CONTRIBUTING.md (PRs that do not follow this convention will not be merged)

@giladgd giladgd requested a review from ido-pluto October 8, 2023 16:07
@giladgd giladgd self-assigned this Oct 8, 2023
Copy link
Contributor

@ido-pluto ido-pluto left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@giladgd giladgd merged commit 3400fce into master Oct 8, 2023
@giladgd giladgd deleted the gilad/alignToLlamaCppInterfaceChanges branch October 8, 2023 21:15
@github-actions
Copy link

github-actions bot commented Oct 9, 2023

🎉 This PR is included in version 2.6.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Set repeat-penalty request

3 participants