Skip to content

Add Prompt templating structures #3

@getnamo

Description

@getnamo

Not sure exactly how, but a better API for setting up various use cases:

  • General chat interaction structure and reliable EOS tags
  • Thought chains
  • Assistant
  • Roleplay
  • External API calls e.g. a function call interpretation by LLM with injected results.

Base chat templating support e.g.

  • ChatML
  • Alpaca
  • llama

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions