[Feature Request] Support InternLM Deploy

[vansinhu]

Dear LLamaSharp developer,

Greetings! I am vansinhu, a community developer and volunteer at InternLM. InternLM is a large language model similar to llama2, and we look forward to InternLM being supported in LLamaSharp. If there are any challenges or inquiries regarding support for InternLM, please feel free to join our Discord discussion at https://discord.gg/gF9ezcmtM3.

Best regards,
vansinhu

[martindevans]

Is InternLM supported by llama.cpp? If it is then we probably already support it!

[geffzhang]

InternLM/InternLM#258

[martindevans]

Some related upstream issues:

• [Feature Request] Support InternLM Deploy ggml-org/llama.cpp#3133
• internlm-chat-7b can convert to gguf but can not run ggml-org/llama.cpp#3551

[martindevans]

ggml-org/llama.cpp#4283

[martindevans]

ggml-org/llama.cpp#5184 has been merged (4 days ago), therefore #479 should include InternLM support for LLamaSharp.

[martindevans]

0.10.0 has just been released which should include InternLM support at long last!