Issue while quering the model #83
Description
Hi,
I habe tried to use a model in gguf format
But i get the below error.
❌ Failed to generate text: LLMToolkitException: No suitable engine found for model: /data/user/0/com.example.roast_excuse/app_flutter/Smol-Llama-v1-Q4_K_M.gguf (detected: InferenceEngineType.llama)
Any ideas?
Thank you in advance.