Supported models

This plugin uses GGUF format models. Download a model and place it to a desired path.
The following models have been tested to work.

• Llama 3 8B
• Llama 3.1 8B

• Phi-3 Medium
• Gemma 7B
• Gemma-2 9B
• Mistral 7B

(Japanese model)

• ArrowPro 7B RobinHood
• ArrowPro 7B KUJIRA
• ELYZA JP 8B