char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Diego Devesallama : add simple-chat example (#10124)a6744e43e

char/aliceai-t5-moe
260 B7 linesraw

llama.cpp/example/simple-chat

The purpose of this example is to demonstrate a minimal usage of llama.cpp to create a simple chat program using the chat template from the GGUF file.

./llama-simple-chat -m Meta-Llama-3.1-8B-Instruct.gguf -c 2048
...
1# llama.cpp/example/simple-chat
2
3The purpose of this example is to demonstrate a minimal usage of llama.cpp to create a simple chat program using the chat template from the GGUF file.
4
5```bash
6./llama-simple-chat -m Meta-Llama-3.1-8B-Instruct.gguf -c 2048
7...