char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Charlotte Somenc/dec in server context8300f1411

char/aliceai-t5-moe
brancheschar/aliceai-t5-moeall refs →
70 files

files

Apertus-8B-Instruct.jinja13.9 KiB
Apriel-1.6-15b-Thinker-fixed.jinja7.9 KiB
Bielik-11B-v3.0-Instruct.jinja4.0 KiB
ByteDance-Seed-OSS.jinja7.5 KiB
Cohere2MoE.jinja12.1 KiB
CohereForAI-c4ai-command-r-plus-tool_use.jinja7.8 KiB
CohereForAI-c4ai-command-r7b-12-2024-tool_use.jinja11.2 KiB
GLM-4.6.jinja3.3 KiB
GLM-4.7-Flash.jinja3.0 KiB
GigaChat3-10B-A1.8B.jinja13.6 KiB
GigaChat3.1-10B-A1.8B.jinja13.1 KiB
HuggingFaceTB-SmolLM3-3B.jinja3.7 KiB
Kimi-K2-Instruct.jinja2.5 KiB
Kimi-K2-Thinking.jinja4.0 KiB
Kimi-K3.jinja14.6 KiB
LFM2-8B-A1B.jinja1.3 KiB
LFM2.5-8B-A1B.jinja4.5 KiB
LFM2.5-Instruct.jinja1.7 KiB
MiMo-VL.jinja2.4 KiB
MiniMax-M1.jinja3.4 KiB
MiniMax-M2.jinja6.3 KiB
MiniMax-M3.jinja11.5 KiB
Mistral-Small-3.2-24B-Instruct-2506.jinja6.5 KiB
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16.jinja10.3 KiB
NVIDIA-Nemotron-Nano-v2.jinja5.4 KiB
NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja4.9 KiB
NousResearch-Hermes-3-Llama-3.1-8B-tool_use.jinja4.9 KiB
Qwen-QwQ-32B.jinja2.8 KiB
Qwen-Qwen2.5-7B-Instruct.jinja2.4 KiB
Qwen-Qwen3-0.6B.jinja4.0 KiB
Qwen3-Coder.jinja6.0 KiB
Qwen3.5-4B.jinja7.6 KiB
README.md3.2 KiB
Reka-Edge.jinja8.0 KiB
Spark2.5.jinja4.5 KiB
StepFun3.5-Flash.jinja4.9 KiB
deepseek-ai-DeepSeek-R1-Distill-Llama-8B.jinja2.4 KiB
deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja2.5 KiB
deepseek-ai-DeepSeek-V3.1.jinja3.3 KiB
deepseek-ai-DeepSeek-V3.2.jinja6.8 KiB
deepseek-ai-DeepSeek-V4-Flash-0731.jinja7.5 KiB
deepseek-ai-DeepSeek-V4.jinja6.8 KiB
fireworks-ai-llama-3-firefunction-v2.jinja3.2 KiB
google-gemma-2-2b-it.jinja591 B
google-gemma-4-31B-it-interleaved.jinja12.5 KiB
google-gemma-4-31B-it.jinja16.1 KiB
ibm-granite-granite-3.3-2B-Instruct.jinja4.5 KiB
ibm-granite-granite-4.0.jinja6.3 KiB
ibm-granite-granite-4.1.jinja6.0 KiB
llama-cpp-deepseek-r1.jinja3.0 KiB
llama-cpp-rwkv-world.jinja1.2 KiB
meetkai-functionary-medium-v3.1.jinja3.2 KiB
meetkai-functionary-medium-v3.2.jinja12.5 KiB
meta-llama-Llama-3.1-8B-Instruct.jinja4.5 KiB
meta-llama-Llama-3.2-3B-Instruct.jinja3.7 KiB
meta-llama-Llama-3.3-70B-Instruct.jinja4.5 KiB
microsoft-Phi-3.5-mini-instruct.jinja430 B
mistralai-Ministral-3-14B-Reasoning-2512.jinja6.1 KiB
mistralai-Mistral-Nemo-Instruct-2407.jinja3.9 KiB
moonshotai-Kimi-K2.jinja1.8 KiB
muse-glimmer.jinja9.8 KiB
openai-gpt-oss-120b.jinja16.3 KiB
openbmb-MiniCPM5-1B.jinja8.8 KiB
poolside-Laguna-S-2.1.jinja3.9 KiB
poolside-Laguna-XS-2.1.jinja6.0 KiB
poolside-Laguna-XS.2.jinja6.1 KiB
tencent-Hy3.jinja10.0 KiB
unsloth-Apriel-1.5.jinja6.4 KiB
unsloth-mistral-Devstral-Small-2507.jinja9.6 KiB
upstage-Solar-Open-100B.jinja7.1 KiB

These templates can be updated with the following commands:

./scripts/get_chat_template.py CohereForAI/c4ai-command-r-plus tool_use      > models/templates/CohereForAI-c4ai-command-r-plus-tool_use.jinja
./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 default  > models/templates/CohereForAI-c4ai-command-r7b-12-2024-default.jinja
./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 rag      > models/templates/CohereForAI-c4ai-command-r7b-12-2024-rag.jinja
./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 tool_use > models/templates/CohereForAI-c4ai-command-r7b-12-2024-tool_use.jinja
./scripts/get_chat_template.py deepseek-ai/DeepSeek-R1-Distill-Llama-8B      > models/templates/deepseek-ai-DeepSeek-R1-Distill-Llama-8B.jinja
./scripts/get_chat_template.py deepseek-ai/DeepSeek-R1-Distill-Qwen-32B      > models/templates/deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja
./scripts/get_chat_template.py fireworks-ai/llama-3-firefunction-v2          > models/templates/fireworks-ai-llama-3-firefunction-v2.jinja
./scripts/get_chat_template.py google/gemma-2-2b-it                          > models/templates/google-gemma-2-2b-it.jinja
./scripts/get_chat_template.py meetkai/functionary-medium-v3.1               > models/templates/meetkai-functionary-medium-v3.1.jinja
./scripts/get_chat_template.py meetkai/functionary-medium-v3.2               > models/templates/meetkai-functionary-medium-v3.2.jinja
./scripts/get_chat_template.py meta-llama/Llama-3.1-8B-Instruct              > models/templates/meta-llama-Llama-3.1-8B-Instruct.jinja
./scripts/get_chat_template.py meta-llama/Llama-3.2-3B-Instruct              > models/templates/meta-llama-Llama-3.2-3B-Instruct.jinja
./scripts/get_chat_template.py meta-llama/Llama-3.3-70B-Instruct             > models/templates/meta-llama-Llama-3.3-70B-Instruct.jinja
./scripts/get_chat_template.py microsoft/Phi-3.5-mini-instruct               > models/templates/microsoft-Phi-3.5-mini-instruct.jinja
./scripts/get_chat_template.py mistralai/Mistral-Nemo-Instruct-2407          > models/templates/mistralai-Mistral-Nemo-Instruct-2407.jinja
./scripts/get_chat_template.py NousResearch/Hermes-2-Pro-Llama-3-8B tool_use > models/templates/NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja
./scripts/get_chat_template.py NousResearch/Hermes-3-Llama-3.1-8B tool_use   > models/templates/NousResearch-Hermes-3-Llama-3.1-8B-tool_use.jinja
./scripts/get_chat_template.py Qwen/Qwen2.5-7B-Instruct                      > models/templates/Qwen-Qwen2.5-7B-Instruct.jinja
./scripts/get_chat_template.py Qwen/QwQ-32B                                  > models/templates/Qwen-QwQ-32B.jinja
./scripts/get_chat_template.py Qwen/Qwen3-0.6B                               > models/templates/Qwen-Qwen3-0.6B.jinja
./scripts/get_chat_template.py zai-org/GLM-4.5                               > models/templates/zai-org-GLM-4.5.jinja
./scripts/get_chat_template.py deepseek-ai/DeepSeek-V3.1                     > models/templates/deepseek-ai-DeepSeek-V3.1.jinja
./scripts/get_chat_template.py XHToken/Spark-X2.5-1.7B                       > models/templates/Spark2.5.jinja
./scripts/get_chat_template.py XHToken/Spark-X2.5-4B                         > models/templates/Spark2.5.jinja