char-fork/llama.cpp
git clone https://git.t4t.associates/char-fork/llama.cpp
3ad1ba733
char/aliceai-t5-moe
These templates can be updated with the following commands:
./scripts/get_chat_template.py CohereForAI/c4ai-command-r-plus tool_use> models/templates/CohereForAI-c4ai-command-r-plus-tool_use.jinja./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 default> models/templates/CohereForAI-c4ai-command-r7b-12-2024-default.jinja./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 rag> models/templates/CohereForAI-c4ai-command-r7b-12-2024-rag.jinja./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 tool_use> models/templates/CohereForAI-c4ai-command-r7b-12-2024-tool_use.jinja./scripts/get_chat_template.py deepseek-ai/DeepSeek-R1-Distill-Llama-8B> models/templates/deepseek-ai-DeepSeek-R1-Distill-Llama-8B.jinja./scripts/get_chat_template.py deepseek-ai/DeepSeek-R1-Distill-Qwen-32B> models/templates/deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja./scripts/get_chat_template.py fireworks-ai/llama-3-firefunction-v2> models/templates/fireworks-ai-llama-3-firefunction-v2.jinja./scripts/get_chat_template.py google/gemma-2-2b-it> models/templates/google-gemma-2-2b-it.jinja./scripts/get_chat_template.py meetkai/functionary-medium-v3.1> models/templates/meetkai-functionary-medium-v3.1.jinja./scripts/get_chat_template.py meetkai/functionary-medium-v3.2> models/templates/meetkai-functionary-medium-v3.2.jinja./scripts/get_chat_template.py meta-llama/Llama-3.1-8B-Instruct> models/templates/meta-llama-Llama-3.1-8B-Instruct.jinja./scripts/get_chat_template.py meta-llama/Llama-3.2-3B-Instruct> models/templates/meta-llama-Llama-3.2-3B-Instruct.jinja./scripts/get_chat_template.py meta-llama/Llama-3.3-70B-Instruct> models/templates/meta-llama-Llama-3.3-70B-Instruct.jinja./scripts/get_chat_template.py microsoft/Phi-3.5-mini-instruct> models/templates/microsoft-Phi-3.5-mini-instruct.jinja./scripts/get_chat_template.py mistralai/Mistral-Nemo-Instruct-2407> models/templates/mistralai-Mistral-Nemo-Instruct-2407.jinja./scripts/get_chat_template.py NousResearch/Hermes-2-Pro-Llama-3-8B tool_use> models/templates/NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja./scripts/get_chat_template.py NousResearch/Hermes-3-Llama-3.1-8B tool_use> models/templates/NousResearch-Hermes-3-Llama-3.1-8B-tool_use.jinja./scripts/get_chat_template.py Qwen/Qwen2.5-7B-Instruct> models/templates/Qwen-Qwen2.5-7B-Instruct.jinja./scripts/get_chat_template.py Qwen/QwQ-32B> models/templates/Qwen-QwQ-32B.jinja./scripts/get_chat_template.py Qwen/Qwen3-0.6B> models/templates/Qwen-Qwen3-0.6B.jinja./scripts/get_chat_template.py zai-org/GLM-4.5> models/templates/zai-org-GLM-4.5.jinja./scripts/get_chat_template.py deepseek-ai/DeepSeek-V3.1> models/templates/deepseek-ai-DeepSeek-V3.1.jinja./scripts/get_chat_template.py XHToken/Spark-X2.5-1.7B> models/templates/Spark2.5.jinja./scripts/get_chat_template.py XHToken/Spark-X2.5-4B> models/templates/Spark2.5.jinja
1These templates can be updated with the following commands: 2 3``` bash 4./scripts/get_chat_template.py CohereForAI/c4ai-command-r-plus tool_use > models/templates/CohereForAI-c4ai-command-r-plus-tool_use.jinja 5./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 default > models/templates/CohereForAI-c4ai-command-r7b-12-2024-default.jinja 6./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 rag > models/templates/CohereForAI-c4ai-command-r7b-12-2024-rag.jinja 7./scripts/get_chat_template.py CohereForAI/c4ai-command-r7b-12-2024 tool_use > models/templates/CohereForAI-c4ai-command-r7b-12-2024-tool_use.jinja 8./scripts/get_chat_template.py deepseek-ai/DeepSeek-R1-Distill-Llama-8B > models/templates/deepseek-ai-DeepSeek-R1-Distill-Llama-8B.jinja 9./scripts/get_chat_template.py deepseek-ai/DeepSeek-R1-Distill-Qwen-32B > models/templates/deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja 10./scripts/get_chat_template.py fireworks-ai/llama-3-firefunction-v2 > models/templates/fireworks-ai-llama-3-firefunction-v2.jinja 11./scripts/get_chat_template.py google/gemma-2-2b-it > models/templates/google-gemma-2-2b-it.jinja 12./scripts/get_chat_template.py meetkai/functionary-medium-v3.1 > models/templates/meetkai-functionary-medium-v3.1.jinja 13./scripts/get_chat_template.py meetkai/functionary-medium-v3.2 > models/templates/meetkai-functionary-medium-v3.2.jinja 14./scripts/get_chat_template.py meta-llama/Llama-3.1-8B-Instruct > models/templates/meta-llama-Llama-3.1-8B-Instruct.jinja 15./scripts/get_chat_template.py meta-llama/Llama-3.2-3B-Instruct > models/templates/meta-llama-Llama-3.2-3B-Instruct.jinja 16./scripts/get_chat_template.py meta-llama/Llama-3.3-70B-Instruct > models/templates/meta-llama-Llama-3.3-70B-Instruct.jinja 17./scripts/get_chat_template.py microsoft/Phi-3.5-mini-instruct > models/templates/microsoft-Phi-3.5-mini-instruct.jinja 18./scripts/get_chat_template.py mistralai/Mistral-Nemo-Instruct-2407 > models/templates/mistralai-Mistral-Nemo-Instruct-2407.jinja 19./scripts/get_chat_template.py NousResearch/Hermes-2-Pro-Llama-3-8B tool_use > models/templates/NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja 20./scripts/get_chat_template.py NousResearch/Hermes-3-Llama-3.1-8B tool_use > models/templates/NousResearch-Hermes-3-Llama-3.1-8B-tool_use.jinja 21./scripts/get_chat_template.py Qwen/Qwen2.5-7B-Instruct > models/templates/Qwen-Qwen2.5-7B-Instruct.jinja 22./scripts/get_chat_template.py Qwen/QwQ-32B > models/templates/Qwen-QwQ-32B.jinja 23./scripts/get_chat_template.py Qwen/Qwen3-0.6B > models/templates/Qwen-Qwen3-0.6B.jinja 24./scripts/get_chat_template.py zai-org/GLM-4.5 > models/templates/zai-org-GLM-4.5.jinja 25./scripts/get_chat_template.py deepseek-ai/DeepSeek-V3.1 > models/templates/deepseek-ai-DeepSeek-V3.1.jinja 26./scripts/get_chat_template.py XHToken/Spark-X2.5-1.7B > models/templates/Spark2.5.jinja 27./scripts/get_chat_template.py XHToken/Spark-X2.5-4B > models/templates/Spark2.5.jinja 28```