char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Olivier ChafikTool call support (generic + native for Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) w/ lazy grammars (#9639)8b576b6c5

char/aliceai-t5-moe
430 B8 linesraw
1{% for message in messages %}{% if message['role'] == 'system' and message['content'] %}{{'<|system|>
2' + message['content'] + '<|end|>
3'}}{% elif message['role'] == 'user' %}{{'<|user|>
4' + message['content'] + '<|end|>
5'}}{% elif message['role'] == 'assistant' %}{{'<|assistant|>
6' + message['content'] + '<|end|>
7'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|assistant|>
8' }}{% else %}{{ eos_token }}{% endif %}