char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Adrien Gallouëtapp : add batched-bench, fit-params, quantize & perplexity (#23459)1d7ab2b94

char/aliceai-t5-moe
131 B5 linesraw
1int llama_batched_bench(int argc, char ** argv);
2
3int main(int argc, char ** argv) {
4    return llama_batched_bench(argc, argv);
5}