char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Georgi Gerganovcparams : rename LLAMA_MAX_PARALLEL_SEQUENCES to LLAMA_MAX_SEQ (#14188)c311ac664

char/aliceai-t5-moe
brancheschar/aliceai-t5-moeall refs →
100 B5 linesraw
1#include "llama-cparams.h"
2
3size_t llama_max_parallel_sequences(void) {
4    return LLAMA_MAX_SEQ;
5}