char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Charlotte Somenc/dec in server context8300f1411

char/aliceai-t5-moe
1 folder4 files

files

Sources/
.gitignore173 B
Makefile230 B
Package.swift766 B
README.md113 B

This is a swift clone of examples/batched.

$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]