char-fork/llama.cpp
git clone https://git.t4t.associates/char-fork/llama.cpp
8300f1411
char/aliceai-t5-moe
files
| Sources/ | |
| .gitignore | 173 B |
| Makefile | 230 B |
| Package.swift | 766 B |
| README.md | 113 B |
This is a swift clone of examples/batched.
$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]