char-fork/llama.cpp
git clone https://git.t4t.associates/char-fork/llama.cpp
8300f1411
char/aliceai-t5-moe
files
| CMakeLists.txt | 247 B |
| README.md | 282 B |
| speculative.cpp | 25.9 KiB |
llama.cpp/examples/speculative
Demonstration of speculative decoding and tree-based speculative decoding techniques
More info:
- https://github.com/ggml-org/llama.cpp/pull/2926
- https://github.com/ggml-org/llama.cpp/pull/3624
- https://github.com/ggml-org/llama.cpp/pull/5625