char-fork/llama.cpp
git clone https://git.t4t.associates/char-fork/llama.cpp
8300f1411
char/aliceai-t5-moe
files
| CMakeLists.txt | 239 B |
| README.md | 394 B |
| passkey.cpp | 8.1 KiB |
llama.cpp/example/passkey
A passkey retrieval task is an evaluation method used to measure a language models ability to recall information from long contexts.
See the following PRs for more info:
- https://github.com/ggml-org/llama.cpp/pull/3856
- https://github.com/ggml-org/llama.cpp/pull/4810
Usage
llama-passkey -m ./models/llama-7b-v2/ggml-model-f16.gguf--junk 250