char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Evan Jonesllama : add grammar-based sampling (#1773)84e09a7d8

char/aliceai-t5-moe
249 B7 linesraw
1# A probably incorrect grammar for Japanese
2root        ::= jp-char+ ([ \t\n] jp-char+)*
3jp-char     ::= hiragana | katakana | punctuation | cjk
4hiragana    ::= [ぁ-ゟ]
5katakana    ::= [ァ-ヿ]
6punctuation ::= [、-〾]
7cjk         ::= [一-鿿]