char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Martin Changggml-et: Initial ET backend (#24179)082b326fc

char/aliceai-t5-moe
brancheschar/aliceai-t5-moeall refs →
304 B17 linesraw
1#pragma once
2
3#include <stdint.h>
4
5struct ggml_et_uberkernel_inst {
6    uint16_t kernel_id;
7    uint16_t flags;
8    uint32_t params_offset;
9    uint32_t params_size;
10};
11
12struct ggml_et_uberkernel_params {
13    uint32_t num_insts;
14    uint32_t inst_stride;
15    uint64_t insts;
16    uint64_t params_blob;
17};