char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Aman GuptaCUDA: add set rows for f32 and f16 (#14551)7de5c7cab

char/aliceai-t5-moe
155 B7 linesraw
1#pragma once
2
3#include "common.cuh"
4
5#define CUDA_SET_ROWS_BLOCK_SIZE 256
6
7void ggml_cuda_op_set_rows(ggml_backend_cuda_context & ctx, ggml_tensor * dst);