char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Johannes Gäßlertests: add gradient tests for all backends (ggml/932)202084d31

char/aliceai-t5-moe
210 B5 linesraw
1#include "common.cuh"
2
3void sum_f32_cuda(ggml_cuda_pool & pool, const float * x, float * dst, const int64_t ne, cudaStream_t stream);
4
5void ggml_cuda_op_sum(ggml_backend_cuda_context & ctx, ggml_tensor * dst);