char-fork/llama.cpp

git clone https://git.t4t.associates/char-fork/llama.cpp

Anav PrasadCUDA: Add Flash Attention Support for Head Dimension 512 (#20998)88458164c

char/aliceai-t5-moe
146 B5 linesraw
1// This file has been autogenerated by generate_cu_files.py, do not edit manually.
2
3#include "../fattn-tile.cuh"
4
5DECL_FATTN_TILE_CASE(512, 512);