Expand description
Attention kernels (flash attention, position-sensitive attention).
Modules§
- flash_
attn2 - Flash Attention 2 — forward and backward kernels.
- psa
- PSA attention helper kernels and RuntimeOp wrappers.
Attention kernels (flash attention, position-sensitive attention).