Skip to main content

Module attention

Module attention 

Source
Expand description

Attention kernels (flash attention, position-sensitive attention).

Modules§

flash_attn2
Flash Attention 2 — forward and backward kernels.
psa
PSA attention helper kernels and RuntimeOp wrappers.