Popular repositories Loading

1. flash-attention flash-attention Public

   Fast and memory-efficient exact attention

   Python 24.5k 2.9k

2. quack quack Public

   A Quirky Assortment of CuTe Kernels

   Python 1.1k 147

3. causal-conv1d causal-conv1d Public

   Causal depthwise conv1d in CUDA, with a PyTorch interface

   Cuda 923 201

4. sonic-moe sonic-moe Public

   Accelerating MoE with IO and Tile-aware Optimizations

   Python 732 94

5. fast-hadamard-transform fast-hadamard-transform Public

   Fast Hadamard transform in CUDA, with a PyTorch interface

   C 340 65

6. gram-newton-schulz gram-newton-schulz Public

   Fast Polar Decomposition for Muon

   Python 167 13