- 🌱 I’m currently exploring about Linear Attention & Diffusion Language Modeling
An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivation. It is probably the code which is the most close to select…