Skip to content

Add sparse MLA backward (DSA top-k), sliding-window attention + attention sink, and block-sparse MLA forward/backward for SM100 - #198

Open
kmswin1 wants to merge 3 commits into
deepseek-ai:mainfrom
kmswin1:feat/mla-training-extensions
Open

Add sparse MLA backward (DSA top-k), sliding-window attention + attention sink, and block-sparse MLA forward/backward for SM100#198
kmswin1 wants to merge 3 commits into
deepseek-ai:mainfrom
kmswin1:feat/mla-training-extensions

Enhance your code review process with GitHub Actions

GitHub Actions make it easy to automate all your software workflows, now with world-class CI/CD.
Build, test, and deploy your code right from GitHub. Learn more about GitHub Actions.

Linux, macOS, Windows, and containers
Linux, macOS, Windows, and containers
Matrix builds
Matrix builds
Any language
Any language
Live logs
Live logs
Built-in secret store
Built-in secret store
Multi-container testing
Multi-container testing