Skip to content

feat(attention_mla): optional sigmoid output gate and NoPE support - #5543

Draft
snehalv2002 wants to merge 1 commit into
kimi-k3-stack/pr1-foundationfrom
kimi-k3-stack/pr4-mla-gate
Draft

feat(attention_mla): optional sigmoid output gate and NoPE support#5543
snehalv2002 wants to merge 1 commit into
kimi-k3-stack/pr1-foundationfrom
kimi-k3-stack/pr4-mla-gate

feat(attention_mla): optional sigmoid output gate (mla_use_output_gate)

90fd652
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Oct 29, 2026 in 8s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ 90fd652 Author: @snehalv2002 <sn****v​@google.com>

(Only the first commit for a unique contributor is listed.)

View more details on Google CLA