gemm block quantization infrastructure for llm decoder style#6814

Merged

nihui merged 43 commits into

Tencent:masterfrom

nihui:block-quantization-infrastructure

Jul 13, 2026

Commits on Dec 4, 2025

gemm block quantization for llm decoder style
nihui
committed
Update src/layer/gemm.cpp

nihui
and
Copilot
authored
Update src/layer/gemm.cpp

nihui
and
Copilot
authored
Update src/layer/gemm.cpp

nihui
and
Copilot
authored
Update src/layer/gemm.cpp

nihui
and
Copilot
authored
Update src/layer/gemm.cpp

nihui
and
Copilot
authored
Update src/layer/gemm.cpp

nihui
and
Copilot
authored
Update src/layer/gemm.cpp

nihui
and
Copilot
authored

Commits on Dec 8, 2025

Commits on Feb 13, 2026

Merge branch 'Tencent:master' into block-quantization-infrastructure
nihui
authored

Commits on Mar 30, 2026

Merge branch 'master' into block-quantization-infrastructure
nihui
authored

Commits on Jul 7, 2026

Merge branch 'master' into block-quantization-infrastructure
nihui
authored
w
nihui
committed
w
nihui
committed
w
nihui
committed
w
nihui
committed
w
nihui
committed
w
nihui
committed
apply code-format changes

nihui
authored and
github-actions[bot]
committed

Commits on Jul 8, 2026

w
nihui
committed
b
nihui
committed
Merge branch 'master' into block-quantization-infrastructure
nihui
authored
fix mha oob read
nihui
committed
another mha oob read
nihui
committed
f
nihui
committed
test++
nihui
committed
cc
nihui
committed
apply code-format changes

nihui
authored and
github-actions[bot]
committed
cc
nihui
committed
b
nihui
committed
cc
nihui
committed
b
nihui
committed
cc
nihui
committed
cc
nihui
committed

Commits on Jul 9, 2026

Commits on Jul 10, 2026

w
nihui
committed
cc
nihui
committed
w
nihui
committed
apply code-format changes

nihui
authored and
github-actions[bot]
committed