Skip to content

docs(glm): add GLM-5.3 training coverage - #3752

Merged
HuiyingLi merged 1 commit into
mainfrom
huiyingl/docs-glm53-training-coverage
Aug 29, 2026
Merged

docs(glm): add GLM-5.3 training coverage#3752
HuiyingLi merged 1 commit into
mainfrom
huiyingl/docs-glm53-training-coverage

Conversation

@HuiyingLi

@HuiyingLi HuiyingLi commented Aug 29, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Extend the existing GLM MoE/DSA model coverage page through GLM-5.3.
  • Document the EP64/PP4 recipe, cuDNN DSA + HybridEP path, expert resharding setting, launch command, Hugging Face logits parity, and training results.
  • Add GLM-5.3 to the README news and supported-model table.
  • Update the nightly documentation navigation label.

This follows the structure of #3744 and documents the support merged in #3747.

Validation

  • MDX syntax validation: passed
  • Fern configuration check: 0 errors
  • Filesystem model-coverage checks: 4 passed
  • git diff --check: passed

Training evidence

  • First-four-layer Hugging Face parity: 0.639% logits relative L2 error and 96.61% top-1 agreement.
  • Full 32-node / 256-GPU run: 100/100 steps completed; loss 1.33347 at step 0 and 0.53756 at step 99.
  • Weights & Biases run

@copy-pr-bot

copy-pr-bot Bot commented Aug 29, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions

github-actions Bot commented Aug 29, 2026

Copy link
Copy Markdown
Contributor

@HuiyingLi HuiyingLi added the docs-only With great power comes great responsibility. label Aug 29, 2026
@HuiyingLi

Copy link
Copy Markdown
Contributor Author

/ok to test 8fe3d33

Comment thread docs/fern/versions/nightly.yml Outdated
Comment thread docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx Outdated
Comment thread docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx Outdated
Comment thread docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx Outdated
Comment thread docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx
Comment thread docs/model-coverage/llm/thudm/glm5-moe-dsa.mdx Outdated
@HuiyingLi
HuiyingLi force-pushed the huiyingl/docs-glm53-training-coverage branch from 28078f2 to d0a22cb Compare August 29, 2026 23:31
Signed-off-by: HuiyingLi <willwin.lee@gmail.com>
@HuiyingLi
HuiyingLi force-pushed the huiyingl/docs-glm53-training-coverage branch from d0a22cb to ae73159 Compare August 29, 2026 23:31
@HuiyingLi

Copy link
Copy Markdown
Contributor Author

/ok to test ae73159

@HuiyingLi
HuiyingLi enabled auto-merge (squash) August 29, 2026 23:56
@HuiyingLi
HuiyingLi merged commit 3ddef9b into main Aug 29, 2026
39 checks passed
@HuiyingLi
HuiyingLi deleted the huiyingl/docs-glm53-training-coverage branch August 29, 2026 23:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs-only With great power comes great responsibility.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants