Skip to content

feat(engine): support Qwen3-VL with native AWEX colocate - #1605

Merged
sitabulaixizawaluduo merged 2 commits into
mainfrom
feat/support-qwen3-vl-colocate
Aug 19, 2026
Merged

feat(engine): support Qwen3-VL with native AWEX colocate#1605
sitabulaixizawaluduo merged 2 commits into
mainfrom
feat/support-qwen3-vl-colocate

Conversation

@sitabulaixizawaluduo

@sitabulaixizawaluduo sitabulaixizawaluduo commented Aug 14, 2026

Copy link
Copy Markdown
Collaborator

Description

This PR adds AWEX colocate support for Qwen3-VL Dense and MoE models.
Key Changes:

  • Passes the complete multimodal Hugging Face configuration to AWEX, including both text_config and vision_config.
  • Reads router_dtype from the nested text configuration used by Qwen3-VL.
  • Delegates nested configuration parsing and weight conversion to AWEX’s native Qwen3-VL implementation.
  • Adds unit tests covering:
    • Dense and MoE model registration.
    • Composite configuration propagation.
    • Vision tower TP sharding.
    • Architecture fallback and router dtype handling.

This PR only contains Qwen3-VL colocate integration.

AWEX has not yet released an official version supporting the Qwen3-VL model. To use it, run:
uv pip install --reinstall --no-deps "awex @ git+https://github.com/inclusionAI/Awex.git@5c6e802e53919818e979f3e03a6c02b1abeb89da"

N/A

Type of Change

  • 🐛 Bug fix
  • ✨ New feature
  • 💥 Breaking change
  • 📝 Documentation update
  • ♻️ Refactoring
  • ⚡ Performance improvement
  • ✅ Test coverage improvement

Checklist

  • I have read the
    Contributing Guide
  • Pre-commit hooks pass (pre-commit run --all-files)
  • Relevant tests pass; new tests added for new functionality
  • Documentation updated (if applicable; built with ./docs/build_all.sh)
  • Branch is up to date with main
  • Self-reviewed via /review-pr command
  • This PR was created by a coding agent via /create-pr
  • This PR is a breaking change

Breaking Change Details (if applicable):

Additional Context


Need help? Check the
Contributing Guide
or ask in GitHub Discussions!

@Le8r0nJames

Copy link
Copy Markdown
Collaborator

Once an AWEX version with Qwen3-VL support is released, please update the dependency, replace pytest.importorskip("awex.models.qwen3_vl") with a regular import, and rerun the tests against the released package.

Preserve the complete multimodal Hugging Face config during colocate\nmetadata exchange so AWEX can resolve both the language model and vision\ntower sharding contracts.\n\nKey changes:\n- Publish composite Qwen3-VL inference configuration\n- Delegate nested config parsing to native AWEX\n- Add Dense and MoE colocate contract tests
SGLang stores only the text config on the Qwen3-VL-MoE runtime model.\nRead the original Hugging Face config from ModelRunner so AWEX also\nreceives the vision tower metadata required for weight sharding.
@sitabulaixizawaluduo
sitabulaixizawaluduo force-pushed the feat/support-qwen3-vl-colocate branch from eb0cca9 to 562a63b Compare August 18, 2026 03:45
@Le8r0nJames

Copy link
Copy Markdown
Collaborator

LGTM

@sitabulaixizawaluduo
sitabulaixizawaluduo merged commit 83d304a into main Aug 19, 2026
6 checks passed
@sitabulaixizawaluduo
sitabulaixizawaluduo deleted the feat/support-qwen3-vl-colocate branch August 19, 2026 02:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants