Skip to content

ci: add vLLM GPU smoke workflow with dynamic EC2 runner lifecycle (#541) - #1055

Draft
skamenan7 wants to merge 6 commits into
praxis-proxy:mainfrom
skamenan7:feat/541-vllm-gpu-smoke-ec2
Draft

skamenan7 wants to merge 6 commits into
praxis-proxy:mainfrom
skamenan7:feat/541-vllm-gpu-smoke-ec2

Conversation

@skamenan7

@skamenan7 skamenan7 commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds a manual GPU smoke workflow for #541. It runs the existing stateless Responses API test through Praxis against vLLM on an ephemeral AWS GPU runner.

Flow

  1. Start runner: GitHub Actions uses OIDC to assume the Praxis AWS role and starts an ephemeral g4dn.xlarge runner.
  2. Run smoke test: The runner verifies the GPU, starts the pinned vLLM image with Qwen/Qwen3-0.6B, starts OGX, builds Praxis, waits for both services, and runs test_stateless_request.
  3. Clean up: A final job always terminates the EC2 runner, including when the test fails.

Safety and validation

  • Manual dispatch only.
  • AWS access uses GitHub OIDC and the repository-scoped role from aaet-infra MR !33.
  • The vLLM GPU workflow uses an image pinned by digest.
  • Failure logs are captured and the GPU runner is cleaned up.
  • Action lint, shellcheck, Rust build, and test collection pass locally.

The first live GPU run is still pending access to the configured repository variables and runner-registration secret.

@praxis-bot-app

Copy link
Copy Markdown

Unsigned commits: b57a227. Please sign your commits.

Add a manual workflow_dispatch GPU smoke workflow that tests vLLM
(Qwen/Qwen3-0.6B) on a dynamically provisioned EC2 g4dn.xlarge instance
using the AWS OIDC role provisioned in aaet-infra (praxis-ai-ec2-github-runner-role).

Lifecycle:
- start-runner: assumes AWS OIDC role, launches ephemeral EC2 instance via machulav/ec2-github-runner
- vllm-gpu-hello: runs existing stateless request integration test against GPU vLLM
- stop-runner: unconditionally terminates the EC2 runner (if: always)

Resolves: praxis-proxy#541
Signed-off-by: Sumanth Kamenani <skamenan@redhat.com>
@skamenan7
skamenan7 force-pushed the feat/541-vllm-gpu-smoke-ec2 branch from b57a227 to f587c64 Compare September 11, 2026 13:15
Comment thread .github/workflows/vllm-gpu-smoke.yaml Outdated
@skamenan7
skamenan7 force-pushed the feat/541-vllm-gpu-smoke-ec2 branch from d2c7fc1 to 782e2f7 Compare September 14, 2026 14:57
Signed-off-by: Sumanth Kamenani <skamenan@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants