Skip to content

Add vLLM offline backend with micro-batching support#736

Open
maryamtahhan wants to merge 5 commits into
vllm-project:mainfrom
maryamtahhan:feat/vllm-offline-batching-backend
Open

Add vLLM offline backend with micro-batching support#736
maryamtahhan wants to merge 5 commits into
vllm-project:mainfrom
maryamtahhan:feat/vllm-offline-batching-backend

Fix mypy type errors for lazy-loaded vllm module

f27b076
Select commit
Loading
Failed to load commit list.