Add vLLM offline backend with micro-batching support#736

maryamtahhan wants to merge 5 commits into

vllm-project:mainvllm-project/guidellm:mainfrom

maryamtahhan:feat/vllm-offline-batching-backendmaryamtahhan/guidellm:feat/vllm-offline-batching-backendCopy head branch name to clipboard