Local run path:
uv syncuv run python scripts/deployment/build_demo_checkpoint.pyuv run python scripts/fastapi_chat_app/serve.py- Open
http://127.0.0.1:8000
Useful checks:
curl http://127.0.0.1:8000/healthcurl http://127.0.0.1:8000/metadatauv run python scripts/deployment/smoke_test.py
Accelerated picoLLM product-track check:
- Run
python -m picollm.accelerated.chat.web - Then run
python scripts/deployment/smoke_test_accelerated.py
Product-track alternatives:
- CLI:
uv run python scripts/cli_and_web_chat/chat_cli.py - Web launcher:
uv run python scripts/cli_and_web_chat/chat_web.py