Skip to content

perf: enable concurrent request routing - #1

Merged
eswar-7116 merged 1 commit into
mainfrom
dev
Apr 13, 2026
Merged

perf: enable concurrent request routing#1
eswar-7116 merged 1 commit into
mainfrom
dev

Conversation

@eswar-7116

Copy link
Copy Markdown
Owner

Description

Implements multi-concurrency worker routing to handle burst loads efficiently, adapting IEEE serverless optimization models.

Changes

  • Multiplex concurrent UDS connections to a single warm worker up to a defined threshold.
  • Restrict connection multiplexing strictly to per-function pools to guarantee zero cross-contamination.

Benchmarks

  • Cold Start: ~590ms -> ~340ms
  • Warm Throughput: ~1,100 req/s -> ~1,900 req/s

Optimize burst load handling by allowing multiple connections to a single warm worker instance. Routing remains strictly locked to per-function pools to ensure zero inter-function cross-contamination.
@eswar-7116
eswar-7116 merged commit 0accc6c into main Apr 13, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant