Skip to content

Define an env for controlling UVloop - #58442

Merged
edoakes merged 2 commits into
ray-project:masterfrom
jugalshah291:add-env-for-uvloop
Nov 10, 2025
Merged

Define an env for controlling UVloop#58442
edoakes merged 2 commits into
ray-project:masterfrom
jugalshah291:add-env-for-uvloop

Conversation

@jugalshah291

@jugalshah291 jugalshah291 commented Nov 7, 2025

Copy link
Copy Markdown
Contributor

Description

Briefly describe what this PR accomplishes and why it's needed.

Our serve ingress keeps running into below error related to uvloop under heavy load

File descriptor 97 is used by transport

The uvloop team have a PR to fix it, but seems like no one is working on it

One of workaround mentioned in the (PR) is to just turn off uvloop .
We tried it in our env and didn't see any major performance difference
Hence as part of this PR, we are defining a new env for controlling UVloop

Related issues

Link related issues: "Fixes #1234", "Closes #1234", or "Related to #1234".

Additional information

Optional: Add implementation details, API changes, usage examples, screenshots, etc.

Signed-off-by: jugalshah291 <shah.jugal291@gmail.com>
@jugalshah291 jugalshah291 changed the title Define a flag for enabling UVloop Define an env for controlling UVloop Nov 7, 2025
@jugalshah291
jugalshah291 marked this pull request as ready for review November 10, 2025 09:50
@jugalshah291
jugalshah291 requested a review from a team as a code owner November 10, 2025 09:50
@ray-gardener ray-gardener Bot added serve Ray Serve Related Issue community-contribution Contributed by the community labels Nov 10, 2025
@edoakes edoakes added the go add ONLY when ready to merge, run all tests label Nov 10, 2025
@edoakes
edoakes enabled auto-merge (squash) November 10, 2025 16:33
@edoakes
edoakes merged commit 217031a into ray-project:master Nov 10, 2025
8 checks passed
landscapepainter pushed a commit to landscapepainter/ray that referenced this pull request Nov 17, 2025
> Briefly describe what this PR accomplishes and why it's needed.

Our serve ingress keeps running into below error related to `uvloop`
under heavy load
```
File descriptor 97 is used by transport
```
The uvloop team have a
[PR](MagicStack/uvloop#646) to fix it, but seems
like no one is working on it

One of workaround mentioned in the
([PR](MagicStack/uvloop#646 (comment)))
is to just turn off uvloop .
We tried it in our env and didn't see any major performance difference
Hence as part of this PR, we are defining a new env for controlling
UVloop

Signed-off-by: jugalshah291 <shah.jugal291@gmail.com>
SheldonTsen pushed a commit to SheldonTsen/ray that referenced this pull request Dec 1, 2025
> Briefly describe what this PR accomplishes and why it's needed.

Our serve ingress keeps running into below error related to `uvloop`
under heavy load
```
File descriptor 97 is used by transport
```
The uvloop team have a
[PR](MagicStack/uvloop#646) to fix it, but seems
like no one is working on it

One of workaround mentioned in the
([PR](MagicStack/uvloop#646 (comment)))
is to just turn off uvloop .
We tried it in our env and didn't see any major performance difference
Hence as part of this PR, we are defining a new env for controlling
UVloop

Signed-off-by: jugalshah291 <shah.jugal291@gmail.com>
Future-Outlier pushed a commit to Future-Outlier/ray that referenced this pull request Dec 7, 2025
> Briefly describe what this PR accomplishes and why it's needed.

Our serve ingress keeps running into below error related to `uvloop`
under heavy load
```
File descriptor 97 is used by transport
```
The uvloop team have a
[PR](MagicStack/uvloop#646) to fix it, but seems
like no one is working on it

One of workaround mentioned in the
([PR](MagicStack/uvloop#646 (comment)))
is to just turn off uvloop .
We tried it in our env and didn't see any major performance difference
Hence as part of this PR, we are defining a new env for controlling
UVloop

Signed-off-by: jugalshah291 <shah.jugal291@gmail.com>
Signed-off-by: Future-Outlier <eric901201@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-contribution Contributed by the community go add ONLY when ready to merge, run all tests serve Ray Serve Related Issue

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Ray fails to serialize self-reference objects

2 participants