Skip to content

Conversation

@karen-sy
Copy link
Contributor

Overview:

vLLM 0.11.2 docker build shows dependency on nixl>=0.6.0, which resolves to 0.8.0.
This PR updates NIXL to 0.8.0; keeping it separate from the vLLM bump PR (#4476) since this affects the base container used by all frameworks.

Details:

Where should the reviewer start?

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

  • closes GitHub issue: #xxx

SGLANG_BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base"
SGLANG_BASE_IMAGE_TAG="25.01-cuda12.8-devel-ubuntu24.04"

NIXL_REF=0.7.1
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If vLLM 0.11.2 docker build shows dependency on nixl>=0.6.0, then wouldn't 0.7.1 work as well?

# NIXL configuration
ARG NIXL_UCX_REF=v1.19.0
ARG NIXL_REF=0.7.1
ARG NIXL_UCX_REF=v1.20.x
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to bump ucx as well for the 0.8.0 version? We haven't in the past bumps so just checking to make sure.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants