Skip to content

NCCL EP zero copy additional support#3187

Draft
YangFei1990 wants to merge 3 commits into
NVIDIA:mainfrom
YangFei1990:nccl_ep_zero_cp
Draft

NCCL EP zero copy additional support#3187
YangFei1990 wants to merge 3 commits into
NVIDIA:mainfrom
YangFei1990:nccl_ep_zero_cp

Conversation

@YangFei1990

Copy link
Copy Markdown

Description

Addition support for NCCL EP zero copy feature, including

  • Expose user provided recv_topk_weights buffer
  • Use symm memory pool to allocate symm buffer

Checklist:

  • I have read and followed the contributing guidelines
  • The functionality is complete
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes

Signed-off-by: YangFei1990 <feiw@nvidia.com>
@github-actions github-actions Bot added the community-contribution PRs from external contributor outside the core maintainers, representing community-driven work. label Jul 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-contribution PRs from external contributor outside the core maintainers, representing community-driven work.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant