mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-11-20 04:22:27 +00:00
Cake needs NCCL 2.30.7 in the process, and the pinned DeepEP needs NCCL 2.31+ (ginMinStride, ginSupport, ncclDevCommRequirements.ginType, ...), so the two cannot share a process. On SM120: - DEEPINFER_SM120_EP_BACKEND defaults to cake; nccl stays the fallback for expert formats other than MXFP4 x FP8, named in the cake error. - build.sh builds the vendored packages against NCCL 2.32.3 (DeepEP no longer compiles against 2.30.7) and installs 2.30.7 afterwards; deep_ep is still imported but its backend is unavailable. - deepep is rejected at worker setup when the loaded NCCL is older than 2.31, read with ncclGetVersion (torch.cuda.nccl.version() reports torch's build). - README.sm120.md documents the backends, the NCCL pin, NCCL_TOPO_FILE, the chunk size, and the 8-GPU results. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>