Files
DeepInfer/tests/worker
Zihua WuandClaude Opus 5.5 4bc0ced7d0 feat(sm120): make Cake MegaMoE the default MoE backend
Cake needs NCCL 2.30.7 in the process, and the pinned DeepEP needs NCCL 2.31+
(ginMinStride, ginSupport, ncclDevCommRequirements.ginType, ...), so the two
cannot share a process. On SM120:

- DEEPINFER_SM120_EP_BACKEND defaults to cake; nccl stays the fallback for
  expert formats other than MXFP4 x FP8, named in the cake error.
- build.sh builds the vendored packages against NCCL 2.32.3 (DeepEP no longer
  compiles against 2.30.7) and installs 2.30.7 afterwards; deep_ep is still
  imported but its backend is unavailable.
- deepep is rejected at worker setup when the loaded NCCL is older than 2.31,
  read with ncclGetVersion (torch.cuda.nccl.version() reports torch's build).
- README.sm120.md documents the backends, the NCCL pin, NCCL_TOPO_FILE, the
  chunk size, and the 8-GPU results.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-18 15:16:27 -08:00
..
2026-10-20 12:09:42 +08:00
2026-10-20 12:09:42 +08:00