mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-11-20 04:22:27 +00:00
SM120 has no DeepEP feature left (no deepep backend, Engram in host memory, no context parallelism, no NVLink domain), yet five modules imported deep_ep at the top, so every SM120 process needed a DeepEP build, one compiled against an NCCL newer than the one the process loads. - mlp, engram, cp, userbuffer: deep_ep names used only in annotations move under TYPE_CHECKING; EPBuffer, EngramBuffer, BucketBuffer and the CP alignment helpers are imported in the functions that build them. - parallel_state: is_within_nvl_domain imports deep_ep after the SM120 and single-rank returns. No behavior change where DeepEP is installed: the same code imports it, later. tests/test_sm120_without_deep_ep.py imports each module in a fresh interpreter that cannot import deep_ep, and runs the SM120 paths (nccl EP buffer, no CP buffer, no NVLink domain) with deep_ep blocked; the nccl backend allocation test blocks deep_ep too. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>