mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-11-20 04:22:27 +00:00
Cake's layers own collective NCCL state (symmetric windows, the GIN device communicator) and must be destroyed on every EP rank, in the same order, before the process group. Register them with the userbuffer manager, which destroys them first in close(); left to garbage collection at exit, a rank could fail after the run had finished. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>