Files
DeepInfer/deepinfer/model_executor/parallel_utils
Zihua WuandClaude Opus 5.5 eb4bb125f2 fix(sm120): destroy Cake MegaMoE layers before the process group
Cake's layers own collective NCCL state (symmetric windows, the GIN device
communicator) and must be destroyed on every EP rank, in the same order,
before the process group. Register them with the userbuffer manager, which
destroys them first in close(); left to garbage collection at exit, a rank
could fail after the run had finished.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-18 09:39:24 -08:00
..
2026-10-20 12:09:42 +08:00
2026-10-20 12:09:42 +08:00
2026-10-20 12:09:42 +08:00
2026-10-20 12:09:42 +08:00