mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-11-20 04:22:27 +00:00
compute_capability() only understood digit indices and GPU- UUIDs, so the first CUDA_VISIBLE_DEVICES entry being a MIG instance made is_sm_major_10/12 return False: SM120 then imported flash_mla/deep_select (not built there) and SM100 lost its GPU-type-dependent paths. Unresolvable entries also silently read as "not this architecture". - Resolve "MIG-<uuid>" (via NVML's MIG lookups) and the legacy "MIG-GPU-<uuid>/<gi>/<ci>" form to the capability of the physical GPU. - Raise LookupError when NVML is present but the entry names no GPU, instead of returning None. - Digit entries are NVML (PCI bus) indices, but CUDA orders devices fastest first unless CUDA_DEVICE_ORDER=PCI_BUS_ID. On hosts whose GPUs differ in capability that is ambiguous, so ask for CUDA_DEVICE_ORDER=PCI_BUS_ID. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>