OpenRouter
A community-authored NVIDIA developer-forums thread (a3refaat, May 2026) documents a reproducible recipe for serving a third-party NVFP4 quantization of MiMo-V2.5 (lukealonso/MiMo-V2.5-NVFP4) on a 2× DGX Spark / GB10 cluster. The setup uses vLLM 0.21.1rc1.dev39 on CUDA 13.2 with tensor parallelism = 2, instanttensor lo Three concrete correctness fixes are detailed: (1) the ModelOpt mixed-precision path must dispatch MXFP8 linear layers to the MXFP8 method rather than falling through when the checkpoint mixes MXFP8 dense layers with NVFP4 experts; (2) the weight_scale_inv field is UE8M0 MXFP8 scale metadata and should not be reciproca
