LLM Gateway
A technical analysis of MiniMax-M3 describes it as a Mixture-of-Experts model with approximately 428 billion total parameters and 23 billion active per token. Its MiniMax Sparse Attention mechanism uses an index branch to rank key-value blocks independently for each GQA group, then a main branch that computes exact attention only over selected blocks. The article further says MiniMax co-designed GPU kernels for H800 hardware using exp-free Top-k selection to improve tensor-core utilization with sparse memory access. These architectural and hardware details provide implementation context for M3, while the source’s separate discussion of gateway access is promotional and outside the model-focused scope.
