CloudFerro Sherlock
Meta released Llama 3.3 70B Instruct on December 6, 2024 under the Llama 3.3 Community License, which permits commercial use. The model is a 70B auto-regressive transformer with Grouped-Query Attention, supports a 128K-token context window, uses a BPE tokenizer from the Llama 3 family, and was pretrained on 15T+ tokens with a December 2023 knowledge cutoff, as documented on the supplied model profile page. According to Meta-attributed figures cited on the page, the 70B model matches or exceeds the larger 405B Llama 3.1 on several benchmarks, including IFEval (92.1 vs 88.6), MATH CoT 0-shot (77.0 vs 73.8), and GPQA Diamond (50.5 vs 49.0), while remaining single-node deployable on 2× A100-80GB. Improvements over Llama 3.1 70B include +9.0 on MATH, +7.9 on HumanEval, and +4.6 on IFEval at the same parameter count, signaling a notable efficiency step for the family.
