Model field guide
DeepSeek-R1-Distill-Llama-70B
16 of 44 hardware configurations have a supported memory fit at one or more recorded quantizations. Runtime compatibility still needs verification.
Total parameters70.55B
Active parameters70.55B
Recorded context limit131,072
Architecturedense
Verified 2026-10-22 · license metadata: mit · commercial use: conditional (review the terms).
- Conditional commercial use: the upstream model card, section 7, identifies MIT terms and derivation from Llama 3.3 70B Instruct under the Llama 3.3 license. Review and comply with the inherited Llama terms in addition to MIT; the MIT metadata tag alone is incomplete.
Actual files, not a size shortcut.
| Quantization | Total file size | Source |
|---|---|---|
| Q4_K_M | 39.600 GiB42,520,396,448 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight. | Pinned file recordVerified 2026-10-22 |
| Q5_K_M | 46.519 GiB49,949,819,552 bytes; 1 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight. | Pinned file recordVerified 2026-10-22 |
| Q8_0 | 69.826 GiB74,975,052,416 bytes; 2 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight. | Pinned file recordVerified 2026-10-22 |
| FP16 | 131.426 GiB141,117,915,936 bytes; 3 file(s)Sum of exact file byte sizes in the repository listing at the recorded commit; every declared shard is present. Auxiliary vision projector and speculative-decoding files are excluded. Labels follow publisher filenames; mixed-precision expert tensors may remain in a differently labeled file, so the estimator uses measured bytes rather than assumed bits per weight. | Pinned file recordVerified 2026-10-22 |
The hardware picture.
Q4_K_M: hardware comparison
| Hardware | Usable memory | Required memory | Fit estimate | Estimated generation |
|---|---|---|---|---|
| Mac mini M6 (12-core GPU) 16GB | 12.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M6 (12-core GPU) 24GB | 18.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M6 (12-core GPU) 32GB | 24.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB | 18.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB | 36.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB | 48.0 GiB | 41.85 GiB | fits | 2.9–5.8 estimated tokens/s |
| Mac Studio M5 Max (32-core GPU) 36GB | 27.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Max (40-core GPU) 64GB | 48.0 GiB | 41.85 GiB | fits | 5.8–11.6 estimated tokens/s |
| Mac Studio M5 Max (40-core GPU) 128GB | 96.0 GiB | 41.85 GiB | fits | 5.8–11.6 estimated tokens/s |
| Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB | 72.0 GiB | 41.85 GiB | fits | 11.3–22.6 estimated tokens/s |
| Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB | 192.0 GiB | 41.85 GiB | fits | 11.3–22.6 estimated tokens/s |
| Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB | 384.0 GiB | 41.85 GiB | fits | 11.3–22.6 estimated tokens/s |
| MacBook Pro 14-inch M5 (10-core GPU) 24GB | 18.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB | 36.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| MacBook Pro 16-inch M5 Max (40-core GPU) 128GB | 96.0 GiB | 41.85 GiB | fits | 5.8–11.6 estimated tokens/s |
| Mac mini (2024) M4 (10-core GPU) 16GB | 12.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 (10-core GPU) 24GB | 18.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 (10-core GPU) 32GB | 24.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 24GB | 18.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 48GB | 36.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 64GB | 48.0 GiB | 41.85 GiB | fits | 2.6–5.1 estimated tokens/s |
| Mac Studio (2025) M4 Max (32-core GPU) 36GB | 27.0 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M4 Max (40-core GPU) 64GB | 48.0 GiB | 41.85 GiB | fits | 5.1–10.3 estimated tokens/s |
| Mac Studio (2025) M4 Max (40-core GPU) 128GB | 96.0 GiB | 41.85 GiB | fits | 5.1–10.3 estimated tokens/s |
| Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB | 72.0 GiB | 41.85 GiB | fits | 7.7–15.4 estimated tokens/s |
| Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB | 192.0 GiB | 41.85 GiB | fits | 7.7–15.4 estimated tokens/s |
| NVIDIA GeForce RTX 3060 12GB | 10.8 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 3090 24GB | 21.6 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4060 Ti 16GB | 14.4 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4070 12GB GDDR6X | 10.8 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4080 16GB | 14.4 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4090 24GB | 21.6 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5060 Ti 16GB | 14.4 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5070 12GB | 10.8 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5070 Ti 16GB | 14.4 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5080 16GB | 14.4 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5090 32GB | 28.8 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB | 86.4 GiB | 41.85 GiB | fits | 16.9–33.7 estimated tokens/s |
| NVIDIA RTX 6000 Ada Generation 48GB | 43.2 GiB | 41.85 GiB | borderline | 9.0–18.1 estimated tokens/s |
| Intel Arc B580 12GB | 10.8 GiB | 41.85 GiB | doesn't fit | Estimated speed unavailable |
| AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB | 89.6 GiB | 41.85 GiB | fits | 2.4–4.8 estimated tokens/s |
| NVIDIA DGX Spark 128GB / 4TB | 96.0 GiB | 41.85 GiB | fits | 2.6–5.1 estimated tokens/s |
| 2 × GeForce RTX 3090 24GB (conditional 48GB aggregate) | 40.8 GiB | 41.85 GiB | Needs verification | Estimated speed unavailable |
| 2 × GeForce RTX 5090 32GB (conditional 64GB aggregate) | 54.4 GiB | 41.85 GiB | Needs verification | Estimated speed unavailable |
Q5_K_M: hardware comparison
| Hardware | Usable memory | Required memory | Fit estimate | Estimated generation |
|---|---|---|---|---|
| Mac mini M6 (12-core GPU) 16GB | 12.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M6 (12-core GPU) 24GB | 18.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M6 (12-core GPU) 32GB | 24.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB | 18.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB | 36.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB | 48.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Max (32-core GPU) 36GB | 27.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Max (40-core GPU) 64GB | 48.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Max (40-core GPU) 128GB | 96.0 GiB | 48.77 GiB | fits | 4.9–9.8 estimated tokens/s |
| Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB | 72.0 GiB | 48.77 GiB | fits | 9.6–19.2 estimated tokens/s |
| Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB | 192.0 GiB | 48.77 GiB | fits | 9.6–19.2 estimated tokens/s |
| Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB | 384.0 GiB | 48.77 GiB | fits | 9.6–19.2 estimated tokens/s |
| MacBook Pro 14-inch M5 (10-core GPU) 24GB | 18.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB | 36.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| MacBook Pro 16-inch M5 Max (40-core GPU) 128GB | 96.0 GiB | 48.77 GiB | fits | 4.9–9.8 estimated tokens/s |
| Mac mini (2024) M4 (10-core GPU) 16GB | 12.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 (10-core GPU) 24GB | 18.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 (10-core GPU) 32GB | 24.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 24GB | 18.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 48GB | 36.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 64GB | 48.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M4 Max (32-core GPU) 36GB | 27.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M4 Max (40-core GPU) 64GB | 48.0 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M4 Max (40-core GPU) 128GB | 96.0 GiB | 48.77 GiB | fits | 4.4–8.7 estimated tokens/s |
| Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB | 72.0 GiB | 48.77 GiB | fits | 6.6–13.1 estimated tokens/s |
| Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB | 192.0 GiB | 48.77 GiB | fits | 6.6–13.1 estimated tokens/s |
| NVIDIA GeForce RTX 3060 12GB | 10.8 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 3090 24GB | 21.6 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4060 Ti 16GB | 14.4 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4070 12GB GDDR6X | 10.8 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4080 16GB | 14.4 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4090 24GB | 21.6 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5060 Ti 16GB | 14.4 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5070 12GB | 10.8 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5070 Ti 16GB | 14.4 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5080 16GB | 14.4 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5090 32GB | 28.8 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB | 86.4 GiB | 48.77 GiB | fits | 14.4–28.7 estimated tokens/s |
| NVIDIA RTX 6000 Ada Generation 48GB | 43.2 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| Intel Arc B580 12GB | 10.8 GiB | 48.77 GiB | doesn't fit | Estimated speed unavailable |
| AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB | 89.6 GiB | 48.77 GiB | fits | 2.1–4.1 estimated tokens/s |
| NVIDIA DGX Spark 128GB / 4TB | 96.0 GiB | 48.77 GiB | fits | 2.2–4.4 estimated tokens/s |
| 2 × GeForce RTX 3090 24GB (conditional 48GB aggregate) | 40.8 GiB | 48.77 GiB | Needs verification | Estimated speed unavailable |
| 2 × GeForce RTX 5090 32GB (conditional 64GB aggregate) | 54.4 GiB | 48.77 GiB | Needs verification | Estimated speed unavailable |
Q8_0: hardware comparison
| Hardware | Usable memory | Required memory | Fit estimate | Estimated generation |
|---|---|---|---|---|
| Mac mini M6 (12-core GPU) 16GB | 12.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M6 (12-core GPU) 24GB | 18.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M6 (12-core GPU) 32GB | 24.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB | 18.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB | 36.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB | 48.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Max (32-core GPU) 36GB | 27.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Max (40-core GPU) 64GB | 48.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Max (40-core GPU) 128GB | 96.0 GiB | 72.08 GiB | fits | 3.3–6.6 estimated tokens/s |
| Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB | 72.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB | 192.0 GiB | 72.08 GiB | fits | 6.4–12.8 estimated tokens/s |
| Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB | 384.0 GiB | 72.08 GiB | fits | 6.4–12.8 estimated tokens/s |
| MacBook Pro 14-inch M5 (10-core GPU) 24GB | 18.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB | 36.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| MacBook Pro 16-inch M5 Max (40-core GPU) 128GB | 96.0 GiB | 72.08 GiB | fits | 3.3–6.6 estimated tokens/s |
| Mac mini (2024) M4 (10-core GPU) 16GB | 12.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 (10-core GPU) 24GB | 18.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 (10-core GPU) 32GB | 24.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 24GB | 18.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 48GB | 36.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 64GB | 48.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M4 Max (32-core GPU) 36GB | 27.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M4 Max (40-core GPU) 64GB | 48.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M4 Max (40-core GPU) 128GB | 96.0 GiB | 72.08 GiB | fits | 2.9–5.8 estimated tokens/s |
| Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB | 72.0 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB | 192.0 GiB | 72.08 GiB | fits | 4.4–8.7 estimated tokens/s |
| NVIDIA GeForce RTX 3060 12GB | 10.8 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 3090 24GB | 21.6 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4060 Ti 16GB | 14.4 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4070 12GB GDDR6X | 10.8 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4080 16GB | 14.4 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4090 24GB | 21.6 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5060 Ti 16GB | 14.4 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5070 12GB | 10.8 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5070 Ti 16GB | 14.4 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5080 16GB | 14.4 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5090 32GB | 28.8 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB | 86.4 GiB | 72.08 GiB | fits | 9.6–19.1 estimated tokens/s |
| NVIDIA RTX 6000 Ada Generation 48GB | 43.2 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| Intel Arc B580 12GB | 10.8 GiB | 72.08 GiB | doesn't fit | Estimated speed unavailable |
| AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB | 89.6 GiB | 72.08 GiB | fits | 1.4–2.7 estimated tokens/s |
| NVIDIA DGX Spark 128GB / 4TB | 96.0 GiB | 72.08 GiB | fits | 1.5–2.9 estimated tokens/s |
| 2 × GeForce RTX 3090 24GB (conditional 48GB aggregate) | 40.8 GiB | 72.08 GiB | Needs verification | Estimated speed unavailable |
| 2 × GeForce RTX 5090 32GB (conditional 64GB aggregate) | 54.4 GiB | 72.08 GiB | Needs verification | Estimated speed unavailable |
FP16: hardware comparison
| Hardware | Usable memory | Required memory | Fit estimate | Estimated generation |
|---|---|---|---|---|
| Mac mini M6 (12-core GPU) 16GB | 12.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M6 (12-core GPU) 24GB | 18.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M6 (12-core GPU) 32GB | 24.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 24GB | 18.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 48GB | 36.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini M5 Pro (15-core CPU / 16-core GPU) 64GB | 48.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Max (32-core GPU) 36GB | 27.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Max (40-core GPU) 64GB | 48.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Max (40-core GPU) 128GB | 96.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Ultra (30-core CPU / 64-core GPU) 96GB | 72.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 256GB | 192.0 GiB | 133.68 GiB | fits | 3.4–6.8 estimated tokens/s |
| Mac Studio M5 Ultra (36-core CPU / 80-core GPU) 512GB | 384.0 GiB | 133.68 GiB | fits | 3.4–6.8 estimated tokens/s |
| MacBook Pro 14-inch M5 (10-core GPU) 24GB | 18.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| MacBook Pro 14-inch M5 Pro (20-core GPU) 48GB | 36.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| MacBook Pro 16-inch M5 Max (40-core GPU) 128GB | 96.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 (10-core GPU) 16GB | 12.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 (10-core GPU) 24GB | 18.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 (10-core GPU) 32GB | 24.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 24GB | 18.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 48GB | 36.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac mini (2024) M4 Pro (16-core GPU) 64GB | 48.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M4 Max (32-core GPU) 36GB | 27.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M4 Max (40-core GPU) 64GB | 48.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M4 Max (40-core GPU) 128GB | 96.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M3 Ultra (28-core CPU / 60-core GPU) 96GB | 72.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Mac Studio (2025) M3 Ultra (32-core CPU / 80-core GPU) 256GB | 192.0 GiB | 133.68 GiB | fits | 2.3–4.6 estimated tokens/s |
| NVIDIA GeForce RTX 3060 12GB | 10.8 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 3090 24GB | 21.6 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4060 Ti 16GB | 14.4 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4070 12GB GDDR6X | 10.8 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4080 16GB | 14.4 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 4090 24GB | 21.6 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5060 Ti 16GB | 14.4 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5070 12GB | 10.8 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5070 Ti 16GB | 14.4 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5080 16GB | 14.4 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA GeForce RTX 5090 32GB | 28.8 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA RTX PRO 6000 Blackwell Workstation Edition 96GB | 86.4 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA RTX 6000 Ada Generation 48GB | 43.2 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| Intel Arc B580 12GB | 10.8 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| AMD Ryzen AI Halo, Ryzen AI Max+ 395, 128GB | 89.6 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| NVIDIA DGX Spark 128GB / 4TB | 96.0 GiB | 133.68 GiB | doesn't fit | Estimated speed unavailable |
| 2 × GeForce RTX 3090 24GB (conditional 48GB aggregate) | 40.8 GiB | 133.68 GiB | Needs verification | Estimated speed unavailable |
| 2 × GeForce RTX 5090 32GB (conditional 64GB aggregate) | 54.4 GiB | 133.68 GiB | Needs verification | Estimated speed unavailable |
A “fits” result checks estimated memory only. “Needs verification” preserves missing cache, vision, or placement information. All speed figures are estimated from the published bandwidth formula.
Field-level sources and verification dates
- id: Official source · verified 2026-10-22. Lowercase URL slug derived from the upstream repository ID; baseModel retains the exact Hugging Face identifier.
- name: Official source · verified 2026-10-22
- baseModel: Official source · verified 2026-10-22
- downloads: Official source · verified 2026-10-22
- tasks: Official source · verified 2026-10-22. Chat denotes a text-generating model, including base models that may require a chat template or instruction tuning. Code label is inferred from the repository model-family name. Vision uses pipeline metadata or vision_config.
- license: Official source · verified 2026-10-22
- commercialUse: Official source · verified 2026-10-22. Conditional commercial use: the upstream model card, section 7, identifies MIT terms and derivation from Llama 3.3 70B Instruct under the Llama 3.3 license. Review and comply with the inherited Llama terms in addition to MIT; the MIT metadata tag alone is incomplete.
- license_url: Official source · verified 2026-10-22. Pinned license file confirmed in repository listing.
- architecture: Official source · verified 2026-10-22. Classification from model_type and expert/state-space configuration fields (llama); hybrid classification takes precedence over expert count.
- parametersB: Official source · verified 2026-10-22. Exact safetensors parameter total reported by the Hugging Face API, divided by 1e9.
- activeParametersB: Official source · verified 2026-10-22. Dense model: all parameters are included. This is not a runtime FLOP measurement.
- contextLength: Official source · verified 2026-10-22. Configured maximum token positions; not a guarantee of runtime support or quality at that length. No speculative RoPE scaling applied.
- kvCache: Official source · verified 2026-10-22. Standard attention KV shape from num_hidden_layers, num_key_value_heads, and head_dim or hidden_size / num_attention_heads; FP16 cache bytes are a separate estimator choice.
- licenseStandard: Official source · verified 2026-10-22. Official standard license text supporting the permissive-license classification; model applicability is identified separately by upstream metadata.