| Family | Version | Parameters | Variant | Size Class | GGUF via HF | Source | |
|---|---|---|---|---|---|---|---|
| SmolLM | 2.0 | 0.135B | Instruct | Tiny | f16 (271MB) | q8 (145MB) | Source |
| SmolLM | 2.0 | 0.36B | Instruct | Tiny | f16 (726MB) | q8 (386MB) | Source |
| SmolLM | 2.0 | 1.7B | Instruct | Tiny | f16 (3.42GB) | q8 (1.82GB) | Source |
| Mistral Small | 3.0 | 24B | Instruct | Small | f16 (47.2GB) | q8 (25.1GB) | Source |