Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

428

Base only

Active filters: lm-studio

richardyoung/Qwen2.5-7B-Instruct-abliterated-GGUF

Text Generation • 8B • Updated Mar 23 • 5.91k • 1

richardyoung/Qwen3-14B-abliterated-GGUF

Text Generation • 15B • Updated Mar 23 • 5.33k • 7

snowmead/qwen3-0.6b-rust-sft-GGUF

0.6B • Updated Dec 11, 2025 • 4

kingjux/ffmpeg-command-generator-gguf

0.5B • Updated Dec 14, 2025 • 16

SiddhJagani/NVIDIA-Nemotron-Nano-12B-v2-mlx-Q6

Text Generation • 12B • Updated Dec 26, 2025 • 12

HexQuant/Pars-Medical-o1-Llama-FFT-GGUF

Text Generation • 3B • Updated Dec 22, 2025 • 38 • 1

purplesquirrelnetworks/purple-squirrel-r1-gguf

Text Generation • 8B • Updated Feb 23 • 29

ermiaazarkhalili/Qwen2.5-0.5B-SFT-UltraChat-GGUF

0.5B • Updated Apr 18 • 18

ermiaazarkhalili/Qwen2.5-1.5B-SFT-UltraChat-GGUF

2B • Updated Apr 18 • 26

ermiaazarkhalili/Qwen3-0.6B-SFT-UltraChat-GGUF

0.6B • Updated Apr 18 • 26

ermiaazarkhalili/Qwen3-1.7B-SFT-UltraChat-GGUF

2B • Updated Apr 18 • 18

ermiaazarkhalili/Qwen2.5-3B-SFT-UltraChat-GGUF

3B • Updated Apr 18 • 25

ermiaazarkhalili/Qwen3-4B-SFT-UltraChat-GGUF

4B • Updated Apr 18 • 12

ermiaazarkhalili/LFM2-350M-GRPO-NuminaMath-10K-GGUF

Text Generation • 0.4B • Updated 16 days ago • 203

ermiaazarkhalili/LFM2-700M-GRPO-NuminaMath-10K-GGUF

Text Generation • 0.7B • Updated 16 days ago • 205

ermiaazarkhalili/LFM2-1.2B-GRPO-NuminaMath-10K-GGUF

Text Generation • 1B • Updated 16 days ago • 191

ermiaazarkhalili/Qwen2.5-0.5B-SFT-OpenHermes-2.5-100-GGUF

0.5B • Updated Apr 18 • 283

SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8

Text Generation • 15B • Updated Dec 30, 2025 • 11

SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6

Text Generation • 15B • Updated Dec 30, 2025 • 13

SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q3

Text Generation • 15B • Updated Dec 30, 2025 • 10

SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q2

Text Generation • 1B • Updated Dec 30, 2025 • 17

SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8

Text Generation • 8B • Updated Dec 30, 2025 • 8

SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6

Text Generation • 8B • Updated Dec 31, 2025 • 14

SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q4

Text Generation • 1B • Updated Dec 31, 2025 • 10

szili2011/Quanta-X-GGUF

3B • Updated Jan 1 • 22

BansheeTechnologies/Ouija-3B

Text Generation • 3B • Updated Jan 5 • 8 • 1

uaebn/leesplank-municipal-GGUF

Text Generation • 2B • Updated Jan 22 • 54

Hob-forge/gpt-oss-20b-Q2_K-GGUF

Text Generation • 21B • Updated 3 days ago • 973 • 1

ahmedds10/gemma-3-270m-psychology-GGUF

0.3B • Updated Feb 9 • 26

bochen2079/AORTA-7B-GGUF

Text Generation • 8B • Updated Feb 15 • 10 • 3