Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

124

Base only

Active filters: w4a4

ApacheOne/orbitquant_unets

Text-to-Image • Updated Jul 10

wazimondo/Qwen-Image-Edit-2511-int4-tensorwise-mixed

ariaotp/INT4-ConvRot-W4A4-ComfyUI

Updated Jul 21 • 31

protoLabsAI/Qwythos-9B-v2-NVFP4

Text Generation • 7B • Updated Jul 12 • 325 • 2

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0060

Text Generation • 31B • Updated Jul 12 • 111

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0195

Text Generation • 31B • Updated Jul 12 • 82

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0330

Text Generation • 31B • Updated Jul 12 • 91

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0475

Text Generation • 31B • Updated Jul 12 • 111

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0620

Text Generation • 31B • Updated Jul 12 • 123

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0730

Text Generation • 31B • Updated Jul 12 • 124

shawnzzzzz/Qwen3-30B-A3B-DAPO-FFN-W4A4-QAT-BF16Master-step-0815

Text Generation • 31B • Updated Jul 12 • 129

sakamakismile/Huihui-ThinkingCap-Qwen3.6-27B-abliterated-NVFP4

Image-Text-to-Text • 17B • Updated Jul 12 • 6.8k • 37

WaveCut/Ideogram-v4-Instant-OrbitQuant-W4A4

Text-to-Image • 5B • Updated Jul 14 • 14 • 1

vroomfondel/glm-5.2-reap-504B-v2-W4A4

Text Generation • 285B • Updated Jul 17 • 112 • 1

Ttimms/zaya1-8b-nvfp4-w4a4

Text Generation • 9B • Updated 3 days ago • 1.18k

anemll/DeepSeek-V4-Flash-NVFP4-TP2-W4A4-v1

Text Generation • 167B • Updated Jul 21 • 167 • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s4000

Text Generation • 6B • Updated Jul 22 • 3

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s4000

Text Generation • 6B • Updated Jul 22 • 5

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s3000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s2000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s2000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s3000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 16B • Updated Jul 24 • 12

sakamakismile/Solar-Open2-250B-NVFP4A16

142B • Updated Jul 24 • 21 • 1

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A4-LR1e-5-s2640

Text Generation • 16B • Updated Jul 24 • 13

JasonW2025/Laguna-S-2.1-ModelOpt-NVFP4-W4A4-vllm

Text Generation • 61B • Updated 14 days ago • 374 • 3

CocaKova/Qwythos-27B-v1-NVFP4

Image-Text-to-Text • 27B • Updated 27 days ago • 499

neroued/Qwen3.6-27B-nvfp4-NInfer

Image-Text-to-Text • Updated 14 days ago • 1.44k • 5