Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

MeganEFlynn updated a dataset 3 days ago

inference-optimization/Qwen3-8B-Regenerated-Collection

kylesayrs updated a collection 5 days ago

kylesayrs updated a model 5 days ago

inference-optimization/TinyQwen3-KV-Cache-Only

View all activity

inference-optimization 's models 506

inference-optimization/Qwen3-8B-DFlash-FP8-BLOCK

Text Generation • 2B • Updated Sep 28 • 59

inference-optimization/qwen3.8-27B-speculator.dflash2.comparisonrecipe.epoch1_step93171

2B • Updated Sep 25 • 69

inference-optimization/Qwen3-8B-DFlash-FP8-DYNAMIC

Text Generation • 2B • Updated Sep 24 • 64

inference-optimization/Qwen3-8B-DFlash-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated Sep 24 • 112

inference-optimization/Qwen3-8B-DFlash-Gauss-NVFP4-W4A4

Text Generation • 1B • Updated Sep 24 • 112

inference-optimization/Qwen3-8B-DFlash-PerfectBlend-FP8-W8A8

Text Generation • 1B • Updated Sep 24 • 52

inference-optimization/Qwen3-8B-DFlash-Gauss-FP8-W8A8

Text Generation • 1B • Updated Sep 24 • 55

inference-optimization/ZAYA1-74B-preview-NVFP4

Text Generation • 75B • Updated Sep 23 • 98

inference-optimization/Kimi-K3-0.40B-MXFP4

0.4B • Updated Sep 18 • 253 • 7

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt2

2B • Updated Sep 17 • 6

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt5

2B • Updated Sep 17 • 9

inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp4

3B • Updated Sep 16 • 56

inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp3

3B • Updated Sep 16 • 56

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt4

2B • Updated Sep 15 • 4

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt3

2B • Updated Sep 15 • 5

inference-optimization/Qwen3-8B-speculator.dflash2.v1.fullvocab.muon.dpace-preresume-epoch2

2B • Updated Sep 15 • 49

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt1

2B • Updated Sep 15 • 6

inference-optimization/qwe3-8B-selfdistill-v3-fresh3ep_ckpt0

2B • Updated Sep 15 • 144

inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp2

3B • Updated Sep 15 • 54

inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp1

3B • Updated Sep 14 • 48

inference-optimization/gemma-4-31B-it-speculator.dflash.latestrecipe.ckp0

3B • Updated Sep 14 • 50

inference-optimization/DSV4-tiny-empty

3B • Updated Sep 14 • 1.5k • 1

inference-optimization/Qwen3.8-Flash-Next-0.2B-A0.2B

Image-Text-to-Text • 0.2B • Updated Sep 14 • 1.01k • 2

inference-optimization/gemma-4-1B-0.8B-tiny

1B • Updated Sep 14 • 1.31k • 2

inference-optimization/GLM-5.3-0.6B-A0.4B

Text Generation • 0.6B • Updated Sep 14 • 1.01k • 1

inference-optimization/NemotronH-0.3B-A0.3B

Text Generation • 0.3B • Updated Sep 14 • 1.55k • 1

inference-optimization/Qwen3.6-8B-A1.6B

Image-Text-to-Text • 8B • Updated Sep 9 • 870

inference-optimization/dspark-inkling-small

3B • Updated Sep 4 • 78 • 1

inference-optimization/Qwen3-8B-speculator.dspark.swa.gammatv.2048anc.muon.regencollection.selfdistill-v3-epoch2

2B • Updated Sep 1 • 61

inference-optimization/Qwen3-8B-speculator.dspark.swa.gammatv.2048anc.muon.regencollection.selfdistill-v3-epoch1

2B • Updated Sep 1 • 50