AI & ML interests
Efficient machine learning for any model and hardware: pruning, quantization, compilation, and more.
Recent Activity
Articles
Organization Card
🌍 Join the Pruna AI community!
💜 Make AI models faster, cheaper, smaller, greener!
Pruna AI makes AI models faster, cheaper, smaller, and greener with the pruna package.
- It supports various models, including CV, NLP, audio, and graphs for predictive and generative AI.
- It supports various hardware, including GPU, CPU, Edge.
- It supports various compression algorithms, including quantization, pruning, distillation, caching, recovery, compilation, or factorization, among others.
- You can combine algorithms to find the optimal configuration and smash/compress your model.
- You can evaluate reliable quality and efficiency metrics of your base vs smashed/compressed models.
Set it up in minutes and compress your first models in a few lines of code!
⏩ How to get started?
You can smash your own models by installing pruna with pip:
pip install pruna
You can start with simple notebooks to experience efficiency gains with:
| Use Case | Free Notebooks |
|---|---|
| 3x Faster Stable Diffusion Models | ⏩ Smash for free |
| Making your LLMs 4x smaller | ⏩ Smash for free |
| Smash your model with a CPU only | ⏩ Smash for free |
| Transcribe 2 hours of audio in less than 2 minutes with Whisper | ⏩ Smash for free |
| 100% faster Whisper Transcription | ⏩ Smash for free |
| Run your Flux model without an A100 | ⏩ Smash for free |
| x2 smaller Sana in action | ⏩ Smash for free |
For more details on installation and free tutorials, check the Pruna AI documentation.
✨ Test our Performance Models
Want to use our optimized models right away? Try them via our API for fast, easy access to Pruna-powered inference.
Train LoRAs at https://replicate.com/prunaai/p-image-edit-trainer. Use LoRAs here: https://replicate.com/prunaai/p-image-edit-lora
-
PrunaAI/p-image-edit-dotted-illustration-lora
Image-to-Image • Updated • 132 -
PrunaAI/p-image-edit-photo-enhancement-lora
Image-to-Image • Updated • 460 • 1 -
PrunaAI/p-image-edit-skin-retouching-lora
Image-to-Image • Updated • 154 • 1 -
PrunaAI/p-image-edit-photo-to-anime-lora
Image-to-Image • Updated • 182 • 1
The latest Pruna model updates are listed for easy reference.
Train LoRAs at https://replicate.com/prunaai/p-image-edit-trainer. Use LoRAs here: https://replicate.com/prunaai/p-image-edit-lora
-
PrunaAI/p-image-edit-dotted-illustration-lora
Image-to-Image • Updated • 132 -
PrunaAI/p-image-edit-photo-enhancement-lora
Image-to-Image • Updated • 460 • 1 -
PrunaAI/p-image-edit-skin-retouching-lora
Image-to-Image • Updated • 154 • 1 -
PrunaAI/p-image-edit-photo-to-anime-lora
Image-to-Image • Updated • 182 • 1
models 169
PrunaAI/project-numina-NuminaMath-7B-TIR-HQQ-8bit-smashed
Updated • 18
PrunaAI/project-numina-NuminaMath-7B-TIR-HQQ-4bit-smashed
Updated • 16
PrunaAI/P-Q-Image-2.1
Text-to-Image • Updated • 457k • 180
PrunaAI/P-Q-Image-2.1-Comfy
Text-to-Image • Updated • 17
PrunaAI/P-SuperPoint
Keypoint Detection • Updated • 3
PrunaAI/livekit-turn-detector-HQQ-4bit-smashed
Updated • 237 • 1
PrunaAI/livekit-turn-detector-HQQ-8bit-smashed
Updated • 241 • 1
PrunaAI/openbmb-MiniCPM5-2B-HQQ-8bit-smashed
Updated • 11 • 1
PrunaAI/openbmb-MiniCPM5-2B-HQQ-4bit-smashed
Updated • 14 • 1
PrunaAI/P-LTX-2.3-VAED
Text-to-Video • Updated • 67
datasets 6
PrunaAI/media-assets
Viewer • Updated • 2 • 57.8k • 1
PrunaAI/pruna-skills
Updated • 609 • 2
PrunaAI/user_generated_content
Updated • 7
PrunaAI/InferBench-evaluation-results-new
Updated • 7
PrunaAI/InferBench-evaluation-results
Viewer • Updated • 1 • 27
PrunaAI/documentation-images
Viewer • Updated • 1 • 259