AI Model Optimization More Flexible Than Ever
•
13
AI & ML interests
Efficient machine learning for any model and hardware: pruning, quantization, compilation, and more.
Recent Activity
View all activity
Articles
PrunaAI/TroyDoesAI-Phi-3-Context-Obedient-RAG-GGUF-smashed
4B
•
Updated
•
511
PrunaAI/internlm-internlm2_5-20b-chat-GGUF-smashed
20B
•
Updated
•
202
PrunaAI/AI-MO-NuminaMath-72B-TIR-GGUF-smashed
73B
•
Updated
•
184
•
1
PrunaAI/Qwen-Qwen2-Math-7B-Instruct-GGUF-smashed
8B
•
Updated
•
231
PrunaAI/unsloth-llama-2-7b-GGUF-smashed
7B
•
Updated
•
32
PrunaAI/KISTI-KONI-KONI-Llama3-8B-Instruct-20240729-GGUF-smashed
8B
•
Updated
•
47
PrunaAI/HiroseKoichi-L3-8B-Lunar-Stheno-GGUF-smashed
8B
•
Updated
•
68
•
2
PrunaAI/abacusai-Smaug-Qwen2-72B-Instruct-GGUF-smashed
73B
•
Updated
•
163
PrunaAI/ibm-granite-granite-8b-code-instruct-128k-AWQ-4bit-smashed
8B
•
Updated
•
6
PrunaAI/OuteAI-Lite-Oute-1-300M-Instruct-QUANTO-int4bit-smashed
Updated
•
5
PrunaAI/NCSOFT-Llama-3-OffsetBias-8B-bnb-8bit-smashed
8B
•
Updated
•
2
PrunaAI/scb10x-typhoon-7b-QUANTO-float8bit-smashed
Updated
•
5
PrunaAI/cognitivecomputations-Samantha-1.11-7b-HQQ-2bit-smashed
Updated
•
12
PrunaAI/mychen76-mistral7b_ocr_to_json_v1-HQQ-4bit-smashed
Updated
•
4
PrunaAI/Nexusflow-NexusRaven-V2-13B-HQQ-4bit-smashed
Updated
•
9
PrunaAI/MysteriousAI-Mia-1B-HQQ-2bit-smashed
Updated
•
4
PrunaAI/rinna-youri-7b-instruction-AWQ-4bit-smashed
7B
•
Updated
•
4
PrunaAI/JackFram-llama-68m-AWQ-4bit-smashed
68M
•
Updated
•
411
PrunaAI/medalpaca-medalpaca-7b-AWQ-4bit-smashed
7B
•
Updated
•
3
PrunaAI/lightblue-suzume-llama-3-8B-multilingual-AWQ-4bit-smashed
8B
•
Updated
•
4
PrunaAI/mychen76-mistral7b_ocr_to_json_v1-AWQ-4bit-smashed
7B
•
Updated
•
3
PrunaAI/cognitivecomputations-dolphin-2.9.2-Phi-3-Medium-AWQ-4bit-smashed
14B
•
Updated
•
4
PrunaAI/MediaTek-Research-Breeze-7B-Instruct-v1_0-QUANTO-float8bit-smashed
Updated
•
2
PrunaAI/openbmb-MiniCPM-1B-sft-bf16-bnb-4bit-smashed
1B
•
Updated
PrunaAI/rinna-japanese-gpt-neox-3.6b-instruction-sft-bnb-4bit-smashed
4B
•
Updated
•
6
PrunaAI/m-a-p-ChatMusician-bnb-4bit-smashed
7B
•
Updated
•
1
PrunaAI/medalpaca-medalpaca-7b-bnb-4bit-smashed
7B
•
Updated
•
3
PrunaAI/microsoft-git-base-textvqa-bnb-4bit-smashed
0.2B
•
Updated
•
8
PrunaAI/mychen76-mistral7b_ocr_to_json_v1-bnb-4bit-smashed
7B
•
Updated
•
7
PrunaAI/M4-ai-tau-0.5B-bnb-4bit-smashed
0.5B
•
Updated
•
8