Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,583

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 9 days ago • 632k • • 1.05k

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 10 days ago • 2.19M • 654

mitkox/antares-1b-Q8_0-GGUF

Text Generation • 2B • Updated 6 days ago • 2.22k • 25

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 869 • 267

Hikari07jp/Ternary-Bonsai-27B-Abliterated-LowDeg-GGUF

Text Generation • 27B • Updated 5 days ago • 1.78k • 14

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 66.3k • 121

jcbtc/Ternary-Bonsai-27B-AMD-Strix-Halo

Text Generation • Updated 7 days ago • 13

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated about 3 hours ago • 16.6k • 68

Abiray/OvisOCR2-GGUF

Image-Text-to-Text • 0.8B • Updated 14 days ago • 7.02k • 16

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 94.5k • 126

Nguuma/security-slm-unsloth-1.5b

Text Generation • 2B • Updated May 7 • 2.48k • 49

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 51.9k • 759

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 6.65k • 39

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 17.9k • 62

Darkknight535/Void-Citrus-L3.3-70B-IQ3_XXS-GGUF

71B • Updated Feb 1 • 87 • 4

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 18.7k • 107

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 363 • 4

AXONVERTEX-AI-RESEARCH/antares-1b-Q8_0-GGUF

Text Generation • 2B • Updated 6 days ago • 399 • 3

prithivMLmods/OpenCaption-4B-VL-SFT-v1.0-GGUF

Image-Text-to-Text • 4B • Updated 2 days ago • 321 • 3

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 119k • 29

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 366 • 50

fdtn-ai/Foundation-Sec-8B-Reasoning-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 18 • 1.6k • 7

Edge-Quant/Nanbeige4.1-3B-Q4_K_M-GGUF

Text Generation • 4B • Updated Feb 11 • 2.29k • 39

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 30.7k • 82

DavidOKB/MathThink-Qwen-3.5-4B

4B • Updated Apr 12 • 164 • 10

dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B-GGUF

Text Generation • 139B • Updated Apr 16 • 333 • 13

audarai/Audar-ASR-V1-Turbo

Automatic Speech Recognition • 2B • Updated 10 days ago • 1.46k • 6

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 6.96k • 15

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 30 days ago • 38.5k • 47

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated Jun 15 • 795 • 18