Models

QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ-BF16Mix

Text Generation • 14B • Updated Sep 5 • 238 • 4

QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ

Text Generation • 31B • Updated Sep 5 • 12.7k • 2

model-scope/glm-4-9b-chat-GPTQ-Int4

Text Generation • 2B • Updated Jul 17, 2024 • 35 • 6

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • 3B • Updated Jul 23, 2024 • 22 • 2

JunHowie/Qwen3-0.6B-GPTQ-Int4

Text Generation • 0.6B • Updated Sep 3 • 269 • 1

JunHowie/Qwen3-0.6B-GPTQ-Int8

Text Generation • 0.6B • Updated Sep 3 • 11

JunHowie/Qwen3-1.7B-GPTQ-Int4

Text Generation • 2B • Updated Sep 3 • 69 • 1

JunHowie/Qwen3-1.7B-GPTQ-Int8

Text Generation • 2B • Updated Sep 3 • 67

JunHowie/Qwen3-32B-GPTQ-Int4

Text Generation • 33B • Updated Sep 5 • 495 • 3

JunHowie/Qwen3-32B-GPTQ-Int8

Text Generation • 33B • Updated Sep 5 • 113 • 3

JunHowie/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 5B • Updated Sep 6 • 116 • 1

JunHowie/Qwen3-14B-GPTQ-Int8

Text Generation • 15B • Updated Sep 5 • 78

JunHowie/Qwen3-14B-GPTQ-Int4

Text Generation • 15B • Updated Sep 5 • 524 • 4

JunHowie/Qwen3-8B-GPTQ-Int8

Text Generation • 8B • Updated Sep 4 • 174

JunHowie/Qwen3-8B-GPTQ-Int4

Text Generation • 8B • Updated Sep 4 • 1.72k • 4

JunHowie/Qwen3-4B-GPTQ-Int4

Text Generation • 4B • Updated Sep 4 • 434 • 1

JunHowie/Qwen3-4B-GPTQ-Int8

Text Generation • 4B • Updated Sep 4 • 46

JunHowie/Qwen3-30B-A3B-GPTQ-Int8

Text Generation • 8B • Updated Sep 6 • 36

QuantTrio/Qwen3-235B-A22B-GPTQ-Int8

Text Generation • 235B • Updated Sep 5 • 63

QuantTrio/DeepSeek-R1-0528-Qwen3-8B-GPTQ-Int4-Int8Mix

Text Generation • 11B • Updated Sep 5 • 236 • 3

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • 721B • Updated Aug 30 • 17 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • 847B • Updated Jun 19 • 23 • 5

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

Text Generation • 912B • Updated Jun 20 • 120 • 1

koushd/Qwen3-235B-A22B-Instruct-2507-AWQ

Text Generation • 33B • Updated Aug 26 • 123 • 4

QuantTrio/Qwen3-235B-A22B-Instruct-2507-GPTQ-Int4-Int8Mix

Text Generation • 248B • Updated Aug 20 • 355 • 2

QuantTrio/Qwen3-235B-A22B-Instruct-2507-AWQ

Text Generation • 235B • Updated Aug 19 • 4.82k • 10

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-AWQ

Text Generation • 480B • Updated Aug 19 • 17.6k • 8

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-GPTQ-Int4-Int8Mix

Text Generation • 534B • Updated Sep 5 • 1.61k • 6

QuantTrio/Qwen3-235B-A22B-Thinking-2507-AWQ

Text Generation • 235B • Updated Sep 5 • 1.96k • 5

QuantTrio/Qwen3-235B-A22B-Thinking-2507-GPTQ-Int4-Int8Mix

Text Generation • 253B • Updated Sep 5 • 83 • 1