mgoin/Llama-2-7b-chat-hf-pruned95
Text Generation
•
7B
•
Updated
•
6
Michael Goin
mgoin
AI & ML interests
LLM inference optimization, compression, quantization, pruning, distillation
Recent Activity
upvoted
a
collection
22 days ago
Speculator Models
updated
a collection
about 1 month ago
Models in CI
updated
a collection
about 1 month ago
Models in CI
Organizations
mgoin/Llama-2-7b-chat-hf-pruned90
Text Generation
•
7B
•
Updated
•
5
mgoin/Llama-2-7b-chat-hf-pruned85
Text Generation
•
7B
•
Updated
•
6
mgoin/Llama-2-7b-chat-hf-pruned80
Text Generation
•
7B
•
Updated
•
6
mgoin/Llama-2-7b-chat-hf-pruned75
Text Generation
•
7B
•
Updated
•
6
mgoin/Hermes-2-Pro-Llama-3-8B-Marlin
Text Generation
•
Updated
•
7
•
1
mgoin/Meta-Llama-3-70B-Instruct-Marlin
Text Generation
•
Updated
•
61
•
6
mgoin/Meta-Llama-3-8B-Instruct-Marlin
Text Generation
•
Updated
•
20
mgoin/Meta-Llama-3-70B-Instruct-GPTQ
Text Generation
•
Updated
•
10
•
2
mgoin/Meta-Llama-3-8B-Instruct-GPTQ
Updated
mgoin/TinyLlama-1.1B-Chat-v1.0-pruned50-quant-ds
Text Generation
•
Updated
•
9
mgoin/bert-base-rotten-tomatoes-pruned90-quant
Text Classification
•
Updated
•
7
mgoin/tiny-random-llama-2-quant
Text Generation
•
104k
•
Updated
•
8
mgoin/tiny-random-LlamaForCausalLM-pruned95-compressed
Text Generation
•
1.22M
•
Updated
•
10
mgoin/llama2-125m-95-compressed
Text Generation
•
75.3M
•
Updated
•
7
mgoin/llama2_70b_sparsegpt_2_4_sft_tp1_fp8
Updated
•
7
mgoin/llama2.c-stories15M-quant-pt
Text Generation
•
Updated
•
6
mgoin/Nous-Hermes-2-Yi-34B-pruned50-compressed
Text Generation
•
22B
•
Updated
•
7
mgoin/TinyLlama-1.1B-Chat-v1.0-pruned2.4-test
Text Generation
•
1B
•
Updated
•
14
mgoin/TinyLlama-1.1B-Chat-v1.0-pruned2.4-compressed
Text Generation
•
0.8B
•
Updated
•
14
mgoin/phi-2-super-gptq
Text Generation
•
0.6B
•
Updated
•
4
mgoin/mistral-7b-gsm8k-gguf
Text Generation
•
7B
•
Updated
•
54
mgoin/all-MiniLM-L6-v2-quant-ds
Feature Extraction
•
Updated
•
4
mgoin/all-MiniLM-L6-v2-pruned50-quant-ds
Feature Extraction
•
Updated
•
8
mgoin/Nous-Hermes-2-Yi-34B-pruned50-quant-ds
Text Generation
•
Updated
•
5
mgoin/Nous-Hermes-2-Yi-34B-pruned50-quant-pt
Text Generation
•
Updated
•
4
•
1
mgoin/llama2-125m-pruned95-quant-ds
Text Generation
•
Updated
•
6
mgoin/llama2-125m-95-ds
Text Generation
•
Updated
•
8
mgoin/llama2-125m-95
Text Generation
•
0.3B
•
Updated
•
6
mgoin/starcoderbase-1b-pruned50
Text Generation
•
Updated
•
6