| Output + Embedding | ||||||||
|---|---|---|---|---|---|---|---|---|
| 2-bit | 3-bit | 4-bit | 5-bit | 6-bit | 8-bit | 16-bit | 32-bit | |
| AXL | BXL | CXL | DXL | EXL | FXL | GXL | HXL | |
Notes
- This model performs poorly on correcting German texts.
- Downloads last month
- 620
Hardware compatibility
Log In
to view the estimation
Model tree for marcelone/Hunyuan-7B-Instruct-GGUF
Base model
tencent/Hunyuan-7B-Pretrain
Finetuned
tencent/Hunyuan-7B-Instruct