About
static quants of https://huggingface.co/InfiX-ai/InfiGUI-R1-3B
THIS REPO CONTAINS mmproj-* FILE, CAN BE DEPLOYED WITH ONE SHOT.
Usage
llama-server -m InfiGUI-R1-3B-IQ4_K_M.gguf --mmproj mmproj-InfiGUI-R1-3B-F16.gguf --jinja -c 8196
- Downloads last month
- 198
Hardware compatibility
Log In
to view the estimation
4-bit