FP8 dynamic quantized model with compressored tensors. per-channel weight and per-token activation.
- Downloads last month
- 3
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
FP8 dynamic quantized model with compressored tensors. per-channel weight and per-token activation.