You can deploy this model and start earning money today!

alecccdd/
alecccddttds-det-analyse-UQFF

Name: alecccddttds-det-analyse-UQFF
Availability: InStock

Views

No views yet

`alecccdd/ttds-det-analyse`, UQFF quantization

Run with mistral.rs. Documentation: UQFF docs.

Flexible: Multiple quantization formats in one file format with one framework to run them all.
Reliable: Compatibility ensured with embedded and checked semantic versioning information from day 1.
Easy: Download UQFF models easily and quickly from Hugging Face, or use a local file.
Customizable: Make and publish your own UQFF files in minutes.

Quantization	Command
AFQ4	`mistralrs run -m alecccdd/alecccddttds-det-analyse-UQFF vision-plain --from-uqff afq4-0.uqff`
FP8	`mistralrs run -m alecccdd/alecccddttds-det-analyse-UQFF vision-plain --from-uqff fp8-0.uqff`
Q4K	`mistralrs run -m alecccdd/alecccddttds-det-analyse-UQFF vision-plain --from-uqff q4k-0.uqff`