You can deploy this model and start earning money today!

RichardErkhov/
sanchit-gandhi_-_distil-mistral-1.5B-v0.1-8bits

Name: sanchit-gandhi_-_distil-mistral-1.5B-v0.1-8bits
Availability: InStock

Views

No views yet

Quantization made by Richard Erkhov.

distil-mistral-1.5B-v0.1 - bnb 8bits

Original model description:

datasets:

To reproduce this run:

accelerate launch --multi_gpu --mixed_precision=fp16 --num_processes=8 run_distillation.py config_mistral.yaml