You can deploy this model and start earning money today!

davidberenstein1957/
sana-sprint-0.6b-smashed

Name: sana-sprint-0.6b-smashed
Availability: InStock

Views

No views yet

Model Card for davidberenstein1957/sana-sprint-0.6b-smashed

This model was created using the pruna library. Pruna is a model optimization framework built for developers, enabling you to deliver more efficient models with minimal implementation overhead.

Usage

First things first, you need to install the pruna library:

pip install pruna

You can then load this model using the following code:

python

from pruna import PrunaModel

loaded_model = PrunaModel.from_hub("davidberenstein1957/sana-sprint-0.6b-smashed")

After loading the model, you can use the inference methods of the original model.

Smash Configuration

The compression configuration of the model is stored in the smash_config.json file.

bash

{
    "batcher": null,
    "cacher": null,
    "compiler": null,
    "factorizer": null,
    "pruner": null,
    "quantizer": "hqq_diffusers",
    "hqq_diffusers_backend": "torchao_int4",
    "hqq_diffusers_group_size": 64,
    "hqq_diffusers_weight_bits": 8,
    "batch_size": 1,
    "device": "mps",
    "save_fns": [
        "hqq_diffusers"
    ],
    "load_fns": [
        "hqq_diffusers"
    ],
    "reapply_after_load": {
        "factorizer": null,
        "pruner": null,
        "quantizer": null,
        "cacher": null,
        "compiler": null,
        "batcher": null
    }
}

Model Configuration

The configuration of the model is stored in the config.json file.

{}

🌍 Join the Pruna AI community!

Discord