You can deploy this model and start earning money today!

LeoZotos/
qwen3_5_9b_without_qwen3_5_9b_bio

Name: qwen3_5_9b_without_qwen3_5_9b_bio
Availability: InStock

Views

No views yet

Unlearned Model: LeoZotos/qwen3_5_9b_without_qwen3_5_9b_bio

This model was unlearned using the RMU (Representation Misdirection Unlearning) algorithm.

Unlearning Configuration

json

{
    "model_name_or_path": "qwen3_5_9b",
    "forget_corpus": "LeoZotos/bio_textbooks",
    "retain_corpus": "LeoZotos/wikitext-2-raw-v1_test",
    "forget_split": "qwen3_5_9b",
    "alpha": 50.0,
    "steering_coeffs": 70.0,
    "batch_size": 2,
    "layer_ids": [
        6,
        7,
        8
    ],
    "layer_id": 8,
    "param_names": [
        "gate_proj"
    ],
    "max_num_batches": 125,
    "num_epochs": 1,
    "lr": 5e-05,
    "min_len": 0,
    "max_len": 2000,
    "seed": 42,
    "verbose": false,
    "save_local": null,
    "push_to_hub": "LeoZotos/qwen3_5_9b_without_qwen3_5_9b_bio",
    "model_config_path": "/home4/p285811/edu_unlearning/configs/model/qwen3_5_9b.json",
    "module_str": "{model_name}.model.layers[{layer_id}]",
    "unlearn_type": "rmu"
}