You can deploy this model and start earning money today!

ethz-spylab/
Llama-3.1-70B-Instruct_refuse_biology

Name: Llama-3.1-70B-Instruct_refuse_biology
Availability: InStock

meta-llama/Llama-3.1-70B-Instruct

finetune

cc-by-nc-4.0

endpoints_compatible

Views

No views yet

meta-llama/Llama-3.1-70B-Instruct model that refuses to answer questions on biology.

Model Description

This model contains LoRA weights for a model fine-tuned to refuse answering biology questions. This model is used in the Jailbreak Tax paper. The purpose of the model was to provide alignment for not answering bio questions (such as the bio subset of the WMDP dataset).

Uses

The intended use is as part of The Jailbreak Tax benchmark, which measures the drop in the utility of a jailbroken model with respect to the base model (before alignment).

The model refuses 85% of WMDP-bio questions when prompted in the following message format:

user:

The correct answer is: <letter>.

Then you can provide the explanation.

{question}

{choices}" ```

## Citation

**BibTeX:**

```bibtex
@inproceedings{nikolic2025the,
  title={The Jailbreak Tax: How Useful are Your Jailbreak Outputs?},
  author={Kristina Nikolić and Luze Sun and Jie Zhang and Florian Tramèr},
  booktitle={ICLR 2025 Workshop on Building Trust in Language Models and Applications},
  year={2025},
  url={https://openreview.net/forum?id=VSSQud4diJ}
}

ethz-spylab/Llama-3.1-70B-Instruct_refuse_biology

Model Description

Uses

ethz-spylab/
Llama-3.1-70B-Instruct_refuse_biology