Views
No views yet
1from inference import load_paraphrase_model
2
3pm = load_paraphrase_model("WizardWang01/depo-paraphrase")
4out = pm.rewrite("Your text here.")
5print(out)1pip install torch transformers peft accelerate
2python inference.py --adapter_path WizardWang01/depo-paraphrase| Parameter | Value |
|---|---|
| Prompt template | preserve-meaning paraphrase (eval_rl) |
| max_new_tokens | 512 |
| temperature | 0.9 |
| top_p | 0.95 |
| torch_dtype | bfloat16 |