MoGU: A Framework for Enhancing Safety of Open-Sourced LLMs While Preserving Their Usability [
https://arxiv.org/abs/2405.14488 ]
We open-source the safer vicuna-7b-v1.5 [
https://huggingface.co/lmsys/vicuna-7b-v1.5 ], trained with our proposed MoGU framework.
Technical details of MoGU can be found in the paper ''MoGU: A Framework for Enhancing Safety of Open-Sourced LLMs While Preserving Their Usability''.
We release the parameters and the inference code.
The current inference code is still in a simple version and we will further improve it.
In the future, we plan to open-source the training data and the training code.
You can use our open-sourced LLM by following the steps below.
Some test examples are provided in inference.py.
