This model is a quantized version of the original model
trend-cybertron/Llama-Primus-Nemotron-70B-Instruct.
It's quantized using the BitsAndBytes library to 4-bit using the
bnb-my-repo space.
The
Llama-Primus-Nemotron series builds upon
nvidia/Llama-3.1-Nemotron-70B-Instruct through continued training. Following the same methodology as described in the
Primus paper, we first performed pre-training on large-scale cybersecurity corpora (over
10B tokens) to obtain
Llama-Primus-Nemotron-Base. We then conducted supervised-finetuning and applied
DELLA to merge with the original Nemotron, resulting in
Llama-Primus-Nemotron-70B-Instruct.
Primus is Trend Micro's pioneering family of lightweight, state-of-the-art open cybersecurity language models and datasets. Developed through our cutting-edge research initiatives and advanced technology, these resources share the innovative foundation that powers our enterprise-class
Trend Cybertron solution. As an industry leader in cybersecurity, Trend Micro is proud to contribute these powerful, efficiency-optimized models and datasets to the community, while maintaining the excellence and reliability that define our global security standards.
This model is based on the MIT license, but you must also comply with the Llama 3.1 Community License Agreement.
