You can deploy this model and start earning money today!

d-matrix/
CodeLlama-7b

Name: CodeLlama-7b
Rating: 2.5 (5 reviews)

Views

No views yet

This is a d-Matrix functional reference of the CODELLAMA-7B model. The reference provides the following functional configurations:

Configuration	Explanation
`BASELINE`	a reference functionally equivalent to the original model
`BASIC`	all linear algebraic operands quantized to `MXINT8-64`

Usage

Install d-Matrix Dmx_Compressor first.

pip install dmx_compressor

The following is an example model and its evaluation.

git clone https://github.com/bigcode-project/bigcode-evaluation-harness.git
cd bigcode-evaluation-harness
pip install -e .

python

# code_eval.py included in HuggingFace repo
from code_eval import evaluate_model

eval_results = evaluate_model("d-matrix/CodeLlama-7b", dmx_config="BASELINE")  # For BASELINE configuration