You can deploy this model and start earning money today!

mgoin/
open_llama_3b_v2-ds

Name: open_llama_3b_v2-ds
Availability: InStock

Views

No views yet

open_llama_3b_v2-ds

https://huggingface.co/openlm-research/open_llama_3b_v2

Inference

python

import deepsparse

model = deepsparse.TextGeneration(model="hf:mgoin/open_llama_3b_v2-ds")
model("Tell me a joke.")

Export

git clone https://huggingface.co/openlm-research/open_llama_3b_v2
sparseml.transformers.export_onnx --model_path ./open_llama_3b_v2 --task text-generation --sequence_length 512