This is quantized version of
ValiantLabs/Llama3.2-3B-Esper2 created using llama.cpp
Esper 2 is a DevOps and cloud architecture code specialist built on Llama 3.2 3b.
Try our code-instruct AI assistant
Enigma!Esper 2 is also available for
Llama 3.1 8b!Esper 2 uses the
Llama 3.2 Instruct prompt format. The example script below can be used as a starting point for general chat:
1import transformers
2import torch
3
4model_id = "ValiantLabs/Llama3.2-3B-Esper2"
5
6pipeline = transformers.pipeline(
7 "text-generation",
8 model=model_id,
9 model_kwargs={"torch_dtype": torch.bfloat16},
10 device_map="auto",
11)
12
13messages = [
14 {"role": "system", "content": "You are an AI assistant."},
15 {"role": "user", "content": "Hi, how do I optimize the size of a Docker image?"}
16]
17
18outputs = pipeline(
19 messages,
20 max_new_tokens=2048,
21)
22
23print(outputs[0]["generated_text"][-1])
Esper 2 is built on top of Llama 3.2 3b Instruct, improving performance through high quality DevOps, code, and chat data in Llama 3.2 Instruct prompt style.
Our current version of Esper 2 is trained on DevOps data from
sequelbox/Titanium, supplemented by code-instruct data from
sequelbox/Tachibana and general chat data from
sequelbox/Supernova.We care about open source.
For everyone to use.
We encourage others to finetune further from our models.
