Views
No views yet
1pip install transformers torch accelerate bitsandbytes
2python -c "
3from transformers import pipeline
4pipe = pipeline('text-generation', model='Merkiumai/Arti-code-mini', device_map='auto')
5print(pipe([{'role': 'user', 'content': 'Write a function that reverses a string.'}], max_new_tokens=200)[0]['generated_text'][-1]['content'])
6"| Property | Value |
|---|---|
| Developer | Merkium AI |
| Parameters | 3 Billion |
| Fine-tuning method | QLoRA (LoRA via Unsloth) |
| Primary use case | Coding assistant |
| Context length | 2,048 tokens |
| Precision | float16 / 4-bit quantized |
| License | Apache 2.0 |
| tuned | Adamas Mini 1 |
pip install transformers torch accelerate bitsandbytes1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3
4model_name = "Merkiumai/Arti-code-mini"
5
6tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
7model = AutoModelForCausalLM.from_pretrained(
8 model_name,
9 torch_dtype=torch.float16,
10 device_map="auto",
11 trust_remote_code=True
12)
13
14messages = [
15 {"role": "user", "content": "Write a Python function that checks if a number is prime."}
16]
17
18text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
19inputs = tokenizer(text, return_tensors="pt").to(model.device)
20
21outputs = model.generate(
22 **inputs,
23 max_new_tokens=300,
24 temperature=0.3,
25 do_sample=True,
26 pad_token_id=tokenizer.eos_token_id
27)
28
29response = tokenizer.decode(outputs[0][inputs.input_ids.shape[-1]:], skip_special_tokens=True)
30print(response)tokenizer.apply_chat_template(). The underlying format:1### System:
2You are Arti Code Mini, a helpful coding assistant created by Merkium AI.
3
4### User:
5Write a Python function that reverses a string.
6
7### Arti:
8def reverse_string(s: str) -> str:
9 return s[::-1]| Component | Minimum | Recommended |
|---|---|---|
| GPU VRAM | 6 GB | 8 GB+ |
| RAM | 8 GB | 16 GB |
| Storage | 4 GB free | 8 GB free |
1@misc{artimini2025,
2 title = {Arti Code Mini: A Lightweight Local Coding Assistant},
3 author = {{Merkium AI}},
4 year = {2025},
5 url = {https://huggingface.co/Merkiumai/Arti-code-mini}
6}