Views
No views yet
<|im_start|> format for easy integration.
Note: The "Blind Test" metric (58%) represents the model's raw semantic accuracy without any tool definitions provided (Zero-Shot). The "Syntax Reliability" (97%) measures the model's ability to generate valid, crash-free JSON structure, which matches GPT-4o class performance.
transformers and unsloth libraries to run Liquid architectures.1from unsloth import FastLanguageModel
2import torch
3
4# Load the model
5model, tokenizer = FastLanguageModel.from_pretrained(
6 model_name = "NovachronoAI/LFM2.5-1.2B-Nova-Function-Calling-Full", # or use the GGUF repo
7 max_seq_length = 4096,
8 dtype = None,
9 load_in_4bit = True,
10)
11FastLanguageModel.for_inference(model)
12
13# Define the Prompt (ChatML Format)
14prompt = """<|im_start|>user
15I need to calculate the area of a circle with a radius of 5.
16<|im_end|>
17<|im_start|>assistant
18"""
19
20# Generate
21inputs = tokenizer([prompt], return_tensors = "pt").to("cuda")
22outputs = model.generate(**inputs, max_new_tokens = 128, use_cache = True)
23print(tokenizer.batch_decode(outputs)[0].split("<|im_start|>assistant")[-1])
24
25Expected Output:
26<tool_call>
27{"name": "calculate_circle_area", "arguments": {"radius": 5}}
28</tool_call>| Version | Description | Recommended For | Link |
|---|---|---|---|
| Standard GGUF | Traditional static quantization. | General testing & broad compatibility. | Download |
| Imatrix GGUF | (Best Quality) Importance Matrix tuned. Higher accuracy at small sizes. | Low VRAM devices (Android/Pi) or max quality needs. | Download |
| Parameter | Value |
|---|---|
| Base Model | LiquidAI/LFM2.5-1.2B-Instruct |
| Framework | Unsloth + Hugging Face TRL |
| Hardware | NVIDIA Tesla T4 (Kaggle) |
| Epochs | ~2 (600 Steps) |
| Learning Rate | 2e-4 |
| Scheduler | Linear |
| Quantization | 4-bit (QLoRA) |
| Training Trajectory | |
| The model showed rapid adaptation to the JSON syntax, dropping from a random-guess loss of 11.6 to a highly capable 2.63. |