1from openai import OpenAI
23# Using HuggingFace Endpoint (Public)4client = OpenAI(5 base_url="https://bqkeuwh1lbn748co.us-east-1.aws.endpoints.huggingface.cloud/v1",6 api_key="none"# Public endpoint7)89# Or using Novita.ai10client = OpenAI(11 base_url="https://api.novita.ai/dedicated/v1/openai",12 api_key="YOUR_NOVITA_KEY"13)1415response = client.chat.completions.create(16 model="crittiksglobal/vertexelite-v1-merged",17 messages=[{"role":"user","content":"find large files over 100MB"}]18)19print(response.choices[0].message.content)
Quick Start (Local)
python
1from transformers import AutoModelForCausalLM, AutoTokenizer
23model = AutoModelForCausalLM.from_pretrained("crittiksglobal/vertexelite-v1-merged")4tokenizer = AutoTokenizer.from_pretrained("crittiksglobal/vertexelite-v1-merged")56prompt ="<|im_start|>user\nList all files in current directory<|im_end|>\n<|im_start|>assistant\n"7inputs = tokenizer(prompt, return_tensors="pt")8outputs = model.generate(**inputs, max_new_tokens=100)9print(tokenizer.decode(outputs[0]))
Model Details
Property
Value
Base Model
Qwen/Qwen2.5-0.5B-Instruct
Type
Merged (Full Model)
Parameters
494M
Size
~1 GB
Format
Safetensors
Capabilities
Tool/Function Calling - Execute functions from natural language
User: "What's the weather in Tokyo?"
Assistant: <functioncall>{"name": "get_weather", "arguments": {"city": "Tokyo"}}</functioncall>
Code Generation
User: "Write a function to check if a number is prime"
Assistant: def is_prime(n):
if n < 2:
return False
for i in range(2, int(n**0.5) + 1):
if n % i == 0:
return False
return True