Views
No views yet
optimum-intel library:1from optimum.intel import OVModelForCausalLM
2from transformers import AutoTokenizer
3
4model_id = "CelesteImperia/Qwen2.5-Coder-7B-Instruct-OpenVINO-INT8"
5tokenizer = AutoTokenizer.from_pretrained(model_id)
6model = OVModelForCausalLM.from_pretrained(model_id)
7
8prompt = "Write a thread-safe Singleton pattern in C# using Lazy<T>."
9inputs = tokenizer(prompt, return_tensors="pt")
10outputs = model.generate(**inputs, max_new_tokens=500)
11print(tokenizer.decode(outputs[0], skip_special_tokens=True))OpenVINO.GenAI framework, providing a low-latency coding companion directly within your Windows development environment.1using OpenVino.GenAI;
2
3// 1. Initialize the LLM Pipeline
4var device = "CPU"; // Use "GPU" to leverage RTX 3090/A4000
5using var pipe = new LLMPipeline("path/to/qwen2.5-coder-int8-model", device);
6
7// 2. Set Generation Config
8var config = new GenerationConfig { MaxNewTokens = 1024, Temperature = 0.2f }; // Low temp for precise code
9
10// 3. Execute Inference
11var prompt = "Generate a C# WPF ViewModel for a real-time hardware monitoring dashboard.";
12var result = pipe.Generate(prompt, config);
13
14Console.WriteLine(result);| Platform | Support Link |
|---|---|
| Global & India | Support via Razorpay |
