Views
No views yet


| Property | Value |
|---|---|
| Base model | microsoft/Phi-3-mini-4k-instruct |
| Fine-tuned for | Logical Reasoning |
| Dataset | lucasmccabe/logiqa |
| Technique | LoRA fine-tuning, merged for direct use |
| Formats available | Full (HF Transformers) + Quantized (.gguf for llama.cpp / Ollama) |
| Project | Circuit |
| Fine-tuned by | Rudransh |
| Variant | Description | File |
|---|---|---|
| Full model | Merged LoRA with base, compatible with transformers | pytorch_model.bin |
| Quantized model (GGUF) | Optimized for CPU/GPU inference via llama.cpp, text-generation-webui, or Ollama | circuit_phi3_q4.gguf |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2import torch
3
4model = AutoModelForCausalLM.from_pretrained(
5 "rudranshjoshi/circuit",
6 torch_dtype=torch.float16,
7 trust_remote_code=True
8)
9tokenizer = AutoTokenizer.from_pretrained(
10 "rudranshjoshi/circuit",
11 trust_remote_code=True
12)
13
14device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
15model.to(device)
16
17prompt = "Your prompt here"
18inputs = tokenizer(prompt, return_tensors="pt").to(device)
19outputs = model.generate(**inputs, max_new_tokens=150)
20print(tokenizer.decode(outputs[0], skip_special_tokens=True))
21