Views
No views yet
deepseek-ai/deepseek-coder-6.7b-instruct| Parameter | Value |
|---|---|
| Learning Rate | 2e-4 |
| LoRA Rank (r) | 16 |
| LoRA Alpha | 32 |
| Dropout | 0.05 |
| Scheduler | Cosine |
| Warmup | 3% |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model = AutoModelForCausalLM.from_pretrained(
4 "<your-username>/bugfixer-deepseek-6.7b",
5 torch_dtype="auto",
6 device_map="auto"
7)
8
9tokenizer = AutoTokenizer.from_pretrained(
10 "<your-username>/bugfixer-deepseek-6.7b"
11)1prompt = """### Instruction:
2Fix the bug in the following code.
3
4### Buggy Code:
5def is_even(n):
6 return n % 2 = 0
7
8### Fixed Code:
9"""
10
11inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
12outputs = model.generate(**inputs, max_new_tokens=100)
13
14print(tokenizer.decode(outputs[0], skip_special_tokens=True))<your-username>/bugfixer-deepseek-6.7b-adapter<your-username>/bugfixer-deepseek-6.7b1@misc{bugfixer_deepseek_6_7b,
2 title={BugFixer-DeepSeek-6.7B},
3 author={<your-name>},
4 year={2026},
5 note={Fine-tuned on CodeXGLUE dataset using LoRA}
6}