Views
No views yet
[CL] token to the syntax.generation_config.json is locked to do_sample: False and temperature: 0.0 to ensure the same input always produces the same output.emirkaanozdemr/bash_command_data_6K dataset. The data was restructured into a rigid non-linguistic format:
[NL] {Natural Language Prompt} [CL] {Bash Command} [END][NL] find all files larger than 100MB in the current directory [CL]1from transformers import AutoModelForCausalLM, AutoTokenizer
2
3model_id = "saadxsalman/SS-Talk-2-Bash"
4tokenizer = AutoTokenizer.from_pretrained(model_id)
5model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto")
6
7prompt = "[NL] list all files in long format [CL]"
8inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
9
10outputs = model.generate(**inputs, max_new_tokens=64)
11print(tokenizer.decode(outputs[0], skip_special_tokens=True))[NL] or [CL] tokens are omitted, the model performance will degrade significantly.| Parameter | Value |
|---|---|
| Learning Rate | $1 \times 10^{-4}$ |
| Optimizer | Paged AdamW 8-bit |
| LoRA R | 64 |
| LoRA Alpha | 128 |
| Batch Size | 16 (4 per device $\times$ 4 grad accum) |
| Precision | Mixed Precision (FP16) |