Views
No views yet
git,tar, ssh, general Unix commands and basic 'sed' and 'grep' commands. Ideal for use in AI assistants, terminal copilots, or educational tools.1from transformers import AutoTokenizer, AutoModelForCausalLM
2from peft import PeftModel
3
4tokenizer = AutoTokenizer.from_pretrained("prital27/tinyllama-lora-cli-utils")
5base = AutoModelForCausalLM.from_pretrained("TinyLlama/TinyLlama-1.1B-Chat-v1.0")
6model = PeftModel.from_pretrained(base, "prital27/tinyllama-lora-cli-utils")
7
8prompt = "### Question:\nHow do I search for TODOs recursively?\n\n### Answer:\n"
9inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
10outputs = model.generate(**inputs, max_new_tokens=50)
11print(tokenizer.decode(outputs[0]))
12
13
14## Training Details
15
16### Training Data
17
18<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
19
20[More Information Needed]
21
22### Training Procedure
23
24<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
25
26#### Preprocessing [optional]
27
28[More Information Needed]
29
30
31#### Training Hyperparameters
32
33Precision: fp16 mixed precision
34
35Epochs: 3
36
37Batch Size: 2 (gradient accumulation = 2)
38
39Learning Rate: 2e-4
40#### Speeds, Sizes, Times [optional]
41
42<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
43
44[More Information Needed]
45
46## Evaluation
47
48<!-- This section describes the evaluation protocols and provides the results. -->
49
50### Testing Data, Factors & Metrics
51
52#### Testing Data
53
54<!-- This should link to a Dataset Card if possible. -->
55
56[More Information Needed]
57
58#### Factors
59
60<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
61
62[More Information Needed]
63
64#### Metrics
65
66<!-- These are the evaluation metrics being used, ideally with a description of why. -->
67
68[More Information Needed]
69
70### Results
71
72Accuracy on direct prompts: ~85%
73
74Basic shell command correctness: high
75
76Limitations on multi-line/bash scripting: present
77
78#### Summary
79
80The model reliably suggests shell commands for common CLI tasks. Performance degrades on ambiguous prompts or complex multi-line scripts.
81
82## Model Examination [optional]
83
84<!-- Relevant interpretability work for the model goes here -->
85
86[More Information Needed]
87
88## Environmental Impact
89
90<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
91
92Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
93
94- **Hardware Type:** [More Information Needed]
95- **Hours used:** [More Information Needed]
96- **Cloud Provider:** [More Information Needed]
97- **Compute Region:** [More Information Needed]
98- **Carbon Emitted:** [More Information Needed]
99
100## Technical Specifications [optional]
101
102### Model Architecture and Objective
103
104[More Information Needed]
105
106### Compute Infrastructure
107
108[More Information Needed]
109
110#### Hardware
111
112[More Information Needed]
113
114#### Software
115
116[More Information Needed]
117
118## Citation [optional]
119
120<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
121
122**BibTeX:**
123
124[More Information Needed]
125
126**APA:**
127
128[More Information Needed]
129
130## Glossary [optional]
131
132<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
133
134[More Information Needed]
135
136## More Information [optional]
137
138[More Information Needed]
139
140## Model Card Authors [optional]
141
142[More Information Needed]
143
144## Model Card Contact
145
146[More Information Needed]
147### Framework versions
148
149- PEFT 0.15.2