• Model creator: https://huggingface.co/LuxAI-CIn-Softex/
• Original model: https://huggingface.co/LuxAI-CIn-Softex/SFT1-Gemma-2-2B/

Original model description:

• llama-factory

Model Card for Model ID

Model Details

Model Description

• Developed by: [More Information Needed]
• Funded by [optional]: [More Information Needed]
• Shared by [optional]: [More Information Needed]
• Model type: [More Information Needed]
• Language(s) (NLP): [More Information Needed]
• License: [More Information Needed]
• Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

• Repository: [More Information Needed]
• Paper [optional]: [More Information Needed]
• Demo [optional]: [More Information Needed]

Uses

Direct Use

Downstream Use [optional]

Out-of-Scope Use

Bias, Risks, and Limitations

Recommendations

How to Get Started with the Model

Training Details

Training Data

Training Procedure

Preprocessing [optional]

Training Hyperparameters

"stage":"sft",  
"do_train": true,
"model_name_or_path":"google/gemma-2-2b-it",
"dataset":"glaive_rag_v1",  
"template":"gemma",
"finetuning_type":"lora",  
"lora_target":"all",  
"output_dir":"gemma_lora",
"per_device_train_batch_size":2,  
"gradient_accumulation_steps":4,  
"lr_scheduler_type":"cosine",
"logging_steps":10,  
"warmup_ratio":0.1,  
"save_steps":1000,  
"learning_rate":5e-5,
"num_train_epochs":3.0,  
"max_samples":500,  
"max_grad_norm":1.0,  
"quantization_bit":4,  
"loraplus_lr_ratio":16.0,  
"fp16": true

• Training regime: [More Information Needed]

Speeds, Sizes, Times [optional]

Evaluation

Testing Data, Factors & Metrics

Testing Data

Factors

Metrics

Results

Summary

Model Examination [optional]

Environmental Impact

• Hardware Type: [More Information Needed]
• Hours used: [More Information Needed]
• Cloud Provider: [More Information Needed]
• Compute Region: [More Information Needed]
• Carbon Emitted: [More Information Needed]

Technical Specifications [optional]

Model Architecture and Objective

Compute Infrastructure

Hardware

Software

Citation [optional]

Glossary [optional]

More Information [optional]

Model Card Authors [optional]

Model Card Contact