Model Card for Model ID

Model Details

Model Description

• Developed by: [More Information Needed]
• Funded by [optional]: [More Information Needed]
• Shared by [optional]: [More Information Needed]
• Model type: [More Information Needed]
• Language(s) (NLP): [More Information Needed]
• License: [More Information Needed]
• Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

• Repository: [More Information Needed]
• Paper [optional]: [More Information Needed]
• Demo [optional]: [More Information Needed]

Uses

Direct Use

Downstream Use [optional]

Out-of-Scope Use

Bias, Risks, and Limitations

Recommendations

How to Get Started with the Model

Training Details

Training Data

• halilibr/collected-turkish-instructions-v0.1

Training Hyperparameters

• Training Arguments:
  • per_device_train_batch_size: 1
  • gradient_accumulation_steps: 4
  • warmup_steps: 2
  • max_steps: 300
  • learning_rate: 2e-4
  • fp16: True
  • weight_decay: 1e-3
  • logging_steps: 1
  • output_dir: "outputs"
  • optim: "paged_adamw_8bit"
• Lora Configuration:
  • r: 8
  • target_modules: ["q_proj", "o_proj", "k_proj", "v_proj", "gate_proj", "up_proj", "down_proj"]
  • task_type: "CAUSAL_LM"

Model Card Authors

Model Card Contact