Dolphin-Coder dataset – a high-quality collection of 100,000+ coding questions and responses. It's perfect for supervised fine-tuning (SFT), and teaching language models to improve on coding-based tasks.

Finetuning Details:

With the utilization of MonsterAPI's no-code LLM finetuner, this finetuning:

Was achieved with great cost-effectiveness.
Completed in a total duration of 15hr 36mins for 1 epochs using an A6000 48GB GPU.
Costed $31.51 for the entire 1 epoch.

Hyperparameters & Additional Details:

Epochs: 1
Cost Per Epoch: $31.51
Model Path: mistralai/Mistral-7B-v0.1
Learning Rate: 0.0002
Data Split: 100% train
Gradient Accumulation Steps: 128
lora r: 32
lora alpha: 64

license: apache-2.0

monsterapi/mistral_7b_DolphinCoder

Finetuning Overview:

Dataset Insights:

Finetuning Details:

Hyperparameters & Additional Details:

monsterapi/
mistral_7b_DolphinCoder