Views
No views yet
bhushanrocks/supportpal-dialoGPTmicrosoft/DialoGPT-medium| Parameter | Value |
|---|---|
| Base Model | DialoGPT-medium |
| Dataset | EmpatheticDialogues |
| Training Epochs | 1 per chunk (≈9 total) |
| Batch Size | 2 |
| Gradient Accumulation | 4 |
| Learning Rate | 5e-5 |
| Warmup Steps | 50 |
| Optimizer | AdamW |
| Precision | FP16 |
| Framework | 🤗 Transformers + PEFT |
| Hardware | NVIDIA T4 (Google Colab) |
| Metric | Before Fine-tuning | After Fine-tuning |
|---|---|---|
| Empathy (Human-rated) | 4.2 | 8.3 |
| Coherence | 5.1 | 8.0 |
| Tone Appropriateness | 4.8 | 8.5 |
| Rouge-L | ↑ 0.37 | |
| BLEU | ↑ 0.21 |
1from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline
2
3model_id = "bhushanrocks/supportpal-dialoGPT"
4tokenizer = AutoTokenizer.from_pretrained(model_id)
5model = AutoModelForCausalLM.from_pretrained(model_id)
6
7chatbot = pipeline("text-generation", model=model, tokenizer=tokenizer, max_new_tokens=150)
8
9prompt = "I’ve been feeling really lonely lately."
10response = chatbot(prompt, do_sample=True, temperature=0.7, top_k=50)[0]["generated_text"]
11print(response)