Model Card for SQPsychLLM-8b-gemma-no_questionnaire
SQPsychLLM-8b-gemma-no_questionnaire is a chat model fine-tuned to roleplay a therapist in synthetic, Cognitive Behavioral Therapy (CBT)-informed counseling conversations. It is part of the SQPsychLLM family released with the paper Roleplaying with Structure: Synthetic Therapist-Client Conversation Generation from Questionnaires.
This checkpoint is Llama-3-8B-Instruct supervised-fine-tuned on SQPsychConv (Gemma, no-questionnaire ablation), the synthetic corpus generated by google/gemma-3-27b-it from real, de-identified structured client profiles. This is the no-questionnaire ablation: unlike the main models, the client agent was not conditioned on questionnaire scores (BDI, HAM-D) during data generation.
⚠️ Research use only. This model is not a medical device and not a substitute for professional mental-health care. It must not be deployed to interact with patients or anyone in distress without rigorous further validation and qualified clinical oversight. See Out-of-Scope Use.
Model Details
Model Description
Developed by: Doan Nam Long Vu and collaborators (Technical University of Darmstadt; Philipps-University Marburg; Justus Liebig University Giessen; University of Münster), released under the AIMH ("AI for Mental Health") organization
Funded by: LOEWE Center DYNAMIC (Hessian LOEWE program), grant LOEWE1/16/519/03/09.001(0009)/98
Model type: Decoder-only causal language model (instruction/chat), fine-tuned for therapist roleplay
Research on synthetic mental-health dialogue: generating therapist-side turns in CBT-style counseling conversations, studying privacy-preserving synthetic data, and benchmarking counseling-oriented language models. For the full questionnaire-conditioned, dual-agent (therapist + client) generation pipeline, see the code repository.
Downstream Use
As a starting point for further research fine-tuning, or as a component in supervised, human-in-the-loop training and education settings (e.g., clinician/student practice simulations) under appropriate oversight and ethics approval.
Out-of-Scope Use
This model must not be used to:
provide therapy, diagnosis, or any clinical decision to real people;
act as a crisis, emergency, or safety-critical support system;
interact with patients or people in distress without further validation, clinical supervision, and regulatory approval;
impersonate, or be presented as, a real licensed clinician.
Bias, Risks, and Limitations
Hallucination and unsafe output. Like all LLMs, it can produce incorrect, fabricated, or clinically inappropriate content, including advice that is not evidence-based.
Limited clinical scope. The conditioning data covers major depressive disorder; other conditions, comorbidities, severities, and acute-risk presentations are out of scope and underrepresented.
Limited population coverage. The source cohort's demographics, language, and cultural context constrain generalization.
Inherited bias. Outputs reflect biases of the base model (Llama-3-8B-Instruct) and of the model (google/gemma-3-27b-it) used to generate the training corpus.
Synthetic-vs-real gap. Generated dialogues may not capture the full complexity or risk dynamics of real clinical interactions.
Recommendations
Keep a qualified human professional in the loop for any applied use, validate on your own population, obtain your own ethics approval before any study involving people, and add explicit safety guardrails and crisis-resource handling in any interactive system. See the project ETHICS statement.
How to Get Started with the Model
python
1from transformers import AutoModelForCausalLM, AutoTokenizer
23model_id ="AIMH/SQPsychLLM-8b-gemma-no_questionnaire"4tokenizer = AutoTokenizer.from_pretrained(model_id)5model = AutoModelForCausalLM.from_pretrained(model_id, dtype="bfloat16", device_map="auto")67messages =[8{"role":"system","content":"You are an empathetic therapist conducting a CBT-informed session."},9{"role":"user","content":"I've felt down and unmotivated for weeks and I don't know why."},10]11inputs = tokenizer.apply_chat_template(12 messages, add_generation_prompt=True, return_tensors="pt"13).to(model.device)1415outputs = model.generate(inputs, max_new_tokens=512, temperature=0.7, do_sample=True)16print(tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True))
AIMH/SQPsychConv_gemma_no_questionnaire, synthetic therapist-client conversations generated by google/gemma-3-27b-it from the de-identified structured profiles of the cohort of Kircher et al. (2019), without questionnaire-score conditioning (the no-questionnaire ablation). The instruction-formatted split used for training is AIMH/SQPsychConv_gemma_no_questionnaire_finetune.
License and data provenance
The model weights derive from Llama-3-8B-Instruct (Llama 3 Community License). The training data was generated by google/gemma-3-27b-it, so Google's Gemma Terms of Use may apply to the synthetic data and to downstream use; review them before redistribution. The source structured data is de-identified and pre-anonymized, and the released conversations are synthetic and contain no personally identifiable information. Released for research only.
