LoRA adapter for Qwen/Qwen3-4B fine-tuned on the SPGI earnings call corpus for proactive response prediction in multi-party conversations. Given a conversational context and a current utterance, the model predicts whether a target speaker will SPEAK next or remain SILENT.

Model Details

Model type: LoRA adapter for causal language model (text classification / sequence classification)
Language(s): English
License: Apache 2.0
Finetuned from: Qwen/Qwen3-4B
SPGI2.0 Corpus: Earnings call transcripts from S&P Global SPGI2.0

Model Sources

Base model: Qwen/Qwen3-4B

How to Get Started with the Model

python

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-4B")
model = PeftModel.from_pretrained(base_model, "kraken07/qwen3-4b-spgi")
tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3-4B")

# Your input format should match training: context turns + current turn
# Output: SPEAK or SILENT prediction for the target speaker

Citation

If you use this model, please cite our work:

bibtex

@misc{bhagtani2026speakstaysilentcontextaware,
  title={Speak or Stay Silent: Context-Aware Turn-Taking in Multi-Party Dialogue},
  author={Bhagtani, Kratika and Anand, Mrinal and Xu, Yu Chen and Yadav, Amit Kumar Singh},
  year={2026},
  archivePrefix={arXiv},
  url={https://arxiv.org/abs/2603.11409}
}

ishiki-labs/qwen3-4b-spgi

Qwen3-4B-SPGI: Proactive Response Prediction in Multi-Party Dialogue

Model Details

Model Sources

How to Get Started with the Model

Citation

ishiki-labs/
qwen3-4b-spgi