A QLoRA adapter for EXAONE 4.0-32B that drafts Korean government civil complaint responses with the appropriate tone, structure, and regulatory awareness.
South Korean government civil servants handle thousands of citizen complaints daily. Each response requires understanding citizen intent, searching relevant regulations across multiple systems, drafting in an appropriate administrative tone, and citing legal grounds -- all for a single complaint. Most of this work is repetitive, yet demands precision and empathy.
GovOn is an agentic CLI shell built with LangGraph that automates this pipeline while keeping the human in full control. Every AI action requires explicit approval before execution. This adapter is the component responsible for generating draft responses to citizen complaints, designed to be dynamically loaded only when needed.
Architecture: Where This Adapter Fits
GovOn uses a Multi-LoRA architecture where the base model handles planning and intent classification, while specialized adapters are attached per-request for specific capabilities.
User Query
|
v
[session_load] --> [planner (base EXAONE 4.0-32B)]
|
[approval_wait] -- human approves -->
|
[tool_execute]
/ \
civil-adapter legal-adapter
(this model) (legal citations)
\ /
[synthesis]
|
[persist] --> Response to citizen
Base model: EXAONE 4.0-32B handles intent classification and tool selection
This adapter: Dynamically attached only when drafting citizen complaint responses
Legal adapter: A companion LoRA for legal citation augmentation (govon-legal-adapter)
Serving: vLLM with per-request LoRA switching (Multi-LoRA)
Quick Start
Standalone with PEFT
python
1from peft import PeftModel
2from transformers import AutoModelForCausalLM, AutoTokenizer
34base = AutoModelForCausalLM.from_pretrained(5"LGAI-EXAONE/EXAONE-4.0-32B",6 torch_dtype="bfloat16",7 device_map="auto",8 trust_remote_code=True,9)10model = PeftModel.from_pretrained(base,"umyunsang/govon-civil-adapter")11tokenizer = AutoTokenizer.from_pretrained("umyunsang/govon-civil-adapter")1213messages =[14{"role":"system","content":"당신은 대한민국 정부 민원 상담 전문가입니다. 시민의 질문에 정확하고 친절하게 답변해 주세요."},15{"role":"user","content":"주민등록증 재발급 절차를 알려주세요."},16]1718input_ids = tokenizer.apply_chat_template(19 messages, tokenize=True, add_generation_prompt=True, return_tensors="pt"20)21output = model.generate(input_ids.to(model.device), max_new_tokens=512)22print(tokenizer.decode(output[0], skip_special_tokens=True))
This adapter was trained on umyunsang/govon-civil-response-data, derived from AI Hub Dataset 71852 (Korean Public Civil Complaint QA). Administrative law data (Dataset 71847) was intentionally excluded and reserved for the companion legal-adapter.
Training used the EXAONE 4.0 native chat template via tokenizer.apply_chat_template() with the following system prompt:
당신은 대한민국 정부 민원 상담 전문가입니다. 시민의 질문에 정확하고 친절하게 답변해 주세요.
Intended Use and Limitations
Intended use
Drafting responses to Korean government civil complaints within the GovOn agentic workflow
Research and experimentation with domain-adapted Korean language models
Educational exploration of LoRA fine-tuning for government NLP tasks
Limitations
This adapter generates draft responses only. Human review is mandatory before any response is sent to citizens.
Quality may degrade for complaint types outside the training data distribution.
Designed specifically for Korean language government civil complaint responses. Performance on other languages or domains is not guaranteed.
For legal citation and evidence augmentation, use the companion legal-adapter.
The base model license permits non-commercial use for research and education. Commercial deployment is available through the FriendliAI platform. The base model may not be used to develop models that compete with EXAONE. For commercial licensing inquiries, contact contact_us@lgresearch.ai.
Users must comply with both licenses when using this adapter.