How it reasons and decides (The Power of Deduction);
Its capacity to align with human values (The Ethical Boundary);
Its potential to adapt to future challenges (The Evolutionary Potential).
If a model pursues nothing but sheer scale or computational power, ignoring the depth and breadth of its logic, it risks becoming a "paper tiger"—imposing on the surface, yet hollow at its core. Conversely, a model built upon elegant logic, even with fewer parameters, can unleash its true vitality in our complex world."
DISCLAIMER
The content generated by this model is for reference purposes only. Users are advised to verify its accuracy independently before use.
This is a 20-billion-parameter foundation model (20B). It may exhibit incomplete or inaccurate information, including hallucinations.
If you find this AI too human-like, please remember: it is merely a more intelligent model — not an actual person.
Thanks mradermacher: For creating the GGUF versions of these models
QiMing-LongWriter-20B-MXFP4 is more than just a language model; it is a "Narrative Engine," architected from the ground up to understand and execute the logic of professional creative writing.
This model is built on a 20B parameter Mixture-of-Experts (MoE) architecture and has been quantized to MXFP4 format, enabling high-performance inference on consumer-grade hardware. Its most striking feature is a staggering 131,072-token theoretical context length, made possible by YaRN Rope Scaling, which unlocks the potential for epic-scale long-form storytelling.
However, its true power is revealed in its exceptional performance demonstrated within a practical 8,192-token window. This proves that its remarkable capabilities stem not from brute-force memory, but from its unique training methodology: "Process-Oriented Overfitting," a paradigm that teaches the model the 'how' of creation, not just the 'what'.
QiMing-LongWriter is a model built for the future, and its performance today is merely a glimpse of its vast potential.
Model Details
Model Type: 20B Parameter MoE Autoregressive Language Model
Special Training: Process-Oriented Overfitting based on the "Writer's Long-form Logic" framework
Languages: Primarily Chinese, with good support for English
Use Cases & Limitations
Intended Use Cases 📚
Novel & Story Writing: Rapidly generate outlines, chapter summaries, and first drafts for various genres (Fantasy, Sci-Fi, Mystery, etc.).
Screenplay & Outline Construction: Create detailed frameworks for multi-episode TV series and feature films, including character arcs, plot points, and synopses.
Game World-Building & Quest Design: Develop rich lore, faction backstories, character biographies, and narrative questlines for video games.
Brainstorming & Idea Expansion: Turn a vague idea into a structured and imaginative narrative path.
Limitations & Biases ⚠️
Hardware Dependency:This is the most critical limitation. The model's 131k token context potential requires a significant amount of VRAM to manage the KV cache. On most consumer or pro-grade hardware, users must set a more practical context length (e.g., 8k, 16k, or 32k) to avoid out-of-memory errors.
Non-Factual Nature: This model is optimized for creative writing. Factual information may be inaccurate or fabricated ("hallucinated"). It should not be used as an authoritative source for knowledge or fact-checking.
Requires Quality Prompts: The model's performance is highly correlated with the quality of the prompt. It is a powerful "executive writer" but needs you to be the "creative director." Providing clear structure, characters, and conflict will unlock its full potential.
Training Procedure
The core innovation of this model lies in its unique training paradigm. Instead of the traditional approach of learning from the "results" of massive text corpora, we focused on teaching the model the "process" of creation.
We constructed a structured creation framework named the "Writer's Long-form Logic," which deconstructs the professional writing process into logical modules (e.g., Genesis Core, Architect Agent, Dramatist Agent). Using a method we term "Process-Oriented Overfitting," we guided the model to deeply learn and internalize this creative workflow, making it an instinct.
The result is a model that instinctively thinks in terms of structure when faced with a creative task. This explains why it maintains long-range logical coherence even within a limited context window—its intelligence stems more from its intrinsic "methodology" than from a vast "memory."
Highlights
Permissive Apache 2.0 license: Build freely without copyleft restrictions or patent risk—ideal for experimentation, customization, and commercial deployment.
Configurable reasoning effort: Easily adjust the reasoning effort (low, medium, high) based on your specific use case and latency needs.
Full chain-of-thought: Gain complete access to the model’s reasoning process, facilitating easier debugging and increased trust in outputs. It’s not intended to be shown to end users.
Fine-tunable: Fully customize models to your specific use case through parameter fine-tuning.
Agentic capabilities: Use the models’ native capabilities for function calling, web browsing, Python code execution, and Structured Outputs.
MXFP4 quantization: The models were post-trained with MXFP4 quantization of the MoE weights, making QiMing-LongWriter-20B-MXFP4 model run within 16GB of memory. All evals were performed with the same MXFP4 quantization.
Inference examples
Transformers
You can use QiMing-LongWriter-20B-MXFP4 with Transformers. If you use the Transformers chat template, it will automatically apply the harmony response format. If you use model.generate directly, you need to apply the harmony format manually using the chat template or use our openai-harmony package.
To get started, install the necessary dependencies to setup your environment:
pip install -U transformers kernels torch
Once, setup you can proceed to run the model by running the snippet below:
py
1from transformers import pipeline
2import torch
34model_id ="aifeifei798/QiMing-LongWriter-20B-MXFP4"56pipe = pipeline(7"text-generation",8 model=model_id,9 torch_dtype="auto",10 device_map="auto",11)1213prompt ="""
14Outline the core plot for a tomb-raiding adventure story:
15Protagonist: A seasoned but greedy tomb raider.
16Setting: A cursed ancient tomb in Chang'an.
17Core Event: The protagonist encounters supernatural monsters and intricate traps.
18Ending Requirement: The protagonist narrowly escapes with their life, but fails to secure any treasure.
19Design a key turning point for the protagonist's escape.
20"""2122messages =[23{"role":"user","content": prompt},24]2526outputs = pipe(27 messages,28 max_new_tokens=2560,29)30print(outputs[0]["generated_text"][-1])
Alternatively, you can run the model via Transformers Serve to spin up a OpenAI-compatible webserver:
vLLM recommends using uv for Python dependency management. You can use vLLM to spin up an OpenAI-compatible webserver. The following command will automatically download the model and start the server.
