This repository hosts the LoRA adapter for the LLaDA-8B-Instruct diffusion LLM (dLLM), produced with the CDLM (Consistency Diffusion Language Models) method. CDLM integrates consistency modeling and a block-wise causal attention mask so the student model becomes fully KV-cache compatible while retaining the strong local bidirectional modeling within each block. In practice, the adapter enables significantly faster inference with competitive quality.
This is a LoRA adapter, not a full model. You must load the base model and then attach this adapter. For best speedups, use the CDLM inference path in the accompanying codebase.
This adapter is released under the MIT License. The base model is governed by its own license; please ensure compliance with the base model’s terms.
1@article{kim2025cdlm,
2 title = {CDLM: Consistency Diffusion Language Models for Faster Sampling},
3 author = {Kim, Minseo and Xu, Chenfeng and Hooper, Coleman and Singh, Harman
4 and Athiwaratkun, Ben and Zhang, Ce and Keutzer, Kurt and Gholami, Amir},
5 journal = {arXiv preprint arXiv:2511.19269},
6 year = {2025},
7 url = {https://arxiv.org/abs/2511.19269}
8}
