Paper | GitHub | Blog | Demo
This repository contains the pseudo-trajectory distillation data presented in the paper "d3LLM: Ultra-Fast Diffusion LLM using Pseudo-Trajectory Distillation".
d3LLM (pseuDo-Distilled Diffusion LLM) is a novel framework for building ultra-fast diffusion language models with negligible accuracy degradation. This dataset provides the pseudo-trajectory data extracted from teacher models, enabling the… See the full description on the dataset page:
https://huggingface.co/datasets/d3LLM/trajectory_data_llada_32.