SpecBundle is an open-source initiative, jointly driven by the community and industry, to democratize speculative decoding by providing high-performance speculative decoding draft weights for mainstream open-source models.

Regenerated the responses in the mlabonne/open-perfectblend and trained the model on 1.4M data samples for 2 epochs. This checkpoint was trained using the SpecForge framework.

You can use this checkpoint with the command below.

This checkpoint exhibits superior performance on various benchmarks.