A 0.5B parameter model for next-edit autocomplete, quantized to Q8_0 GGUF format.
Sweep Next-Edit predicts your next code edit before you make it. It runs locally on your laptop in under 500ms (with speculative decoding) and outperforms models over 4x its size on next-edit benchmarks. More details
here.
1uv pip install llama-cpp-python huggingface_hub
2python run_model.py
The model uses a specific prompt format with file context, recent diffs, and current state to predict the next edit. See run_model.py for a complete example.
