This model was quantised primarily for use with OpenMarker — an open source AI assistant designed to help professors, lecturers, and educators automatically grade and review student work.

OpenMarker uses local quantised models so that:

No student data is sent to external APIs
It runs fully offline and privately
Anyone can self-host it for free

👉 https://github.com/theDALEX/openmarker

📦 Quant Details

Quant	Size	Description
Q4_K_M	~2GB	Good quality, recommended for most use cases

Quantised using llama.cpp on Windows.

🔗 Original Model

Original weights: meta-llama/Llama-3.2-3B-Instruct
Original license: Llama 3.2 Community License
Changes made: None — weights are unchanged beyond quantisation

dalexdavis/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Llama-3.2-3B-Instruct GGUF (Q4_K_M)

🎓 About OpenMarker

📦 Quant Details

🔗 Original Model

dalexdavis/
Llama-3.2-3B-Instruct-Q4_K_M-GGUF