You can deploy this model and start earning money today!

gist-sparse-attention/
GSA-FT-Llama-3.2-1B-chunk8

Name: GSA-FT-Llama-3.2-1B-chunk8
Availability: InStock

Views

No views yet

GSA-FT-Llama-3.2-1B-chunk8

This model is fine-tuned from gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk8 using Gist Sparse Attention (GSA) with chunk size chunk8.

GSA: Gist Sparse Attention via Learnable Compression and Selective Unfolding

Field	Value
Base model	gist-sparse-attention/GSA-PT-Llama-3.2-1B-chunk8
Training type	Supervised Fine-Tuning
Chunk size	chunk8
Architecture	Llama-3.2-1B