yichunkuo/
Llama-2-7b-hf-gptq

Name: Llama-2-7b-hf-gptq
Availability: InStock

Views

No views yet

GPTQ quantized falcon-rw-1b

Branch	Bits	GS	Act Order	Damp %	GPTQ Dataset	Seq Len	Size	ExLlama	Desc
main	4	None	No	0.01	c4	4096	--	No	4-bit, without Act Order and no grouop size.

yichunkuo/Llama-2-7b-hf-gptq