You can deploy this model and start earning money today!

DSAiLab/
llama2-70b-gptq-4bit-32g

Base Model: LLaMA2-70B
Quantization Type: GPTQ 4bit
Group Size: 32
Bits: 4bit (int4)
Activation Ordering: Enabled
Quantization Format: AutoGPTQ compatible
지원 프레임워크: vLLM, SGLang

Name: llama2-70b-gptq-4bit-32g
Availability: InStock

Views

No views yet

LLaMA2-70B-GPTQ-4bit-32g

본 모델은 Meta의 LLaMA2-70B 모델을 기반으로 GPTQ 방식으로 4bit 양자화된 버전입니다.