You can deploy this model and start earning money today!

ShubhaLabs/
quantized_qwen_model

Name: quantized_qwen_model
Availability: InStock

qwen2

Qwen/Qwen2.5-0.5B-Instruct

finetune

apache-2.0

Views

No views yet

Quantized Qwen Model

This repository contains a quantized version of the Qwen model for causal language modeling.

Model Details

Model Type: Qwen2ForCausalLM
Quantization: Dynamic Quantization

Usage

You can load this model using the Hugging Face Transformers library:

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("ShubhaLabs/quantized_qwen_model")
tokenizer = AutoTokenizer.from_pretrained("ShubhaLabs/quantized_qwen_model")