phi-4-4bit-bnb – AI Model by fhamborg | AlphaNeural AI

You can deploy this model and start earning money today!

Phi-4 GPTQ (4-bit Quantized)

Model

Model Description

This is a 4-bit quantized version of the Phi-4 transformer model, optimized for efficient inference while maintaining performance.

Intended Use

Fast inference with minimal VRAM usage
Deployment in resource-constrained environments
Optimized for low-latency text generation

Model Details

Attribute	Value
Model Name	Phi-4 GPTQ
Quantization	4-bit (GPTQ)
File Format	`.safetensors`
Tokenizer	`phi-4-tokenizer.json`
VRAM Usage	~X GB (depending on batch size)