Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

SmolVLM-256M-Instruct-torchao-W4A8 – AI Model by Azaz666 | AlphaNeural AI

You can deploy this model and start earning money today!

Azaz666/
SmolVLM-256M-Instruct-torchao-W4A8

like

0

vision-language-model

HuggingFaceTB/SmolVLM-256M-Instruct

Views

No views yet

HuggingFaceTBSmolVLM-256M-Instructtorchao_w4a8

This is a torchao W4A8 (4-bit) quantized version of HuggingFaceTB/SmolVLM-256M-Instruct.

Quantization Details

Method: torchao W4A8
Bits: 4
Base model: HuggingFaceTB/SmolVLM-256M-Instruct
Weight bits: 4
Activation bits: 8 (dynamic)
Group size: 128
Backend: torchao (Int8DynamicActivationInt4Weight)

Usage

python

from transformers import AutoProcessor, AutoModelForImageTextToText
import torch

model = AutoModelForImageTextToText.from_pretrained(
    "{REPO_ID}",
    torch_dtype=torch.float16,
    device_map="auto",
    trust_remote_code=True,
)
processor = AutoProcessor.from_pretrained("{REPO_ID}", trust_remote_code=True)

Replace {REPO_ID} with the repo ID of this model.

Original Model

See HuggingFaceTB/SmolVLM-256M-Instruct for the original FP16 model.