Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
flux1-dev-modelopt-nvfp4-sglang-transformer – AI Model by BBuf | AlphaNeural AI
You can deploy this model and start earning money today!
BBuf
/
flux1-dev-modelopt-nvfp4-sglang-transformer
like
0
sglang
diffusers
safetensors
text-to-image
black-forest-labs/FLUX.1-dev
quantized
modelopt
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
FLUX.1-dev ModelOpt NVFP4 SGLang Transformer Override
This repository contains a mixed BF16 plus NVFP4 transformer override for black-forest-labs/FLUX.1-dev built for SGLang Diffusion.
What is inside
ModelOpt fp4 export of the FLUX.1-dev transformer
SGLang mixed-transformer post-processing for validated BF16 fallback layers
swap_weight_nibbles set to false in the quantization config for this validated export family
Intended usage
Keep the base FLUX.1-dev model separate
Download this transformer override locally
Load it with the transformer-path flag in SGLang
Example sglang generate --model-path black-forest-labs/FLUX.1-dev --transformer-path /path/to/this-repo --prompt-path /tmp/prompt.txt --num-gpus 4 --enable-torch-compile false
This is not a full standalone FLUX.1-dev model repo.
