Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
FluxKlein4b-nvfp4_mixed – AI Model by ApacheOne | AlphaNeural AI
You can deploy this model and start earning money today!
ApacheOne
/
FluxKlein4b-nvfp4_mixed
like
0
custom
art
en
black-forest-labs/FLUX.2-klein-4B
quantized
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Just some testing
Pin down what is needed between 50s,40s,30s cards
Translate info for use in TensorRT fp4 converting / onnx
Anyone that has made fp4 onnx before with NVIDIA’s Model Optimizer PTQ help in the Community tab is welcomed.
Currently working on correct Quantize/Dequantize nodes for onnx export to build fp4 RT engine for 50s cards.
Klein 4B NVFP4 Variants —
txt_attn
dtype notes
Klein4b-nvfp4.safetensors
txt_attn
weights:
NVFP4
Klein4b-nvfp4_BF16.safetensors
txt_attn
weights:
BF16
Klein4b-nvfp4_fp8e4m3fn_absmax.safetensors
txt_attn
weights:
FP8 (float8_e4m3fn)
txt_attn
scaling:
absmax
Klein4b-nvfp4_fp8e5m2_absmax.safetensors
txt_attn
weights:
FP8 (float8_e5m2)
txt_attn
scaling:
absmax
