You can deploy this model and start earning money today!

pat883/
w4a8-fp8-wmma

Name: w4a8-fp8-wmma
Availability: InStock

Views

No views yet

W4A8-FP8 WMMA Dense + MoE GEMM (RDNA4/gfx1200+gfx1201)

W4A8-FP8 WMMA dense GEMM and MoE GEMM (fat binary for gfx1200 + gfx1201).

Built with kernel-builder for AMD RDNA4 (gfx1201). Load with the kernels library:

python

from kernels import get_kernel
kernel = get_kernel("pat883/w4a8-fp8-wmma")

Requires a ROCm PyTorch build (torch 2.10 / ROCm 7.x) on an RDNA4 card. Built variants: torch210-cxx11-rocm70 and torch210-cxx11-rocm71.