You can deploy this model and start earning money today!

1anH/
MiniMax-M2.1-REAP-40-W4A16

Name: MiniMax-M2.1-REAP-40-W4A16
Availability: InStock

safetensors

minimax_m2

custom_code

0xSero/MiniMax-M2.1-139B

Views

No views yet

Reproduction

yaml

from auto_round import AutoRound
from auto_round.logger import logger as ar_logger

ar = AutoRound(
    './MiniMax-M2.1-REAP-40',
    device='cuda',
    device_map='auto',
    nsamples=128,
    seqlen=2048,
    batch_size=8,
    enable_torch_compile=False
)
ar.quantize_and_save('./MiniMax-M2.1-REAP-40-W4A16', format='auto_round')

Acknowledgments

REAP conversion by 0xSero
REAP implementation by Cerebras
Base model by MiniMax

1anH/MiniMax-M2.1-REAP-40-W4A16

Reproduction

Acknowledgments

1anH/
MiniMax-M2.1-REAP-40-W4A16