Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

mixsft-normal-smollm-1p7b-500B-30n-2048sl-960gbsz – AI Model by Raghav-Singhal | AlphaNeural AI

You can deploy this model and start earning money today!

Raghav-Singhal/
mixsft-normal-smollm-1p7b-500B-30n-2048sl-960gbsz

like

0

HuggingFaceH4/ultrachat_200k

allenai/wildjailbreak

allenai/wildguardmix

Raghav-Singhal/normal-smollm-1p7b-500B-30n-2048sl-960gbsz

Views

No views yet

mixsft-normal-smollm-1p7b-500B-30n-2048sl-960gbsz

Full-model SFT of normal-smollm-1p7b-500B-30n-2048sl-960gbsz on a shuffled mixture:

HuggingFaceH4/ultrachat_200k (train_sft) — 207,865 rows
allenai/wildjailbreak (train) — 261,559 rows
allenai/wildguardmix (wildguardtrain) — 37,934 rows (prompt + response pairs only)

Total: 507,358 training examples, response-only masked, SmolLM2 chat template.

Training

LR: 1e-5, cosine with min_lr_ratio=0.1, warmup_ratio=0.03
Epochs: 1
Seq length: 2048
Effective batch: 128 (mbs=1, grad_accum=8, 16 GPUs)
Precision: bf16, flash-attention-2