Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

minimind-135m-cpt – AI Model by achavan1211 | AlphaNeural AI

You can deploy this model and start earning money today!

achavan1211/
minimind-135m-cpt

like

0

Views

No views yet

minimind-135m-cpt

Continued-pretrained MiniMind (135M) base language model.

Model details

Architecture: decoder-only Transformer (GPT-style), 12 layers / 768 dim / 12 heads, block size 512
Parameters: ~135M
Tokenizer: 32k byte-level BPE (tokenizer.json)
Continued-pretrained from an OpenWebText base on ~2.57B tokens (Wikipedia / Books / FineWeb-Edu / C4), ~1 epoch.
Val perplexity ~30.9 on the held-out mix.

Files

minimind_model.pt — native PyTorch checkpoint (dict with model_state_dict + config)
tokenizer.json / tokenizer_config.json / special_tokens_map.json

Load (native)

python

import torch
from <your_module> import MiniMind   # class definition lives in the training notebook
ck = torch.load('minimind_model.pt', map_location='cpu')
model = MiniMind(**ck['config'])
model.load_state_dict(ck['model_state_dict'])