Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

olmo3-190m-zh-full-4000 – AI Model by jieying0729 | AlphaNeural AI

You can deploy this model and start earning money today!

jieying0729/
olmo3-190m-zh-full-4000

like

0

jieying0729/olmo3-190m-zh-full-4000

Views

No views yet

OLMo3-190M-zh-full-4000

为零基础 AI 大模型研发训练营（llm001）L04 Full 模型（190M 参数，4000 步训练）。

模型配置

hidden_size: 768, num_layers: 12, num_heads: 12, intermediate_size: 3072
vocab_size: 48000, sliding_window: 4096

训练配置

数据：cmz1024/llm101-olmo3-zh-demo-data (500M tokens)
训练：H100, max_steps=4000, bs=24×5=120, lr=5e-4, bf16
train/loss: 4.09, val/loss: 3.99

用法

python

from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("jieying0729/olmo3-190m-zh-full-4000")
tok = AutoTokenizer.from_pretrained("jieying0729/olmo3-190m-zh-full-4000")