Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

olmo3-190m-zh-nano-continue – AI Model by HumanHarshezz | AlphaNeural AI

You can deploy this model and start earning money today!

HumanHarshezz/
olmo3-190m-zh-nano-continue

like

0

continued-pretraining

HumanHarshezz/olmo3-190m-zh-nano

Views

No views yet

olmo3-190m-zh-nano-continue

持续预训练版本：基于 HumanHarshezz/olmo3-190m-zh-nano，在 cmz1024/llm101-olmo3-zh-demo-data/continue 中文语料上继续训练约 700 步。

训练配置

起点模型：HumanHarshezz/olmo3-190m-zh-nano（作业1，从随机初始化训练）
学习率：2e-4（较基础预训练降低约 5×，防止灾难性遗忘）
Warmup：10%（更平缓地适应新数据分布）
LR 调度：cosine
loss 起点 ≈ 9.5（约等于作业1收敛点，因为权重非随机初始化）

用法

python

from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("HumanHarshezz/olmo3-190m-zh-nano-continue")
tok = AutoTokenizer.from_pretrained("HumanHarshezz/olmo3-190m-zh-nano-continue")