Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

olmo3-190m-zh-full-4000-continue – AI Model by jieying0729 | AlphaNeural AI

You can deploy this model and start earning money today!

jieying0729/
olmo3-190m-zh-full-4000-continue

like

0

continued-pretraining

jieying0729/olmo3-190m-zh-full-4000

Views

No views yet

jieying0729/olmo3-190m-zh-full-4000-continue

持续预训练版本：基于 jieying0729/olmo3-190m-zh-full-4000（基础预训练 4000 步，loss 4.09），在 full_v31 数据上继续训练 200 步（loss 8.79 → 5.53）。

训练配置

数据：cmz1024/llm101-olmo3-zh-demo-data/continue/full_v31.bin
LR：2e-4（低 LR 防止灾难性遗忘）
Warmup：10%

用法

python

from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("jieying0729/olmo3-190m-zh-full-4000-continue")
tok = AutoTokenizer.from_pretrained("jieying0729/olmo3-190m-zh-full-4000-continue")