Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

hubertusz-small-wiki – AI Model by SzegedAI | AlphaNeural AI

You can deploy this model and start earning money today!

SzegedAI/
hubertusz-small-wiki

like

0

generated_from_keras_callback

endpoints_compatible

Views

No views yet

hubert-small-wiki

This model was trained from scratch on the Wikipedia subset of Hungarian Webcorpus 2.0 with MLM and SOP tasks.

Pre-Training Parameters:

First phase:

Training steps: 500.000
Sequence length: 128
Batch size: 1024

Second phase:

Training steps: 100.000
Sequence length: 512
Batch size: 384

Framework versions

Transformers 4.21.3
TensorFlow 2.10.0
Datasets 2.4.0
Tokenizers 0.12.1

Acknowledgement

Artificial Intelligence - National Laboratory - Hungary