Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

occiglot5 – AI Model by GermanT5 | AlphaNeural AI

You can deploy this model and start earning money today!

GermanT5/
occiglot5

like

0

occiglot/occiglot-fineweb-v1.0

HuggingFaceFW/fineweb

HuggingFaceFW/fineweb-edu

Views

No views yet

Occiglot5

Occiglot5

Occiglot5 is a modern T5 model for German with 1.42B parameters and the following features:

Pretrained on the German Occiglot FineWeb corpus (except deWaC and Open Legal Data) and on the 10BT subsets of FineWeb and FineWeb-Edu
UL2 is used as pretraining objective
Efficient T5 architecture from the "Scale Efficiently" paper is used
Pretrained for 5M steps using a batch size of 128 and an input/output sequence length of 512
One-shot training on a v4-32 TPU Pod for 22.3 days without any crashes

Acknowledgments

Research supported with Cloud TPUs from Google's TPU Research Cloud (TRC). Many Thanks for providing access to the TPUs over many years ❤️

Made from Bavarian Oberland with ❤️ and 🥨.