Beta

Explore
Marketplace
Neural Labs
Playground
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

switch-tokenizer-exp-1 – AI Model by hardesttype | AlphaNeural AI

You can deploy this model and start earning money today!

hardesttype/
switch-tokenizer-exp-1

like

0

Views

No views yet

Switchable Tokenizer Experiment Results

Experiment Settings

Base model: gpt2-medium
English tokenizer: gpt2
Russian tokenizer: ai-forever/ruGPT-3.5-13B

Results Overview

This repository contains:

Final trained models (no checkpoints)
Tokenizers
Performance plots (perplexity, tokenization efficiency, training losses)
Detailed results in experiment1_results.txt

For more details on the implementation, visit the Switch-Tokenizer project repository.