Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

gpt2-scratch-small-ftn-baseline – AI Model by WyvernAI | AlphaNeural AI

You can deploy this model and start earning money today!

WyvernAI/
gpt2-scratch-small-ftn-baseline

like

0

text-generation

causal-language-modeling

scratch-trained

text-generation-inference

endpoints_compatible

Views

No views yet

GPT-2 Scratch Small FTN Baseline

Scratch-trained small GPT-2 baseline used for FTN comparisons on TinyStories.

This checkpoint is the small scratch GPT-2 baseline used for FTN comparison experiments.

Training summary

Layers: 4
Hidden size: 256
Heads: 4
Context length: 256
Best validation loss: 3.590700
Best epoch: 10

Files

standard Hugging Face GPT-2 weights and config
metrics_summary.json
metrics_history.csv
samples.json / samples.txt

Load the model

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained('.')
tokenizer = AutoTokenizer.from_pretrained('.')