Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

dream-transformer – AI Model by sato2ru | AlphaNeural AI

You can deploy this model and start earning money today!

sato2ru/
dream-transformer

like

0

text-generation

Views

No views yet

DreamTransformer

A language model that generates mid-scene with no start token and no narrative entry point.

Architecture

4 Transformer blocks, d_model=128, 4 heads
RoPE positional encoding — local order awareness, no global anchor
Random latent injection replaces BOS token
Local window attention (64 tokens) — simulates suppressed prefrontal coherence
Trained on DreamBank (~21K dream reports)
Parameters: 7.2M | Val loss: 4.2456 | Val PPL: 69.8

Quick start

python

import torch
ckpt = torch.load('dream_transformer.pt')
model.load_state_dict(ckpt['model_state'])
text = dream(model, temperature=1.3)