Beta

Explore
Marketplace
Neural Labs
Playground
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

Wiola360M – AI Model by oscowlai | AlphaNeural AI

You can deploy this model and start earning money today!

oscowlai/
Wiola360M

like

0

text-generation

causal-language-model

Views

No views yet

Wiola-360M

Wiola-360M is a 360 million parameter decoder-only language model developed by OSCOWL AI.

Architecture

Wiola introduces several architectural improvements over a standard Transformer decoder:

Grouped Query Attention (GQA)
Spiral Rotary Positional Encoding (SRPE)
Adaptive Token Merging (ATM)
Gated Cross Layer Attention (GCLA)
Dual Stream Feed Forward (DSFF)

Model

Parameters: 360M
Context Length: 2048
Vocabulary Size: 32000
Attention Heads: 16
Key/Value Heads: 4

Usage

python

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained(
    "oscowlai/Wiola360M",
    trust_remote_code=True,
)

model = AutoModelForCausalLM.from_pretrained(
    "oscowlai/Wiola360M",
    trust_remote_code=True,
)

License

Apache-2.0