RtaForge OPC Private Limited · ANVAYA Sovereign AI Research
Beta research release.
Overview
Architecture
RtaSSM v7.4 ("Tungsten")
Model Type
State Space Language Model
Parameters
2.7 Billion
Layers
64
Hidden Size
2560
Tokenizer
EleutherAI GPT-NeoX (50,280 vocabulary)
Release
0.5TG-beta
License
Anvaya Model License — free for individual personal/research use; revenue-gated for organizational use; resale/bundling requires permission
Summary
Rabbit 2.7B is the first public release built on the Tungsten (RtaSSM v7.4) architecture.
This release establishes the Tungsten training baseline for future TG releases and supersedes earlier prototype checkpoints.
Version 0.5TG-beta is intended as a stable engineering milestone and reference checkpoint for continued training and evaluation, not a finished, production-grade model.
Architecture
Rabbit belongs to the RtaSSM family of state-space language models developed by RtaForge.
The Tungsten architecture represents the current production training stack used within the ANVAYA research program and serves as the foundation for future Rabbit development.
Training
Training is performed using RtaForge's Rust-native training stack.
Current training features include:
Tungsten training architecture
Constitutional training validation
Multi-phase curriculum training
Future releases continue curriculum expansion and instruction tuning.
Checkpoint
base/
Anavya-Rabbit-2.7B-0.5TG-beta.pt
Context
Current release status:
Capability
Status
Training
✅
Continued Training
✅
4K Context Training
✅ Verified
8K Context Training
Active engineering work
Baseline Evaluation
The following results provide a baseline for future Tungsten releases.
Task
Metric
Score
ARC Challenge
Accuracy
0.3379
ARC Challenge
Normalized Accuracy
0.3703
ARC Easy
Accuracy
0.6616
ARC Easy
Normalized Accuracy
0.5833
HellaSwag
Accuracy
0.4583
HellaSwag
Normalized Accuracy
0.6063
WinoGrande
Accuracy
0.6164
Future releases will publish comparisons against previous Rabbit checkpoints and additional public benchmarks.
Historical Releases
Earlier Rabbit prototype checkpoints are retained for historical reference but are not recommended as starting points for continued training.
Tungsten (v0.5TG-beta) is the supported baseline for all future TG releases.
Roadmap
Release
Focus
0.5TG-beta
Tungsten baseline
0.6TG
Reasoning + extended context
0.7TG
Mathematics
0.8TG
Science / STEM
1.0
Full curriculum + instruction tuning + expanded benchmarks
Free for an individual's own personal use or independent research.
Organizational use (by or for any company, non-profit, or other entity, regardless of
revenue) requires either staying under the revenue threshold (INR 1 crore / USD 100,000
per year, whichever is lower) or an Enterprise License.
Resale, paid bundling, or hosted API access to the model or a derivative always
requires RtaForge's prior written permission, regardless of revenue.
Derivatives and fine-tunes must credit both Anvaya-Rabbit-2.7B and RtaForge OPC
Private Limited by name.
No content safeguards are mandated — you are solely responsible for what you generate
and how you deploy it.
Read the full LICENSE.md for the binding terms — this summary is for
convenience only and does not override it.
About ANVAYA
ANVAYA is RtaForge's research program exploring sovereign state-space language models, Rust-native AI infrastructure, and deployable intelligence systems.
Development emphasizes reproducible engineering, inspectable mechanisms, and continual architectural refinement.
