Views
No views yet
| Property | Value |
|---|---|
| Parameters | 35,314,944 |
| Architecture | GPT-style decoder-only Transformer |
| Vocabulary | 32,000 BPE tokens (Telugu-optimized) |
| Context length | 256 tokens |
| Embedding dim | 384 |
| Layers | 6 |
| Attention heads | 6 |
| Dropout | 0.1 |
model_epoch_1.pt through model_epoch_8.pt — PyTorch checkpoints (model + optimizer state)telugu_tokenizer.json — trained BPE tokenizer (Hugging Face tokenizers format)1import torch
2from tokenizers import Tokenizer
3
4tokenizer = Tokenizer.from_file("telugu_tokenizer.json")
5checkpoint = torch.load("model_epoch_8.pt", map_location="cpu")
6# Load into your GPT model class from models/gpt_model.py@mastersthesis{marpally2026tellama,
title={TeLLaMA: A GPT-Style Language Model from Scratch for Telugu},
author={Marpally, Anirudh},
year={2026},
school={Defence Institute of Advanced Technology (DIAT), Pune}
}