csermely-mlx – AI Model by emese-tech | AlphaNeural AI

You can deploy this model and start earning money today!

emese-tech/
csermely-mlx

like

0

text-generation

Views

No views yet

Csermely (MLX)

MLX version of Csermely — a 190M parameter Hungarian language model optimized for Apple Silicon. Part of the Emese model family.

This is the native MLX bfloat16 checkpoint. For the HuggingFace transformers version, see emese-tech/csermely.

Model Details


Version	0.2
Parameters	190.2M
Architecture	LLaMA-style (decoder-only transformer)
Context length	4,096 tokens (YaRN RoPE, 4× factor)
Training context	1,024 tokens
Precision	bfloat16
Vocabulary	32,000 (SentencePiece Unigram, Hungarian)
Training data	~2B tokens of Hungarian text
Framework	MLX (Apple Silicon)
License	MIT

Architecture

16 transformer layers
896 hidden dimension
14 attention heads
2560 FFN intermediate size
RMSNorm pre-layer normalization
Rotary positional embeddings (RoPE) with YaRN extension (4× factor, base 1024)
SwiGLU feed-forward activation
Tied input/output embeddings

Usage

python

import mlx.core as mx
from model import Emese, ModelConfig

config = ModelConfig()
model = Emese(config)
model.load_weights("model.safetensors")