Mew1-2.6B is a 2.69B-parameter LFM2-family text-generation model released by Unmid. This is the canonical BF16 Transformers checkpoint; ready-to-run GGUF files are published separately in Unmid/Mew1-2.6B-GGUF.

Model details

Property	Value
Architecture	LFM2 hybrid (`Lfm2ForCausalLM`)
Parameters	2.69B
Layers	30
Context configured by this checkpoint	128,000 tokens
Vocabulary	128,000 tokens
Weight format	BF16 Safetensors, 4 shards
Chat format	ChatML-like template with tool-use support
Primary tested language	English
License	LFM Open License v1.0

The checkpoint is intended for local conversational generation, creative writing, roleplay, instruction following, and experimentation on resource-constrained hardware. A complete reproducibility report and independent benchmark suite for the Mew1 modification have not yet been published; performance claims should be evaluated on your own workloads.

Files in this repository

The four model-0000x-of-00004.safetensors files are the actual BF16 model weights. model.safetensors.index.json maps every tensor to its shard. These are standard Transformers files and should be kept together.

Usage with Transformers

LFM2 is supported natively by recent Transformers releases. No custom remote code is required.

python

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "Unmid/Mew1-2.6B"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    dtype=torch.bfloat16,
    device_map="auto",
)

messages = [
    {"role": "system", "content": "You are a helpful assistant."},
    {"role": "user", "content": "Write a short story about a cat exploring the Moon."},
]

input_ids = tokenizer.apply_chat_template(
    messages,
    add_generation_prompt=True,
    return_tensors="pt",
).to(model.device)

output = model.generate(
    input_ids,
    max_new_tokens=512,
    do_sample=True,
    temperature=0.7,
    top_k=50,
    top_p=0.9,
    repetition_penalty=1.1,
)

print(tokenizer.decode(output[0, input_ids.shape[-1]:], skip_special_tokens=True))

GGUF downloads

The owner-maintained GGUF release is Unmid/Mew1-2.6B-GGUF.

For backward compatibility, the earlier GGUF copies under this repository's ggufs/ directory remain available. No model artifacts were removed during the reorganization.

Quant	Size	Suggested use	Download
Q2_K	1.09 GB	Minimum memory	GGUF
Q4_0	1.59 GB	Fast legacy 4-bit	GGUF
Q4_K_M	1.67 GB	Recommended balance	GGUF
Q5_K_M	1.94 GB	Higher quality	GGUF
Q6_K	2.22 GB	High quality	GGUF
Q8_0	2.87 GB	Maximum quantized quality	GGUF

Additional community quantizations are available from mradermacher:

Limitations and responsible use

Mew1 may produce incorrect, biased, unsafe, or fabricated text. “Uncensored” describes reduced refusal behavior; it does not guarantee accuracy or suitability. Validate outputs before relying on them, especially for medical, legal, financial, security, or other high-impact decisions. Users are responsible for complying with applicable law and the model license.

License and attribution

This derivative is distributed under the LFM Open License v1.0. Review LICENSE, including its attribution and commercial-use conditions. Mew1 builds on work by Liquid AI and SC117; quantized community releases should also credit their respective quantizers.