Views
No views yet
lthn/lemer for devices that can't load the full multimodal build (≥3 GB ceiling).| Variant | Size | Towers |
|---|---|---|
| lthn/lemer | 4.06 GB | text + vision + audio |
| lthn/lemer-lite (you are here) | 2.47 GB | text only |
-lite prefix is a promise: we are packing this tight, results will vary, but you get to load and run the model.1from mlx_lm import load, generate
2model, tokenizer = load("lthn/lemer-lite")
3prompt = tokenizer.apply_chat_template(
4 [{"role": "user", "content": "Hello"}],
5 tokenize=False, add_generation_prompt=True,
6)
7print(generate(model, tokenizer, prompt=prompt, max_tokens=200))