Views
No views yet
safetensors layout.lthn/lemer-mlx-bf16 for use on non-MLX platforms (NVIDIA/AMD GPU, Kaggle TPU, vanilla transformers).| Source | This repo |
|---|---|
lthn/lemer-mlx-bf16 (MLX format) | lthn/lemer-hf-bf16 (HF safetensors) |
language_model.model.* keys | model.language_model.* keys |
| MLX conv layout (C,K,I) / (O,H,W,I) | PyTorch layout (C,I,K) / (O,I,H,W) |
1from transformers import AutoModelForCausalLM, AutoTokenizer
2tok = AutoTokenizer.from_pretrained("lthn/lemer-hf-bf16")
3model = AutoModelForCausalLM.from_pretrained(
4 "lthn/lemer-hf-bf16",
5 dtype="bfloat16",
6 device_map="auto",
7)