from mlx_lm import load, generate

model, tokenizer = load("roboalchemist/ReaderLM-v2-mlx-fp16")

html_content = "<html><body><h1>Hello World</h1><p>This is a test.</p></body></html>"
prompt = f"Extract the main content from the following HTML and convert it to Markdown format:\n```html\n{html_content}\n```"

response = generate(model, tokenizer, prompt=prompt, max_tokens=2048)
print(response)

Conversion Details

Original Model: jinaai/ReaderLM-v2
Parameters: 1.5B
Precision: bfloat16 (full precision)
Format: MLX safetensors
Size: ~2.9GB

Converted using:

mlx_lm.convert --hf-path jinaai/ReaderLM-v2 --mlx-path ./ReaderLM-v2-mlx-fp16

License

This model inherits the CC-BY-NC-4.0 license from the original ReaderLM-v2.

Acknowledgments

Jina AI for the original ReaderLM-v2 model
MLX team at Apple for the framework