Views
No views yet
rLLM/rLLM-FinQA-4B for Apple Silicon.
No additional training. Conversion/quantization only.1pip install mlx-lm
2mlx_lm.generate \
3 --model snsnc/rLLM-FinQA-4B-MLX-4bit \
4 --max-tokens 512 \
5 --temp 0.1 \
6 --top-p 0.8 \
7 --prompt "Write a BigQuery SQL query to calculate daily revenue from an orders table."