Views
No views yet
llama.cppMeta-Llama-3.1-8B-Instruct.Q4_K_M.gguf) to run it.--lora or --lora-scaled flags in llama.cpp to apply it at runtime.1llama-cli -m "path/to/Meta-Llama-3.1-8B-Instruct.Q4_K_M.gguf" \
2 --lora "path/to/syntheticlab-fix-json-lora.gguf" \
3 -c 2048 -n 256 -p "Your prompt here"