Views
No views yet
| Property | Value |
|---|---|
| Base Model | Qwen/Qwen2.5-14B-Instruct |
| Fine-tuning | LoRA (rank 64, alpha 128) via Unsloth |
| Training Data | 527 weekly market analysis pairs (2016–2026) |
| Quantization | Q4_K_M via llama.cpp |
| File Size | ~8.4 GB |
| Context Length | 4096 tokens |
| Format | GGUF (compatible with Ollama, llama.cpp, LM Studio) |
1# Download the GGUF file
2# Create a Modelfile:
3cat > Modelfile << 'EOF'
4FROM ./finsight_q4km.gguf
5PARAMETER temperature 0.3
6PARAMETER num_ctx 4096
7SYSTEM "You are FinSight, an expert AI financial analyst..."
8EOF
9
10ollama create finsight -f Modelfile
11ollama run finsight "What are the market implications of rising inflation?"