Views
No views yet
alwaysgood/scp-stage4-oneshot-forward_dpo_sigmoid for llama.cpp and LM Studio.| File | Purpose |
|---|---|
TranslateQwen_v1-Q4_K_M.gguf | Main text model, recommended default |
TranslateQwen_v1-BF16.gguf | BF16 text model, larger reference build |
TranslateQwen_v1-mmproj-BF16.gguf | Multimodal projector for vision/image input |
BF16 and Q4_K_M GGUF files are language/text models. Vision/image tensors are split into the separate mmproj-BF16 GGUF, so image input requires loading both the main model and the matching mmproj file.Instruction and Source headers in the custom template.Advanced Configuration -> Prompt Template, choose Custom, and use:| Field | Value |
|---|---|
| Choose template | Custom |
| Before System | leave empty |
| After System | \n\n |
| Before User | ### Instruction:\nTranslate the English source into Korean.\n\n### Source:\n |
| After User | \n\n |
| Before Assistant | ### Response:\n |
| After Assistant | \n\n |
The Federal Reserve raised interest rates by 25 basis points.1### Instruction:
2Translate the English source into Korean.
3
4### Source:
5The Federal Reserve raised interest rates by 25 basis points.
6
7### Response:0.0 to 0.3, context length 8192.1llama-cli \
2 -m TranslateQwen_v1-Q4_K_M.gguf \
3 --color -ngl all -fa -c 8192 \
4 -p $'### Instruction:\nTranslate the English source into Korean.\n\n### Source:\nThe Federal Reserve raised interest rates by 25 basis points.\n\n### Response:\n'1llama-mtmd-cli \
2 -m TranslateQwen_v1-Q4_K_M.gguf \
3 --mmproj TranslateQwen_v1-mmproj-BF16.gguf \
4 --image /path/to/image.png \
5 -p $'### Instruction:\nTranslate the English source into Korean.\n\n### Source:\nDescribe this image in Korean.\n\n### Response:\n' \
6 -ngl all -fa -c 8192