You can deploy this model and start earning money today!

jbmarsha/
nurse-navigator-GGUF

Name: nurse-navigator-GGUF
Availability: InStock

gguf

endpoints_compatible

conversational

Views

No views yet

nurse-navigator - GGUF Format

This is the GGUF version of nurse-navigator for use with Ollama and llama.cpp.

Usage with Ollama

bash

# Download the model
wget https://huggingface.co/jbmarsha/nurse-navigator-GGUF/resolve/main/nurse_navigator.gguf

# Create Ollama model
cat << 'EOF' > Modelfile
FROM ./nurse_navigator.gguf

SYSTEM "You are an Oncology Nurse Navigator AI assistant specializing in NCCN Guidelines."

PARAMETER temperature 0.3
PARAMETER num_ctx 4096
EOF

ollama create nurse-navigator -f Modelfile

# Run
ollama run nurse-navigator

Usage with llama.cpp

./main -m nurse_navigator.gguf -p "[INST] Your question here [/INST]"