Views
No views yet
| File | Size | Description |
|---|---|---|
gemma4-biomedical-e4b.gguf | 15 GB | Main language model |
mmproj-gemma-4-E4B-it-BF16.gguf | 991 MB | Vision projector for multimodal |
<|channel>thought tokens1# Download model
2wget https://huggingface.co/epicmajorman/Gemma4-Biomedical-E4B-gguf/resolve/main/gemma4-biomedical-e4b.gguf
3
4# Run with llama.cpp
5./llama-cli -m gemma4-biomedical-e4b.gguf \
6 -p "How do I synthesize aspirin?" \
7 -n 512 \
8 --temp 1.0 \
9 --top-p 0.95
10
11# With vision (multimodal)
12./llama-cli -m gemma4-biomedical-e4b.gguf \
13 --mmproj mmproj-gemma-4-E4B-it-BF16.gguf \
14 --image path/to/image.jpg \
15 -p "Describe this medical image"1# Run directly from Ollama Hub
2ollama run epicmajorman/gemma4-biomedical1# Create Modelfile
2echo "FROM ./gemma4-biomedical-e4b.gguf
3PARAMETER temperature 1.0
4PARAMETER top_p 0.95
5PARAMETER num_ctx 8192" > Modelfile
6
7# Build model
8ollama create gemma4-biomedical -f Modelfile
9
10# Run
11ollama run gemma4-biomedical1# Download directly via CLI
2lms get epicmajorman/gemma4-biomedical-e4b-gguf1from llama_cpp import Llama
2
3llm = Llama(
4 model_path="gemma4-biomedical-e4b.gguf",
5 n_ctx=8192,
6 n_gpu_layers=-1 # Use GPU if available
7)
8
9output = llm(
10 "How do I synthesize aspirin?",
11 max_tokens=512,
12 temperature=1.0,
13 top_p=0.95
14)
15
16print(output['choices'][0]['text'])