You can deploy this model and start earning money today!

LGAI-EXAONE/
EXAONE-4.5-33B-GGUF

Name: EXAONE-4.5-33B-GGUF
Availability: InStock

LGAI-EXAONE/EXAONE-4.5-33B

Views

No views yet

EXAONE 4.5

We introduce EXAONE 4.5, the first open-weight vision language model developed by LG AI Research. Integrating a dedicated visual encoder into the existing EXAONE 4.0 framework, we expand the model's capability toward multimodality. EXAONE 4.5 features 33 billion parameters in total, including 1.2 billion parameters from the vision encoder. EXAONE 4.5 achieves competitive performance in general benchmark while outperforming SOTA models of similar size in document understanding and Korean contextual reasoning, inheriting powerful language capabilities from our previous language models.

For more details, please refer to the technical report, blog and GitHub.

Model Configuration

Model Type: Causal Language Model + Vision Encoder
Number of Parameters (Language Model): 31.7B
Number of Parameters (Vision Encoder): 1.29B
Hidden Dimension: 5,120
Intermediate size: 27,392
Number of Layers: 64 Main layers + 1 MTP layers
- Hybrid Attention Pattern: 16 x (3 Sliding window attention + 1 Global attention)
- Reordered Norm: Apply normalization after Attention/MLP, and before residual connection
Sliding Window Attention
- Number of Attention Heads: 40 Q-heads and 8 KV-heads
- Head Dimension: 128 for both Q/KV
- Sliding Window Size: 128
Global Attention
- Number of Attention Heads: 40 Q-heads and 8 KV-heads
- Head Dimension: 128 for both Q/KV
- No Rotary Positional Embedding Used (NoPE)
Vision Encoder
- Grouped Query Attention (GQA)
- 2D RoPE for vision embeddings
Vocab Size: 153,600
Context Length: 262,144 tokens
Knowledge Cutoff: Dec 2024 (2024/12)
Quantization:
- Language Model: Q8_0, Q6_K, Q5_K_M, Q4_K_M, IQ4_XS in GGUF format (also includes BF16 weights)
- Vision Encoder: F32, F16, BF16 in GGUF format

Evaluation Results

The following table shows the benchmark results for the original EXAONE 4.5. Detailed evaluation results of the original model can be found in our technical report.

Vision-Language Tasks

	EXAONE 4.5 33B (Reasoning)	GPT-5 mini (Reasoning: high)	Qwen3-VL 32B Thinking	Qwen3-VL 235B Thinking	Qwen3.5 27B (Reasoning)
Architecture	Dense	-	Dense	MoE	Dense
Total Params	33B	-	33B	236B	27B
Active Params	33B	-	33B	22B	27B
STEM / Puzzle
MMMU	78.7	79.0	78.1	80.6	82.3
MMMU-Pro	68.6	67.3	68.1	69.3	75.0
MedXpertQA-MM	42.1	34.4	41.6	47.6	62.4
MathVision	75.2	71.9	70.2	74.6	86.0
MathVista (mini)	85.0	79.1	85.9	85.8	87.8
WeMath	79.1	70.3	71.6	74.8	84.0
LogicVista	73.8	70.3	70.9	72.2	77.0
BabyVision	18.8	20.9	17.4	22.2	44.6
Document Understanding
AI2D	89.0	88.2	88.9	89.2	92.9
ChartQAPro	62.2	60.9	61.4	61.2	66.8
CharXiv (RQ)	71.7	68.6	65.2	66.1	79.5
OCRBench v2	63.2	55.8	68.4	66.8	67.3
OmniDocBench v1.5	81.2	77.0	83.1	84.5	88.9
General
MMStar	74.9	74.1	79.4	78.7	81.0
BLINK	68.8	67.7	68.5	67.1	71.6
HallusionBench	63.7	63.2	67.4	66.7	70.0
Korean
KMMMU	42.7	42.6	37.8	42.1	51.7
K-Viscuit	80.1	78.5	78.5	83.9	84.0
KRETA	91.9	94.8	90.3	92.8	96.5

Language-only Tasks

	EXAONE 4.5 33B (Reasoning)	GPT-5 mini (Reasoning: high)	K-EXAONE 236B (Reasoning)	Qwen3-VL 235B Thinking	Qwen3.5 27B (Reasoning)
Architecture	Dense	-	MoE	MoE	Dense
Total Params	33B	-	236B	236B	27B
Active Params	33B	-	23B	22B	27B
Reasoning
AIME 2025	92.9	91.1	92.8	89.7	93.5
AIME 2026	92.6	92.4	92.2	89.4	90.8
GPQA-Diamond	80.5	82.3	79.1	77.1	85.5
LiveCodeBench v6	81.4	78.1	80.7	70.1	80.7
MMLU-Pro	83.3	83.3	83.8	83.8	86.1
Agentic Tool Use
τ²-Bench (Retail)	77.9	78.3	78.6	67.0	84.7
τ²-Bench (Airline)	56.5	60.0	60.4	62.0	67.5
τ²-Bench (Telecom)	73.0	74.1	73.5	44.7	99.3
Instruction Following
IFBench	62.6	74.0	67.3	59.2	76.5
IFEval	89.6	92.8	89.7	88.2	95.0
Long Context Understanding
AA-LCR	50.6	68.0	53.5	58.7	67.3
Korean
KMMLU-Pro	67.6	72.5	67.3	71.1	73.0
KoBALT	52.1	63.6	61.8	51.1	54.9

Quickstart

Serving EXAONE 4.5

For better inference speed and memory usage, it is preferred to serve the model using optimized inference engines. The EXAONE 4.5 model is supported by various frameworks, including TensorRT-LLM, vLLM, SGLang, and llama.cpp. Support will be expanded in the future.

Practically, you can serve the EXAONE 4.5 model with 256K context length on single H200 GPU, or 4x A100-40GB GPUs by using a tensor-parallelism.

llama.cpp

The EXAONE 4.5 model is officially supported by llama.cpp in b9453 build and after.

After installing the llama.cpp library, you can launch the server with the following code snippet. You can remove unnecessary arguments from the snippet.

bash

llama-server \
    -m EXAONE-4.5-33B-Q4_K_M.gguf \
    -mm mmproj-EXAONE-4.5-33B-BF16.gguf \
    -ngl 999 -cb \
    -c 262144 -n 32768 \
    -fa on -sm row \
    --temp 1.0 --top-p 0.95 --min-p 0 \
    --presence-penalty 1.5 \
    --no-context-shift \
    --port 8000 \
    -a EXAONE-4.5-33B \
    --jinja

When the server is ready, you can test the model using the chat-style UI at http://localhost:8000, and access the OpenAI-compatible API at http://localhost:8000/v1.

Using EXAONE 4.5

After launching the OpenAI-compatible server with EXAONE 4.5, you can seamlessly use the model via API with a single code integration, even though the serving framework has changed. To use OpenAI Python SDK and following examples, you should install the openai library on your environment.

[!IMPORTANT] To achieve the expected performance, we recommend using the following configurations:

We recommend to use temperature=1.0, top_p=0.95, presence_penalty=1.5 for general purpose.

We recommend to use temperature=0.6, top_p=0.95, presence_penalty=1.5, top_k=20 for OCR/document-related tasks, and Korean inputs.

We recommend to use temperature=1.0, top_p=0.95 for text-only inputs.

Different from EXAONE-4.0, EXAONE 4.5 uses enable_thinking=True as default. Thus, you need to set enable_thinking=False when you want to use non-reasoning mode.

EXAONE 4.5 prefers using \boxed{} format to answer the question. We recommend using this format with the corresponding format instruction for better parsing accuracy.

You can easily try model's chat completions by using OpenAI Python SDK. For your server in local machine, you will need to change your base_url and api_key for the OpenAI client.

Image-Text QA

Reasoning mode

For tasks that require accurate results, you can run the EXAONE 4.5 model in reasoning mode as follows.

python

from openai import OpenAI

client = OpenAI(
    base_url="http://localhost:8000/v1",
    api_key="EMPTY",
)

messages = [
    {
        "role": "user",
        "content": [
            {
                "type": "image_url",
                "image_url": {
                    "url": "https://github.com/LG-AI-EXAONE/EXAONE-4.5/blob/main/assets/exaone45_input2.png?raw=true",
                },
            },
            {
                "type": "text",
                "text": "How much larger is the model released in winter 2025 compared with the one released in summer 2024?",
            },
        ]
    }
]

response = client.chat.completions.create(
    model="EXAONE-4.5-33B",
    messages=messages,
    max_tokens=32768,
    temperature=1.0,
    top_p=0.95,
    presence_penalty=1.5,
    extra_body={
        "chat_template_kwargs": {
            "enable_thinking": True,  # default: True
        }
    }, 
)
print(response)

Non-reasoning mode

For tasks where latency matters more than accuracy, you can run the EXAONE 4.5 model in non-reasoning mode as follows.

python

from openai import OpenAI

client = OpenAI(
    base_url="http://localhost:8000/v1",
    api_key="EMPTY",
)

messages = [
    {
        "role": "user",
        "content": [
            {
                "type": "image_url",
                "image_url": {
                    "url": "https://github.com/LG-AI-EXAONE/EXAONE-4.5/blob/main/assets/exaone45_input1.jpg?raw=true",
                },
            },
            {
                "type": "text",
                "text": "What dish is the person preparing, and how is it made?",
            },
        ]
    }
]

response = client.chat.completions.create(
    model="EXAONE-4.5-33B",
    messages=messages,
    max_tokens=32768,
    temperature=1.0,
    top_p=0.95,
    presence_penalty=1.5,
    extra_body={
        "chat_template_kwargs": {
            "enable_thinking": False,  # default: True
        }
    }, 
)
print(response)

Text-only QA

python

from openai import OpenAI

client = OpenAI(
    base_url="http://localhost:8000/v1",
    api_key="EMPTY",
)

messages = [
    {
        "role": "user",
        "content": "Explain how useful you are.",
    }
]

response = client.chat.completions.create(
    model="EXAONE-4.5-33B",
    messages=messages,
    max_tokens=32768,
    temperature=1.0,
    top_p=0.95,
    extra_body={
        "chat_template_kwargs": {
            "enable_thinking": True,  # default: True
        }
    }, 
)
print(response)

Agentic Use

The following example demonstrates the agentic capability of EXAONE 4.5 for image-text inputs. You can use your own agents, skills, or other harnesses with the EXAONE 4.5 model.

python

# If needed:
# pip install langchain langchain-openai langchain-mcp-adapters
# curl -LsSf https://astral.sh/uv/install.sh | sh
# sudo apt-get update && sudo apt-get install -y nodejs npm

import os
import asyncio
from langchain_openai import ChatOpenAI
from langchain.agents import create_agent
from langchain_mcp_adapters.client import MultiServerMCPClient

def print_message(msg):
    parts = msg.content if isinstance(msg.content, list) else [{"type": "text", "text": msg.content or ""}]
    text_out, reasoning_out = [], []

    for p in parts:
        if isinstance(p, dict):
            if p.get("type") in ("text", "output_text") and p.get("text"):
                text_out.append(p["text"])
            elif p.get("type") in ("reasoning", "reasoning_text") and p.get("text"):
                reasoning_out.append(p["text"])

    if reasoning_out:
        print("\n[assistant_reasoning_content]")
        print("\n".join(reasoning_out))
    if text_out:
        print("\n[assistant_content]")
        print("\n".join(text_out))

async def main():
    model = ChatOpenAI(
        model="EXAONE-4.5-33B",
        base_url="http://localhost:8000/v1",
        api_key="EMPTY",
        temperature=1.0,
        model_kwargs={"top_p": 0.95},
    )

    client = MultiServerMCPClient({
        "filesystem": {
            "transport": "stdio",
            "command": "npx",
            "args": ["-y", "@modelcontextprotocol/server-filesystem", "/tmp"],
        },
        "fetch": {
            "transport": "stdio",
            "command": "uvx",
            "args": ["mcp-server-fetch"],
        },
        "duckduckgo": {
            "transport": "stdio",
            "command": "uvx",
            "args": ["duckduckgo-mcp-server"],
        },
    })

    agent = create_agent(model, await client.get_tools())

    inputs = {
        "messages": [{
            "role": "user",
            "content": [
                {
                    "type": "text",
                    "text": (
                        "Look at the image and identify the landmark. "
                        "Use the DuckDuckGo MCP tool to verify its name, height, and location. "
                        "Then use the fetch tool to read a fuller article page about it. "
                        "Create /tmp/mcp-demo and write a short markdown file to "
                        "/tmp/mcp-demo/landmark.md with: name, location, height, and a one-sentence summary of the article. "
                        "Finally, return only the exact file content."
                    ),
                },
                {
                    "type": "image_url",
                    "image_url": {
                        "url": "https://upload.wikimedia.org/wikipedia/commons/a/a8/Tour_Eiffel_Wikimedia_Commons.jpg"
                    },
                },
            ],
        }]
    }

    async for step in agent.astream(inputs, stream_mode="values"):
        msg = step["messages"][-1]
        if getattr(msg, "type", "") == "ai":
            print_message(msg)
            for tc in getattr(msg, "tool_calls", []) or []:
                print(f"\n[tool call] {tc['name']}({tc['args']})")

if __name__ == "__main__":
    asyncio.run(main())

Limitation

EXAONE 4.5 models, like all existing multimodal models, have certain limitations and may occasionally generate inappropriate responses. The multimodal model generates responses based on the output probability of tokens, and it is determined during learning from training data. While we make every effort to exclude personal, harmful, and biased information from the training data, some problematic content may still be included, potentially leading to undesirable responses. Please note that the text generated by EXAONE 4.5 models does not reflect the views of LG AI Research.

Inappropriate answers may be generated, which contain personal, harmful or other inappropriate information.
Biased responses may be generated, which are associated with age, gender, race, and so on.
The generated responses rely heavily on statistics from the training data, which can result in the generation of semantically or syntactically incorrect sentences.
Since the models do not reflect the latest information, the responses may be false or contradictory.

LG AI Research strives to reduce potential risks that may arise from EXAONE 4.5 models. Users are not allowed to engage in any malicious activities (e.g., keying in illegal information) that may induce the creation of inappropriate outputs violating LG AI’s ethical principles when using EXAONE 4.5 models.

License

The model is licensed under EXAONE AI Model License Agreement 1.2 - NC

Citation

@article{exaone-4.5,
  title={EXAONE 4.5 Technical Report},
  author={{LG AI Research}},
  journal={arXiv preprint arXiv:2604.08644},
  year={2026}
}

Contact

LG AI Research Technical Support: contact_us@lgresearch.ai

LGAI-EXAONE/EXAONE-4.5-33B-GGUF

EXAONE 4.5

Model Configuration

Evaluation Results

Vision-Language Tasks

Language-only Tasks

Quickstart

Serving EXAONE 4.5

llama.cpp

Using EXAONE 4.5

Image-Text QA

Reasoning mode

Non-reasoning mode

Text-only QA

Agentic Use

Limitation

License

Citation

Contact

LGAI-EXAONE/
EXAONE-4.5-33B-GGUF