EditScore is a series of state-of-the-art open-source reward models (7B–72B) designed to evaluate and enhance instruction-guided image editing.
✨ Highlights
- State-of-the-Art Performance: Effectively matches the performance of leading proprietary VLMs. With a self-ensembling strategy, our largest model surpasses even GPT-5 on our comprehensive benchmark, EditReward-Bench.
- A Reliable Evaluation Standard: We introduce EditReward-Bench, the first public benchmark specifically designed for evaluating reward models in image editing, featuring 13 subtasks, 11 state-of-the-art editing models (including proprietary models) and expert human annotations.
- Simple and Easy-to-Use: Get an accurate quality score for your image edits with just a few lines of code.
- Versatile Applications: Ready to use as a best-in-class reranker to improve editing outputs, or as a high-fidelity reward signal for stable and effective Reinforcement Learning (RL) fine-tuning.
🔥 News
- 2025-09-30: We release OmniGen2-EditScore7B, unlocking online RL For Image Editing via high-fidelity EditScore. LoRA weights are available at Hugging Face and ModelScope.
- 2025-09-30: We are excited to release EditScore and EditReward-Bench! Model weights and the benchmark dataset are now publicly available. You can access them on Hugging Face: Models Collection and Benchmark Dataset, and on ModelScope: Models Collection and Benchmark Dataset.
📖 Introduction
While Reinforcement Learning (RL) holds immense potential for this domain, its progress has been severely hindered by the absence of a high-fidelity, efficient reward signal.
To overcome this barrier, we provide a systematic, two-part solution:
-
A Rigorous Evaluation Standard: We first introduce EditReward-Bench, a new public benchmark for the direct and reliable evaluation of reward models. It features 13 diverse subtasks and expert human annotations, establishing a gold standard for measuring reward signal quality.
-
A Powerful & Versatile Tool: Guided by our benchmark, we developed the EditScore model series. Through meticulous data curation and an effective self-ensembling strategy, EditScore sets a new state of the art for open-source reward models, even surpassing the accuracy of leading proprietary VLMs.
Benchmark results on EditReward-Bench.
We demonstrate the practical utility of EditScore through two key applications:
- As a State-of-the-Art Reranker: Use EditScore to perform Best-of-N selection and instantly improve the output quality of diverse editing models.
- As a High-Fidelity Reward for RL: Use EditScore as a robust reward signal to fine-tune models via RL, enabling stable training and unlocking significant performance gains where general-purpose VLMs fail.
This repository releases both the EditScore models and the EditReward-Bench dataset to facilitate future research in reward modeling, policy optimization, and AI-driven model improvement.
EditScore as a superior reward signal for image editing.
📌 TODO
We are actively working on improving EditScore and expanding its capabilities. Here's what's next:
🚀 Quick Start
🛠️ Environment Setup
✅ Recommended Setup
1# 1. Clone the repo
2git clone git@github.com:VectorSpaceLab/EditScore.git
3cd EditScore
4
5# 2. (Optional) Create a clean Python environment
6conda create -n editscore python=3.12
7conda activate editscore
8
9# 3. Install dependencies
10# 3.1 Install PyTorch (choose correct CUDA version)
11pip install torch==2.7.1 torchvision --extra-index-url https://download.pytorch.org/whl/cu126
12
13# 3.2 Install other required packages
14pip install -r requirements.txt
15
16# EditScore runs even without vllm, though we recommend install it for best performance.
17pip install vllm
🌏 For users in Mainland China
1# Install PyTorch from a domestic mirror
2pip install torch==2.7.1 torchvision --index-url https://mirror.sjtu.edu.cn/pytorch-wheels/cu126
3
4# Install other dependencies from Tsinghua mirror
5pip install -r requirements.txt -i https://pypi.tuna.tsinghua.edu.cn/simple
6
7# EditScore runs even without vllm, though we recommend install it for best performance.
8pip install vllm -i https://pypi.tuna.tsinghua.edu.cn/simple
🧪 Usage Example
Using EditScore is straightforward. The model will be automatically downloaded from the Hugging Face Hub on its first run.
1from PIL import Image
2from editscore import EditScore
3
4# Load the EditScore model. It will be downloaded automatically.
5# Replace with the specific model version you want to use.
6model_path = "Qwen/Qwen2.5-VL-7B-Instruct"
7lora_path = "EditScore/EditScore-7B"
8
9scorer = EditScore(
10 backbone="qwen25vl", # set to "qwen25vl_vllm" for faster inference
11 model_name_or_path=model_path,
12 enable_lora=True,
13 lora_path=lora_path,
14 score_range=25,
15 num_pass=1, # Increase for better performance via self-ensembling
16)
17
18input_image = Image.open("example_images/input.png")
19output_image = Image.open("example_images/output.png")
20instruction = "Adjust the background to a glass wall."
21
22result = scorer.evaluate([input_image, output_image], instruction)
23print(f"Edit Score: {result['final_score']}")
24# Expected output: A dictionary containing the final score and other details.
📊 Benchmark Your Image-Editing Reward Model
We provide an evaluation script to benchmark reward models on EditReward-Bench. To evaluate your own custom reward model, simply create a scorer class with a similar interface and update the script.
1# This script will evaluate the default EditScore model on the benchmark
2bash evaluate.sh
3
4# Or speed up inference with VLLM
5bash evaluate_vllm.sh
❤️ Citing Us
If you find this repository or our work useful, please consider giving a star ⭐ and citation 🦖, which would be greatly appreciated:
1@article{luo2025editscore,
2 title={EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modeling},
3 author={Xin Luo and Jiahao Wang and Chenyuan Wu and Shitao Xiao and Xiyan Jiang and Defu Lian and Jiajun Zhang and Dong Liu and Zheng Liu},
4 journal={arXiv preprint arXiv:2509.23909},
5 year={2025}
6}
