Combination of hERG-Blocker, Absorption-pgp and Metabolism-CYP_P450_2C19 questions from the TD-Commons datasets that could not been solved by Qwen3-4B after n=10 generations and therefore considered hard.
Datasets were generated with Qwen3-4B (unsloth/Qwen3-4B-bnb-4bit).
hERG-Blocker data:
Script to generate the data:
from datasets import load_dataset, concatenate_datasets, Dataset
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft… See the full description on the dataset page:
https://huggingface.co/datasets/Sebasdi/chemist_benchmark_v0.
