IFParse is a benchmark for structured extraction from real developer logs: can a model turn a raw, unstructured log line into JSON that satisfies a fixed schema, with no code fence, no commentary, and no type errors. Scoring is binary and covers only compliance, not extraction creativity, so the signal is isolated to whether the output would actually parse in a production pipeline.
Each prompt gives the model a single raw log line, either an Apache access log record… See the full description on the dataset page:
https://huggingface.co/datasets/Muse-research/ifparse-v1.0.
