APIEval-20: A Benchmark for Black-Box API Test Suite Generation
Motivation
Testing APIs thoroughly is one of the most critical, yet consistently underserved, activities in software engineering. Despite a rich ecosystem of API testing tools — Postman, RestAssured, Schemathesis, Dredd, and others — we found ourselves asking a deceptively simple question:
Given only the schema and an example payload of an API request — no source code, no documentation, no prior knowledge —… See the full description on the dataset page: https://huggingface.co/datasets/kusho-ai/api-eval-20.