This dataset contains QA that requires DB and API access at the same time. It is composed of two new benchmarks consisting of questions whose answers require a
combination of database and API calls, both of
which are augmentations of the popular Spider
dataset and benchmark.
Benchmark I replaces a fraction of the real Spider database tables with
equivalents that are executed via APIs. This allows us to directly test the mechanism by which
database and… See the full description on the dataset page:
https://huggingface.co/datasets/ibm-research/SQL-API-Bench.
