BenGQL: An Extensible Benchmarking Framework for Automated GraphQL Testing

GraphQL APIs provide a unified endpoint for retrieving and uploading data in a web application. Due to its efficient data-fetching strategy, which allows for the retrieval of only the required data, GraphQL is gaining popularity. Its software nature necessitates robust testing, both functional and non-functional. As automated testing tools, including load testing tools and fuzzers, are developed, they are found to lack an exhaustive set of targets to evaluate. To cope with it, we present BenGQL, a benchmarking framework containing 23 representative open-source GraphQL server applications, spanning different underlying engines and schema complexities. BenGQL provides an extensible framework, allowing developers and researchers to include new case studies, tools, and analysis procedures. The ultimate goal of BenGQL is to foster more rigorous, reproducible automated testing research in the GraphQL ecosystem. As a consequence, we release the source code at , inviting other researchers to contribute. A video demonstration is also available at .

ASE 2025 (Tool Demonstration Track)