ICSOC 2025 / LLM Agents

BIS: NL2SQL Service Evaluation Benchmark for Business Intelligence Scenarios

A benchmark and evaluation study for NL2SQL services in business intelligence scenarios, connecting language interfaces with service-oriented data systems.

Research area

AI search, skill retrieval, NL2SQL benchmarks, LLM serving systems, and capability governance are treated as system surfaces that should be inspected before they are trusted.

Publication record

Authors
B Caglayan, M Wang, JD Kelleher, S Fei, G Tong, Jiandong Ding, P Zhang
Venue
International Conference on Service-Oriented Computing (ICSOC '24), Lecture Notes in Computer Science 15405, 357-372
Year
2025
Area
LLM Agents