LNCS 2025 / LLM Agents

BIS: NL2SQL Service Evaluation Benchmark for Business Intelligence Scenarios

A benchmark and evaluation study for NL2SQL services in business intelligence scenarios, connecting language interfaces with service-oriented data systems.

Research area

Skill retrieval, semantic identifiers, NL2SQL benchmarks, and LLM serving systems are treated as capability surfaces that should be inspected before they are trusted.

Publication record

Authors
B Caglayan, M Wang, JD Kelleher, S Fei, G Tong, J Ding, P Zhang
Venue
Lecture Notes in Computer Science, 15405, 357-372
Year
2025
Area
LLM Agents