LUBM: A Benchmark for OWL Knowledge Base Systems

Yuanbo Guo, Zhengxiang Pan, Jeff Heflin

Abstract


We describe our method for benchmarking Semantic Web knowledge base systems with respect to use in large OWL applications. We present the Lehigh University Benchmark (LUBM) as an example of how to design such benchmarks. The LUBM features an ontology for the university domain, synthetic OWL data scalable to an arbitrary size, fourteen extensional queries representing a variety of properties, and several performance metrics. The LUBM can be used to evaluate systems with different reasoning capabilities and storage mechanisms. We demonstrate this with an evaluation of two memorybased systems and two systems with persistent storage.

Full Text: PDF
Type of Paper: Ontology Paper
Keywords: Semantic Web; Knowledge Base System; Lehigh University Benchmark; Evaluation
Show BibTex format: BibTeX