Apples and Oranges: A Comparison of RDF Benchmarks and Real RDF Datasets

Summary: Compares RDF benchmarks to real RDF data, showing benchmarks fail to reflect real datasets. Proposes new metrics and a principled generator that converts any dataset into a benchmark via integer programming; first methodological RDF benchmark study. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 4440
Venue: SIGMOD
Year: 2011
Pagerank: 7.6419269e-05
Overall Rank: 3,201 | 78.04%
DOI: 10.1145/1989323.1989340

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{duan_sigmod11,
        title = {{Apples and Oranges: A Comparison of RDF Benchmarks and Real RDF Datasets}},
        author = {Duan, Songyun and Kementsietsidis, Anastasios and Srinivas, Kavitha and Udrea, Octavian},
        series = {{SIGMOD} '11},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/1989323.1989340},
        url = {https://dl.acm.org/doi/10.1145/1989323.1989340},
        year = {2011}
}

Incoming Citations (Sorted by Pagerank)

Showing 12 of 12 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
1,963	Building an Efficient RDF Store Over a Relational Database	2013	SIGMOD	9.3915212e-05
3,404	Data Generation for Application-Specific Benchmarking	2011	VLDB	7.4411075e-05
4,982	Workload Matters: Why RDF Databases Need a New Design	2014	VLDB	6.4127848e-05
7,777	S2RDF: RDF Querying with SPARQL on Spark	2016	VLDB	5.5461212e-05
7,866	Dscaler: Synthetically Scaling A Given Relational Database	2016	VLDB	5.5281143e-05
8,462	Inferray: fast in-memory RDF inference	2016	VLDB	5.4211759e-05
8,582	RBench: Application-Specific RDF Benchmarking	2015	SIGMOD	5.4081423e-05
9,126	A Principled Approach to Bridging the Gap between Graph Data and their Schemas	2014	VLDB	5.3189752e-05
11,087	Towards Sufficient GPU-accelerated Dynamic Graph Management: Survey and Experiment	2025	VLDB	5.093636e-05
11,944	Stylus: A Strongly-Typed Store for Serving Massive RDF Data	2018	VLDB	5.093636e-05
12,119	Left Bit Right: For SPARQL Join Queries with OPTIONAL Patterns (Left-outer-joins)	2015	SIGMOD	5.093636e-05
12,339	SPAM: A SPARQL Analysis and Manipulation Tool	2012	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 4 of 4 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
366	Scalable Semantic Web Data Management Using Vertical Partitioning	2007	VLDB	0.00020039981
944	RDF-3X: a RISC-style Engine for RDF	2008	VLDB	0.00013067088
1,671	A Normal Form for XML Documents	2002	PODS	0.00010043595
5,209	Prefix Based Numbering Schemes for XML: Techniques, Applications and Performances	2008	VLDB	6.3163287e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,622	Revisiting Graph Analytics Benchmark	2025	SIGMOD
2	6,258	Cloud-based RDF Data Management	2014	SIGMOD
3	4,025	Beyond Macrobenchmarks: Microbenchmark-based Graph Database Evaluation	2019	VLDB
4	500	Scalable SPARQL Querying of Large RDF Graphs	2011	VLDB
5	7,798	A Survey and Experimental Comparison of Distributed SPARQL Engines for Very Large RDF Data	2017	VLDB
6	9,339	Efficient Exploration of Interesting Aggregates in RDF Graphs	2021	SIGMOD
7	9,126	A Principled Approach to Bridging the Gap between Graph Data and their Schemas	2014	VLDB
8	859	An Efficient SQL-based RDF Querying Scheme	2005	VLDB
9	4,982	Workload Matters: Why RDF Databases Need a New Design	2014	VLDB
10	8,582	RBench: Application-Specific RDF Benchmarking	2015	SIGMOD