Realistic Re-evaluation of Knowledge Graph Completion Methods: An Experimental Study

Summary: Systematic re-evaluation of knowledge graph completion embeddings after removing leakage from standard benchmarks (FB15k/WN18) and problematic Cartesian-product/reverse relations. Results show substantially lower accuracy than reported, challenging the effectiveness of current embedding approaches and urging re-investigation of viable methods. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5812
Venue: SIGMOD
Year: 2020
Pagerank: 9.9175408e-05
Overall Rank: 1,966 | 86.33%
DOI: 10.1145/3318464.3380599

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,915	A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphs	2020	VLDB	6.6332294e-05
5,377	Parallel Training of Knowledge Graph Embedding Models: A Comparison of Techniques	2022	VLDB	5.5410858e-05
6,408	Explaining Link Prediction Systems based on Knowledge Graph Embeddings	2022	SIGMOD	5.0763482e-05
8,701	Compact Walks: Taming Knowledge-Graph Embeddings With Domain- and Task-Specific Pathways	2022	SIGMOD	4.4656059e-05
8,906	Mining Geospatial Relationships from Text	2023	SIGMOD	4.427232e-05
8,908	Deep Active Alignment of Knowledge Graph Entities and Schemata	2023	SIGMOD	4.427232e-05
10,083	GeoKGM: A Multimodal Large Language Model for Zero-Shot Knowledge Graph Completion in Geospatial Databases	2026	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 2 of 2 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
62	Freebase: A Collaboratively Created Graph Database For Structuring Human Knowledge	2008	SIGMOD	0.0006429466
804	YAGO3: A Knowledge Base from Multilingual Wikipedias	2015	CIDR	0.00016463579

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,320	Schemaless and Structureless Graph Querying	2014	VLDB	7.2249102e-05
6,689	Efficient Knowledge Graph Accuracy Evaluation	2019	VLDB	4.9623586e-05
11,369	PGE: Robust Product Graph Embedding Learning for Error Detection	2022	VLDB	4.1945683e-05
5,377	Parallel Training of Knowledge Graph Embedding Models: A Comparison of Techniques	2022	VLDB	5.5410858e-05
8,908	Deep Active Alignment of Knowledge Graph Entities and Schemata	2023	SIGMOD	4.427232e-05
6,714	Cardinality Estimation over Knowledge Graphs with Embeddings and Graph Neural Networks	2024	SIGMOD	4.9512171e-05
11,054	Enriching Relations with Additional Attributes for ER	2024	VLDB	4.1945683e-05
1,914	Creating Embeddings of Heterogeneous Relational Datasets for Data Integration Tasks	2020	SIGMOD	0.00010109102
6,408	Explaining Link Prediction Systems based on Knowledge Graph Embeddings	2022	SIGMOD	5.0763482e-05
3,915	A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphs	2020	VLDB	6.6332294e-05