REFEREE: An open framework for practical testing of recommender systems using ResearchIndex

Summary: REFEREE framework for testing recommender systems on ResearchIndex. Hybrid PD-Live fuses content features (author, title, abstract) with collaborative signals and citations; real-world, scalable metrics emphasize user buy-in over offline accuracy. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 9022
Venue: VLDB
Year: 2002
Pagerank: 5.9425753e-05
Overall Rank: 6,231 | 57.26%
DOI: 10.1016/B978-155860869-6/50012-3

Incoming Non-self Citations Over Time

Authors

1. Dan Cosley (University of Minnesota)
2. Steve Lawrence (NEC Research Institute)
3. David M. Pennock (NEC Research Institute)

BibTeX Citation

@article{cosley_vldb02,
        title = {{REFEREE: An open framework for practical testing of recommender systems using ResearchIndex}},
        author = {Cosley, Dan and Lawrence, Steve and Pennock, David M.},
        journal = {PVLDB},
        series = {{VLDB} '02},
        doi = {10.1016/B978-155860869-6/50012-3},
        url = {https://doi.org/10.1016/B978-155860869-6/50012-3},
        year = {2002}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
12,793	AWESOME - A Data Warehouse-based System for Adaptive Website Recommendations	2004	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 0 of 0 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,288	QuEval: Beyond high-dimensional indexing à la carte	2013	VLDB
2	2,929	StreamRec: A Real-Time Recommender System	2011	SIGMOD
3	10,279	PathSeer: Adaptive Neighbor Handling for Efficient Filtered ANN Search	2026	SIGMOD
4	8,601	Goals and Benchmarks for Autonomic Configuration Recommenders	2005	SIGMOD
5	4,529	TencentRec: Real-time Stream Recommendation in Practice	2015	SIGMOD
6	13,869	Personalized Systems: Models and Methods from an IR and DB perspective	2005	VLDB
7	8,530	Modern Recommender Systems: from Computing Matrices to Thinking with Neurons	2018	SIGMOD
8	5,544	RecDB in Action: Recommendation Made Easy in Relational Databases	2013	VLDB
9	3,048	FlexRecs: Expressing and Combining Flexible Recommendations	2009	SIGMOD
10	12,406	RecBench: Benchmarks for Evaluating Performance of Recommender System Architectures	2011	VLDB