Lessons Learned from Managing a Petabyte

Summary: Empirical lessons from operating petabyte-scale HEP data (BaBar), contrasting a commercial ODBMS and a home-grown file-based object persistence to expose scale-driven operational, tuning, deployment, and scalability pitfalls. Distills format-independent challenges and tradeoffs across two major system iterations. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 42
Venue: CIDR
Year: 2005
Pagerank: -
Overall Rank: 13,895 | 5.00%
DOI: -

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Jacek Becla (Stanford Linear Accelerator Center)
2. Daniel L. Wang (Stanford Linear Accelerator Center)

BibTeX Citation

@inproceedings{becla_cidr05,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '05},
        title = {{Lessons Learned from Managing a Petabyte}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Becla, Jacek and Wang, Daniel L.},
        year = {2005}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 0 of 0 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,451	Resiliency-Aware Data Management	2011	VLDB
2	4,551	A Specialized Data Management System For Parallel Execution of Particle Physics Codes	1988	SIGMOD
3	6,701	Petabyte Scale Databases and Storage Systems at Facebook	2013	SIGMOD
4	7,498	Are We Experiencing a Big Data Bubble?	2014	SIGMOD
5	3,746	Solving Big Data Challenges for Enterprise Application Performance Management	2012	VLDB
6	14,031	Data Management Challenges in Very Large Enterprises	2002	VLDB
7	13,832	Smoothing the ROI Curve for Scientific Data Management Applications	2007	CIDR
8	12,138	The Case for Small Data Management	2015	CIDR
9	5,576	Critical Database Technologies for High Energy Physics	1997	VLDB
10	9,056	Petabyte Databases	1999	SIGMOD