Big Metadata: When Metadata is Big Data

Summary: Demonstrates scalable metadata management at exabyte scale in BigQuery without sacrificing query latency. Leverages the same distributed techniques used for data to enable fast queries over billions of objects and their metadata. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hffda6393b3802d7a
Venue: VLDB
Year: 2021
Pagerank: 6.9192051e-05
Overall Rank: 3,928 | 73.60%
DOI: 10.14778/3476311.3476385

Incoming Non-self Citations Over Time

Authors

1. Pavan Edara (Google)
2. Mosha Pasumansky (Google)

BibTeX Citation

@article{edara_vldb21,
        title = {{Big Metadata: When Metadata is Big Data}},
        author = {Edara, Pavan and Pasumansky, Mosha},
        journal = {PVLDB},
        series = {{VLDB} '21},
        volume = {14},
        number = {12},
        pages = {3083--3095},
        doi = {10.14778/3476311.3476385},
        url = {https://doi.org/10.14778/3476311.3476385},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,423	AutoTQA: Towards Autonomous Tabular Question Answering through Multi-Agent Large Language Models	2024	VLDB	7.313499e-05
4,530	BigLake: BigQuery’s Evolution toward a Multi-Cloud Lakehouse	2024	SIGMOD	6.5588866e-05
6,920	Petabyte-Scale Row-Level Operations in Data Lakehouses	2024	VLDB	5.6441822e-05
7,160	Cost-Intelligent Data Analytics in the Cloud	2024	CIDR	5.5962258e-05
8,637	Magnus: A Holistic Approach to Data Management for Large-Scale Machine Learning Workloads	2025	VLDB	5.2978926e-05
9,684	The HANA Native Query Engine for Lakehouse Systems	2025	VLDB	5.1423628e-05
9,733	Vortex: A Stream-oriented Storage Engine For Big Data Analytics	2024	SIGMOD	5.1349531e-05
10,909	Incremental Query Optimizer Statistics in Amazon Redshift	2026	VLDB	4.9793485e-05
11,062	Highly-Efficient Large-Scale k-means with Individual Fairness	2026	VLDB	4.9793485e-05
11,376	FDBKeeper: Enabling Scalable Coordination Services for Metadata Management using Distributed Key-Value Databases	2025	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
49	Dremel: Interactive Analysis of Web-Scale Datasets	2010	VLDB	0.00043160717
52	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00041219077
61	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.000392237
91	On the Propagation of Errors in the Size of Join Results	1991	SIGMOD	0.0003475226
163	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.0002749118
179	The Vertica Analytic Database: C-Store 7 Years Later	2012	VLDB	0.00026611886
216	Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing	1998	VLDB	0.00024485024
233	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.00023783585
459	Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores	2020	VLDB	0.00017856221
1,135	Dremel: A Decade of Interactive SQL Analysis at Web Scale	2020	VLDB	0.00011891907
3,446	Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing	2019	SIGMOD	7.2942885e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	10,178	Rapid Adoption of Cloud Data Warehouse Technology Using Datometry Hyper-Q	2018	SIGMOD
2	2,915	F1 Query: Declarative Querying at Scale	2018	VLDB
3	13,820	Formal Approaches to Querying Big Data in Shared-Nothing Systems	2019	SIGMOD
4	7,610	On Scale Independence for Querying Big Data	2014	PODS
5	509	Goods: Organizing Google's Datasets	2016	SIGMOD
6	8,589	Big Data and Cloud Computing: New Wine or just New Bottles?	2010	VLDB
7	4,183	Intensional Associations Between Data and Metadata	2007	SIGMOD
8	3,700	Data Management Projects at Google	2006	SIGMOD
9	1,390	Metadata Management for Large Statistical Databases	1982	VLDB
10	4,530	BigLake: BigQuery’s Evolution toward a Multi-Cloud Lakehouse	2024	SIGMOD