Navigating the Data Lake with DATAMARAN: Automatically Extracting Structure from Log Datasets

Summary: Datamaran automatically extracts structure from semi-structured log data, identifying endpoints and filtering noise. It discovers structures without boundaries, achieving 95% extraction accuracy on GitHub logs, ~66% higher than unsupervised schemes. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 5467
Venue: SIGMOD
Year: 2018
Pagerank: 6.8326441e-05
Overall Rank: 3,693 | 74.34%
DOI: 10.1145/3183713.3183746

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 8 of 8 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
936	Data Lake Management: Challenges and Opportunities	2019	VLDB	0.00015197838
3,254	Auto-Suggest: Learning-to-Recommend Data Preparation Steps Using Data Science Notebooks	2020	SIGMOD	7.3172324e-05
3,263	AS-Parser: Log Parsing Based on Adaptive Segmentation	2023	SIGMOD	7.307731e-05
5,279	Auto-Tables: Synthesizing Multi-Step Transformations to Relationalize Tables without Using Examples	2023	VLDB	5.5851818e-05
5,283	Explaining Dataset Changes for Semantic Data Versioning with Explain-Da-V	2023	VLDB	5.5843052e-05
8,090	PIDS: Attribute Decomposition for Improved Compression and Query Performance in Columnar Storage	2020	VLDB	4.5853298e-05
10,126	Visual Template Inference for Data Extraction from Documents	2026	SIGMOD	4.1905499e-05
11,696	Enabling Data Science for the Majority	2019	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
108	WebTables: Exploring the Power of Tables on the Web	2008	VLDB	0.00048345996
112	Potter's Wheel: An Interactive Data Cleaning System	2001	VLDB	0.00047010908
365	Annotating and Searching Web Tables Using Entities, Types and Relationships	2010	VLDB	0.00025616694
420	InfoGather: Entity Augmentation and Attribute Discovery By Holistic Matching with Web Tables	2012	SIGMOD	0.00023700634
534	RoadRunner: Towards Automatic Data Extraction from Large Web Sites	2001	VLDB	0.00020739037
586	Extracting Structured Data from Web Pages	2003	SIGMOD	0.0001963091
609	Goods: Organizing Google's Datasets	2016	SIGMOD	0.00019223217
814	Finding Related Tables	2012	SIGMOD	0.00016298739
1,005	Recovering Semantics of Tables on the Web	2011	VLDB	0.00014694038
1,266	Foofah: Transforming Data By Example	2017	SIGMOD	0.00012921038
1,316	Harvesting Relational Tables from Lists on the Web	2009	VLDB	0.00012616422
1,585	Answering Table Augmentation Queries from Unstructured Lists on the Web	2009	VLDB	0.00011245609
1,831	Data Wrangling: The Challenging Journey from the Wild to the Lake	2015	CIDR	0.0001037061
3,232	InfoGather+: Semantic Matching and Annotation of Numeric and Time-Varying Attributes in Web Tables	2013	SIGMOD	7.3324293e-05
3,283	Constance: An Intelligent Data Lake System	2016	SIGMOD	7.27606e-05
4,438	Robust Web Extraction: An Approach Based on a Probabilistic Tree-Edit Model	2009	SIGMOD	6.1819088e-05
5,408	Joint Unsupervised Structure Discovery and Information Extraction	2011	SIGMOD	5.5238635e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
5,805	Discovering Related Data At Scale	2021	VLDB	5.3197639e-05
636	Automatic segmentation of text into structured records	2001	SIGMOD	0.00018815341
7,642	Cross Modal Data Discovery over Structured and Unstructured Data Lakes	2023	VLDB	4.6856127e-05
11,882	Graph-based Exploration of Non-graph Datasets	2016	VLDB	4.1905499e-05
11,739	CoreKG: a Knowledge Lake Service	2018	VLDB	4.1905499e-05
8,919	Data Lakes Empowered by Knowledge Graph Technologies	2021	SIGMOD	4.4229886e-05
3,360	Organizing Data Lakes for Navigation	2020	SIGMOD	7.1719486e-05
10,803	A Demonstration of QueryArtisan: Real-Time Data Lake Analysis via Dynamically Generated Data Manipulation Code	2025	VLDB	4.1905499e-05
9,960	QueryArtisan: Generating Data Manipulation Codes for Ad-hoc Analysis in Data Lakes	2025	VLDB	4.2254157e-05
1,088	Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes	2024	VLDB	0.00014158762