Data

Following the Data Breadcrumbs: Data Lineage using OpenLineage

WHAT YOU'LL DISCOVER:
• Demystify data lineage and its critical role in modern data ecosystems
• Explore real-world use cases that demonstrate the power of lineage tracking:
- Accelerate incident response with upstream dependency analysis
- Conduct impact analysis for safer downstream changes
- Ensure compliance with regulations (HIPAA, GDPR, CCPA)
- Enable data governance and enhance data quality initiatives

DEEP DIVE INTO OPENLINEAGE:
• Understanding OpenLineage's open standard for metadata collection
• Real-time pipeline monitoring and metadata capture
• Integration with popular tools and platforms
• Contributing to the open-source ecosystem
• Live demonstrations of existing features

WHO SHOULD ATTEND:
This session is perfect for diverse data professionals, including:
• Data Engineers seeking end-to-end pipeline visibility
• Business Intelligence Analysts tracking data sources
• Analytics Engineers managing transformations
• Data Architects designing robust data systems
• Data Warehouse Engineers optimizing data flows
• Compliance Officers ensuring data governance

Whether you're troubleshooting data issues, planning pipeline changes, or ensuring compliance, this session will equip you with the knowledge to leverage OpenLineage for better data visibility and control.

Join us to learn how following your data's breadcrumbs (Data Lineage) can transform your team's efficiency and data reliability!

20 Mar

2:30 pm

2:40 pm PST

Add to Calendar

Speaker

Rahul Madan

Rahul is a Software Engineer II at Atlan, where he specializes in data lineage solutions for modern data stacks. As a key member of the data lineage team, he focuses on building robust lineage collection systems for Apache Airflow and Spark jobs using OpenLineage. With hands-on experience in implementing data lineage at scale, Rahul has made contributions to the open-source community, particularly to OpenLineage and Apache Airflow projects. His work has helped organizations better understand their data flows and improve their data governance practices. At Atlan, he helps organizations unlock the full potential of their data assets by implementing end-to-end lineage solutions that provide crucial visibility into data pipelines. His expertise spans across data orchestration, metadata management, and building scalable data systems. Rahul is passionate about sharing knowledge and actively contributes to the data community through open-source contributions and technical discussions.