Modern Data Engineering on Databricks
Welcome to “Modern Data Engineering on Databricks” – a hands-on training workshop designed to demonstrate the benefits of data engineering on the Databricks Lakehouse.
In this workshop, you’ll learn how Databricks and Delta Live Tables have revolutionized data engineering with a comprehensive and immersive experience, intelligently removing the pain and suffering associated with edge cases and exceptions.
As an engineer, Databricks allows you to leverage the full power of both SQL and Python, bring your own IDE to the table, and leverage broad tooling as first-class citizens, ensuring that you can work exactly the way you want to.
Furthermore, the collaborative nature of engineering in Databricks means that you can work together with your colleagues in real-time, making it easy for everyone to be on the same page building the best possible solution.
In the workshop we will show you how to:
- Complete a full bronze-silver-gold pipeline utilizing Delta Live Tables
- Understand the differences between batch vs streaming
- Understand AutoLoader within Delta Live Tables for incremental data ingestion
- Get quick data quality / data validation with DLT
- Build a data observability dashboard in minutes from the rich DLT log
- Use both SQL and Python orientation
- Explore when and how to use Photon
Don't miss this opportunity!
Explore the benefits of modern data engineering on Databricks.
Take your data engineering skills to the next level!
