Real world Modern Data Warehouse project for Data Engineers using Azure Data Factory, Sql, Data Lake, Databricks
Sub Category
- Other IT & Software
{inAds}
Objectives
- You will learn how to build data pipelines in Azure Data Factory (ADF) through a step-by-step approach.
- You will learn how to ingest data in different formats into Azure Data Lake Gen2 using Azure Data Factory (ADF)
- You will learn how to use and build various types of transformations in Azure Data Factory (ADF)
- You will learn hands-on implementations of building generic artifacts in Azure Data Factory (ADF) such as Flowlets and Templates
- You will learn how to transform data into the Medallion layers in Azure Data Lake Gen2 using Data Flows in Azure Data Factory (ADF)
- You will learn how to implement ETL/ELT using Azure Data Factory (ADF) in order to implement a Data Warehouse
- You will learn how to create generic metadata driven pipelines in Azure Data Factory (ADF) to implement the ETL/ELT processes
- You will learn the concepts of the Modern Data Warehouse Architecture and the Delta Lake
- You will learn the concepts of Slowly Changing Dimensions and how to implement them in Azure Data Factory (ADF)
- You will learn how to load transformed data from Azure Data Lake Storage Gen2 to Azure SQL Database using Azure Data Factory (ADF)
- You will learn how to implement a Delta Lake using Databricks Notebook Activity in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2
- You will learn how to transform your raw data into a finished data warehouse using Azure Data Factory (ADF) and then visualize it in PowerBI
- You will learn how to build pipelines using good practices and naming standards as in a typical real-world data engineering project
- You will learn how to implement different types of Triggers in Azure Data Factory (ADF) and how to schedule your data pipelines
- You will learn how to monitor pipelines using Azure Data Factory (ADF), Azure Monitor, and how to recover from pipeline failures
- By the end of this course you will have learnt all the topics required on Azure Data Factory to pass the Azure Data Engineer Associate Certification Exam DP203
Pre Requisites
- Basic understanding of Sql will be beneficial
- Basic understanding of cloud computing will be beneficial
- Experience in Azure is not required, we will learn this step by step within this course as we build the project
- Understanding of data warehouses will be beneficial, but not necessary, we will learn it as we build the project in the course
- An Azure account is required for the course, we will learn how you can create it during the course
FAQ
- Q. How long do I have access to the course materials?
- A. You can view and review the lecture materials indefinitely, like an on-demand channel.
- Q. Can I take my courses with me wherever I go?
- A. Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don't have an internet connection, some instructors also let their students download course lectures. That's up to the instructor though, so make sure you get on their good side!
{inAds}
Coupon Code(s)