Implementing a Data Analytics Solution with Azure Databricks
- Course Code M-DP3011
- Duration 1 day
Course Delivery
Course Delivery
This course is available in the following formats:
-
Company Event
Event at company
-
Public Classroom
Traditional Classroom Learning
-
Virtual Learning
Learning that is virtual
Request this course in a different delivery format.
Course Overview
TopLearn how to harness the power of Apache Spark and powerful clusters running on the Azure Databricks platform to run large data engineering workloads in the cloud.
Company Events
These events can be delivered exclusively for your company at our locations or yours, specifically for your delegates and your needs. The Company Events can be tailored or standard course deliveries.
Course Schedule
TopCourse Objectives
Top- Explore Azure Databricks
- Perform data analysis with Azure Databricks
- Use Apache Spark in Azure Databricks
- Manage data with Delta Lake
- Build data pipelines with Delta Live Tables
- Deploy workloads with Azure Databricks Workflows
- Use SQL Warehouses in Azure Databricks
- Run Azure Databricks Notebooks with Azure Data Factory
Course Content
TopModule 1 : Explore Azure Databricks
- Provision an Azure Databricks workspace
- Identify core workloads for Azure Databricks
- Use Data Governance tools Unity Catalog and Microsoft Purview
- Describe key concepts of an Azure Databricks solution
Module 2 : Perform data analysis with Azure Databricks
- Ingest data using Azure Databricks.
- Using the different data exploration tools in Azure Databricks.
- Analyze data with DataFrame APIs.
Module 3 : Use Apache Spark in Azure Databricks
- Describe key elements of the Apache Spark architecture.
- Create and configure a Spark cluster.
- Describe use cases for Spark.
- Use Spark to process and analyze data stored in files.
- Use Spark to visualize data.
Module 4 : Manage data with Delta Lake
- What Delta Lake is
- How to manage ACID transactions using Delta Lake
- How to use schema versioning and time travel in Delta Lake
- How to maintain data integrity with Delta Lake
Module 5 : Build data pipelines with Delta Live Tables
- Describe Delta Live Tables
- Ingest data into Delta Live Tables
- Use Data Pipelines for real time data processing
Module 6 : Deploy workloads with Azure Databricks Workflows
- What Azure Databricks Workflows are
- The key components and benefits of Azure Databricks Workflows
- How to deploy workloads using Azure Databricks Workflows
Module 7 : Use SQL Warehouses in Azure Databricks
- Create and configure SQL Warehouses in Azure Databricks.
- Create databases and tables.
- Create queries and dashboards.
Module 8 : Run Azure Databricks Notebooks with Azure Data Factory
- Describe how Azure Databricks notebooks can be run in a pipeline.
- Create an Azure Data Factory linked service for Azure Databricks.
- Use a Notebook activity in a pipeline.
- Pass parameters to a notebook.
Course Prerequisites
TopNone