Azure Synapse Analytics For Data Engineers -Hands On Project

Azure Synapse Analytics For Data Engineers -Hands On Project, available at $94.99, has an average rating of 4.6, with 132 lectures, based on 3143 reviews, and has 23661 subscribers.

You will learn about You will learn how to build a real world project using Azure Synapse Analytics. This course has been taught using real world data from NYC Taxi Trips data You will acquire professional level data engineering skills in Azure Synapse Analytics You will learn how to create SQL scripts and Spark notebooks in Azure Synapse Analytics You will learn how to create dedicated SQL pools and spark pools in Azure Synapse Analytics You will learn how to enable synapse link and enable analytic store in Cosmos DB You will learn how to ingest and transform data Serverless SQL Pool and Spark Pool You will learn how to load data into dedicated SQL Pool You will learn how to serve data to Power BI from Serverless SQL Pool and Dedicated SQL Pool You will learn how to execute scripts and notebooks using Synapse Pipelines and Triggers You will learn how to do operational reporting from the data stored in Cosmos DB using Azure Synapse Analytics You will learn how to build reports in Power BI for the data stored in Azure Synapse Analytics This course is ideal for individuals who are University students looking for a career in Data Engineering or IT developers working on other disciplines trying to move to Data Engineering or Data Engineers/ Data Warehouse Developers currently working on on-premises technologies, or other cloud platforms such as AWS or GCP who want to learn Azure Data Technologies or Data Architects looking to gain an understanding about Azure Data Engineering stack It is particularly useful for University students looking for a career in Data Engineering or IT developers working on other disciplines trying to move to Data Engineering or Data Engineers/ Data Warehouse Developers currently working on on-premises technologies, or other cloud platforms such as AWS or GCP who want to learn Azure Data Technologies or Data Architects looking to gain an understanding about Azure Data Engineering stack.

Enroll now: Azure Synapse Analytics For Data Engineers -Hands On Project

Summary

Title: Azure Synapse Analytics For Data Engineers -Hands On Project

Price: $94.99

Average Rating: 4.6

Number of Lectures: 132

Number of Published Lectures: 132

Number of Curriculum Items: 132

Number of Published Curriculum Objects: 132

Original Price: $27.99

Quality Status: approved

Status: Live

What You Will Learn

You will learn how to build a real world project using Azure Synapse Analytics. This course has been taught using real world data from NYC Taxi Trips data

You will acquire professional level data engineering skills in Azure Synapse Analytics

You will learn how to create SQL scripts and Spark notebooks in Azure Synapse Analytics

You will learn how to create dedicated SQL pools and spark pools in Azure Synapse Analytics

You will learn how to enable synapse link and enable analytic store in Cosmos DB

You will learn how to ingest and transform data Serverless SQL Pool and Spark Pool

You will learn how to load data into dedicated SQL Pool

You will learn how to serve data to Power BI from Serverless SQL Pool and Dedicated SQL Pool

You will learn how to execute scripts and notebooks using Synapse Pipelines and Triggers

You will learn how to do operational reporting from the data stored in Cosmos DB using Azure Synapse Analytics

You will learn how to build reports in Power BI for the data stored in Azure Synapse Analytics

Who Should Attend

University students looking for a career in Data Engineering

IT developers working on other disciplines trying to move to Data Engineering

Data Engineers/ Data Warehouse Developers currently working on on-premises technologies, or other cloud platforms such as AWS or GCP who want to learn Azure Data Technologies

Data Architects looking to gain an understanding about Azure Data Engineering stack

Target Audiences

University students looking for a career in Data Engineering

IT developers working on other disciplines trying to move to Data Engineering

Data Engineers/ Data Warehouse Developers currently working on on-premises technologies, or other cloud platforms such as AWS or GCP who want to learn Azure Data Technologies

Data Architects looking to gain an understanding about Azure Data Engineering stack

Welcome!

I am looking forward to helping you with learning one of the in-demand data engineering tools in the cloud, Azure Synapse Analytics! This course has been taught with implementing a data engineering solution using Azure Synapse Analytics for a real world project of analysing and reporting on NYC Taxi trips data.

This is like no other course in Udemy for Azure Synapse Analytics. Once you have completed the course including all the assignments, I strongly believe that you will be in a position to start a real world data engineering project on your own and also proficient on Azure Synapse Analytics.  The primary focus of the course is Azure Synapse Analytics, but it also covers the relevant concepts and connectivity to the other technologies mentioned.

The course follows a logical progression of a real world project implementation with technical concepts being explained and the scripts and notebooks being built at the same time. Even though this course is not specifically designed to teach you the skills required for passing the exams Azure Data Engineer Associate Certification [DP-203] or Designing and Implementing Enterprise-Scale Analytics Solutions Using Microsoft Azure and Microsoft Power BI [DP-500], it can greatly help you get most of the necessary skills required for the exams.

I value your time as much as I do mine. So, I have designed this course to be fast-paced and to the point. Also, the course has been taught with simple English and no jargons. I start the course from basics and by the end of the course you will be proficient in the technologies used.

Currently the course teaches you the following

Azure Synapse Analytics Architecture

Serverless SQL Pool

Spark Pool

Dedicated SQL Pool

Synapse Pipelines

Synapse Link for Cosmos DB / Hybrid Transactional and Analytical Processing (HTAP) capability

Power BI Integration with Azure Synapse Analytics

Azure Data Lake Storage Gen2 integration with Azure Synapse Analytics

Project using NYC Taxi Trips data using the above technologies

Please note that the following are not currently covered

Data Flows

Advanced concepts around Dedicated SQL Pool

Spark Programming

SQL Fundamentals

Course Curriculum

Chapter 1: Introduction

Lecture 1: Course Introduction

Lecture 2: Course Materials Download

Lecture 3: Useful Links

Chapter 2: Azure Subscription (Optional)

Lecture 1: Creating Azure Account

Lecture 2: Azure Portal Overview

Chapter 3: Azure Synapse Analytics Overview

Lecture 1: Introduction to Azure Synapse Analytics

Lecture 2: History of Data Warehouse/ Data Lakes

Lecture 3: Emergence of Azure Synapse Analytics

Lecture 4: Create Azure Synapse Analytics Workspace

Lecture 5: Azure Synapse Analytics Workspace Overview

Lecture 6: Azure Synapse Studio Overview

Lecture 7: Data Hub Overview

Lecture 8: Develop Hub Overview

Lecture 9: Integrate Hub Overview

Lecture 10: Monitor Hub Overview

Lecture 11: Manage Hub Overview

Chapter 4: NYC Taxi Project Overview

Lecture 1: Section Overview

Lecture 2: NYC Taxi Data Source Overview

Lecture 3: NYC Taxi Data Files Overview

Lecture 4: Upload NYC Taxi Data to Data Lake

Lecture 5: Project Requirements Overview

Lecture 6: Solution Architecture Overview

Chapter 5: Serverless SQL Pool – Overview

Lecture 1: Section Overview

Lecture 2: Introduction to Serverless SQL Pool

Lecture 3: Serverless SQL Pool Cost Control

Lecture 4: Connect from Azure Data Studio to Serverless SQL Pool (Optional)

Chapter 6: Serverless SQL Pool – Query CSV

Lecture 1: Section Overview

Lecture 2: OPENROWSET Function Overview

Lecture 3: Query Taxi Zone File (CSV File)

Lecture 4: Specify Data Types

Lecture 5: Specify Collation

Lecture 6: Query Subset of Columns

Lecture 7: Debugging & Identifying Errors

Lecture 8: Use External Data Source

Lecture 9: Query Calendar File (CSV File) – Assignment

Lecture 10: Query Vendor File (Quoted and Escaped Columns)

Lecture 11: Query Trip Type File (TSV File) – Assignment

Chapter 7: Serverless SQL Pool – Query JSON

Lecture 1: Section Overview

Lecture 2: Query Payment Type (Single Line JSON) – JSON_VALUE Function

Lecture 3: Query Payment Type (Single Line JSON) – OPENJSON Function

Lecture 4: Query JSON Array

Lecture 5: Query Standard JSON

Lecture 6: Query Multi Line JSON (Assignment)

Chapter 8: Serverless SQL Pool – Query Folders & Multiple Files

Lecture 1: Query Folders and Subfolders

Lecture 2: File Metadata Functions

Chapter 9: Serverless SQL Pool – Query Columnar Formats

Lecture 1: Query Single Parquet File

Lecture 2: Query Folders and Sub Folders (Assignment)

Lecture 3: Query Delta files

Chapter 10: Serverless SQL Pool – Data Discovery

Lecture 1: Data Discovery Overview

Lecture 2: Identify Duplicates

Lecture 3: Data Quality Checks

Lecture 4: Joining Files

Lecture 5: Transform Data

Lecture 6: Data Discovery Assignment

Chapter 11: Serverless SQL Pool – Data Virtualisation

Lecture 1: Data Virtualisation Overview

Lecture 2: Introduction to External Tables

Lecture 3: Create External Table – CSV

Lecture 4: Handling Rejections

Lecture 5: Create External Table – CSV (Assignment)

Lecture 6: Create External Table – Parquet

Lecture 7: Create External Table – Delta (Assignment)

Lecture 8: Views – Introduction

Lecture 9: Create View for JSON files

Lecture 10: Create View for JSON files (Assignment)

Lecture 11: Partition Pruning

Chapter 12: Serverless SQL Pool – Data Ingestion

Lecture 1: Section Overview

Lecture 2: CREATE EXTERNAL TABLE AS (CETAS)

Lecture 3: Transform to Parquet

Lecture 4: Transform to Parquet (Assignment)

Lecture 5: Transform JSON to Parquet

Lecture 6: Transform JSON to Parquet (Assignment)

Lecture 7: Transform Partitioned Data to Parquet

Lecture 8: Introduction to Stored Procedure

Lecture 9: Transform Partitioned Data – Solution

Lecture 10: Transform Partitioned Data – Solution Lab

Lecture 11: Create View (assignment)

Chapter 13: Serverless SQL Pool – Data Transformation

Lecture 1: Section Overview

Lecture 2: Project Requirements

Lecture 3: Select Statement

Lecture 4: Stored Procedure

Lecture 5: Create View

Lecture 6: Assignment

Chapter 14: Synapse Pipelines & Triggers

Lecture 1: Section Overview

Lecture 2: Synapse Pipelines Overview

Lecture 3: Synapse Pipeline Components

Lecture 4: Transformation Pipeline Design – Taxi Zone

Instructors

Ramesh Retnasamy
Senior Data Engineer/ Machine Learning Engineer

Rating Distribution

1 stars: 12 votes

2 stars: 17 votes

3 stars: 160 votes

4 stars: 995 votes

5 stars: 1959 votes

Frequently Asked Questions

How long do I have access to the course materials?

You can view and review the lecture materials indefinitely, like an on-demand channel.

Can I take my courses with me wherever I go?

Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don’t have an internet connection, some instructors also let their students download course lectures. That’s up to the instructor though, so make sure you get on their good side!