Overview What You Will Learn Curriculum Instructor

Course Overview

As more and more data get stored and evolved over the time, the problem is generally how do you use that data and how to churn meaningful data out. In this course you will learn about how to use Azure data factory to process, structure and streamline datasets and build a reliable end to end data pipeline. Azure Data Factory is a data-integration service based on the Cloud that allows us to create data-driven workflows in the cloud for orchestrating and automating data movement and data transformation. Data Factory is a perfect ETL (extract, transform, load) tool on Cloud. Data Factory is designed to deliver extraction, transformation, and loading processes within the cloud.

As you begin the course, you will get introduced to Azure Data Factory, followed by implementation and configuration of Azure Data Factory. You’ll also get to work with data factory wherein you’ll get to know about triggers and how to trigger data pipeline. Lastly, you’ll also find out how to work with datasets and configure CICD pipeline for spark jobs.

By the end of this course, you’ll have thorough understanding of Azure Data Factory.

What You Will Learn

  • Find out how to set up data pipeline using Azure Data Factory.
  • Learn to build production ready data pipeline.
  • Learn about triggers and to use them to trigger data pipeline.
  • Configuration of CI CD pipeline for spark jobs via Azure Data factory
  • Explore how to monitor and trace application using Azure Data factory.
  • Learn to transform data flow.

Program Curriculum

  • Introduction to Azure Data Factory
  • Data Factory Core Components
  • Configuring Azure Data Factory
  • $7 Million Cybersecurity Scholarship by EC-Council
  • Chapter 1 Quiz

  • Automate Data Factory with Terraform
  • Understand Pipeline, Activities, and Linked Service
  • Move File Using Template
  • Integrating Code Repo with Data Factory
  • Chapter 2 Quiz

  • Trigger Pipeline via StorageAccount Event
  • Databricks Integration
  • Mapping Data Flow
  • Transformation via Select
  • Transformation via Aggregation
  • Chapter 3 Quiz

  • Generate Alerts for ADF Activities
  • Logging and Creating Dashboard for ADF
  • Chapter 4 Quiz

Instructor

Shantanu Das

Infrastructure Consultant

Shantanu Das is a seasoned author for many DevOps courses like Puppet, Microservices, Terraform & Azure DevOps. He has a worked as a Site Reliability Engineer with solid hands-on experience in Google Cloud and Microsoft Azure technologies in Cloud/DevOps practice, architecting solutions along with migrating, managing supporting enterprise suite of applications. He has helped fortune 500 companies in automating build and deployments of code which needs to be shipped to different environments. Also, he has experience in hosting and supporting dockerized applications via Kubernetes on GCP, support Google managed Hadoop/data proc clusters along with ETL solutions built on top of Airflow backed by Hive and MySQL DB.

Join over 1 Million professionals from the most renowned Companies in the world!

certificate

Empower Your Learning with Our Flexible Plans

Invest in your future with our flexible subscription plans. Whether you're just starting out or looking to enhance your expertise, there's a plan tailored to meet your needs. Gain access to in-demand skills and courses for your continuous learning needs.

Monthly Plans
Annual Plans
Save 20% with our annual plans!

Pro

Ideal for continuous learning, offering extensive resources with 600+ courses and diverse Learning Paths to enhance your skills.

$ 499.00
Billed annually or $59.00 billed monthly
Get Started Now
Start your 7-day trial for $1

What is included

  • 700+ Premium Short Courses
  • 50+ Structured Learning Paths
  • Validation of Completion with all courses and learning paths
  • New Courses added every month
Early Access Offer

Pro +

Experience immersive learning with Practice Labs, CTF Challenges, and exclusive EC-Council certifications for comprehensive skill-building.

$ 599.00
Billed annually or $69.00 billed monthly
Get Started Now
Start your 7-day trial for $1

Everything in Pro and

  • 800+ Practice Lab exercises with guided instructions
  • 150+ CTF Challenges with detailed walkthroughs
  • New Practice Labs and Challenges added every month
  • 3 Official EC-Council Essentials Certifications¹ (retails at $897!)
    Exclusive Bonus with Annual Plans

¹This plan includes Digital Forensics Essentials (DFE), Ethical Hacking Essentials (EHE), and Network Defense Essentials (NDE) certifications. No other EC-Council certifications are included.

Related Courses

  • AWS Certified Security Specialty - Cert Prep

    AWS Certified Security Specialty - Cert Prep

    Short Course

    AWS Certified Security Specialty - Cert Prep

    Cloud Security

    Everything that you need to know to pass the Amazon Web Servi...

    $49.99

    Intermediate

    5 hr 48 m

  • Azure Kubernetes Service - Deploy ElasticStack (ELK)

    Azure Kubernetes Service - Deploy ElasticStack (ELK)

    Short Course

    Azure Kubernetes Service - Deploy ElasticStack (ELK)

    Cloud Security

    Learn Kubernetes fundamentals right from scratch

    $49.99

    Intermediate

    4 hr 0 m

  • Containers and Kubernetes on Azure

    Containers and Kubernetes on Azure

    Short Course

    Containers and Kubernetes on Azure

    Cloud Security

    Containerize your applications with Containers and Kubernetes...

    $49.99

    Beginner

    1 hr 30 m

  • Introduction to Azure Cloud Security Tools and Services

    Introduction to Azure Cloud Security Tools and Services

    Short Course

    Introduction to Azure Cloud Security Tools and Services

    Cloud Security

    Explore the Microsoft Azure Cloud Platform and gain an unders...

    $49.99

    Beginner

    1 hr 39 m

  • AZ 900 - Basics of Cloud Computing

    AZ 900 - Basics of Cloud Computing

    Short Course

    AZ 900 - Basics of Cloud Computing

    Cloud Security

    Everything you need to know about Cloud Computing with Azure

    $49.99

    Beginner

    1 hr 0 m

  • Entra ID and Entra Domain Services

    Entra ID and Entra Domain Services

    Short Course

    Entra ID and Entra Domain Services

    Cloud Security

    Learn how Entra ID (Azure Active Directory), On-Premises AD a...

    $49.99

    Intermediate

    4 hr 0 m

  • Introduction to Cloud Computing

    Introduction to Cloud Computing

    Short Course

    Introduction to Cloud Computing

    Cloud Security

    Learn about evolution of cloud and cloud models

    $49.99

    Beginner

    2 hr 0 m

  • Serverless Computing on AWS with Lambda, API Gateway, S3 and DynamoDB

    Serverless Computing on AWS with Lambda, API Gateway, S3 and DynamoDB

    Short Course

    Serverless Computing on AWS with Lambda, API Gateway, S3 and D...

    Cloud Security

    Master serverless computing technologies on AWS while develop...

    $59.99

    Intermediate

    4 hr 0 m

1 8