Overview What You Will Learn Curriculum Instructor

Course Overview

As more and more data get stored and evolved over the time, the problem is generally how do you use that data and how to churn meaningful data out. In this course you will learn about how to use Azure data factory to process, structure and streamline datasets and build a reliable end to end data pipeline. Azure Data Factory is a data-integration service based on the Cloud that allows us to create data-driven workflows in the cloud for orchestrating and automating data movement and data transformation. Data Factory is a perfect ETL (extract, transform, load) tool on Cloud. Data Factory is designed to deliver extraction, transformation, and loading processes within the cloud.

As you begin the course, you will get introduced to Azure Data Factory, followed by implementation and configuration of Azure Data Factory. You’ll also get to work with data factory wherein you’ll get to know about triggers and how to trigger data pipeline. Lastly, you’ll also find out how to work with datasets and configure CICD pipeline for spark jobs.

By the end of this course, you’ll have thorough understanding of Azure Data Factory.

What You Will Learn

  • Find out how to set up data pipeline using Azure Data Factory.
  • Learn to build production ready data pipeline.
  • Learn about triggers and to use them to trigger data pipeline.
  • Configuration of CI CD pipeline for spark jobs via Azure Data factory
  • Explore how to monitor and trace application using Azure Data factory.
  • Learn to transform data flow.

Program Curriculum

  • Introduction to Azure Data Factory
  • Data Factory Core Components
  • Configuring Azure Data Factory
  • $7 Million Cybersecurity Scholarship by EC-Council
  • Chapter 1 Quiz

  • Automate Data Factory with Terraform
  • Understand Pipeline, Activities, and Linked Service
  • Move File Using Template
  • Integrating Code Repo with Data Factory
  • Chapter 2 Quiz

  • Trigger Pipeline via StorageAccount Event
  • Databricks Integration
  • Mapping Data Flow
  • Transformation via Select
  • Transformation via Aggregation
  • Chapter 3 Quiz

  • Generate Alerts for ADF Activities
  • Logging and Creating Dashboard for ADF
  • Chapter 4 Quiz
Load more modules

Instructor

Shantanu Das

Infrastructure Consultant

Shantanu Das is a seasoned author for many DevOps courses like Puppet, Microservices, Terraform & Azure DevOps. He has a worked as a Site Reliability Engineer with solid hands-on experience in Google Cloud and Microsoft Azure technologies in Cloud/DevOps practice, architecting solutions along with migrating, managing supporting enterprise suite of applications. He has helped fortune 500 companies in automating build and deployments of code which needs to be shipped to different environments. Also, he has experience in hosting and supporting dockerized applications via Kubernetes on GCP, support Google managed Hadoop/data proc clusters along with ETL solutions built on top of Airflow backed by Hive and MySQL DB.

Join over 1 Million professionals from the most renowned Companies in the world!

certificate

Fastest Way to Level Up Your Cybersecurity Skills

Invest in your future with flexible subscription plans that give you access to the world’s largest online cybersecurity course library. Whether you're exploring cybersecurity courses for beginners or advancing your expertise,
access in-demand courses, practical labs, and CTF challenges designed to support continuous learning.

Monthly Plans
Annual Plans
Save 20% with our annual plans!

Pro

Build your cybersecurity skills with 900+ bite-sized courses and curated learning paths designed for continuous learning.

$ 69.00
Billed monthly or $599.00 billed annually
Get Started Now
Start your 7-day trial for $1

What is included

  • 880+ Premium Short Courses
  • 70+ Structured Learning Paths
  • Validation of Completion with all courses and learning paths
  • New Courses added every month
Early Access Offer

Pro +

Develop real-world cybersecurity skills through hands-on labs and CTF challenges designed for practical learning.

$ 79.00
Billed monthly or $699.00 billed annually
Get Started Now
Start your 7-day trial for $1

Everything in Pro, Plus:

  • 1600+ Hands-on lab exercises with guided instructions
  • 150+ CTF Challenges with detailed walkthroughs
  • New Hands-on Labs and Challenges added every month

Related Courses

  • Bootstrap 4 Quick Website Bootstrap Components Course

    Bootstrap 4 Quick Website Bootstrap Components Course

    Short Course

    Bootstrap 4 Quick Website Bootstrap Components Course

    Software Development

    Explore the basics of Bootstrap and learn to create a website...

    $49.99

    Beginner

    1 hr 30 m

  • CCNA - Understanding Routers and Switches

    CCNA - Understanding Routers and Switches

    Short Course

    CCNA - Understanding Routers and Switches

    Security Architecture and Operations

    A comprehensive guide to understanding the in-depth functioni...

    $49.99

    Intermediate

    2 hr 0 m

  • The Complete Full-Stack JavaScript Course

    The Complete Full-Stack JavaScript Course

    Short Course

    The Complete Full-Stack JavaScript Course

    Software Development

    Learn full-stack web development using JavaScript (ReactJS, N...

    $79.99

    Beginner

    24 hr 17 m

  • React.JS for Ecommerce: Building a Store with React.JS

    React.JS for Ecommerce: Building a Store with React.JS

    Short Course

    React.JS for Ecommerce: Building a Store with React.JS

    DevSecOps

    From React.js Fundamentals to Crafting an Online Storefront

    $49.99

    Advanced

    3 hr 30 m

  • CISSP Certification Domains 5, 6, 7, and 8 Video Training

    CISSP Certification Domains 5, 6, 7, and 8 Video Training

    Short Course

    CISSP Certification Domains 5, 6, 7, and 8 Video Training

    Cybersecurity

    This course is ideal for individuals who desire to pass the I...

    $69.99

    Intermediate

    6 hr 30 m

  • Helm 3 - Package Manager for Kubernetes

    Helm 3 - Package Manager for Kubernetes

    Short Course

    Helm 3 - Package Manager for Kubernetes

    Software Development

    A must tool for every DevOps engineer

    $49.99

    Intermediate

    1 hr 27 m

  • Learn Ethical Hacking by Hacking Real Websites Legally

    Learn Ethical Hacking by Hacking Real Websites Legally

    Short Course

    Learn Ethical Hacking by Hacking Real Websites Legally

    Vulnerability Assessment and Pentesting

    Fun way to learn ethical hacking by playing online hacking ga...

    $69.99

    Beginner

    4 hr 18 m

  • Mastering Ansible Playbooks: Debugging and Security

    Mastering Ansible Playbooks: Debugging and Security

    Short Course

    Mastering Ansible Playbooks: Debugging and Security

    Software Development

    Securing and Automating Linux and Windows Systems with Advanc...

    $99.99

    Advanced

    5 hr 34 m

1 50
View all