Overview What You Will Learn Curriculum Instructor

Course Overview

As more and more data is getting stored and evolving over time, the challenge is how to use that data and extract meaningful insights from it. Azure Databricks is a fast, easy, and collaborative Apache Spark-based big data analytics service designed for data science and data engineering.

In this course, you will learn how to work with unstructured data and turn it into meaningful insights. We will kick-start Azure Databricks by understanding how it evolved and why there was a need for another big data solution. Further in this course, we will work with smaller datasets and mount Azure Blob Storage to store and maintain processed data. You will also learn about DBFS (Databricks File System), where we will process CSV data stored at production scale. Finally, we will explore security and how to enforce cluster policies for different teams by creating cluster policies using JSON templates and applying them to existing and new clusters. We will also integrate a Git repository with Databricks to support continuous integration and delivery and eventually set up CI/CD for our Spark application using Azure DevOps.

By the end of this course, you’ll master the deployment of Azure Databricks and be well equipped with the knowledge of how to read and transform data and load the transformed data into a sink.

What You Will Learn

  • Azure Databricks deployment
  • What is a notebook, job, and a cluster?
  • How to read and transform data
  • How to load the transformed data into a sink
  • Deploy JOB written to process data into a spark cluster
  • Perform automated deployment

Program Curriculum

  • Introduction to Big Data
  • Spark Internals and Architecture
  • Overview of Azure Databricks
  • $7 Million Cybersecurity Scholarship by EC-Council
  • Chapter 1 Quiz

  • Create and Deploy Azure Databricks Workspace
  • Introduction to Databricks Utility via CLI
  • Create Notebooks and Run Initial Databricks Command to Validate
  • Manage and Automate Databricks Deployment Using Terraform
  • Running Your First Spark Query
  • Global Init Script
  • Chapter 2 Quiz

  • Mount Azure Blob Storage
  • Reading Data from External Sources
  • Understand How to Read Data, Filter Data, and Create Data Frames
  • Introduction to Streaming Application
  • Chapter 3 Quiz

  • Configuring Security in Databrick Environment?
  • Deploy the Spark Application as a Job in a Databricks Cluster
  • Configure and Integrate GIT Repo with Databricks
  • Configure CICD of Jobs Using Azure DevOps
  • Chapter 4 Quiz
Load more modules

Instructor

Shantanu Das

Shantanu Das is a seasoned author for many DevOps courses like Puppet, Microservices, Terraform, and Azure DevOps. He has worked as a Site Reliability Engineer with solid hands-on experience in Google Cloud and Microsoft Azure technologies in Cloud/DevOps practice, architecting solutions along with migrating, managing, and supporting enterprise suites of applications.

He has helped Fortune 500 companies automate the build and deployment of code that needs to be shipped to different environments. He also has experience in hosting and supporting Dockerized applications via Kubernetes on GCP, supporting Google-managed Hadoop/Dataproc clusters, along with ETL solutions built on top of Airflow backed by Hive and MySQL DB.

Join over 1 Million professionals from the most renowned Companies in the world!

certificate

Choose the Pro Plan That Fits Your Learning Journey

Invest in your future with flexible Pro subscription plans. Whether you're starting your cybersecurity journey or expanding your expertise, choose the membership duration that works for you and gain access to our complete learning platform.

Monthly Plans
Annual Plans
Save 20% with our annual plans!

Pro

Ideal for continuous learning, offering extensive resources with 900+ courses and diverse Learning Paths to enhance your skills.

$ 599.00
Billed annually or $69.00 billed monthly
Get Started Now
Start your 7-day trial for $1

What is included

  • Access to 900+ Premium Short Courses
  • 70+ Structured Learning Paths
  • Validation of Completion with All Courses and Learning Paths
  • New Courses Added Every Month
Early Access Offer

Pro +

Experience immersive learning with Practice Labs and CTF Challenges for comprehensive skill-building.

$ 699.00
Billed annually or $79.00 billed monthly
Get Started Now
Start your 7-day trial for $1

Everything in Pro and

  • 500+ Practice Labs with Guided Instructions
  • 400+ CTF Challenges with Detailed Walkthroughs
  • New Practice Labs and Challenges Added Every Month

Related Courses

  • Bootstrap 4 Quick Website Bootstrap Components Course
    Short Course

    Bootstrap 4 Quick Website Bootstrap Components Course

    Software Development

    Explore the basics of Bootstrap and learn to create a website...

    $49.99

    Beginner

    1 hr 30 m

  • CCNA - Understanding Routers and Switches
    Short Course

    CCNA - Understanding Routers and Switches

    Security Architecture and Operations

    A comprehensive guide to understanding the in-depth functioni...

    $49.99

    Intermediate

    2 hr 0 m

  • The Complete Full-Stack JavaScript Course
    Short Course

    The Complete Full-Stack JavaScript Course

    Software Development

    Learn full-stack web development using JavaScript (ReactJS, N...

    $79.99

    Beginner

    24 hr 17 m

  • React.JS for Ecommerce: Building a Store with React.JS
    Short Course

    React.JS for Ecommerce: Building a Store with React.JS

    DevSecOps

    From React.js Fundamentals to Crafting an Online Storefront

    $49.99

    Advanced

    3 hr 30 m

  • CISSP Certification Domains 5, 6, 7, and 8 Video Training
    Short Course

    CISSP Certification Domains 5, 6, 7, and 8 Video Training

    Cybersecurity

    This course is ideal for individuals who desire to pass the I...

    $69.99

    Intermediate

    6 hr 30 m

  • Helm 3 - Package Manager for Kubernetes
    Short Course

    Helm 3 - Package Manager for Kubernetes

    Software Development

    A must tool for every DevOps engineer

    $49.99

    Intermediate

    1 hr 27 m

  • Learn Ethical Hacking by Hacking Real Websites Legally
    Short Course

    Learn Ethical Hacking by Hacking Real Websites Legally

    Vulnerability Assessment and Pentesting

    Fun way to learn ethical hacking by playing online hacking ga...

    $69.99

    Beginner

    4 hr 18 m

  • Mastering Ansible Playbooks: Debugging and Security
    Short Course

    Mastering Ansible Playbooks: Debugging and Security

    Software Development

    Securing and Automating Linux and Windows Systems with Advanc...

    $99.99

    Advanced

    5 hr 34 m

1 50
View all