Language: English (US)

Databricks Master Program with customer requirement and designing Data pipeline in Databricks

https://www.udemy.com/course/databricksazure/

What is Azure Databricks

Challenges to solutions with Azure Databricks

History of Azure Databricks

Azure Databricks Architecture

Azure Databricks Data Flow Architecture

Batch Data Processing with Azure Databricks

Stream Data Processing with Azure Databricks

Machine Learning on batch data with Azure Databricks

Interface

Workspace

Data Management

Computation Management

Model Management

Authentication and Authorization

How to login  into azure portal

How to create Azure Databricks

Dashboard

Home

Workspace

Recent

Data Management

Computation Management

Model Management

Job Management

Search

Creating and configuring clusters in Azure Databricks

How to create Python notebook

How to create Scala notebook

How to create SQL notebook

How to create R notebook

How to login  into azure portal

How to create Azure Databricks

Creating and configuring clusters in Azure Databricks

How to create notebook

How to detach and attach notebook to another cluster

How to Export Notebook in different formats

How to Import Notebook from different formats

How to clone Notebook

How to move Notebook

How to change default language of Notebook

How to move cells

How to create and delete cells

How to use shortcuts to execute cells

How to comment code in notebook

All Options available on Notebook

How to create new database in Azure Databricks

How to describe database in Azure Databricks

How to drop database in Azure Databricks

How to drop Non empty database in Azure Databricks

How to create table with UI

How to create table with Notebook

Difference between table with UI and table with notebook

How to create table in specified database with UI

How to create table in specified database with Notebook

How to create empty table

How to create Partition table with Notebook

How to append or overwrite partitions in table

How to describe table in Azure Databricks

How to drop table in Azure Databricks

How to upload data into Databricks File System

Command to create directory in dbfs

Command to create file and write data to it

Command to display file content

Command to list down content in a directory

Command to move files from one directory to another directory

Command to copy file from one directory to another directory

Command to remove file and directories

Command to mount and unmount file system

Command to list down mount

Command to refresh mount points

Command to install the packages

Command to find current notebook path/ from UI

Command to run one notebook from another notebook

Command to exit notebook execution

Command to list down secret scopes

What is widget and Types

How to create widget to pass dynamic values to Python notebook

How to read dynamic parameter values in Python notebook

How to remove widget from python notebook

How to create widget to pass dynamic values to Scala notebook

How to read dynamic parameter values in  Scala notebook

How to remove widget from scala notebook

How to run notebook whenever we change the dynamic parameter values

Widgets panel settings

Prerequisites to install databricks cli

How to install databricks cli

How to authenticate to databricks workspace from cli

How to create cluster

How to terminate cluster

How to start cluster

How to restart cluster

How to get list of clusters

How to get list of notebook

How to import notebook into databricks from local

How to export notebook

How to remove notebook

How to create folders

How to get list of folders in dbfs

How to create folder in dbfs

How to copy files from local to dbfs

How to move file from one folder to another folder

How to remove files from dbfs

How to remove folders from dbfs

How to install libraries

How to uninstall libraries

How to create job

How to run job

1. PySpark Read CSV file into DataFrame

Read single file

Read all CSV files in a directory

2. Options while reading CSV file

delimiter

InferSchema

header

3. Read CSV files with a user-specified schema