What you'll learn

Pass the Databricks Data Engineer Associate certification

Understand the basics of Databricks

Use Databricks in your day-to-day job

Be confident in interviews requiring Databaricks knowledge

Requirements

No python nor spark knowledge required at all

Very basic SQL experience can be useful, but do not worry, we will go over the basics when required

Description

If you are interested in learning Databricks while having no background at all, and successfully pass the official Data Engineer Associate certification, you are at the right place!At the end of this course, you will:Understand how Databricks was designed Control Plane, Compute Plane and their integration with your cloud providerThe benefits of a Data Lakehouse over Data Warehouse and Data LakesThe Medallion architectureHow to navigate the tools & features provided by DatabricksClustersNotebooksSQL Engine (SQL Warehouse Serverless, …)SparkTable constraintsManipulate data easilyRead from tables & filesApply various Spark SQL methodsUse stored views, temporary views, global temporary viewsNavigate externable tables & managed tables and their differencesData Storage of the tables (parquet, transactional logs, …)Understand the benefits of Delta LakeACID TransactionsData storage optimizationNavigate the history of your tables, and revert to previous versionsUse Delta Live Tables to run your Data Engineering pipelinesStreaming tables for low latencyThe different pipeline modes to schedule jobs or run continuous jobsPlan your tasks Investigate logsUnderstand Change Data Stream in an event based architectureUnderstand how Data Governance is applied on DatabricksUnity Catalog vs Hive MetastoreThe various entities availableThe access rights for each of these entitiesWith all the knowledge, and experience through a lot of Hands On, acquired through this course, you will be ready to pass the official Databricks Data Engineer Associate certification!