by Emmanuel Asimadi, Tomasz Lelek | Released March 2018 | ISBN: 9781788628242

Get in-depth knowledge of Machine Learning libraries, analytics, and prediction with Apache SparkAbout This VideoLearn the best practices involved in building, evaluating, tuning, and deploying Spark pipelines.Stream applications to provide real-time insights and predictionsyou're your business.Perform Natural Language Processing and Deep Learning in Spark.In DetailThe aim of this course is to provide a practical understanding of advanced Machine Learning algorithms in Apache Spark to make predictions and recommendation and derive insights from large distributed datasets. This course starts with an introduction to the key concepts and data types that are fundamental to understanding distributed data processing and Machine Learning with Spark.Further to this, we provide practical recipes that demonstrate some of the most popular algorithms in Spark, leading to the creation of sophisticated Machine Learning pipelines and applications. The final sections are dedicated to more advanced use cases for Machine Learning: streaming, Natural Language Processing, and Deep Learning. In each section, we briefly establish the theoretical basis of the topic under discussion and then cement our understanding with practical use cases. Show and hide more

1. Chapter 1 : Introduction to Key Concepts and Data Types
   • The Course Overview 00:03:43
   • Spark Data Structures — RDD, DataFrames, and Datasets 00:12:03
   • Dense and Sparse Vectors 00:03:18
   • Labeled Points, Matrix, and Other Data Types 00:04:59
   • Key Concepts, Machine Learning Pipelines, and Operations 00:03:02
2. Chapter 2 : Machine Learning at Scale
   • Feature Engineering 00:06:03
   • Supervised Learning – Classification, Regression 00:04:55
   • Unsupervised Learning 00:04:15
   • Recommendation Engines 00:09:58
3. Chapter 3 : ML Pipelines, Evaluation, Tuning, and Deployment
   • Deep Dive into Regression Models 00:05:02
   • Deep Dive into Decision Tree Models 00:05:43
   • Evaluating and Tuning Our Model 00:03:57
   • Saving and Deploying Our Model 00:04:04
4. Chapter 4 : Spark Machine Learning and Streaming
   • Overview of Spark Streaming 00:06:03
   • Your Own Streaming Application with Kafka 00:03:49
   • Your First Streaming Application 00:08:05
   • Analyzing Sensors Data in a Streaming Way 00:10:11
5. Chapter 5 : Advanced Topics Natural Language Processing
   • Natural Language Processing Overview 00:04:05
   • Feature Generation from Text — CountVectorizer, TFIDF, and LDA 00:09:53
   • Feature Generation from Text — Word Embeddings 00:05:09
   • NLP Document Classification Application 00:04:04
6. Chapter 6 : Deep Learning with Spark
   • The Spark Versus Deep Learning Use Case 00:08:36
   • Spark for Parallelizing Deep Learning Evaluation 00:05:28
   • Deep Learning as a Feature Generator for Existing Spark ML Algorithms 00:05:45
   • Spark/Deep Learning Made Easy 00:02:40
Show and hide more