by William Rothwell | Released February 2018 | ISBN: 0134833686

Almost 4 hours of video instruction to help you learn the key concepts and features behind Kafka and how it can be used to solve many problems related to the transfer of data. Overview Apache Kafka Fundamentals LiveLessons provides a complete overview of Kafka and Kafka- related topics. The course begins with a general overview of Kafka and then dives into use cases and the design of Kafka. Learners are introduced to the concept of clusters as well as how to create producers and consumers. Additional topics, such as security, connectors, and streams, are covered. The course finishes with a discussion of how Kafka can be used with Big Data software. With detailed, hands-on code examples, provided with the intent to translate to a coding language of your choosing, learners are walked through multiple scenarios involving projects from Twitter, Netflix, Yahoo!, and other real-world scenarios. Topics include * Kafka concepts * Use cases * Kafka design * API overview * Installation and configuration * Clusters * Writing producers * Writing consumers * Kafka operations * Connectors * Streams What You Will Learn * A complete overview of Kafka * How to install and configure Kafka * How Kafka fits into the big picture of Big Data Who Should Take This Course? * IT professional who are responsible for implementing and maintaining their organizations' Big Data solution * IT managers who have an interest in understanding how Kafka can solve part of their Big Data issues Course Requirements Requires a basic knowledge of Linux and a programming language such as Java, Perl, Python, C, or Ruby. Lesson Descriptions Lesson 1, “Kafka Concepts”: You learn the essentials of what Kafka is, it's history, and some of the key concepts of the Kafka solution. We compare Kafka to other potential solutions and point out the major advantages of using it. Lesson 2, “Use Cases”: In this lesson you see how Kafka is used in real-world scenarios using projects from Twitter, Netflix, and Yahoo! Lesson 3, “Kafka Design”: In this lesson you learn the design principals of Kafka. You start by learning key features and concepts, including the Kafka APIs, topics, logs, producers, and consumers. You also learn different ways in which Kafka can be used, including as a message system, a storage system, and for stream processing. Lesson 4, “API Overview”: This lesson explores some basics of the producer and consumer APIs. The goal of this lesson is to start exploring the Java libraries that are used while creating Kafka applications. Lesson 5, “Installation and Configuration”: As its names suggests, this lesson covers how to install and configure Kafka. It starts by discussing hardware and operating system considerations. It then covers the installation of Zookeeper, a separate software tool that is needed for Kafka to perform correctly. Finally, it covers how to install Kafka and perform some basic configuration operations. Lesson 6, “Clusters”: Clusters are a key component of Kafka. The purpose and replication of clusters are discussed in this lesson. You also see a demonstration of the configuration of clusters. Lesson 7, “Writing Producers”: This lesson explains the concepts and code for creating producers. The lesson focuses on how producers communicate with Kafka and how to handle serialization. Lesson 8, “Writing Consumers”: This lesson discusses the concepts and code for creating consumers. The lesson starts with key concepts of consumers, including consumer groups, and then discusses how to create a consumer and subscribe to topics. The lesson also covers the concepts of polling, commits, rebalancing listeners, and deserializers. Lesson 9, “Kafka Operations”: This lesson focuses on several features of Kafka that can be used to modify the manner in which Kafka performs, and shows you how you can modify them. It starts with how to administer topics and then jumps into a discussion on balancing and mirroring. Bandwidth and quotas are also covered. Lesson 10, “Connectors”: Kafka Connect is a newer feature of Kafka that provides an easy way to pull in data from non- Kafka sources. The goal of this lesson is to provide a good overview of what connectors are and discuss some basic configuration of Kafka Connect, transformations, and the Connect REST API interface. Lesson 11, “Streams”: Streams are a newer feature of Kafka that provide an easy way to pull in data from non-Kafka sources. This is a rather large topic, so the goal of this lesson is to provide a good overview of what streams are. In addition to covering the basics concepts of streams, we discuss how streams might be implemented in a system that also uses Kafka Connect. About Pearson Video Training Pearson publishes expert-led video tutorials covering a wide selection of technology topics designed to teach you the skills you need to succeed. These professional and personal technology videos feature world-leading author instructors published by your trusted technology brands: Addison-Wesley, Cisco Press, Pearson IT Certification, Prentice Hall, Sams, and Que Topics include IT Certification, Network Security, Cisco Technology, Programming, Web Development, Mobile Development, and more. Learn more about Pearson Video training at http:// www.informit.com/video. Show and hide more

1. Introduction
   • Apache Kafka Fundamentals LiveLessons: Introduction 00:01:51
2. Lesson 1: Kafka Concepts
   • Learning objectives 00:00:26
   • 1.1 Understanding Messaging 00:06:57
   • 1.2 Origin: The LinkedIn Story 00:04:46
   • 1.3 The Kafka Solution 00:08:19
   • 1.4 Kafka Advantages 00:05:31
3. Lesson 2: Use Cases
   • Learning objectives 00:00:21
   • 2.1 Overview of Use Cases 00:05:20
   • 2.2 Use Case #1 00:05:56
   • 2.3 Use Case #2 00:05:55
   • 2.4 Use Case #3 00:03:31
4. Lesson 3: Kafka Design
   • Learning objectives 00:00:33
   • 3.1 Distributed Streaming Platform 00:09:01
   • 3.2 Overview of APIs 00:03:46
   • 3.3 Topics and Partitions 00:06:58
   • 3.4 Producers and Consumers 00:03:15
   • 3.5 Kafka as a Messaging System 00:02:11
   • 3.6 Kafka as a Storage System 00:02:07
   • 3.7 Kafka for Stream Processing 00:02:16
5. Lesson 4: API Overview
   • Learning objectives 00:00:22
   • 4.1 The Producer API 00:04:58
   • 4.2 The Consumer API 00:01:01
6. Lesson 5: Installation and Configuration
   • Learning objectives 00:00:31
   • 5.1 Hardware Considerations 00:04:29
   • 5.2 Operating System and Java Installation 00:08:45
   • 5.3 Zookeeper Installation 00:08:37
   • 5.4 Kafka Broker Installation 00:10:28
   • 5.5 Topics Configurations 00:09:55
   • 5.6 Lab Exercise 00:01:12
7. Lesson 6: Clusters
   • Learning objectives 00:00:23
   • 6.1 What Are Kafka Clusters? 00:02:05
   • 6.2 Replication 00:04:38
8. Lesson 7: Writing Producers
   • Learning objectives 00:00:26
   • 7.1 Producer Configuration 00:07:15
   • 7.2 Constructing Producers 00:06:11
   • 7.3 Communicating with Kafka 00:03:39
   • 7.4 Serializers 00:08:02
   • 7.5 Partitions 00:04:35
9. Lesson 8: Writing Consumers
   • Learning objectives 00:00:33
   • 8.1 Understanding Consumers 00:02:34
   • 8.2 Consumer Groups 00:04:21
   • 8.3 Consumer Configuration 00:01:51
   • 8.4 Subscribing to Topics 00:03:37
   • 8.5 Polls 00:04:39
   • 8.6 Commits 00:10:15
   • 8.7 Rebalancing Listeners 00:01:40
   • 8.8 Deserializers 00:02:29
10. Lesson 9: Kafka Operations
    • Learning objectives 00:00:30
    • 9.1 Topic Administration 00:02:57
    • 9.2 Balancing and Mirroring 00:03:50
    • 9.3 Bandwidth and Quotas 00:03:44
11. Lesson 10: Connectors
    • Learning objectives 00:00:32
    • 10.1 Overview 00:02:12
    • 10.2 Configuration 00:05:22
    • 10.3 Transformations 00:02:51
    • 10.4 REST API 00:03:26
12. Lesson 11: Streams
    • Learning objectives 00:00:33
    • 11.1 Overview 00:02:29
    • 11.2 Concepts and Architecture 00:02:36
13. Summary
    • Apache Kafka Fundamentals LiveLessons: Summary 00:00:15
Show and hide more