by Tomasz Lelek | Released August 2017 | ISBN: 9781788622462

Build event-driven architectures using Apache KafkaAbout This VideoBuild an application with the Apache Kafka architecture.Use Apache Kafka and its API to learn to use its Producer and Consumer.How Kafka works under-the-hood: Kafka InternalsDescriptionToday's applications are built using the microservice architecture. Having a lot of microservices that need to communicate with each other can be problematic as they quickly become tightly coupled. Apache Kafka allows us to create services that are loosely coupled and operate in an event-driven way.We can build components that process events, apply business logic as events arrive, and publish those events further into the processing chain. You will learn how to use Apache Kafka to create applications that work in the publish-subscribe model.We will delve into the Kafka architecture and its Producer and Consumer API. You will learn how replication and fault tolerance is achieved in Kafka.What you will learnLearn about the Apache Kafka architecture.Build Kafka clusters with Apache.Send messages using the Kafka Producer API.Understand how partitioning data affects scalability and performance.Retrieve messages using the Consumer API.Learn how fault-tolerance is achieved by using data replication.Understanding the processing flow Who should take this courseThis video targets software engineers who have professional experience in Java and want to learn how to leverage the full power of Apache Kafka.About the authorTomasz Lelek is a Software Engineer, programming mostly in Java and Scala. He is a fan of microservice architectures and functional programming. He dedicates a lot of time and effort to being better every day. He has recently delved into Big Data technologies such as Apache Spark and Hadoop. He is passionate about nearly everything associated with software development; his belief is that we should always try to consider different solutions and approaches before solving a problem. Recently he was a speaker at conferences in Poland - Confitura and JDD (Java Developers Day) and also at Krakow Scala User Group. He also conducted a live coding session at Geecon Conference. He is a co-founder of www.initlearn.com, an e-learning platform built with the Java language.He also writes articles about everything related to the Java world: http://www.baeldung.com/Private consultant and is a trainer in Bottega Solutions http://bottega.com.pl/trener-tomasz-lelek. He conducts workshops on Apache Kafka technology.About Packt VideoPackt Video publishes friendly, practical video tutorials, packed with practical skills, concepts and guidance to help you succeed with new technologies and tasks. Packt Video's series include Learn, Hands-On, Mastering, In 7 Days, Troubleshooting, and more. Our courses cover web and software development, security and ethical hacking, data science, and other key tech topics. We exist to make cutting-edge topics accessible for all. Show and hide more Publisher resources Download Example Code

1. Chapter 1 : Apache Kafka Architecture
   • The Course Overview 00:02:24
   • Building Applications in the Publish-Subscribe Architecture 00:02:37
   • Topics and Partitions 00:04:40
   • How Kafka Cluster is Built? - Brokers 00:02:56
   • Setup of Kafka - Using Docker 00:02:07
2. Chapter 2 : Producers and Consumers
   • Sending Events to Kafka - Producers API 00:04:56
   • Asynchronous Send 00:08:03
   • Partitioning of Topics - Implementing Custom Partitioner 00:02:53
   • Reading Events from Kafka - Consumer API 00:06:25
   • Consumer Pool Loop - Offset Management 00:07:41
   • Rebalancing of Consumers 00:08:14
3. Chapter 3 : Advanced Kafka - Understanding Internals
   • Electing Partition Leaders - Kafka Controller Component 00:02:45
   • Data Replication in Kafka 00:01:51
   • Append-Only Distributed Log - Storing Events in Kafka 00:02:01
   • Compaction Process 00:01:42
   • Summary of Apache Kafka Course 00:00:52
Show and hide more