Section 1 : Kafka Introduction

Lecture 1 Welcome! 00:01:20 Duration
Lecture 2 Apache Kafka in 5 minutes 00:05:20 Duration
Lecture 3 Course Objectives 00:01:47 Duration
Lecture 4 Important Message 00:00:24 Duration

Section 2 : Code Download

Lecture 1 INTRODUCTION TO BRAINMEASURES PROCTOR SYSTEM

Section 3 : ====== Kafka Fundamentals ======

Lecture 1 Kafka Fundamentals

Section 4 : Kafka Theory

Lecture 1 Kafka Theory Overview 00:00:26 Duration
Lecture 2 Topics, Partitions and Offsets 00:06:48 Duration
Lecture 3 Brokers and Topics 00:03:20 Duration
Lecture 4 Topic Replication
Lecture 5 Producers and Message Keys 00:05:25 Duration
Lecture 6 Consumers & Consumer Groups 00:04:37 Duration
Lecture 7 Consumer Offsets & Delivery Semantics 00:04:40 Duration
Lecture 8 Kafka Broker Discovery 00:02:23 Duration
Lecture 9 Zookeeper 00:02:42 Duration
Lecture 10 Kafka Guarantees 00:01:09 Duration
Lecture 11 Theory Roundup 00:01:59 Duration

Section 5 : Starting Kafka

Lecture 1 Important Starting Kafka 00:00:19 Duration
Lecture 2 FAQ for Setup Problems
Lecture 3 Mac OS X - Download and Setup Kafka in PATH 00:04:45 Duration
Lecture 4 Mac OS X - Using brew 00:01:30 Duration
Lecture 5 Mac OS X - Start Zookeeper and Kafka 00:05:38 Duration
Lecture 6 Mac OS X - Summary
Lecture 7 Linux - Download and Setup Kafka in PATH 00:05:34 Duration
Lecture 8 Linux - Start Zookeeper and Kafka 00:04:56 Duration
Lecture 9 Linux - Summary
Lecture 10 Windows - Download Kafka and PATH Setup 00:08:13 Duration
Lecture 11 Windows - Start Zookeeper & Kafka 00:04:59 Duration
Lecture 12 Windows - Summary

Section 6 : CLI (Command Line Interface) 101

Lecture 1 CLI Introduction 00:00:20 Duration
Lecture 2 WINDOWS WARNING PLEASE READ
Lecture 3 Kafka Topics CLI 00:07:32 Duration
Lecture 4 Kafka Console Producer CLI 00:07:09 Duration
Lecture 5 Kafka Console Consumer CLI 00:03:21 Duration
Lecture 6 Kafka Consumers in Group 00:06:29 Duration
Lecture 7 Kafka Consumer Groups CLI 00:04:13 Duration
Lecture 8 Resetting Offsets 00:04:08 Duration
Lecture 9 CLI Options that are good to know
Lecture 10 About Proctor Testing
Lecture 11 INTRODUCTION TO BRAINMEASURES PROCTOR SYSTEM

Section 7 : Kafka Java Programming 101

Lecture 1 Intro to Kafka Programming 00:00:21 Duration
Lecture 2 Installing Java 8 & IntelliJ Community Edition
Lecture 3 Creating Kafka Project 00:06:24 Duration
Lecture 4 Java Producer 00:10:49 Duration
Lecture 5 Java Producer Callbacks 00:06:52 Duration
Lecture 6 Java Producer with Keys 00:06:08 Duration
Lecture 7 Java Consumer 00:11:50 Duration
Lecture 8 Java Consumer inside Consumer Group 00:06:29 Duration
Lecture 9 Java Consumer with Threads 00:11:51 Duration
Lecture 10 Java Consumer Seek and Assign 00:04:23 Duration
Lecture 11 Client Bi-Directional Compatibility 00:01:17 Duration
Lecture 12 INTRODUCTION TO BRAINMEASURES PROCTOR SYSTEM

Section 8 : ===== Kafka Real World Project =====

Lecture 1 Real World Project Overview 00:00:45 Duration
Lecture 2 About Certification

Section 9 : Kafka Twitter Producer & Advanced Configurations

Lecture 1 Producer and Advanced Configurations Overview
Lecture 2 Twitter Setup 00:04:44 Duration
Lecture 3 Producer Part 1 - Writing Twitter Client 00:10:14 Duration
Lecture 4 Producer Part 2 - Writing the Kafka Producer 00:07:32 Duration
Lecture 5 Producer Configurations Introduction 00:00:49 Duration
Lecture 6 acks & min 00:06:16 Duration
Lecture 7 retries, delivery 00:04:45 Duration
Lecture 8 Idempotent Producer 00:04:29 Duration
Lecture 9 Producer Part 3 - Safe Producer 00:05:15 Duration
Lecture 10 Producer Compression 00:04:44 Duration
Lecture 11 Producer Batching 00:04:52 Duration
Lecture 12 Producer Part 4 - High Throughput Producer 00:03:07 Duration
Lecture 13 Producer Default Partitions and Key Hashing 00:02:24 Duration
Lecture 14 [Advanced] max 00:02:31 Duration
Lecture 15 Refactoring the Project 00:03:04 Duration

Section 10 : Kafka ElasticSearch Consumer & Advanced Configurations

Lecture 1 Consumer and Advanced Configuration Overview 00:00:22 Duration
Lecture 2 Setting up ElasticSearch in the Cloud 00:03:13 Duration
Lecture 3 ElasticSearch 101
Lecture 4 Consumer Part 1 - Setup Project 00:08:22 Duration
Lecture 5 Consumer Part 2 - Write the Consumer & Send to ElasticSearch 00:06:21 Duration
Lecture 6 Delivery Semantics for Consumers 00:04:12 Duration
Lecture 7 Consumer Part 3 - Idempotence 00:07:45 Duration
Lecture 8 Consumer Poll Behaviour 00:02:58 Duration
Lecture 9 Consumer Offset Commit Strategies 00:02:44 Duration
Lecture 10 Consumer Part 4 - Manual Commit of Offsets 00:04:39 Duration
Lecture 11 Consumer Part 5 - Performance Improvement using Batching 00:05:39 Duration
Lecture 12 Consumer Offsets Reset Behaviour 00:02:07 Duration
Lecture 13 Consumer Part 6 - Replaying Data 00:01:58 Duration
Lecture 14 Consumer Internal Threads 00:03:02 Duration

Section 11 : ===== Kafka Ecosystem & Real-World Architectures =====

Lecture 1 Kafka in the Real World 00:00:43 Duration

Section 12 : Kafka Extended APIs for Developers

Lecture 1 Kafka Connect Introduction 00:04:47 Duration
Lecture 2 Kafka Connect Twitter Hands-On 00:08:07 Duration
Lecture 3 Kafka Streams Introduction 00:03:21 Duration
Lecture 4 Kafka Streams Hands-On 00:11:58 Duration
Lecture 5 Kafka Schema Registry Introduction 00:04:42 Duration
Lecture 6 Which Kafka API should I use

Section 13 : Real World Insights and Case Studies (Big Data Fast Data)

Lecture 1 Choosing Partition Count & Replication Factor 00:08:36 Duration
Lecture 2 Kafka Topics Naming Convention
Lecture 3 Case Study - MovieFlix 00:05:09 Duration
Lecture 4 Case Study - GetTaxi 00:04:18 Duration
Lecture 5 Case Study - MySocialMedia 00:05:32 Duration
Lecture 6 Case Study - MyBank 00:03:42 Duration
Lecture 7 Case Study - Big Data Ingestion 00:01:49 Duration
Lecture 8 Case Study - Logging and Metrics Aggregation 00:01:59 Duration

Section 14 : Kafka in the Enterprise for Admins

Lecture 1 Kafka Cluster Setup High Level Architecture Overview 00:02:43 Duration
Lecture 2 Kafka Monitoring & Operations 00:02:59 Duration
Lecture 3 Kafka Security 00:05:02 Duration
Lecture 4 Kafka Multi Cluster & MirrorMaker 00:06:48 Duration

Section 15 : ===== Advanced Kafka =====

Lecture 1 Advanced Kafka

Section 16 : Advanced Topics Configurations

Lecture 1 Changing a Topic Configuration 00:04:43 Duration
Lecture 2 Segment and Indexes 00:05:11 Duration
Lecture 3 Log Cleanup Policies 00:02:30 Duration
Lecture 4 Log Cleanup Delete 00:02:07 Duration
Lecture 5 Log Compaction Theory 00:06:04 Duration
Lecture 6 Log Compaction Practice 00:07:02 Duration
Lecture 7 min 00:03:04 Duration
Lecture 8 Unclean Leader Election 00:01:17 Duration

Section 17 : ===== Annexes =====

Lecture 1 What are annexes 00:00:29 Duration

Section 18 : Annex - Starting Kafka Differently

Lecture 1 Annex 1 - Overview 00:00:29 Duration
Lecture 2 Starting Kafka with the Confluent CLI
Lecture 3 Starting a multi broker Kafka Cluster using Binaries 00:06:32 Duration
Lecture 4 Note on Docker Setup
Lecture 5 Start Kafka Development environment using Docker 00:04:20 Duration
Lecture 6 Starting a multi broker Kafka Cluster using Docker 00:02:55 Duration
Lecture 7 Kafka Advertised Host Setting 00:03:25 Duration
Lecture 8 Starting Kafka on a Remote Machine

Section 19 : ===== Next Steps =====

Lecture 1 What's Next 00:00:52 Duration