Section 1 : Kafka Introduction
|
Lecture 1 | Welcome! | 00:01:20 Duration |
|
Lecture 2 | Apache Kafka in 5 minutes | 00:05:20 Duration |
|
Lecture 3 | Course Objectives | 00:01:47 Duration |
|
Lecture 4 | Important Message | 00:00:24 Duration |
Section 2 : Code Download
|
Lecture 1 | INTRODUCTION TO BRAINMEASURES PROCTOR SYSTEM |
Section 3 : ====== Kafka Fundamentals ======
|
Lecture 1 | Kafka Fundamentals |
Section 4 : Kafka Theory
|
Lecture 1 | Kafka Theory Overview | 00:00:26 Duration |
|
Lecture 2 | Topics, Partitions and Offsets | 00:06:48 Duration |
|
Lecture 3 | Brokers and Topics | 00:03:20 Duration |
|
Lecture 4 | Topic Replication | |
|
Lecture 5 | Producers and Message Keys | 00:05:25 Duration |
|
Lecture 6 | Consumers & Consumer Groups | 00:04:37 Duration |
|
Lecture 7 | Consumer Offsets & Delivery Semantics | 00:04:40 Duration |
|
Lecture 8 | Kafka Broker Discovery | 00:02:23 Duration |
|
Lecture 9 | Zookeeper | 00:02:42 Duration |
|
Lecture 10 | Kafka Guarantees | 00:01:09 Duration |
|
Lecture 11 | Theory Roundup | 00:01:59 Duration |
Section 5 : Starting Kafka
|
Lecture 1 | Important Starting Kafka | 00:00:19 Duration |
|
Lecture 2 | FAQ for Setup Problems | |
|
Lecture 3 | Mac OS X - Download and Setup Kafka in PATH | 00:04:45 Duration |
|
Lecture 4 | Mac OS X - Using brew | 00:01:30 Duration |
|
Lecture 5 | Mac OS X - Start Zookeeper and Kafka | 00:05:38 Duration |
|
Lecture 6 | Mac OS X - Summary | |
|
Lecture 7 | Linux - Download and Setup Kafka in PATH | 00:05:34 Duration |
|
Lecture 8 | Linux - Start Zookeeper and Kafka | 00:04:56 Duration |
|
Lecture 9 | Linux - Summary | |
|
Lecture 10 | Windows - Download Kafka and PATH Setup | 00:08:13 Duration |
|
Lecture 11 | Windows - Start Zookeeper & Kafka | 00:04:59 Duration |
|
Lecture 12 | Windows - Summary |
Section 6 : CLI (Command Line Interface) 101
|
Lecture 1 | CLI Introduction | 00:00:20 Duration |
|
Lecture 2 | WINDOWS WARNING PLEASE READ | |
|
Lecture 3 | Kafka Topics CLI | 00:07:32 Duration |
|
Lecture 4 | Kafka Console Producer CLI | 00:07:09 Duration |
|
Lecture 5 | Kafka Console Consumer CLI | 00:03:21 Duration |
|
Lecture 6 | Kafka Consumers in Group | 00:06:29 Duration |
|
Lecture 7 | Kafka Consumer Groups CLI | 00:04:13 Duration |
|
Lecture 8 | Resetting Offsets | 00:04:08 Duration |
|
Lecture 9 | CLI Options that are good to know | |
|
Lecture 10 | About Proctor Testing | |
|
Lecture 11 | INTRODUCTION TO BRAINMEASURES PROCTOR SYSTEM |
Section 7 : Kafka Java Programming 101
|
Lecture 1 | Intro to Kafka Programming | 00:00:21 Duration |
|
Lecture 2 | Installing Java 8 & IntelliJ Community Edition | |
|
Lecture 3 | Creating Kafka Project | 00:06:24 Duration |
|
Lecture 4 | Java Producer | 00:10:49 Duration |
|
Lecture 5 | Java Producer Callbacks | 00:06:52 Duration |
|
Lecture 6 | Java Producer with Keys | 00:06:08 Duration |
|
Lecture 7 | Java Consumer | 00:11:50 Duration |
|
Lecture 8 | Java Consumer inside Consumer Group | 00:06:29 Duration |
|
Lecture 9 | Java Consumer with Threads | 00:11:51 Duration |
|
Lecture 10 | Java Consumer Seek and Assign | 00:04:23 Duration |
|
Lecture 11 | Client Bi-Directional Compatibility | 00:01:17 Duration |
|
Lecture 12 | INTRODUCTION TO BRAINMEASURES PROCTOR SYSTEM |
Section 8 : ===== Kafka Real World Project =====
|
Lecture 1 | Real World Project Overview | 00:00:45 Duration |
|
Lecture 2 | About Certification |
Section 9 : Kafka Twitter Producer & Advanced Configurations
|
Lecture 1 | Producer and Advanced Configurations Overview | |
|
Lecture 2 | Twitter Setup | 00:04:44 Duration |
|
Lecture 3 | Producer Part 1 - Writing Twitter Client | 00:10:14 Duration |
|
Lecture 4 | Producer Part 2 - Writing the Kafka Producer | 00:07:32 Duration |
|
Lecture 5 | Producer Configurations Introduction | 00:00:49 Duration |
|
Lecture 6 | acks & min | 00:06:16 Duration |
|
Lecture 7 | retries, delivery | 00:04:45 Duration |
|
Lecture 8 | Idempotent Producer | 00:04:29 Duration |
|
Lecture 9 | Producer Part 3 - Safe Producer | 00:05:15 Duration |
|
Lecture 10 | Producer Compression | 00:04:44 Duration |
|
Lecture 11 | Producer Batching | 00:04:52 Duration |
|
Lecture 12 | Producer Part 4 - High Throughput Producer | 00:03:07 Duration |
|
Lecture 13 | Producer Default Partitions and Key Hashing | 00:02:24 Duration |
|
Lecture 14 | [Advanced] max | 00:02:31 Duration |
|
Lecture 15 | Refactoring the Project | 00:03:04 Duration |
Section 10 : Kafka ElasticSearch Consumer & Advanced Configurations
|
Lecture 1 | Consumer and Advanced Configuration Overview | 00:00:22 Duration |
|
Lecture 2 | Setting up ElasticSearch in the Cloud | 00:03:13 Duration |
|
Lecture 3 | ElasticSearch 101 | |
|
Lecture 4 | Consumer Part 1 - Setup Project | 00:08:22 Duration |
|
Lecture 5 | Consumer Part 2 - Write the Consumer & Send to ElasticSearch | 00:06:21 Duration |
|
Lecture 6 | Delivery Semantics for Consumers | 00:04:12 Duration |
|
Lecture 7 | Consumer Part 3 - Idempotence | 00:07:45 Duration |
|
Lecture 8 | Consumer Poll Behaviour | 00:02:58 Duration |
|
Lecture 9 | Consumer Offset Commit Strategies | 00:02:44 Duration |
|
Lecture 10 | Consumer Part 4 - Manual Commit of Offsets | 00:04:39 Duration |
|
Lecture 11 | Consumer Part 5 - Performance Improvement using Batching | 00:05:39 Duration |
|
Lecture 12 | Consumer Offsets Reset Behaviour | 00:02:07 Duration |
|
Lecture 13 | Consumer Part 6 - Replaying Data | 00:01:58 Duration |
|
Lecture 14 | Consumer Internal Threads | 00:03:02 Duration |
Section 11 : ===== Kafka Ecosystem & Real-World Architectures =====
|
Lecture 1 | Kafka in the Real World | 00:00:43 Duration |
Section 12 : Kafka Extended APIs for Developers
|
Lecture 1 | Kafka Connect Introduction | 00:04:47 Duration |
|
Lecture 2 | Kafka Connect Twitter Hands-On | 00:08:07 Duration |
|
Lecture 3 | Kafka Streams Introduction | 00:03:21 Duration |
|
Lecture 4 | Kafka Streams Hands-On | 00:11:58 Duration |
|
Lecture 5 | Kafka Schema Registry Introduction | 00:04:42 Duration |
|
Lecture 6 | Which Kafka API should I use |
Section 13 : Real World Insights and Case Studies (Big Data Fast Data)
|
Lecture 1 | Choosing Partition Count & Replication Factor | 00:08:36 Duration |
|
Lecture 2 | Kafka Topics Naming Convention | |
|
Lecture 3 | Case Study - MovieFlix | 00:05:09 Duration |
|
Lecture 4 | Case Study - GetTaxi | 00:04:18 Duration |
|
Lecture 5 | Case Study - MySocialMedia | 00:05:32 Duration |
|
Lecture 6 | Case Study - MyBank | 00:03:42 Duration |
|
Lecture 7 | Case Study - Big Data Ingestion | 00:01:49 Duration |
|
Lecture 8 | Case Study - Logging and Metrics Aggregation | 00:01:59 Duration |
Section 14 : Kafka in the Enterprise for Admins
|
Lecture 1 | Kafka Cluster Setup High Level Architecture Overview | 00:02:43 Duration |
|
Lecture 2 | Kafka Monitoring & Operations | 00:02:59 Duration |
|
Lecture 3 | Kafka Security | 00:05:02 Duration |
|
Lecture 4 | Kafka Multi Cluster & MirrorMaker | 00:06:48 Duration |
Section 15 : ===== Advanced Kafka =====
|
Lecture 1 | Advanced Kafka |
Section 16 : Advanced Topics Configurations
|
Lecture 1 | Changing a Topic Configuration | 00:04:43 Duration |
|
Lecture 2 | Segment and Indexes | 00:05:11 Duration |
|
Lecture 3 | Log Cleanup Policies | 00:02:30 Duration |
|
Lecture 4 | Log Cleanup Delete | 00:02:07 Duration |
|
Lecture 5 | Log Compaction Theory | 00:06:04 Duration |
|
Lecture 6 | Log Compaction Practice | 00:07:02 Duration |
|
Lecture 7 | min | 00:03:04 Duration |
|
Lecture 8 | Unclean Leader Election | 00:01:17 Duration |
Section 17 : ===== Annexes =====
|
Lecture 1 | What are annexes | 00:00:29 Duration |
Section 18 : Annex - Starting Kafka Differently
|
Lecture 1 | Annex 1 - Overview | 00:00:29 Duration |
|
Lecture 2 | Starting Kafka with the Confluent CLI | |
|
Lecture 3 | Starting a multi broker Kafka Cluster using Binaries | 00:06:32 Duration |
|
Lecture 4 | Note on Docker Setup | |
|
Lecture 5 | Start Kafka Development environment using Docker | 00:04:20 Duration |
|
Lecture 6 | Starting a multi broker Kafka Cluster using Docker | 00:02:55 Duration |
|
Lecture 7 | Kafka Advertised Host Setting | 00:03:25 Duration |
|
Lecture 8 | Starting Kafka on a Remote Machine |
Section 19 : ===== Next Steps =====
|
Lecture 1 | What's Next | 00:00:52 Duration |