Section 1 : Overview

Lecture 1 INTRODUCTION TO BRAINMEASURES PROCTOR SYSTEM
Lecture 2 Course Structure and Approach copy 00:03:15 Duration
Lecture 3 Course Pre-requisites 00:02:49 Duration
Lecture 4 Course Outcomes 00:02:09 Duration

Section 2 : Environment Setup

Lecture 1 Google Cloud Account Setup 00:01:39 Duration
Lecture 2 Creating a Dataproc Cluster 00:12:47 Duration
Lecture 3 GCP Account Best Practices 00:02:55 Duration
Lecture 4 Twitter Developer Account Setup 00:03:31 Duration

Section 3 : Getting Started with Big Data Journey

Lecture 1 Definition of Big Data 00:10:20 Duration
Lecture 2 Data Lake Overview 00:06:03 Duration
Lecture 3 Key Roles in Big Data Science Project 00:16:56 Duration
Lecture 4 Big Data Logical Architecture 00:20:01 Duration
Lecture 5 Typical Big Data Pipeline 00:06:00 Duration
Lecture 6 Hadoop Overview 00:09:20 Duration
Lecture 7 Bonus Demystifying JVM vs JDK vs JRE

Section 4 : Hadoop Filesystem

Lecture 1 HDFS Overview 00:06:17 Duration
Lecture 2 Small FS vs HDFS 00:03:13 Duration
Lecture 3 HDFS Architecture 00:11:24 Duration
Lecture 4 Hands-on HDFS 00:11:32 Duration
Lecture 5 Hands-on HDFS

Section 5 : Distributed Processing using MapReduce and Beyond

Lecture 1 Introduction to MapReduce 00:05:07 Duration
Lecture 2 Logical & Physical Architecture of MR
Lecture 3 YARN (Distributed OS) 00:07:08 Duration
Lecture 4 YARN Architecture 00:14:55 Duration
Lecture 5 Hands-on Spark Job on YARN 00:09:52 Duration
Lecture 6 Spark on Yarn - Hands-on

Section 6 : Data Persistence in Big Database

Lecture 1 RDBMS USPs & its Limitations 00:06:58 Duration
Lecture 2 Polyglot Persistence 00:06:36 Duration
Lecture 3 Why HBase and Limitations 00:10:50 Duration
Lecture 4 HBase Terms 00:09:42 Duration
Lecture 5 HBase Physical Storage 00:04:38 Duration
Lecture 6 HBase Architecture 00:16:59 Duration
Lecture 7 Installation HBase on DataProc cluster 00:05:07 Duration
Lecture 8 Installing Confluent Kafka 00:07:39 Duration
Lecture 9 Installing Confluent Kafka - Hands On
Lecture 10 Hands-on HBase 00:08:13 Duration
Lecture 11 Hands-on HBase

Section 7 : Data Ingestion using Sqoop

Lecture 1 Sqoop Overview 00:07:07 Duration
Lecture 2 Sqoop Architecture 00:08:51 Duration
Lecture 3 Sqoop Installation 00:11:49 Duration
Lecture 4 Sqoop Installation
Lecture 5 Sqoop Hands-on 00:05:12 Duration
Lecture 6 Sqoop Hands-on

Section 8 : Data Analysis using Hive & Impala

Lecture 1 Hive Introduction 00:08:12 Duration
Lecture 2 Hive Architecture 00:06:54 Duration
Lecture 3 Impala Overview 00:06:52 Duration
Lecture 4 Impala Architecture 00:12:27 Duration
Lecture 5 Text vs Binary Data Formats 00:03:29 Duration
Lecture 6 Avro Format
Lecture 7 Hive Hands-on 00:16:19 Duration
Lecture 8 Hive Hands-on
Lecture 9 Hands-on Sqoop + Hive Integration 00:09:28 Duration
Lecture 10 Hands-on Sqoop + Hive Integration
Lecture 11 Hands-on Schema Evolution 00:18:54 Duration
Lecture 12 Hands-on Schema Evolution

Section 9 : Data Processing using Spark

Lecture 1 Spark Overview 00:06:55 Duration
Lecture 2 Spark Logical Perspective 00:07:17 Duration
Lecture 3 Spark Physical Architecture
Lecture 4 Spark Core Vs Spark SQL 00:04:22 Duration
Lecture 5 Spark Execution Modes 00:08:51 Duration
Lecture 6 Hands-on Spark on Jupyter 00:13:08 Duration

Section 10 : Streaming Events through Kafka

Lecture 1 Introduction to Apache Kafka 00:09:24 Duration
Lecture 2 Evolution of Kafka
Lecture 3 Why Kafka 00:12:07 Duration
Lecture 4 Apache Kafka Vs Confluent Kafka 00:07:09 Duration
Lecture 5 Kafka Architecture 00:20:41 Duration
Lecture 6 Kafka Demo - Producer Consumer 00:04:06 Duration
Lecture 7 Kafka Demo - Producer Consumer

Section 11 : Building Dataflows using NiFi

Lecture 1 NiFi Overview 00:10:57 Duration
Lecture 2 NiFi UseCases 00:03:17 Duration
Lecture 3 NiFi Limitations 00:03:19 Duration
Lecture 4 NiFi Components and its Architecture 00:09:12 Duration
Lecture 5 Hands-on NiFi Installation on GCP 00:07:11 Duration
Lecture 6 Hands-on NiFi Installation on GCP
Lecture 7 Hands-on Twitter Data Ingestion Using Nifi Part 1 00:15:09 Duration
Lecture 8 Hands-on Twitter Data Ingestion Using Nifi Part 2 00:14:02 Duration
Lecture 9 Hands-on Twitter Data Ingestion Using Nifi Part 3 00:04:40 Duration

Section 12 : Epilogue

Lecture 1 Conclusion 00:00:39 Duration