Section 1 : Overview
|
Lecture 1 | INTRODUCTION TO BRAINMEASURES PROCTOR SYSTEM | |
|
Lecture 2 | Course Structure and Approach copy | 00:03:15 Duration |
|
Lecture 3 | Course Pre-requisites | 00:02:49 Duration |
|
Lecture 4 | Course Outcomes | 00:02:09 Duration |
Section 2 : Environment Setup
|
Lecture 1 | Google Cloud Account Setup | 00:01:39 Duration |
|
Lecture 2 | Creating a Dataproc Cluster | 00:12:47 Duration |
|
Lecture 3 | GCP Account Best Practices | 00:02:55 Duration |
|
Lecture 4 | Twitter Developer Account Setup | 00:03:31 Duration |
Section 3 : Getting Started with Big Data Journey
|
Lecture 1 | Definition of Big Data | 00:10:20 Duration |
|
Lecture 2 | Data Lake Overview | 00:06:03 Duration |
|
Lecture 3 | Key Roles in Big Data Science Project | 00:16:56 Duration |
|
Lecture 4 | Big Data Logical Architecture | 00:20:01 Duration |
|
Lecture 5 | Typical Big Data Pipeline | 00:06:00 Duration |
|
Lecture 6 | Hadoop Overview | 00:09:20 Duration |
|
Lecture 7 | Bonus Demystifying JVM vs JDK vs JRE |
Section 4 : Hadoop Filesystem
|
Lecture 1 | HDFS Overview | 00:06:17 Duration |
|
Lecture 2 | Small FS vs HDFS | 00:03:13 Duration |
|
Lecture 3 | HDFS Architecture | 00:11:24 Duration |
|
Lecture 4 | Hands-on HDFS | 00:11:32 Duration |
|
Lecture 5 | Hands-on HDFS |
Section 5 : Distributed Processing using MapReduce and Beyond
|
Lecture 1 | Introduction to MapReduce | 00:05:07 Duration |
|
Lecture 2 | Logical & Physical Architecture of MR | |
|
Lecture 3 | YARN (Distributed OS) | 00:07:08 Duration |
|
Lecture 4 | YARN Architecture | 00:14:55 Duration |
|
Lecture 5 | Hands-on Spark Job on YARN | 00:09:52 Duration |
|
Lecture 6 | Spark on Yarn - Hands-on |
Section 6 : Data Persistence in Big Database
|
Lecture 1 | RDBMS USPs & its Limitations | 00:06:58 Duration |
|
Lecture 2 | Polyglot Persistence | 00:06:36 Duration |
|
Lecture 3 | Why HBase and Limitations | 00:10:50 Duration |
|
Lecture 4 | HBase Terms | 00:09:42 Duration |
|
Lecture 5 | HBase Physical Storage | 00:04:38 Duration |
|
Lecture 6 | HBase Architecture | 00:16:59 Duration |
|
Lecture 7 | Installation HBase on DataProc cluster | 00:05:07 Duration |
|
Lecture 8 | Installing Confluent Kafka | 00:07:39 Duration |
|
Lecture 9 | Installing Confluent Kafka - Hands On | |
|
Lecture 10 | Hands-on HBase | 00:08:13 Duration |
|
Lecture 11 | Hands-on HBase |
Section 7 : Data Ingestion using Sqoop
|
Lecture 1 | Sqoop Overview | 00:07:07 Duration |
|
Lecture 2 | Sqoop Architecture | 00:08:51 Duration |
|
Lecture 3 | Sqoop Installation | 00:11:49 Duration |
|
Lecture 4 | Sqoop Installation | |
|
Lecture 5 | Sqoop Hands-on | 00:05:12 Duration |
|
Lecture 6 | Sqoop Hands-on |
Section 8 : Data Analysis using Hive & Impala
|
Lecture 1 | Hive Introduction | 00:08:12 Duration |
|
Lecture 2 | Hive Architecture | 00:06:54 Duration |
|
Lecture 3 | Impala Overview | 00:06:52 Duration |
|
Lecture 4 | Impala Architecture | 00:12:27 Duration |
|
Lecture 5 | Text vs Binary Data Formats | 00:03:29 Duration |
|
Lecture 6 | Avro Format | |
|
Lecture 7 | Hive Hands-on | 00:16:19 Duration |
|
Lecture 8 | Hive Hands-on | |
|
Lecture 9 | Hands-on Sqoop + Hive Integration | 00:09:28 Duration |
|
Lecture 10 | Hands-on Sqoop + Hive Integration | |
|
Lecture 11 | Hands-on Schema Evolution | 00:18:54 Duration |
|
Lecture 12 | Hands-on Schema Evolution |
Section 9 : Data Processing using Spark
|
Lecture 1 | Spark Overview | 00:06:55 Duration |
|
Lecture 2 | Spark Logical Perspective | 00:07:17 Duration |
|
Lecture 3 | Spark Physical Architecture | |
|
Lecture 4 | Spark Core Vs Spark SQL | 00:04:22 Duration |
|
Lecture 5 | Spark Execution Modes | 00:08:51 Duration |
|
Lecture 6 | Hands-on Spark on Jupyter | 00:13:08 Duration |
Section 10 : Streaming Events through Kafka
|
Lecture 1 | Introduction to Apache Kafka | 00:09:24 Duration |
|
Lecture 2 | Evolution of Kafka | |
|
Lecture 3 | Why Kafka | 00:12:07 Duration |
|
Lecture 4 | Apache Kafka Vs Confluent Kafka | 00:07:09 Duration |
|
Lecture 5 | Kafka Architecture | 00:20:41 Duration |
|
Lecture 6 | Kafka Demo - Producer Consumer | 00:04:06 Duration |
|
Lecture 7 | Kafka Demo - Producer Consumer |
Section 11 : Building Dataflows using NiFi
|
Lecture 1 | NiFi Overview | 00:10:57 Duration |
|
Lecture 2 | NiFi UseCases | 00:03:17 Duration |
|
Lecture 3 | NiFi Limitations | 00:03:19 Duration |
|
Lecture 4 | NiFi Components and its Architecture | 00:09:12 Duration |
|
Lecture 5 | Hands-on NiFi Installation on GCP | 00:07:11 Duration |
|
Lecture 6 | Hands-on NiFi Installation on GCP | |
|
Lecture 7 | Hands-on Twitter Data Ingestion Using Nifi Part 1 | 00:15:09 Duration |
|
Lecture 8 | Hands-on Twitter Data Ingestion Using Nifi Part 2 | 00:14:02 Duration |
|
Lecture 9 | Hands-on Twitter Data Ingestion Using Nifi Part 3 | 00:04:40 Duration |
Section 12 : Epilogue
|
Lecture 1 | Conclusion | 00:00:39 Duration |