Section 1 : Welcome to the course!
|
|
Lecture 1 | INTRODUCTION TO BRAINMEASURES PROCTOR SYSTEM |
Section 2 : Part 0 - Fundamentals Of Reinforcement Learning
|
|
Lecture 1 | Welcome to Part 0 - Fundamentals of Reinforcement |
Section 3 : Q-Learning Intuition
|
|
Lecture 1 | Plan of Attack | 00:04:04 Duration |
|
|
Lecture 2 | What is reinforcement learning | 00:11:27 Duration |
|
|
Lecture 3 | The Bellman Equation | 00:18:25 Duration |
|
|
Lecture 4 | The Plan | 00:02:12 Duration |
|
|
Lecture 5 | Markov Decision Process | 00:16:27 Duration |
|
|
Lecture 6 | Policy vs Plan | 00:12:55 Duration |
|
|
Lecture 7 | Adding a Living Penalty | 00:09:47 Duration |
|
|
Lecture 8 | Q-Learning Intuition | 00:14:46 Duration |
|
|
Lecture 9 | Temporal Difference | 00:19:27 Duration |
|
|
Lecture 10 | Q-Learning Visualization | 00:07:50 Duration |
Section 4 : Part 1 - Self-Driving Car (Deep Q-Learning)
|
|
Lecture 1 | Welcome to Part 1 - Self-Driving Car (Deep Q-Learn |
Section 5 : Deep Q-Learning Intuition
|
|
Lecture 1 | Plan of Attack | 00:02:18 Duration |
|
|
Lecture 2 | Deep Q-Learning Intuition - Learning | 00:15:15 Duration |
|
|
Lecture 3 | Deep Q-Learning Intuition - Acting | 00:06:06 Duration |
|
|
Lecture 4 | Experience Replay | 00:15:45 Duration |
|
|
Lecture 5 | Action Selection Policies | 00:16:23 Duration |
Section 6 : Installation for Part 1
|
|
Lecture 1 | Plan of Attack (Practical Tutorials) | |
|
|
Lecture 2 | Windows Option 2 - Part A Installing Ubuntu on Win | 00:13:52 Duration |
|
|
Lecture 3 | Mac or Linux Installing Anaconda | 00:07:08 Duration |
|
|
Lecture 4 | Mac or Linux Installing PyTorch and Kivy | 00:06:42 Duration |
|
|
Lecture 5 | Kivy Installation Walk Through Mac | 00:03:28 Duration |
|
|
Lecture 6 | Kivy Installation Walk Through Linux | 00:02:18 Duration |
|
|
Lecture 7 | Getting Started | 00:05:41 Duration |
Section 7 : Creating the environment
|
|
Lecture 1 | Self Driving Car - Step 1 | 00:09:15 Duration |
|
|
Lecture 2 | Self Driving Car - Step 2 | 00:16:18 Duration |
Section 8 : Building an AI
|
|
Lecture 1 | Self Driving Car - Step 3 | 00:06:45 Duration |
|
|
Lecture 2 | Self Driving Car - Step 4 | 00:14:24 Duration |
|
|
Lecture 3 | Self Driving Car - Step 5 | 00:05:59 Duration |
|
|
Lecture 4 | Self Driving Car - Step 6 | 00:06:01 Duration |
|
|
Lecture 5 | Self Driving Car - Step 7 | 00:05:46 Duration |
|
|
Lecture 6 | Self Driving Car - Step 8 | 00:10:51 Duration |
|
|
Lecture 7 | Self Driving Car - Step 9 | 00:17:27 Duration |
|
|
Lecture 8 | Self Driving Car - Step 10 | 00:13:51 Duration |
|
|
Lecture 9 | Self Driving Car - Step 11 | 00:15:21 Duration |
|
|
Lecture 10 | Self Driving Car - Step 12 | 00:12:57 Duration |
|
|
Lecture 11 | Self Driving Car - Step 13 | 00:12:28 Duration |
|
|
Lecture 12 | Self Driving Car - Step 14 | 00:02:53 Duration |
|
|
Lecture 13 | Self Driving Car - Step 15 | 00:05:29 Duration |
|
|
Lecture 14 | Self Driving Car - Step 16 | 00:07:19 Duration |
Section 9 : Playing with the AI
|
|
Lecture 1 | Self Driving Car - Level 1 | 00:08:51 Duration |
|
|
Lecture 2 | Self Driving Car - Level 2 | 00:04:39 Duration |
|
|
Lecture 3 | Self Driving Car - Level 3 | 00:07:21 Duration |
|
|
Lecture 4 | Self Driving Car - Level 4 | 00:06:09 Duration |
Section 10 : Part 2 - Doom (Deep Convolutional Q-Learning)
|
|
Lecture 1 | Welcome to Part 2 - Doom (Deep Convolutional Q-Lea |
Section 11 : Deep Convolutional Q-Learning Intuition
|
|
Lecture 1 | Plan of Attack | 00:03:27 Duration |
|
|
Lecture 2 | Deep Convolutional Q-Learning Intuition | 00:07:13 Duration |
|
|
Lecture 3 | Eligibility Trace | 00:08:38 Duration |
|
|
Lecture 4 | Installing Open AI Gym and ppaquette |
Section 12 : Installation for Part 2
|
|
Lecture 1 | Installing Open AI Gym Walk Through (Mac Version) | 00:03:56 Duration |
|
|
Lecture 2 | Installing Open AI Gym Walk Through (Ubuntu Versio | 00:05:36 Duration |
Section 13 : Building an AI
|
|
Lecture 1 | Doom - Step 1 | 00:05:55 Duration |
|
|
Lecture 2 | Doom - Step 2 | 00:09:42 Duration |
|
|
Lecture 3 | Doom - Step 3 | 00:09:52 Duration |
|
|
Lecture 4 | Doom - Step 4 | 00:12:32 Duration |
|
|
Lecture 5 | Doom - Step 5 | 00:14:16 Duration |
|
|
Lecture 6 | Doom - Step 6 | 00:06:32 Duration |
|
|
Lecture 7 | Doom - Step 7 | 00:04:40 Duration |
|
|
Lecture 8 | Doom - Step 8 | 00:06:39 Duration |
|
|
Lecture 9 | Doom - Step 9 | 00:03:44 Duration |
|
|
Lecture 10 | Doom - Step 10 | 00:07:51 Duration |
|
|
Lecture 11 | Doom - Step 11 | 00:06:33 Duration |
|
|
Lecture 12 | Doom - Step 12 | 00:04:14 Duration |
|
|
Lecture 13 | Doom - Step 13 | 00:06:49 Duration |
|
|
Lecture 14 | Doom - Step 14 | 00:15:32 Duration |
|
|
Lecture 15 | Doom - Step 15 | 00:08:27 Duration |
|
|
Lecture 16 | Doom - Step 16 | 00:10:38 Duration |
|
|
Lecture 17 | Doom - Step 17 | 00:19:38 Duration |
Section 14 : Playing with the AI
|
|
Lecture 1 | Watching our AI play Doom | 00:18:39 Duration |
Section 15 : Part 3 - Breakout (A3C)
|
|
Lecture 1 | Welcome to Part 3 - Breakout (A3C) | |
|
|
Lecture 2 | Plan of Attack | 00:03:40 Duration |
|
|
Lecture 3 | The three A's in A3C | 00:04:45 Duration |
|
|
Lecture 4 | Actor-Critic | 00:06:36 Duration |
|
|
Lecture 5 | Asynchronous | 00:11:43 Duration |
|
|
Lecture 6 | Advantage | 00:15:21 Duration |
|
|
Lecture 7 | LSTM Layer | 00:15:36 Duration |
Section 16 : Installation for Part 3
|
|
Lecture 1 | Installing OpenCV |
Section 17 : Building an AI
|
|
Lecture 1 | Breakout - Step 1 | 00:10:08 Duration |
|
|
Lecture 2 | Breakout - Step 2 | 00:08:01 Duration |
|
|
Lecture 3 | Breakout - Step 3 | 00:12:24 Duration |
|
|
Lecture 4 | Breakout - Step 4 | 00:13:10 Duration |
|
|
Lecture 5 | Breakout - Step 5 | 00:10:33 Duration |
|
|
Lecture 6 | Breakout - Step 6 | 00:11:46 Duration |
|
|
Lecture 7 | Breakout - Step 7 | 00:07:46 Duration |
|
|
Lecture 8 | Breakout - Step 8 | 00:11:30 Duration |
|
|
Lecture 9 | Breakout - Step 9 | 00:11:31 Duration |
|
|
Lecture 10 | Breakout - Step 10 | 00:08:05 Duration |
|
|
Lecture 11 | Breakout - Step 11 | 00:05:06 Duration |
|
|
Lecture 12 | Breakout - Step 12 | 00:15:39 Duration |
|
|
Lecture 13 | Breakout - Step 13 | 00:08:22 Duration |
|
|
Lecture 14 | Breakout - Step 14 | 00:05:22 Duration |
|
|
Lecture 15 | Breakout - Step 15 | 00:10:52 Duration |
Section 18 : Annex 1 Artificial Neural Networks
|
|
Lecture 1 | What is Deep Learning | 00:12:34 Duration |
|
|
Lecture 2 | Plan of Attack | 00:02:52 Duration |
|
|
Lecture 3 | The Neuron | 00:16:15 Duration |
|
|
Lecture 4 | The Activation Function | 00:08:29 Duration |
|
|
Lecture 5 | How do Neural Networks work | 00:12:48 Duration |
|
|
Lecture 6 | How do Neural Networks learn | 00:12:59 Duration |
|
|
Lecture 7 | Gradient Descent | 00:10:13 Duration |
|
|
Lecture 8 | Stochastic Gradient Descent | 00:08:45 Duration |
|
|
Lecture 9 | Backpropagation | 00:05:22 Duration |
Section 19 : Annex 2 Convolutional Neural Networks
|
|
Lecture 1 | Plan of Attack | 00:03:32 Duration |
|
|
Lecture 2 | What are convolutional neural networks | 00:15:49 Duration |
|
|
Lecture 3 | Step 1 - Convolution Operation | 00:16:38 Duration |
|
|
Lecture 4 | Step 1(b) - ReLU Laye | 00:06:41 Duration |
|
|
Lecture 5 | Step 2 - Pooling | 00:14:13 Duration |
|
|
Lecture 6 | Step 3 - Flattening | 00:01:53 Duration |
|
|
Lecture 7 | Step 4 - Full Connection | 00:19:25 Duration |
|
|
Lecture 8 | Summary | 00:04:20 Duration |
|
|
Lecture 9 | Softmax & Cross-Entropy | 00:18:20 Duration |
