Section 1 : Welcome to the course!

lecture 1 INTRODUCTION TO BRAINMEASURES PROCTOR SYSTEM Pdf

Section 2 : Part 0 - Fundamentals Of Reinforcement Learning

lecture 2 Welcome to Part 0 - Fundamentals of Reinforcement Text

Section 3 : Q-Learning Intuition

lecture 3 Plan of Attack 4:4
lecture 4 What is reinforcement learning 11:27
lecture 5 The Bellman Equation 18:25
lecture 6 The Plan 2:12
lecture 7 Markov Decision Process 16:27
lecture 8 Policy vs Plan 12:55
lecture 9 Adding a Living Penalty 9:47
lecture 10 Q-Learning Intuition 14:46
lecture 11 Temporal Difference 19:27
lecture 12 Q-Learning Visualization 7:50

Section 4 : Part 1 - Self-Driving Car (Deep Q-Learning)

lecture 13 Welcome to Part 1 - Self-Driving Car (Deep Q-Learn Text

Section 5 : Deep Q-Learning Intuition

lecture 14 Plan of Attack 2:18
lecture 15 Deep Q-Learning Intuition - Learning 15:15
lecture 16 Deep Q-Learning Intuition - Acting 6:6
lecture 17 Experience Replay 15:45
lecture 18 Action Selection Policies 16:23

Section 6 : Installation for Part 1

lecture 19 Plan of Attack (Practical Tutorials) Text
lecture 20 Windows Option 2 - Part A Installing Ubuntu on Win 13:52
lecture 21 Mac or Linux Installing Anaconda 7:8
lecture 22 Mac or Linux Installing PyTorch and Kivy 6:42
lecture 23 Kivy Installation Walk Through Mac 3:28
lecture 24 Kivy Installation Walk Through Linux 2:18
lecture 25 Getting Started 5:41

Section 7 : Creating the environment

lecture 26 Self Driving Car - Step 1 9:15
lecture 27 Self Driving Car - Step 2 16:18

Section 8 : Building an AI

lecture 28 Self Driving Car - Step 3 6:45
lecture 29 Self Driving Car - Step 4 14:24
lecture 30 Self Driving Car - Step 5 5:59
lecture 31 Self Driving Car - Step 6 6:1
lecture 32 Self Driving Car - Step 7 5:46
lecture 33 Self Driving Car - Step 8 10:51
lecture 34 Self Driving Car - Step 9 17:27
lecture 35 Self Driving Car - Step 10 13:51
lecture 36 Self Driving Car - Step 11 15:21
lecture 37 Self Driving Car - Step 12 12:57
lecture 38 Self Driving Car - Step 13 12:28
lecture 39 Self Driving Car - Step 14 2:53
lecture 40 Self Driving Car - Step 15 5:29
lecture 41 Self Driving Car - Step 16 7:19

Section 9 : Playing with the AI

lecture 42 Self Driving Car - Level 1 8:51
lecture 43 Self Driving Car - Level 2 4:39
lecture 44 Self Driving Car - Level 3 7:21
lecture 45 Self Driving Car - Level 4 6:9

Section 10 : Part 2 - Doom (Deep Convolutional Q-Learning)

lecture 46 Welcome to Part 2 - Doom (Deep Convolutional Q-Lea Text

Section 11 : Deep Convolutional Q-Learning Intuition

lecture 47 Plan of Attack 3:27
lecture 48 Deep Convolutional Q-Learning Intuition 7:13
lecture 49 Eligibility Trace 8:38
lecture 50 Installing Open AI Gym and ppaquette Text

Section 12 : Installation for Part 2

lecture 51 Installing Open AI Gym Walk Through (Mac Version) 3:56
lecture 52 Installing Open AI Gym Walk Through (Ubuntu Versio 5:36

Section 13 : Building an AI

lecture 53 Doom - Step 1 5:55
lecture 54 Doom - Step 2 9:42
lecture 55 Doom - Step 3 9:52
lecture 56 Doom - Step 4 12:32
lecture 57 Doom - Step 5 14:16
lecture 58 Doom - Step 6 6:32
lecture 59 Doom - Step 7 4:40
lecture 60 Doom - Step 8 6:39
lecture 61 Doom - Step 9 3:44
lecture 62 Doom - Step 10 7:51
lecture 63 Doom - Step 11 6:33
lecture 64 Doom - Step 12 4:14
lecture 65 Doom - Step 13 6:49
lecture 66 Doom - Step 14 15:32
lecture 67 Doom - Step 15 8:27
lecture 68 Doom - Step 16 10:38
lecture 69 Doom - Step 17 19:38

Section 14 : Playing with the AI

lecture 70 Watching our AI play Doom 18:39

Section 15 : Part 3 - Breakout (A3C)

lecture 71 Welcome to Part 3 - Breakout (A3C) Text
lecture 72 Plan of Attack 3:40
lecture 73 The three A's in A3C 4:45
lecture 74 Actor-Critic 6:36
lecture 75 Asynchronous 11:43
lecture 76 Advantage 15:21
lecture 77 LSTM Layer 15:36

Section 16 : Installation for Part 3

lecture 78 Installing OpenCV Text

Section 17 : Building an AI

lecture 79 Breakout - Step 1 10:8
lecture 80 Breakout - Step 2 8:1
lecture 81 Breakout - Step 3 12:24
lecture 82 Breakout - Step 4 13:10
lecture 83 Breakout - Step 5 10:33
lecture 84 Breakout - Step 6 11:46
lecture 85 Breakout - Step 7 7:46
lecture 86 Breakout - Step 8 11:30
lecture 87 Breakout - Step 9 11:31
lecture 88 Breakout - Step 10 8:5
lecture 89 Breakout - Step 11 5:6
lecture 90 Breakout - Step 12 15:39
lecture 91 Breakout - Step 13 8:22
lecture 92 Breakout - Step 14 5:22
lecture 93 Breakout - Step 15 10:52

Section 18 : Annex 1 Artificial Neural Networks

lecture 94 What is Deep Learning 12:34
lecture 95 Plan of Attack 2:52
lecture 96 The Neuron 16:15
lecture 97 The Activation Function 8:29
lecture 98 How do Neural Networks work 12:48
lecture 99 How do Neural Networks learn 12:59
lecture 100 Gradient Descent 10:13
lecture 101 Stochastic Gradient Descent 8:45
lecture 102 Backpropagation 5:22

Section 19 : Annex 2 Convolutional Neural Networks

lecture 103 Plan of Attack 3:32
lecture 104 What are convolutional neural networks 15:49
lecture 105 Step 1 - Convolution Operation 16:38
lecture 106 Step 1(b) - ReLU Laye 6:41
lecture 107 Step 2 - Pooling 14:13
lecture 108 Step 3 - Flattening 1:53
lecture 109 Step 4 - Full Connection 19:25
lecture 110 Summary 4:20
lecture 111 Softmax & Cross-Entropy 18:20