01 Welcome to the course
03 Q-Learning Intuition
-
006 Plan of Attack (4:04)
-
007 What is reinforcement learning (11:27)
-
008 The Bellman Equation (18:25)
-
009 The Plan (2:12)
-
010 Markov Decision Process (16:27)
-
011 Policy vs Plan (12:55)
-
012 Adding a Living Penalty (9:47)
-
013 Q-Learning Intuition (14:46)
-
014 Temporal Difference (19:27)
-
015 Q-Learning Visualization (13:31)
05 Deep Q-Learning Intuition
06 Installation for Part 1
07 Creating the environment
08 Building an AI
-
034 Self Driving Car - Step 3 (6:45)
-
035 Self Driving Car - Step 4 (14:24)
-
036 Self Driving Car - Step 5 (5:59)
-
037 Self Driving Car - Step 6 (6:01)
-
038 Self Driving Car - Step 7 (5:46)
-
039 Self Driving Car - Step 8 (10:51)
-
040 Self Driving Car - Step 9 (17:27)
-
041 Self Driving Car - Step 10 (13:51)
-
042 Self Driving Car - Step 11 (15:21)
-
043 Self Driving Car - Step 12 (12:57)
-
044 Self Driving Car - Step 13 (12:28)
-
045 Self Driving Car - Step 14 (2:53)
-
046 Self Driving Car - Step 15 (5:29)
-
047 Self Driving Car - Step 16 (7:19)
09 Playing with the AI
11 Deep Convolutional Q-Learning Intuition
12 Installation for Part 2
13 Building an AI
-
061 Doom - Step 1 (5:55)
-
062 Doom - Step 2 (9:42)
-
063 Doom - Step 3 (9:52)
-
064 Doom - Step 4 (10:35)
-
065 Doom - Step 5 (14:16)
-
066 Doom - Step 6 (6:32)
-
067 Doom - Step 7 (4:40)
-
068 Doom - Step 8 (6:39)
-
069 Doom - Step 9 (3:44)
-
070 Doom - Step 10 (7:51)
-
071 Doom - Step 11 (6:33)
-
072 Doom - Step 12 (4:14)
-
073 Doom - Step 13 (6:49)
-
074 Doom - Step 14 (15:32)
-
075 Doom - Step 15 (8:27)
-
076 Doom - Step 16 (10:38)
-
077 Doom - Step 17 (19:38)
14 Playing with the AI
16 A3C Intuition
18 Building an AI
-
087 Breakout - Step 1 (10:08)
-
088 Breakout - Step 2 (8:01)
-
089 Breakout - Step 3 (12:24)
-
090 Breakout - Step 4 (12:58)
-
091 Breakout - Step 5 (10:33)
-
092 Breakout - Step 6 (11:46)
-
093 Breakout - Step 7 (7:46)
-
094 Breakout - Step 8 (11:30)
-
095 Breakout - Step 9 (11:31)
-
096 Breakout - Step 10 (8:05)
-
097 Breakout - Step 11 (5:06)
-
098 Breakout - Step 12 (15:39)
-
099 Breakout - Step 13 (8:22)
-
100 Breakout - Step 14 (5:22)
-
101 Breakout - Step 15 (10:52)
19 Annex 1 Artificial Neural Networks
20 Annex 2 Convolutional Neural Networks
-
111 Plan of Attack (3:32)
-
112 What are convolutional neural networks (15:49)
-
113 Step 1 - Convolution Operation (16:38)
-
114 Step 1(b) - ReLU Layer (6:41)
-
115 Step 2 - Pooling (14:13)
-
116 Step 3 - Flattening (1:52)
-
117 Step 4 - Full Connection (19:25)
-
118 Summary (4:20)
-
119 Softmax Cross-Entropy (18:20)
