Practical Intro To Reinforcement Learning Using Robotics

Learn to build robots that can automatically learn to behave well in their environments without explicit instructions.

5.00 (5 reviews)
Udemy
platform
English
language
Other
category
instructor
41
students
2.5 hours
content
Feb 2022
last update
$44.99
regular price

What you will learn

Understanding the differences between Reinforcement Learning and the other AI paradigms.

Identifying areas in robotics where Reinforcement Learning can be applied.

Framing problems in robotics as Reinforcement Learning problems.

Applying the Multi-Armed Bandit algorithm to help robots to automatically learn expected behaviours.

Developing reward functions for Reinforcement Learning in robotic contexts.

Using Python to control sensor and actuators on EV3 Mindstorms robots.

Programming simple robots that can automatically learn the best actions to take in their environments.

Understanding the multi-armed bandit algorithm.

Balancing exploration and exploitation using various strategies.

Description

Diving into Reinforcement Learning can seem daunting if you don't have the proper hands-on guidance. Many times, people have asked me whether they should master Deep Learning before delving into Reinforcement Learning and my answer has always been that "it depends on what you want to do with RL". RL is a broad domain in its own respect. There are classical RL algorithms that can be learned and applied without any Deep Learning experience. There is also Deep Reinforcement Learning which leverages neural networks to help RL agents to learn proper behaviors in their environment through trials-and-error with reward functions.


This course has been designed to be the easiest and fastest basic entry point into RL and its applications in Robotics. From the first to the last videos, I explain every concept in RL in the context of robotics. I am intentional about this because I want to empower you to readily know when and how to apply RL techniques in Robotics. It is not an advanced course. Instead, it is your best option when you are getting started in RL (without any prior knowledge) and you are interested in being able to readily apply what you learn in your robotic projects.


Even though I use sensors and actuators from the EV3 Mindstorms robotics kit in the hands-on implementation sessions, you don't necessarily have to purpose the kit to get the best out of this course. It will certainly enhance your learning experience if you have the kit but don't worry if you don't. Without the kit, you can still understand the concepts and apply them on any robotic platform. It is my desire that after finishing this course, your passion for RL will be ignited and you will study further to know about more advanced algorithms and techniques.


So, while this course won't teach you how to build super-human capabilities into your robotics projects, you will certainly learn how to program robots to behave well in their environments without explicit instructions on what's considered "proper behavior".

Content

Introduction

Introduction
RL Explained

The RL Cycle

The RL Workflow

RL In Robotics

Framing A Robotics Problem As RL

The MAB Algorithm

Introducing The MAB Algorithm
Rewards Definitions For MAB Problems
Balancing Exploration & Exploitation

Applying MAB In Robotics

Framing A Robot Behaviour As MAB
Implementing MAB For The Robot
Demonstrating Automatic Learning On The Robot

Programming EV3 MINDSTORM In Python

Installing EV3 MicroPython
Installing The VS Code Extension
Running Programs On The EV3
Sensing Touch
Waiting For Touch Events
Controlling LED Lights
Controlling The Motors
Sweeping Angles At Specific Speeds
Running Rotations At Specific Speeds
Running Motors For Set Times

Screenshots

Practical Intro To Reinforcement Learning Using Robotics - Screenshot_01Practical Intro To Reinforcement Learning Using Robotics - Screenshot_02Practical Intro To Reinforcement Learning Using Robotics - Screenshot_03Practical Intro To Reinforcement Learning Using Robotics - Screenshot_04

Charts

Price

Practical Intro To Reinforcement Learning Using Robotics - Price chart

Rating

Practical Intro To Reinforcement Learning Using Robotics - Ratings chart

Enrollment distribution

Practical Intro To Reinforcement Learning Using Robotics - Distribution chart
4557472
udemy ID
2/18/2022
course created date
3/9/2022
course indexed date
Bot
course submited by