Volver a Fundamentals of Reinforcement Learning

estrellas

2,092 calificaciones

•

521 reseña

Reinforcement Learning is a subfield of Machine Learning, but is also a general purpose formalism for automated decision-making and AI. This course introduces you to statistical learning techniques where an agent explicitly takes actions and interacts with the world. Understanding the importance and challenges of learning agents that make decisions is of vital importance today, with more and more companies interested in interactive agents and intelligent decision-making.
This course introduces you to the fundamentals of Reinforcement Learning. When you finish this course, you will:
- Formalize problems as Markov Decision Processes
- Understand basic exploration methods and the exploration/exploitation tradeoff
- Understand value functions, as a general-purpose tool for optimal decision-making
- Know how to implement dynamic programming as an efficient solution approach to an industrial control problem
This course teaches you the key concepts of Reinforcement Learning, underlying classic and modern algorithms in RL. After completing this course, you will be able to start using RL for real problems, where you have or can specify the MDP.
This is the first course of the Reinforcement Learning Specialization....

AT

6 de jul. de 2020

An excellent introduction to Reinforcement Learning, accompanied by a well-organized & informative handbook. I definitely recommend this course to have a strong foundation in Reinforcement Learning.

NH

7 de abr. de 2020

This course is one of the best I've learned so far in coursera. The explanations are clear and concise enough. It took a while for me to understand Bellman equation but when I did, it felt amazing!

Filtrar por:

por JingZeng X

•25 de sep. de 2020

Good!

por Yetao W

•23 de abr. de 2020

Good!

por Yatin T

•11 de abr. de 2020

Nice

por Hakan K

•1 de mar. de 2020

I enjoyed this introduction course in Reinforcement Learning (RL). It explained in detail the fundamentals of RL such as k-armed bandits, Contextual Bandits and - of course - Markov Decision Processes (MDP). The lectures explained the conceps with nice examples and as well as the math behind (Bellman equations). The coursebook was the great "RL bible" ("Reinforcement Learning - An Introduction", 2nd edition by Sutton & Bartto); the lectures followed the first 4 chapters of the book quite closely.

I liked the programming assignments. It took some time to understand the structure of the tools used (e.g. the little known RLGlue) but after that it was quite straight forward, especially since the Notebook had great support for testing the solutions before submitting the assignment.

It was also interesting to see the guest lectures talk about the world outside the simple example MDPs used as examples, such as RL in the real world (using Contextual Bandits as a foundation), and about solving huge Fleet Management problems with RL.

One thing I missed in this course was more details about MDP and linear programming, which was mentioned in passim by the lecturers, and was an essential tool for solving the Fleet Management Problem (using approximate linear programming). Perhaps some of the next courses will discuss linear programming more...

por Michael S

•21 de may. de 2020

I thought that the course content was extremely interesting, and the tests and programming were informative.

I did think though that the lectures were a little terse and could have given more information and worked through more examples. I think the presenters of this course and the people who constructed it could learn a lot from how, say, Andrew Ing's Coursera courses and Geoffrey Hinton's Coursera courses are put together and presented.

Specifically, the actual video time was very short and huge dependence was placed on the text book (which is very good textbook). I found Jupyter note book buggy and had to reset it a few times, but that might be me: I am not familar with it. I think as well, in a preliminary section, there could have been more on the Jupyter notebook and programming - even if this was just a document. As a user inexperienced with the Jupyter notebook, I found debugging and running test code in the lecturer's notebook in order to find my errors really hard. I often had to reset the notebook. Some assistance would have been appreciated here. In other courses that I have done, the prgramming environment has been more flexible which has made debugging easier, but I accept that my concerns here may be due to my inexperience.

por Rohit K

•19 de oct. de 2020

Hi,

I don't know whether this feedback will reach the correct ears or not.

I have already completed the course before and now I am doing it again. One thing that I found is the coding assignments are using library and is not letting the student do the thing from scratch. Things will be very clear to the student if the build everything from scratch using the basic libraries. for eg. not using rl_glue, but coding up the environment, coding up the agent. Using abstraction is good, but for those who already know the things. Since this course is more about the fundamentals of RL, it should teach the basics of building environment, agent from scratch. Maybe we can use library once we have done it from scratch, like starting from week 3 or course 2. I persnally was not able to get the full understanding of the things untill I implemented the things from scratch.

Thanks:)

overall course very nice. A great effort !

por Stefano P

•19 de may. de 2020

The course is overall very good, and it actually introduces you to Reinforcement Learning from scratch. Lectures are very clear, quizzes are challenging and the course relies on a text book, provided when you enroll. The only weak point, but not a serious issue, is that most of the lectures do not add content to what is in the book. Since studying the book is in fact mandatory, they could have used the lectures to better explain some concepts, assuming people read the book. Sometimes they do, but not so often.

por Laurence G

•3 de may. de 2021

Overall fairly satisfied with this course.

Good coverage of the fundamentals through textbook backed up by videos and labs. Some of the quiz questions are a bit outside the box and include weird multi choice options that feel like they could be right depending on interpretation. I wasn't a fan of how the textbook handled Week 2 and 3, and spent a lot the time thinking "but why" - could be improved by explaining the policy and value dance from chapter 4 prior to commencing.

por Yashar S

•17 de jul. de 2021

This course enabled me to be familiar with core concepts of Reinforecement learning. I was able to understand how Markov Decision Process and Dynamic Programming help to solve the problems. the lectures were clear and assignements were good and helpfull. I just expect to go more with how we can code agen-envirnoment interactions which are missed in this course. By the way, thanks for all the efforts done by the teachers.

por Hadrien H

•5 de nov. de 2020

Very good course which goes very well with reading the book alongside. I found very useful to read the chatper first and then brush and check my understanding by watching the videos. The explainations are clear and good and the videos length is just very good for me. Only thing I would improve is more coding assignment. With a more step by step series of exercises where one is learning to implement more things.

por Sanat D

•21 de jun. de 2020

The course material (the textbook in particular) is great. I'm not sure how much value the videos add to the readings, but everyone has their preferred style of learning. My one dissatisfaction with this course is that I feel the material is not conducive to multiple choice quizzes. I wish there were fewer of those, and many more programming assignments. The coding parts were where I learned the most.

por Nikhil S

•22 de nov. de 2020

Great material! The course was very well taught and at an appropriate pace. I do think that the teaching style was a bit too formal, however. Also, the entire course, lectures, and order are centered around the book which is easy enough to understand on its own. It might be useful to discuss some practical tips and methods instead of only the book theory. Learned a lot anyway. Thank you!

por Ananthapadmanaban, J

•23 de may. de 2020

Reading all weeks' suggested sections from the book before going through the videos would make it easy to understand the concepts. I actually read after watching half the videos, but it makes more sense to read before the videos. The assignments are decent. Policy evaluation, policy iteration and policy improvement are the concepts the course is trying to explain.

por Satish C R

•6 de oct. de 2020

I have definitely learned basics of reinforcement learning by taking the course. In my opinion, to really absorb the material, one needs to read the provided textbook carefully and do the exercises. I suggest doing the some of the textbook programming problems as well to really learn the material. The videos only provide an overview.

por Rishi R

•3 de ago. de 2020

An amazing course with great insights that drive a new learner in this field want to know more. The only slight drawback I felt was in missing details in implementing the algorithm, which of course the assignments took care of. Yet a good elucidation of the algorithms step-by-step will give a better understanding.

por Arun R

•12 de feb. de 2020

Great class and I learned a lot - docking one star because the final programming assignment didn't give a comprehensive enough checker inside the Notebook, so I had to keep submitting and look to discussions for help in solving (for really a minor issue that it looks like many students faced on an edge test case).

por J B

•15 de jun. de 2020

A very well constructed course with two excellent lecturers leading it. A lovely introduction to RL although some may prefer a more mathematical treatment (in which case you need to find a longer course). No tutorial support during the course though so you need to be prepared to sort out your own problems.

por Sebastian T

•22 de feb. de 2020

Slightly too theoretical but clarified couple loose ideas and enabled me to work with python a bit. although a t the beginning of the course they speak that it is not about python, we actually get a chance using it although indeed we are not getting nice python code examples in course materials.

por Russel C

•15 de feb. de 2020

Really good introduction to Reinforcement Learning foundations. The lectures were great, and helped translate the theory from the RL book. I would like there to be a few more detailed walk-thru of the update algorithms in week 4, but I was able to work through the programming assignments okay.

por Shashidhara K

•13 de nov. de 2019

I really sorry for giving 4 star, my only reason for giving 4 star is so you can read this review. Please include some exercise on calculating the equations by hand, with solutions(this is the only reason for 4 star).

Thank you for the course

Course deserves 5 stars.(pardon my 4 stars, sorry)

por bob n

•22 de dic. de 2020

For me, math a bit harder and more opaque than other ML courses I've taken. Even though only a few lines, final programming assignment one of more challenging ones in taking book equations to python implementation. Explanations pretty clear in videos.

por Lucas L

•8 de abr. de 2021

Great course with interesting material and good examples. The only reason for rating 4 and not 5 is because I feel that programming assignments are a little too easy. Maybe they could benefit from letting the student implement more parts.

por Dror L

•31 de jul. de 2020

Clear and pleasant recorded presentations. Very good and precise reading materials. Time estimate for reading materials are super optimistic. Guest lectures are at best inspiring. No real value. They are unfocused and all over the place.

por Ed J

•25 de abr. de 2020

I think the course was well put together and the labs were clear. My only real complaint is that the book and tests spent a lot of time proving and manipulating equations. I am mostly interested in using the formulas and programming.

por Aresh B

•13 de ene. de 2021

The coding assignments are a bit confusing. If you expand on coding assignment and probably provide a more step by step instruction as how the functions are being defined, or how the environments are created it would be way better.

- Analista de datos de Google
- Gestión de proyectos de Google
- Diseño de experiencia del usuario (UX) de Google
- Soporte de TI de Google
- Ciencia de datos de IBM
- Analista en datos de IBM
- Análisis de datos de IBM con Excel y R
- Analista de ciberseguridad de IBM
- Marketing en redes sociales: Facebook
- Desarrollador de la nube de pila completa de IBM
- Representante de desarrollo de ventas de Salesforce
- Operaciones de venta de Salesforce
- Soporte de Tecnologías de la Información de Google
- Certificado profesional de Suporte em TI do Google
- Automatización de TI de Google con Python
- DeepLearning.AI Tensorflow
- Certificaciones populares en Seguridad Cibernética
- Certificaciones populares en SQL
- Certificaciones populares en TI
- Ver todos los certificados

- cursos gratuitos
- Aprende un idioma
- python
- Java
- diseño web
- SQL
- Cursos gratis
- Microsoft Excel
- Administración de proyectos
- seguridad cibernética
- Recursos Humanos
- Cursos gratis en Ciencia de los Datos
- hablar inglés
- Redacción de contenidos
- Desarrollo web de pila completa
- Inteligencia artificial
- Programación C
- Aptitudes de comunicación
- Cadena de bloques
- Ver todos los cursos

- Habilidades para equipos de ciencia de datos
- Toma de decisiones basada en datos
- Habilidades de ingeniería de software
- Habilidades sociales para equipos de ingeniería
- Habilidades para administración
- Habilidades en marketing
- Habilidades para equipos de ventas
- Habilidades para gerentes de productos
- Habilidades para finanzas
- Proyectos de desarrollo de Android
- Proyectos de TensorFlow y Keras
- Python para todos
- Aprendizaje profundo
- Habilidades de Excel aplicadas para los negocios
- Aspectos básicos de los negocios
- Aprendizaje Automático
- Aspectos básicos de AWS
- Bases de la Ingeniería de Datos
- Habilidades como analista de datos
- Habilidades para diseñadores de experiencia del usuario

- MasterTrack® Certificates
- Certificados profesionales
- Certificados universitarios
- MBA y títulos de grado en negocios
- Títulos en ciencias de los datos
- Títulos en ciencias informáticas
- Títulos en Análisis de datos
- Títulos en salud pública
- Títulos de grado en Ciencias Sociales
- Títulos en administración
- Títulos de grado de las principales universidades europeas
- Maestrías
- Licenciaturas
- Títulos de grado con trayectoria de desempeño
- Cursos BSc
- ¿Qué es una licenciatura?
- ¿Cuánto tiempo dura una Maestría?
- ¿Vale la pena hacer una MBA en línea?
- Siete maneras de pagar la escuela de posgrado
- Ver todos los títulos