distributional reinforcement learning

Summary of research paper “A Distributional Perspective on Reinforcement Learning”

Leave a Comment / Conceptual, Paper Note /

Overview In this note about distributional reinforcement learning, I am going to reflect on the paper titled A Distributional Perspective on Reinforcement Learning. I will try to give an overview of the underlying ideas behind this paper. Please keep in mind that a research contribution is often a culmination of multiple ideas/components. This makes from […]

Summary of research paper “A Distributional Perspective on Reinforcement Learning” Read More »

linear regression

An Intuitive Explanation of Linear Regression

1 Comment / Code, Conceptual, Implementation, Tutorial /

Linear regression is one of the algorithm machine learning enthusiasts start to learn first. In this article, l will walk you through the linear regression intuition. We will implement the basic form of it without using any machine learning packages. The main philosophy of supervised machine learning algorithms is to learn from data. The algorithms

An Intuitive Explanation of Linear Regression Read More »

Iterative Policy Evaluation

Iterative Policy Evaluation for Estimating Value Function

Leave a Comment / Code, Tutorial /

Introduction In this tutorial, I am going to code the iterative policy evaluation algotithm from the book “Reinforcement Learning: An Introduction by Andrew Barto and Richard S. Sutton”. I am going to take psuedo code, image and examples from this text. The example I am taking for this tutorial is the gird world maze from Chapter

Iterative Policy Evaluation for Estimating Value Function Read More »

discount factor dynamics

Discount Factor in Reinforcement Learning

Leave a Comment / Code, Computational Biology, Conceptual, Historical, Tutorial /

This article shows two key visual intuitions behind the usage of a discount factor in reinforcement learning with image, code, and video. Introduction Most of the advances in science and technology happened in the last 100 years. We can see mind-boggling progress in automotive, medicine, communication, energy, etc. . Among these advances, some technologies shake

Discount Factor in Reinforcement Learning Read More »