Conceptual

Normal distribution visual explanation

Gaussian Distribution Explained Visually

Gaussian distribution appears in various parts of science and engineering. Apart from a distribution often appear in nature, it has got important properties such as its relation to Central Limit Theorem (CLT). The figure above shows one-dimensional Gaussian distributions of various mean and variance values. Libraries like NumPy provide functions that can return Gaussian distribution …

Gaussian Distribution Explained Visually Read More »

TwoStateMDP

Coding a Simple Markov Decision Process

A Markov Decision Process (MDP) is a mathematical framework used to model decision-making situations where the outcome of a decision depends on both the current state of the system and the actions taken by the decision maker. In an MDP, the decision maker is represented as an agent, and the system is represented as a …

Coding a Simple Markov Decision Process Read More »

An Intuitive Explanation of Naive Bayes Classifier

Introduction In this post, let’s take a look at the intuition behind Naive Bayes Classifier used in machine learning. Naive Bayes classifier is one of the basic algorithms often encountered in machine learning applications. If linear regression was based on concepts from linear algebra and calculus, naive Bayes classifier mostly backed up by probability theory. …

An Intuitive Explanation of Naive Bayes Classifier Read More »

distribution

Nine key papers in Distributional Reinforcement Learning Literature

In this post, I am going to give a summary of nine key papers from the distributional reinforcement learning (DRL) area. Paper 001 : A Distributional Perspective on Reinforcement Learning  This is the seminal paper in this area. The key idea of  the paper is the argument that the value distribution is important in reinforcement …

Nine key papers in Distributional Reinforcement Learning Literature Read More »

reinforcement learning framework

Paper Note: Distributional Reinforcement Learning with Quantile Regression

This article is a tutorial style discussion of the research paper titled “Distributional RL with Quantile Regression”. Here I try to reflect and convey the ideas of the paper with an intuitive style. Introduction Supervised machine learning deals with learning from examples. This is in contrast to real-life where we often don’t have a proper …

Paper Note: Distributional Reinforcement Learning with Quantile Regression Read More »