Code

Bivariate Gaussian Distribution

Hacking the Bivariate Gaussian Distribution

In one of our earlier posts, we have seen how we can visually relate the parts of the one-dimensional Gaussian distribution equation. In this post, we will follow the same strategy to understand the terms that comes up with a Multivariable Gaussian distribution. We will focus on the Bivariate Gaussian distribution as distributions of higher-order …

Hacking the Bivariate Gaussian Distribution Read More »

Normal distribution visual explanation

Gaussian Distribution Explained Visually

Gaussian distribution appears in various parts of science and engineering. Apart from a distribution often appear in nature, it has got important properties such as its relation to Central Limit Theorem (CLT). The figure above shows one-dimensional Gaussian distributions of various mean and variance values. Libraries like NumPy provide functions that can return Gaussian distribution …

Gaussian Distribution Explained Visually Read More »

TwoStateMDP

Coding a Simple Markov Decision Process

A Markov Decision Process (MDP) is a mathematical framework used to model decision-making situations where the outcome of a decision depends on both the current state of the system and the actions taken by the decision maker. In an MDP, the decision maker is represented as an agent, and the system is represented as a …

Coding a Simple Markov Decision Process Read More »

An Intuitive Explanation of Naive Bayes Classifier

Introduction In this post, let’s take a look at the intuition behind Naive Bayes Classifier used in machine learning. Naive Bayes classifier is one of the basic algorithms often encountered in machine learning applications. If linear regression was based on concepts from linear algebra and calculus, naive Bayes classifier mostly backed up by probability theory. …

An Intuitive Explanation of Naive Bayes Classifier Read More »

linear regression

An Intuitive Explanation of Linear Regression

Linear regression is one of the algorithm machine learning enthusiasts start to learn first. In this article, l will walk you through the linear regression intuition. We will implement the basic form of it without using any machine learning packages. The main philosophy of supervised machine learning algorithms is to learn from data. The algorithms …

An Intuitive Explanation of Linear Regression Read More »

Iterative Policy Evaluation

Iterative Policy Evaluation for Estimating Value Function

Introduction In this tutorial, I am going to code the iterative policy evaluation algotithm from the book “Reinforcement Learning: An Introduction by Andrew Barto and Richard S. Sutton”. I am going to take psuedo code, image and examples from this text. The example I am taking for this tutorial is the gird world maze from Chapter …

Iterative Policy Evaluation for Estimating Value Function Read More »

discount factor dynamics

Discount Factor in Reinforcement Learning

This article shows two key visual intuitions behind the usage of a discount factor in reinforcement learning with image, code, and video. Introduction Most of the advances in science and technology happened in the last 100 years. We can see mind-boggling progress in automotive, medicine, communication, energy, etc. . Among these advances, some technologies shake …

Discount Factor in Reinforcement Learning Read More »