Hello World, In this article let us take a look at the process of matrix multiplication from a different perspective. Often matrix multiplication is taught or learned as a boring process of certain rules. This spoils the fun of doing it. So why don’t we look for better way to think about it by having …
Introduction In this post, let’s take a look at the intuition behind Naive Bayes Classifier used in machine learning. Naive Bayes classifier is one of the basic algorithms often encountered in machine learning applications. If linear regression was based on concepts from linear algebra and calculus, naive Bayes classifier mostly backed up by probability theory. …
An Intuitive Explanation of Naive Bayes Classifier Read More »
Introduction In the initial years of my signal processing career, I have struggled to find tools and software that can do audio signal processing tasks. I was aware of free software like Audacity and python programming language. But I often felt a curated list of all possible options would have helped me a lot …
Introduction In this tutorial, I am going to code the iterative policy evaluation algotithm from the book “Reinforcement Learning: An Introduction by Andrew Barto and Richard S. Sutton”. I am going to take psuedo code, image and examples from this text. The example I am taking for this tutorial is the gird world maze from Chapter …
Iterative Policy Evaluation for Estimating Value Function Read More »
This article shows two key visual intuitions behind the usage of a discount factor in reinforcement learning with image, code, and video. Introduction Most of the advances in science and technology happened in the last 100 years. We can see mind-boggling progress in automotive, medicine, communication, energy, etc. . Among these advances, some technologies shake …
In summertime when I go out, I don’t take the raincoat with me. On what basis am I not expecting it to rain during summer?. Isn’t it my past experience gives me that knowledge and estimate the outcome?. The expected value in probability theory leverages such a pattern in data to make a good representation …
This tutorial is on the typesetting language called LaTeX. LaTeX is useful when it comes to creating complex documents like thesis, project reports, research articles, etc. We will see the basic use-cases in around 22 examples. LaTeX Installation Instructions Windows In Windows, you need to install two programs called MiKTeX and TeXstudio. Please be careful to install …
Introduction Bandit problems are the simplest possible reinforcement learning scenario. Here the bandit machine can have k arms and pulling each arm leaves the user a reward. One of the arms will be giving higher rewards in the long run and moreover this pattern could be changing over a time period. Think of the scenario …
Did you ever needed to do automated PDF creation using a table of information?. Creating a Word document with certain formatting, styles, and tables would be the easy choice for a few pages of data. But what if you have data that might fill 100+ pages?. Would you do it by hand? or can we …
Automated Document Generation with Python & LaTeX Read More »
Here in this article, I explain how to do inset plotting using Python. Inorder to do that, we will be using Python programming language and a famous plotting library named matplotlib. Let us start with a story to understand the requirement. A use case scenario Once upon a time, there was a scientist named Sarah. …