## A Short Intuitive Explanation of Vectors

What is a vector? I know you might be already thinking- “a vector is something which has magnitude and direction”. But that’s old school definition. I also used to think that way, but after I left the academic world, I had to dig deeper. The more I explored, the deeper the concept became. This post …

## Iterative Policy Improvement

Introduction Iterative Policy Improvement (IPI) is an algorithm in reinforcement learning to find the optimal course of action given the enviroment conditions. This blog post explains how it is done using a simple grid world navigating example. It works by iteratively improving an initial policy using the policy evaluation and policy improvement steps. Here’s how …

## Epsilon Greedy Algorithm in Bandit Problems

Introduction Bandit problems are the simplest possible reinforcement learning scenario. Here the bandit machine can have k arms and pulling each arm leaves the user a reward. One of the arms will be giving higher rewards in the long run and moreover this pattern could be changing over a time period. Think of the scenario …

## Automated Document Generation with Python & LaTeX

Did you ever needed to do automated PDF creation using a table of information?.  Creating a Word document with certain formatting, styles, and tables would be the easy choice for a few pages of data. But what if you have data that might fill 100+ pages?. Would you do it by hand? or can we …

## Inset Plotting with Matplotlib

Here in this article, I explain how to do inset plotting using Python. Inorder to do that, we will be using Python programming language and a famous plotting library named matplotlib. Let us start with a story to understand the requirement. A use case scenario Once upon a time, there was a scientist named Sarah. …