## Paper Note: Distributional Reinforcement Learning with Quantile Regression

This article is a tutorial style discussion of the research paper titled “Distributional RL with Quantile Regression”. Here I try to reflect and convey the ideas of the paper with an intuitive style. Introduction Supervised machine learning deals with learning from examples. This is in contrast to real-life where we often don’t have a proper …

A few years ago, this post (Confession as AI Researcher) on machine learning Reddit community got a lot of attention. It was asking for machine learning research advice. A lot of suggestions/advice have been made by the community. I am summarizing all the points made by different community members along with my thoughts. Hope this …

This is a curated list of resources, blogs, YouTube channels/playlists, and special interest groups which discuss machine learning papers. These machine learning reading groups are an excellent opportunity for anyone working in machine learning to improve their knowledge and skillset and also to network remotely. For any machine learning or data science aspirant or even …

## Complementary Actions

I always asked myself what is the best way to do various things. I mean to do more in less time and in an efficient manner. Things like how to study better?. How to think better?. How to manage time better?. How to solve problems quickly?. How to wake up early?. Such questions are always …

## Probability Primer

Introduction This post is going to be a short and birds-eye view of probability theory. During my undergraduate days, I often wonder what is the use of probability theory provided its fluctuating nature. For example chance of getting ahead by tossing a fair coin is 0.5. Suppose we got the head the first time, there …

## A conceptual look at Bellman operator

Bellman operators come in Reinforcement Learning (RL). When I first encountered it, I had many questions regarding it. I often feel it is interesting to observe that what feels intriguing to someone. Many questions surface out in our minds. Why is it called an operator?. What are the inputs to it and output from it?. …

## Animate Matplotlib Graphs

In this post, we will see how to animate matplotlib graphs. In many situations you might wish to create an animated content of some dynamic graph or process. You might want to do this to explain or understand a concept better. It is especially appealing for people like me who cannot think in abstract terms. …

## Summary of research paper “A Distributional Perspective on Reinforcement Learning”

Overview In this note about distributional reinforcement learning, I am going to reflect on the paper titled A Distributional Perspective on Reinforcement Learning. I will try to give an overview of the underlying ideas behind this paper. Please keep in mind that a research contribution is often a culmination of multiple ideas/components. This makes from …

## Open Source Audio Signal Processing Tools

Introduction In the initial years of my signal processing career, I have struggled to find tools and software that can do audio signal processing tasks. I was aware of free software like Audacity and python programming language. But I often felt a curated list of all possible options would have helped me a lot …

## An Intuitive Explanation of Linear Regression

Linear regression is one of the algorithm machine learning enthusiasts start to learn first. In this article, l will walk you through the linear regression intuition. We will implement the basic form of it without using any machine learning packages. The main philosophy of supervised machine learning algorithms is to learn from data. The algorithms …