A Markov Decision Process (MDP) is a mathematical framework used to model decision-making situations where the outcome of a decision depends on both the current state of the system and the actions taken by the decision maker. In an MDP, the decision maker is represented as an agent, and the system is represented as a …
Following is a list (in progress) of resources on Reinforcement Learning and allied topics. Though not comprehensive, it includes University lectures, YouTube playlists, MOOCs, blogs, etc. Hope this would be useful to someone getting started in reinforcement learning. UC Berkely CS 285 at UC Berkeley Deep Reinforcement Learning (23) Deep RL Bootcamp (15) CS 294: …
In this article, let us explore what is meant by the concept of orthogonality. Orthogonal or orthogonality is often introduced from a mathematical perspective. In general, most resources explains it in terms of linear algebra and vectors. One such example is when we learn about right-angled triangles the two sides are drawn as perpendicular or …
“Small parts of curves are nearly straight line“ I heard this first-time years back in one of MIT’s OpenCourseWare calculus classes. Little did I know it is going to be a life-long lesson to me at that time. This concept is going to be one of the first principles we will be dealing with in …
Every day, computational fields like machine learning, artificial intelligence, neuroscience, cryptography, etc. are making great progress. Anyone pursuing a career in all such fields might be looking for a solid foundation. If we dig deeper, we often trace back to the Queen of Science- Mathematics. How to learn mathematics for machine learning To learn mathematics …
Introduction In this post, let’s take a look at the intuition behind Naive Bayes Classifier used in machine learning. Naive Bayes classifier is one of the basic algorithms often encountered in machine learning applications. If linear regression was based on concepts from linear algebra and calculus, naive Bayes classifier mostly backed up by probability theory. …
An Intuitive Explanation of Naive Bayes Classifier Read More »
This article list out some of the foundational mathematics courses freely available on YouTube. A strong foundation flags off a voyage to knowledge and success. Anyone wish to have a great problem solving skill in science, technology or engineering will have to aquire the fundamental nuggets of mathematical ideas. This is because almost any problem …
Hello, world, In this post, I summarize the book The Art Of Thinking Clearly by Rolf Dobelli. This book has some interesting observations about thinking clearly. I have listed out the main ideas in bold, its summary from respective chapters, along with my thoughts and view points. Introduction to Thinking Clearly Failure to think clearly …
Book summary: The Art Of Thinking Clearly by Rolf Dobelli Read More »
In this post, I am going to give a summary of nine key papers from the distributional reinforcement learning (DRL) area. Paper 001 : A Distributional Perspective on Reinforcement Learning This is the seminal paper in this area. The key idea of the paper is the argument that the value distribution is important in reinforcement …
Nine key papers in Distributional Reinforcement Learning Literature Read More »
I always aspired to be a great thinker. My quest for this skill led me to various types of thinking from different sources. The ones I have encountered so far are summarized below. I am jotting down my thoughts on each of these areas. Critical Thinking This is the top in the list and is …