Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Personal webpage

Posts

Notes on Soft Actor-Critic

4 minute read

A short blog post explaining how SAC works. I also implement SAC from scratch and train on a few tasks.

Notes on DDPG

4 minute read

A short blog post explaining how DDPG works. I also implement DDPG from scratch and train on a few tasks.

Random Walk

1 minute read

I compare different policy evaluation approaches on the random walk problem.

Grid World

less than 1 minute read

Find the shortest path on a grid using RL.

portfolio

Mixed State Entanglement In Quantized Chaotic Systems

Master’s thesis carried out at IIT Madras. Studied the connections between chaos and quantum entanglement. In particular, studied entanglement dynamics in mixed states of quantized chaotic systems, focusing on the quantum coupled standard map.

Physics-Informed Model-Based Reinforcement Learning

Published at Learning for Dynamics & Control Conference (L4DC), 2023. We learn the dynamics model of a robot using a physics-informed neural network and use it to train a model-based RL algorithm. We show that, in model-based RL, model accuracy mainly matters in environments that are sensitive to initial conditions, where numerical errors accumulate fast.

publications

talks

teaching

Teaching experience 1

This is a description of a teaching experience. You can use markdown like any other post.

Teaching experience 2

This is a description of a teaching experience. You can use markdown like any other post.