Publications
2026
- ICAPSGammaZero: Learning to Guide Belief-Space Search for Long-Horizon POMDPs with Generalizable Graph RepresentationsRajesh Mangannavar, and Prasad TadepalliIn International Conference on Automated Planning and Scheduling (ICAPS), 2026
2025
2019
- Learning Agents with Prioritization and Parameter Noise in Continuous State and Action SpaceR. Mangannavar, and G. SrinivasaraghavanAdvances in Neural Networks – ISNN, 2019
Among the many variants of RL, an important class of problems is where the state and action spaces are continuous—autonomous robots, autonomous vehicles, optimal control are all examples of such problems that can lend themselves naturally to reinforcement based algorithms, and have continuous state and action spaces. In this paper, we introduce a prioritized form of a combination of state-of-the-art approaches such as Deep Q-learning (DQN) and Deep Deterministic Policy Gradient (DDPG) to outperform the earlier results for continuous state and action space problems. Our experiments also involve the use of parameter noise during training resulting in more robust deep RL models outperforming the earlier results significantly. We believe these results are a valuable addition for continuous state and action space problems.