What Does Partially Observable Markov Decision Process (POMDP) Mean?
A partially observable Markov decision process (POMPD) is a Markov decision process in which the agent cannot directly observe the underlying states in the model. The Markov decision process (MDP) is a mathematical framework for modeling decisions showing a system with a series of states and providing actions to the decision maker based on those states.
The POMPD builds on that concept to show how a system can deal with the challenges of limited observation.
