Relationship Between Dynamic Programming and the Maximum Principle Under State Constraints

Bellman's dynamic programming and Pontryagin's maximum principle are two basic tools for studying optimal control theory. We consider the optimal control problem under state constraints and examine the relationship between the maximum principle and dynamic programming via the adjoint, Hamiltonian and value functions. For this purpose the notions of generalized superdifferentials are introduced