A qualitative approach to Markovian equilibrium in infinite horizon economies with capital

Using lattice programming and order theoretic fixpoint theory, we develop a new class of monotone iterative methods that provide a qualitative theory of Markovian equilibrium decision processes for a large class of infinite horizon economies with capital. The class of economies includes models with public policy, valued fiat money, monopolistic competition, production externalities, and various other nonconvexities in the production sets. The results can be adapted to construct symmetric Markov equilibrium in models with many agents and market incompleteness. As the methods are constructive, they provide the foundations for a rigorous analysis of numerical approximation schemes that study extremal Markovian equilibrium. Equilibrium comparative statics results relative to the space of economies are available. Of independent interest, we provide new conditions for preserving complementarity under maximization, and new generalized envelope theorems for nonconcave dynamic programming problems. Our fixed point algorithms are sharp, and are able to distinguish sufficient conditions under which Markovian equilibrium form a complete lattice of Lipschitz continuous, uniformly continuous and semicontinuous monotone functions as well as unique continuously differentiable equilibrium.