Decision-theoretic harmony: A first step

This paper presents a novel harmony generation method based on decision-theoretic planning. We are the first to model music generation using Markov decision processes (MDPs). We give a proof of concept for this approach by using MDP planning to generate four-part harmony, given the melody or soprano line. Our initial results show feasibility, and show the variance possible, depending on the choice of reward functions.