Poisson's equation for discrete-time single-birth processes

We consider Poisson's equation for discrete-time single-birth processes, and we derive its solutions by solving a linear system of infinitely many equations. We apply the solution of Poisson's equation to obtain the asymptotic variance. The results are further applied to birth-death processes and the scalar-valued GI/M/1-type Markov chains.