Stochastic observability in network state estimation and control

A hidden Markov model for the traffic congestion control problem in transmission control protocol (TCP) networks is developed, and the question of observability of this system is posed. Of specific interest are the dependence of observability on the congestion control law and the interaction between observability ideas and the effectiveness of feedback control. Analysis proceeds with a survey of observability concepts and an extension of some available definitions for linear and nonlinear stochastic systems. The key idea is to link the improvement of state estimator performance to the conditioning on the output data sequence. The observability development proceeds from linear deterministic systems to linear Gaussian systems, nonlinear systems, etc., with backwards compatibility to deterministic ideas. The principal concepts relate to the entropy decrease of scalar functions of the state, which in the linear case are describable in terms of covariance matrices. A feature of nonlinear systems is that the estimator properties may affect the closed-loop control performance. Results are derived linking stochastic reconstructibility to strict improvement of the optimal closed-loop control performance over open-loop control for the hidden Markov model. The entropy provides a means to quantify and thus order simulation results for a simplified TCP network. Motivated by the link between feedback control and reconstructibility, the entropy formulation is also explored as a means to discriminate between different control strategies for improving estimator performance. This approach has connections to dual-adaptive control ideas, where the control has the simultaneous and opposing goals of regulating the system and of exciting the system to prevent estimator divergence.