Perturbation analysis of communication networks with feedback control using stochastic hybrid models

Communication networks may be abstracted through Stochastic Fluid Models (SFM) with the node dynamics described by switched flow equations as various events take place, thus giving rise to hybrid automaton models with stochastic transitions. The inclusion of feedback mechanisms complicates these dynamics. In a tandem setting, a typical feedback mechanism is the control of a node processing rate as a threshold-based function of the downstream node’s buffer level. We consider the problem of controlling the threshold parameters so as to optimize performance metrics involving average workload and packet loss and show how Infinitesimal Perturbation Analysis (IPA) can be used to analyze congestion propagation through a network and develop gradient estimators of such metrics.