Bayesian filter based behavior recognition in workflows allowing for user feedback

In this paper, we propose a novel online framework for behavior understanding, in visual workflows, capable of achieving high recognition rates in real-time. To effect online recognition, we propose a methodology that employs a Bayesian filter supported by hidden Markov models. We also introduce a novel re-adjustment framework of behavior recognition and classification by incorporating the user’s feedback into the learning process through two proposed schemes: a plain non-linear one and a more sophisticated recursive one. The proposed approach aims at dynamically correcting erroneous classification results to enhance the behavior modeling and therefore the overall classification rates. The performance is thoroughly evaluated under real-life complex visual behavior understanding scenarios in an industrial plant. The obtained results are compared and discussed.

► A novel online classification framework for behavior recognition in visual workflows. ► The framework is based on HMMs and Bayesian filtering and exploits prior knowledge. ► An approach for improving the supplied results by allowing interaction with the user. ► Two different neural network based schemes are introduced: non-linear and recursive.