Doctor of Philosophy
School of Electrical, Computer and Telecommunications Engineering, Faculty of Informatics
Bouttefroy, Philippe L., Contextual bayesian inference for visual object tracking and abnormal behavior detection, Doctor of Philosophy thesis, School of Electrical, Computer and Telecommunications Engineering, Faculty of Informatics, University of Wollongong, 2010. http://ro.uow.edu.au/theses/3117
Visual object tracking has been extensively investigated in the last two decades for its attractiveness and proﬁtability. It remains an active area of research because of the lack of a satisfactory holistic tracking system that can deal with intrinsic and extrinsic distortions. Illumination variations, occlusions, noise and errors in object matching and classiﬁcation are only afraction oftheproblems currently encountered in visual object tracking. The work developed in this thesis integrates contextual information in a Bayesian framework for object tracking and abnormal behavior detection; more precisely, it focuses on the intrinsic characteristics of video signals in conjunction with object behavior to improve tracking outcomes. Therepresentationofprobabilitydensityfunctionsisessentialformodelingstochas¬tic variables. In particular, parametric modeling is convenient since it makes possi¬ble the eﬃcient storage of the representation and the simulation of the underlying stochastic process. The Gaussian mixture model is employed in this thesis to rep¬resent the pixel color distribution for segregation of foreground from background. The model adapts quickly to fast changes in illumination and resolves the problem of “pixel saturation” experienced by some existing background subtraction algo¬rithms. The technique leads to better accuracy in the extraction of the foreground for higher-level tasks such as motion estimation. The solutionof theBayesianinferenceproblemforMarkovchainsand,inparticular, the well-known Kalman and particle ﬁlters is also investigated. The integration of contextual inference is of paramount importance in the aforementioned estimators; it resultsinobject-speciﬁctracking solutionswithimproved robustness. Thevehicle tracking problem is explored in detail. The projective transformation, imposed by the environment conﬁguration, is integrated into the Kalman and particle ﬁlters, which yields the “projective Kalman ﬁlter” and the “projective particle ﬁler”. Ex¬tensive experimental results are presented, which demonstrate that the projective Kalman and particle ﬁlters improve tracking robustness by reducing tracking drift and errors in the estimated trajectory. The constraint on the known nature of the environment is then relaxed to allow general tracking of pedestrians. A mixture of GaussianMarkovrandom ﬁeldsisintroduced tolearnpatternsof motionand model contextualinformationwithparticle ﬁltering. Suchinferenceresultsinanincreased tracking robustness to occlusions. The local modeling with the Markov random ﬁelds also provides inference on ab-normalbehaviordetection. Sincelocalpatterns are unveiledby theMarkov random ﬁeld mixture, detecting abnormal behavior is reduced to the matching of an object feature vector to the underlying local distribution, whereas the global approach, introducinggeneralization errors, involves complex, cumbersome andinaccuratede¬cisions. Experimental evaluationonsyntheticand realdatashow superiorresultsin abnormal behavior detection for driving under the inﬂuence of alcohol and pedes¬trians crossing highways.