Detecting abnormal behavior in video sequences has become a crucial task with the development of automatic video-surveillance systems. Here, we propose an algorithm which locally models the probability distribution of objects behavioral features. A temporal Gaussian mixture with local update is introduced to estimate the local probability distribution. The update of the feature probability distribution is thus temporal and local, allowing a smooth transition for neighboring locations. The integration of local information in the estimation provides a fast adaptation along with an efficient discrimination between normal and abnormal behavior. The proposed technique is evaluated on both synthetic and real data. Synthetic data simulates different scenarios occurring in road traffic, and illustrates how the model adapts to local conditions. Real data demonstrates the ability of the system to detect abnormal behavior due to the presence of pedestrians and animals on highways. In all tested scenarios the system identifies abnormal and normal behavior correctly.