In Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy

Fatima Zohra Daha

will defend her dissertation

Graph-based Approach for Anomaly Detection in Video Surveillance

Abstract

With the rise of technology, cameras are found to be a very useful tool to monitor different areas for public safety and security. Human operators of modern surveillance systems are confronted with a huge amount of digital video data that needs to be monitored constantly. However, due to many limitations such as fatigue and time efficiency, human operators are not continuously watching these surveillance videos. Hence, they are not able to prevent incidents and reduce the scale of mishaps. In some cases, the recorded videos are watched after the incident to identify when it happened. However, given the massive amount of video data recorded and the number of cameras that might be involved, the identification of anomalies will take a significant amount of time. This manual analysis of video data requires extensive manpower and is lacking efficacy and reliability. In this thesis, we propose two anomaly detection systems to overcome these issues-- an offline framework to detect anomalies after they happen, and an online framework to identify incidents while they are happening to limit their damage. The contributions of this thesis are divided into three main parts. The first part introduces a method based on dynamic graphs to represent motion and semantic information present in the scene. This method utilizes hand-crafted features as well as graph properties to extract useful information from video sequences. The second part presents an offline framework that uses a one-class classifier to model normal activities represented by spatiotemporal features and features extracted using the graph-based approach. In the third part, we propose to learn regularities using autoencoders. This approach is based on the intuition that the autoencoder learns to reproduce the test input with good fidelity if it resembles the training data, which will produce low reconstruction errors for normal instances. Therefore, reconstruction error between the network’s output and the target output is used to classify a video sequence as normal or abnormal. Quantitative and qualitative experiments show that the proposed approaches can reach state-of-the-art performance on three challenging anomaly detection datasets that represent real-world scenarios.

Date: Monday, July 06, 2020
Time: 10:00 AM - 12:00 PM
Place: Online Presentation - MS Teams meeting
https://teams.microsoft.com/l/meetup-join/19%3ae9fb3f97653441d0a660395030feda5f%40thread.tacv2/1592501006281?context=%7b%22Tid%22%3a%22170bbabd-a2f0-4c90-ad4b-0e8f0f0c4259%22%2c%22Oid%22%3a%22e2a35c59-70ea-485a-b7f0-68482384fe7b%22%7d
Advisor: Dr. Shishir K. Shah

Faculty, students, and the general public are invited.