Published on Wed May 23 2018

Deep Active Learning for Anomaly Detection

Tiago Pimentel, Marianne Monteiro, Adriano Veloso, Nivio Ziviani

Anomalies are intuitively easy for human experts to understand, but they are hard to define mathematically. In order to have performance assurances in unsupervised anomaly detection, priors need to be assumed on what the anomalies are. Active learning provides the necessary priors through appropriate expert feedback.

0
0
0
Abstract

Anomalies are intuitively easy for human experts to understand, but they are hard to define mathematically. Therefore, in order to have performance guarantees in unsupervised anomaly detection, priors need to be assumed on what the anomalies are. By contrast, active learning provides the necessary priors through appropriate expert feedback. Thus, in this work we present an active learning method that can be built upon existing deep learning solutions for unsupervised anomaly detection, so that outliers can be separated from normal data effectively. We introduce a new layer that can be easily attached to any deep learning model designed for unsupervised anomaly detection to transform it into an active method. We report results on both synthetic and real anomaly detection datasets, using multi-layer perceptrons and autoencoder architectures empowered with the proposed active layer, and we discuss their performance on finding clustered and low density anomalies.