Published on Tue May 11 2021

BikNN: Anomaly Estimation in Bilateral Domains with k-Nearest Neighbors

Zhongping Ji
0
0
0
Abstract

In this paper, a novel framework for anomaly estimation is proposed. The basic idea behind our method is to reduce the data into a two-dimensional space and then rank each data point in the reduced space. We attempt to estimate the degree of anomaly in both spatial and density domains. Specifically, we transform the data points into a density space and measure the distances in density domain between each point and its k-Nearest Neighbors in spatial domain. Then, an anomaly coordinate system is built by collecting two unilateral anomalies from k-nearest neighbors of each point. Further more, we introduce two schemes to model their correlation and combine them to get the final anomaly score. Experiments performed on the synthetic and real world datasets demonstrate that the proposed method performs well and achieve highest average performance. We also show that the proposed method can provide visualization and classification of the anomalies in a simple manner. Due to the complexity of the anomaly, none of the existing methods can perform best on all benchmark datasets. Our method takes into account both the spatial domain and the density domain and can be adapted to different datasets by adjusting a few parameters manually.

Mon Jul 08 2019
Machine Learning
Statistical Analysis of Nearest Neighbor Methods for Anomaly Detection
Nearest-neighbor (NN) procedures are well studied and widely used in both supervised and unsupervised learning problems. We show that NN methods compare favorably to some of the other state-of-the-art algorithms for anomaly detection based on benchmark synthetic datasets.
0
0
0
Tue May 05 2020
Machine Learning
Classification-Based Anomaly Detection for General Data
Anomaly detection is one of the fundamental problems of artificial intelligence. We present a unifying view and propose an open-set method, GOAD, to relax current generalization assumptions.
0
0
0
Sun Apr 25 2021
Computer Vision
Unsupervised Learning of Multi-level Structures for Anomaly Detection
0
0
0
Sat Mar 23 2019
Computer Vision
Spatially-weighted Anomaly Detection with Regression Model
Visual anomaly detection is common in several applications including medical screening and production quality check. Conventional methods cannot use the available data and do not have a robustness of noise. In this paper, we propose a novel spatially-weighted reconstruction-loss-based anomaly detection.
0
0
0
Tue Jun 28 2016
Artificial Intelligence
A Local Density-Based Approach for Local Outlier Detection
This paper presents a simple but effective density-based outlier detection approach with the local kernel density estimation (KDE) A Relative Density-based Outlier Score (RDOS) is introduced to measure the local outlierness of objects.
0
0
0
Tue Nov 17 2020
Machine Learning
Sub-clusters of Normal Data for Anomaly Detection
Anomaly detection in data analysis is an interesting but still challenging topic in real world applications. Existing anomaly detection methods show limited performances with high dimensional data such as ImageNet. We propose to perform semantic clustering on given normal data.
0
0
0