1 Efficient Computation, The Department2 Theoretical Computer Science, The Department3 Algorithms, Software & Systems, The Department4 Computer Science, IT University of Copenhagen
Outlier mining in d-dimensional point sets is a fundamental and well studied data mining task due to its variety of applications. Most such applications arise in high-dimensional domains. A bottleneck of existing approaches is that implicit or explicit assessments on concepts of distance or nearest neighbor are deteriorated in high-dimensional data. Following up on the work of Kriegel et al. (KDD '08), we investigate the use of angle-based outlier factor in mining high-dimensional outliers. While their algorithm runs in cubic time (with a quadratic time heuristic), we propose a novel random projection-based technique that is able to estimate the angle-based outlier factor for all data points in time near-linear in the size of the data. Also, our approach is suitable to be performed in parallel environment to achieve a parallel speedup. We introduce a theoretical analysis of the quality of approximation to guarantee the reliability of our estimation algorithm. The empirical experiments on synthetic and real world data sets demonstrate that our approach is efficient and scalable to very large high-dimensional data sets.
Kdd '12 Proceedings of the 18th Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, 2012, p. 877-885
Outlier detection; high-dimensional; angle-based; random projection; AMS Sketch