Efficient Uncertainty Minimization for Fuzzy Spectral Clustering

Details Efficient Uncertainty Minimization for Fuzzy Spectral Clustering Efficient Uncertainty Minimization for Fuzzy Spectral Clustering

2007-03-27

arxiv.org/abs/physics/0703238v5

Phys. Rev. E 80 (2009) 056705

Physics

Data Analysis, Statistics and Probability

Keywords: cluster analysis, clustering, spectral clustering, fuzzy clustering, pattern recognition, spectral graph theory, spe

Scientific paper

10.1103/PhysRevE.80.056705

Spectral clustering uses the global information embedded in eigenvectors of an inter-item similarity matrix to correctly identify clusters of irregular shape, an ability lacking in commonly used approaches such as k-means and agglomerative clustering. However, traditional spectral clustering partitions items into hard clusters, and the ability to instead generate fuzzy item assignments would be advantageous for the growing class of domains in which cluster overlap and uncertainty are important. Korenblum and Shalloway [Phys. Rev. E 67, 056704 (2003)] extended spectral clustering to fuzzy clustering by introducing the principle of uncertainty minimization. However, this posed a challenging non-convex global optimization problem that they solved by a brute-force technique unlikely to scale to data sets having more than O(10^2) items. Here we develop a new method for solving the minimization problem, which can handle data sets at least two orders of magnitude larger. In doing so, we elucidate the underlying structure of uncertainty minimization using multiple geometric representations. This enables us to show how fuzzy spectral clustering using uncertainty minimization is related to and generalizes clustering motivated by perturbative analysis of almost-block-diagonal matrices. Uncertainty minimization can be applied to a wide variety of existing hard spectral clustering approaches, thus transforming them to fuzzy methods.

Affiliated with

Also associated with

No associations

Rating

Efficient Uncertainty Minimization for Fuzzy Spectral Clustering does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Efficient Uncertainty Minimization for Fuzzy Spectral Clustering, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Efficient Uncertainty Minimization for Fuzzy Spectral Clustering will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-373074