Evolutionary k-means for distributed data sets
Naldi, M.C., and Campello, Ricardo (2014) Evolutionary k-means for distributed data sets. Neurocomputing, 127. pp. 30-42.
PDF (Published Version)
- Published Version
Restricted to Repository staff only |
Abstract
One of the challenges for clustering resides in dealing with data distributed in separated repositories, because most clustering techniques require the data to be centralized. One of them, k-means, has been elected as one of the most influential data mining algorithms for being simple, scalable and easily modifiable to a variety of contexts and application domains. Although distributed versions of k-means have been proposed, the algorithm is still sensitive to the selection of the initial cluster prototypes and requires the number of clusters to be specified in advance. In this paper, we propose the use of evolutionary algorithms to overcome the k-means limitations and, at the same time, to deal with distributed data. Two different distribution approaches are adopted: the first obtains a final model identical to the centralized version of the clustering algorithm; the second generates and selects clusters for each distributed data subset and combines them afterwards. The algorithms are compared experimentally from two perspectives: the theoretical one, through asymptotic complexity analyses; and the experimental one, through a comparative evaluation of results obtained from a collection of experiments and statistical tests. The obtained results indicate which variant is more adequate for each application scenario.
Item ID: | 47649 |
---|---|
Item Type: | Article (Research - C1) |
ISSN: | 1872-8286 |
Keywords: | distributed clustering; distributed data mining; evolutionary k-means |
Funders: | CNPq-Brazil, São Paulo State Foundation for Research Support (FAPESP), FAPEMIG |
Date Deposited: | 10 Mar 2017 00:28 |
FoR Codes: | 01 MATHEMATICAL SCIENCES > 0104 Statistics > 010401 Applied Statistics @ 100% |
SEO Codes: | 97 EXPANDING KNOWLEDGE > 970101 Expanding Knowledge in the Mathematical Sciences @ 100% |
Downloads: |
Total: 1 |
More Statistics |