The use of CART and multivariate regression trees for supervised and unsupervised feature selection

Questier, F., Put, R., Coomans, D., Walczak, B., and Vander Heyden, Y. (2005) The use of CART and multivariate regression trees for supervised and unsupervised feature selection. Chemometrics and Intelligent Laboratory Systems, 76 (1). pp. 45-54.

[img] PDF (Published Version)
Restricted to Repository staff only

View at Publisher Website: http://dx.doi.org/10.1016/j.chemolab.200...
 
65
4


Abstract

Feature selection is a valuable technique in data analysis for information-preserving data reduction. This paper describes Classification and Regression Trees (CART) and Multivariate Regression Trees (MRT)-based approaches for both supervised and unsupervised feature selection. The well-known CART method allows to perform supervised feature selection by modeling one response variable (y) by some explanatory variables (x). The recently proposed CART extension, MRT can handle more than one response variable (y). This allows to perform a supervised feature selection in the presence of more than one response variable. For unsupervised feature selection, where no response variables are available, we propose Auto-Associative Multivariate Regression Trees (AAMRT) where the original variables (x) are not only used as explanatory variables (x), but also as response variables (y=x). Since (AA)MRT is grouping the objects into groups with similar response values by using explanatory variables, this means that the variables are found which are most responsible for the cluster structure in the data. We will demonstrate how these approaches can improve (the detection of) the cluster structure in data and how they can be used for knowledge discovery.

Item ID: 4503
Item Type: Article (Refereed Research - C1)
Keywords: AAMRT; auto-associative; CART; clustering; feature selection; MRT; multivariate regression trees; supervised; unsupervised
ISSN: 1873-3239
Date Deposited: 11 Jun 2009 01:46
SEO Codes: 92 HEALTH > 9299 Other Health > 929999 Health not elsewhere classified @ 100%
Downloads: Total: 4
More Statistics

Actions (Repository Staff Only)

Item Control Page Item Control Page