The Analysis of Multivariate Data Using SemiDefin

Authors: AH AlIbrahim

Publish Date: 2015/10/07

Volume: 32, Issue: 3, Pages: 382-413

PDF Link

Abstract

A model is presented for analyzing general multivariate data The model puts as its prime objective the dimensionality reduction of the multivariate problem The only requirement of the model is that the input data to the statistical analysis be a covariance matrix a correlation matrix or more generally a positive semidefinite matrix The model is parameterized by a scale parameter and a shape parameter both of which take on nonnegative values smaller than unity We first prove a wellknown heuristic for minimizing rank and establish the conditions under which rank can be replaced with trace This result allows us to solve our rank minimization problem as a SemiDefinite Programming SDP problem by a number of available solvers We then apply the model to four case studies dealing with four wellknown problems in multivariate analysis The first problem is to determine the number of underlying factors in factor analysis FA or the number of retained components in principal component analysis PCA It is shown that our model determines the number of factors or components more efficiently than the commonly used methods The second example deals with a problem that has received much attention in recent years due to its wide applications and it concerns sparse principal components and variable selection in PCA When applied to a data set known in the literature as the pitprop data we see that our approach yields PCs with larger variances than PCs derived from other approaches The third problem concerns sensitivity analysis of the multivariate models a topic not widely researched in the sequel due to its difficulty Finally we apply the model to a difficult problem in PCA known as lack of scale invariance in the solutions of PCA This is the problem that the solutions derived from analyzing the covariance matrix in PCA are generally different and not linearly related to the solutions derived from analyzing the correlation matrix Using our model we obtain the same solution whether we analyze the correlation matrix or the covariance matrix since the analysis utilizes only the signs of the correlations/covariances but not their values This is where we introduce a new type of PCA called Sign PCA which we speculate on its applications in social sciences and other fields of science

Keywords: