## Search This Blog

### FACTOR ANALYSIS

Factor analysis is a collection of methods used to examine how underlying constructs influence the responses on a number of measured variables. There are basically two types of factor analysis: exploratory and confirmatory. Exploratory factor analysis (EFA) attempts to discover the nature of the constructs influencing a set of responses. Confirmatory factor analysis (CFA) tests whether a specified set of constructs is influencing responses in a predicted way. SPSS only has the capability to perform EFA. CFAs require a program with the ability to perform structural equation modeling, such as LISREL or AMOS.

The primary objectives of an EFA are to determine the number of factors influencing a set of measures and the strength of the relationship between each factor and each observed measure. To perform an EFA, you first identify a set of variables that you want to analyze. SPSS will then examine the correlation matrix between those variables to identify those that tend to vary together. Each of these groups will be associated with a factor (although it is possible that a single variable could be part of several groups and several factors). You will also receive a set of factor loadings, which tells you how strongly each variable is related to each factor. They also allow you to calculate factor scores for each participant by multiplying the response on each variable by the corresponding factor loading. Once you identify the construct underlying a factor, you can use the factor scores to tell you how much of that construct is possessed by each participant.

Some common uses of EFA are to:

Identify the nature of the constructs underlying responses in a specific content area.
Determine what sets of items ‘‘hang together’’ in a questionnaire.
Demonstrate the dimensionality of a measurement scale. Researchers often wish to develop scales that respond to a single characteristic.
Determine what features are most important when classifying a group of items.
Generate ‘‘factor scores’’ representing values of the underlying constructs for use in other analyses.
Create a set of uncorrelated factor scores from a set of highly collinear predictor variables.
Use a small set of factor scores to represent the variable contained in a larger set of variables. This is often referred to as data reduction.

It is important to note that EFA does not produce any statistical tests. It therefore cannot ever provide concrete evidence that a particular structure exists in your data. it can only direct you to what patterns there may be. If you want to actually test whether a particular structure exists in your data you should use CFA, which does allow you to test whether your proposed structure is able to account for a significant amount of variability in your items.

EFA is strongly related to another procedure called principle components analysis (PCA). The two have basically the same purpose: to identify a set of underlying constructs that can account for the variability in a set of variables. However, PCA is based on a different statistical model, and produces slightly different results when compared to EFA. EFA tends to produce better results when you want to identify a set of latent factors that underlie the responses on a set of measures, whereas PCA works better when you want to perform data reduction. Although SPSS says that it performs “factor analysis,” statistically it actually performs PCA. The differences are slight enough that you will generally not need to be concerned about them - you can use the results from a PCA for all of the same things that you would the results of an EFA. However, if you want to identify latent constructs, you should be aware that you might be able to get slightly better results if you used a statistical package that can actually perform EFA, such as SAS, AMOS, or LISREL.

Factor analyses require a substantial number of subjects to generate reliable results. As a general rule, the minimum sample size should be the larger of 100 or 5 times the number of items in your factor analysis. Though you can still conduct a factor analysis with fewer subjects, the results will not be very stable.

To perform an EFA in SPSS

Choose Analyze thengoto Data Reduction thengoto Factor.
Move the variables you want to include in your factor analysis to the Variables box.
If you want to restrict the factor analysis to those cases that have a particular value on a variable, you can put that variable in the Selection Variable box and then click Value to tell SPSS which value you want the included cases to have.
Click the Extraction button to indicate how many factors you want to extract from your items. The maximum number of factors you can extract is equal to the number of items in your analysis, although you will typically want to examine a much smaller number. There are several different ways to choose how many factors to examine. First, you may want to look for a specific number of factors for theoretical reasons. Second, you can choose to keep factors that have eigenvalues over 1. A factor with an eigenvalue of 1 is able to account for the amount of variability present in a single item, so factors that account for less variability than this will likely not be very meaningful. A final method is to create a Scree Plot, where you graph the amount of variability that each of the factors is able to account for in descending order. You then use all the factors that occur prior to the last major drop in the amount of variance accounted for. If you wish to use this method, you should run the factor analysis twice - once to generate the Scree plot, and a second time where you specify exactly how many factors you want to examine.
If you want SPSS to save the factor scores as variables in your data set, then you can click the Scores button and check the box next to Save as variables.
Click the Ok button when you are ready for SPSS to perform the analysis.

The output from a factor analysis will vary depending on the type of rotation you chose. Both orthogonal and oblique rotations will contain the following sections.

Communalities. The communality of a given item is the proportion of its variance that can be accounted for by your factors. In the first column you.ll see that the communality for the initial extraction is always 1. This is because the full set of factors is specifically designed to account for the variability in the full set of items. The second column provides the communalities of the final set of factors that you decided to extract.
Total Variance Explained. Provides you with the eigenvalues and the amount of variance explained by each factor in both the initial and the rotated solutions. If you requested a Scree plot, this information will be presented in a graph following the table.