About Factor Analysis

 

Note: Run|Factor Analysis cannot be selected unless your job and data files are open.

WinCross’ Factor Analysis module performs a standard R-Factor Analysis on a set of items. Using varimax rotation, the user is allowed to preset the number of factors or to determine the number of factors based on a size-of-eigenvalues criterion (the default being the set of eigenvalues that are greater than 1.0). This module also produces factor scores for each respondent for each factor as determined by the factor analysis. These factor scores can themselves be saved for further analysis. In addition, this module determines the factor for which the respondent has the highest factor score, and assigns the respondent to the segment, also knows as a factor group, corresponding to that factor. The factor group assignments can also be saved, so that they can be used by the WinCross user in crosstabulations.

 

Considerations

How large does a factor loading have to be to consider that variable as a defining part of that factor? A general rule of thumb is that if the absolute value of the standardized loading is greater than 0.3, the variable is relevant for the particular factor. Another rule-of-thumb terms loadings as "weak" if less than 0.4, "strong" if more than 0.6, and otherwise as "moderate." These rules are arbitrary, and do not constitute a test of significance. The meaning of the factor loading magnitudes varies by research context. (For instance, loadings of 0.45 might be considered "high" for dichotomous items but for Likert scales a 0.6 might be required to be considered "high.")

 

In their article in the 1967 Psychological Bulletin, Cliff and Hamburger have suggested the reciprocal of the square root of the sample size as an approximate standard error for the factor loading. Thus, for a sample of 100 the standard error is 0.1, and so one can dub a pair of factor loadings as "significantly different" if they differ by 0.2. (Cudeck, R. & O'Dell, L. L. (1994). Applications of standard error estimates in unrestricted factor analysis: Significance tests for factor loadings and correlations. Psychological Bulletin, 115, 475-487 present a more rigorous, but computationally difficult to implement, method for significance testing of rotated loadings.)

 

WinCross has supplemented these rules of thumb with additional rules that govern the designation of "importance" to a factor loading, and hence to its labeling:

  1. If the factor loading is greater than 0.3 in absolute value, we label it with a *.
  2. The largest loading across the factors is labeled with an XX. This determination overrides the previous labeling.
  3. If the factor loading is at least 0.2 higher than the next higher loading, we label it with ****. This latter overrides both of the above.

Usually the largest factor loading satisfies (3), and there are no other factor loadings that exceed 0.3 in absolute value. In that case the largest factor loading is labeled by a **** and no other loading receives a label.

 

Following are three examples in which this is not the case.

The table presents the items, their factor loadings on 20 factors, and the importance labels.

 

 

FACTORS

 

 

 

 

 

 

 

1

2

3

4

5

6

7

 

8

9

10

11

12

13

14

 

15

16

17

18

19

20

 

Highest loading is 0.56494, next highest is 0.32555, diff > 0.2

 

 

 

 

 

 

 

 

****

 

 

 

 

 

 

5 Graduating from this school will help me get what I want out of life.

0.56494

0.10092

-0.01549

0.04284

-0.00944

-0.00445

0.00782

 

 

 

*

 

 

*

 

 

-0.04346

0.07651

0.32555

0.05315

0.12037

0.30609

0.05102

 

 

 

 

 

 

 

 

 

-0.18074

-0.01449

0.11934

0.05823

-0.04424

0.06868

 

Highest loading is 0.37420, next highest is 0.35708, both exceed 0.3

 

 

 

 

 

 

 

 

XX

 

 

 

 

 

 

12 I don't mind the work of school right now because it will get me a good job.

0.37420

0.08723

0.06290

-0.16903

0.05956

0.17526

0.00723

 

 

 

*

 

 

 

 

 

-0.14181

0.13418

0.35708

0.11630

0.01278

0.22553

0.02621

 

 

 

 

 

 

 

 

 

0.20366

-0.11563

0.10764

0.11206

-0.14884

0.13503

 

Highest loading is 0.34446, next highest is 0.26945

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

74 All coursework should be career-oriented.

0.06897

0.02231

0.06989

0.02821

0.04932

0.12302

0.26945

 

 

XX

 

 

 

 

 

 

0.00076

0.34446

0.08295

-0.06306

-0.11508

0.27577

-0.05754

 

 

 

 

 

 

 

 

 

0.08475

0.19388

-0.26358

0.10817

-0.04645

0.13641

 

Related topics:

Factor Analysis - Variable data

Factor Analysis - ASCII data