A CROSS-CULTURAL SHORTENED FORM OF THE ZKPQ (ZKPQ-50-CC) ADAPTED TO ENGLISH, FRENCH, GERMAN, AND SPANISH LANGUAGES 

Anton Aluja1, Jérôme Rossier2, Luis F. García1, Alois Angleitner3, Michael Kuhlman4,and Marvin Zuckerman4

1University of Lleida (Spain)

2University of Lausanne (Switzerland)

3University of Bielefeld (Germany)

4University of Delaware (United States)

 

 

INTRODUCTION

The Zuckerman-Kuhlman Personality Questionnaire (ZKPQ) was designed within the framework of Zuckerman's Alternative Five personality model (Zuckerman, Kuhlman, Teta, Joireman, & Kraft, 1993). This model was developed by comparing structures based on 3, 4, 5, and 6 factor solutions of several personality questionnaires (Zuckerman, Kuhlman, & Camac, 1988; Zuckerman, Kuhlman, Thornquist & Kiers, 1991). These two studies of scale factors were followed by one based upon factor analyses of items from the scales most clearly defining the factors (Zuckerman et al., 1993). From these studies, Zuckerman et al. (1993) concluded that both the three and five-factor models were robust and reliable. Based on these results, a questionnaire was developed using the items most clearly defining the five factors, excluding items showing a strong social desirability influence. The 99-item version contained the following scales: Impulsive Sensation Seeking (ImpSS, 19 items), Neuroticism-Anxiety (N-Anx, 19 items), Aggression-Hostility (Agg-Host, 17 items), Activity (Act, 17 items), Sociability (Sy, 17 items), and Infrequency (Inf, 10 items). The Inf scale is only used to assess the validity of individual records and is not intended to be a trait scale.  Internal consistency for both sexes varied between 0.72 and 0.86 (for more detail on the development of the ZKPQ and its reliability and validity, see Joireman & Kuhlman, 2004, and Zuckerman, 2002).

The raw scores of the ZKPQ, the EPQ (Eysenck, & Eysenck, 1975), and the NEO-PI-R (Costa, & McCrae, 1992) scales were factor analyzed conjointly (Zuckerman et al., 1993). Solutions of three, four, and five factors were obtained. In the three factor rotation, the Sy and Act scales loaded on the Extraversion factor with the EPQ-E, and the NEO-E, and the N-Anx loaded on a Neuroticism factor along with the EPQ-N and the NEO-N scales. ImpSS, Agg-Host, the Psychoticism Scale of the EPQ-R, and the Agreeableness and Conscientiousness Scales of the NEO-PI-R loaded mainly on the third factor. This factor was split into two in the four-factor structure. Conscientiousness, Psychoticism, and Impulsive Sensation Seeking defined one factor, whereas Agreeableness, Aggression-Hostility, and Openness loaded mainly on the other one. Finally, in the five-factor structure, the 30 facets of the NEO-PI-R were used instead of the Big-Five dimension scales. These results corroborated the previous 4-factor structure plus an additional factor exclusively formed by the 6 Openness facets. These results have been replicated in Spanish populations (Aluja, García, & García, 2002; 2004a; Romero, Luengo, Gómez, & Sobral, 2002).

The original version of the ZKPQ has been adapted in different countries and languages: China (Wu, Wang, Du, Li, Jiang, & Wang, 2000), Germany (Ostendorf, & Angleitner, 1994), Italy (De Pascalis, & Russo, 2003), Japan (Shiomi, Kuhlman, Zuckerman, Joreiman, Sato, & Yata, 1996), and Spain (Catalan [Gomà-i-Freixanet, Valero, Puntí & Zuckerman, 2004; Gomà-i-Freixenet, Wismeijer, & Valero, 2005], and Spanish versions [Aluja et al., 2002, 2004a; Herrero, Viña, González, Ibáñez, & Peñate, 2001; Romero et al., 2002]). In general, the factor structure and the psychometric properties have replicated results found for the original English version.  Two German versions of the ZKPQ have been developed and both confirm the basic structure of the test as described in the American results (Angleitner, Riemann, & Spinath, 2004; Schmitz, 2004). Angleitner et al. (2004) also reported the first behavior genetic twin study on the ZKPQ scales. Schmitz (2004) has used the ZKPQ in acculturation studies of immigrants to Germany and studies of the relationships between the ZKPQ dimensions and love styles.

As far as we know, two short versions of the ZKPQ have been developed. The first one (Zuckerman, 2002) is made up of 35 items, with seven items per scale. Items with the highest correlations with the total scores on each of the five factors and the greater response variance were selected. Several items were eliminated because of redundancy of content, and the next highest correlation was substituted. These short scales had Cronbach alphas between 0.62 and 0.79. The second one (Aluja, García, & García, 2003a) is composed of 69 items selected through the following procedure, which combines exploratory and confirmatory factor analysis (Byrne, 1993; Yadama, & Drake, 1995): (1) items with loadings equal to or higher than 0.30 on their own factor were selected; (2) a confirmatory factor analysis was carried out over these selected items. One item from each pair of highly correlated items (i.e. with a modification index of the correlations between the error terms of the items higher than 100) was suppressed; (3) a second factor analysis was conducted using the 76 surviving items. Following the same criteria in point 1, 69 items were retained for the short version. These 69 items were distributed across scales as follows: ImpSS (14), N-Anx (18), Agg-Host (13), Sy (13), and Act (11). Internal consistencies were similar to the 89-item version, and varied between 0.74 and 0.81.

The 69-item version was developed following an empirical criterion with no pre-conceived idea as to the number of items. The resulting scales presented a number of items per scale between 11 (Activity) and 18 (N-Anx) (Aluja et al., 2003a). However, the number of items retained in the 69-item version and the statistical procedure described above made it possible to further reduce the number of items per scale. This approach generated a shorter version maintaining the same psychometric properties, including reliability coefficients, of the ZKPQ as well as the structural validity of the questionnaire. Two instances support this possibility. Firstly, the Activity scale improved its psychometric properties in the short version, although six items were suppressed (Aluja, et al., 2003a). Secondly, the 10-item Extroversion and Neuroticism scales of the EPQ-R presented good psychometric and structural properties (Aluja, García, & García, 2003b). According to these findings, we hypothesised that ZKPQ scales formed by 8 to12 items will only have similar psychometric properties to the original questionnaire. The availability of these short scales has obvious advantages in practical and research settings, since the administration and correction time are considerably reduced (Buchanan, Johnson, Goldberg, 2005).

The aim of the present study was to develop a version of the ZKPQ with a robust structure and acceptable psychometric properties in four languages: English (United States), French (Switzerland), German (Germany), and Spanish (Spain). In developing this version, a procedure similar to that used by Aluja et al. (2003a) was carried out combining exploratory and confirmatory factor analysis. Note that cross-cultural studies are usually focused on differences between cultures. However, this study looks for structural similarities in the four languages analysed.

The present study is focused on an etic (versus emic) research approach. The etic perspective looks for universal traits and is centered on comparison across cultures. The emic perspective seeks to describe personalities with culturally sensitive elements (Triandis, & Such, 2002). The results of the current study pose several questions for personality assessment beyond the cross-cultural validity of the ZKPQ. Developing the same measure for different countries has the advantage of establishing the same metric for all countries analyzed. This characteristic would largely facilitate cross-cultural research with Zuckerman’s Alternative Five Personality Model. 

 

 

METHOD
Subjects

The total sample consisted of 4,621 subjects (1,667 males [36.1%], and 2,954 females [63.9%]) from 4 countries. Inclusion in the study was restricted to subjects under 35 years of age in order to reduce the age differences between samples. The numbers of subjects in the four countries were 517 from Germany (Mean age: 26.94; SD: 4.31), 962 from Spain (Mean age: 21.39; SD 2.97), 764 from the French-speaking part of Switzerland (Mean age: 21.68; SD 3.05), and 2,378 from the United States of America (the age variable was not coded for this sample). Since all subjects in the American sample were university students enrolled in introductory psychology courses, the mean age is known to be around 19 years. Frequencies for sex were 117 males and 400 females for Germany, 351 and 611 for Spain, 294 and 470 for Switzerland, and 905 and 1,473 for USA. The samples from Spain, Switzerland, and the United States of America were university students. The German sample was a pool of two sub samples: one of university students, and one taken from the Bielefeld twin study.

Measures

 

 ZKPQ. The long form of the ZKPQ has 99 items, and measures the following personality factors:  Impulsive Sensation Seeking (ImpSS), Neuroticism-Anxiety (N-Anx), Aggression-Hostility (Agg-Host), Activity (Act), and Sociability (Sy). Reliability coefficients (Cronbach alpha) for the ZKPQ ranged between .72 and .83 in the original American study (Zuckerman et al., 1992; Zuckerman et al., 1993).  The German and Spanish versions of the ZKPQ have been published by Ostendorf, and Angleitner (1994), and Aluja, et al., (2002), respectively.  The French version is under revision (Rossier, Verardi, Massoudi, & Aluja, submitted).  These three non-English versions show a factor structure and reliability indices similar to those for the American ZKPQ.  The Infrequency scale was not used in the statistical analyses of these studies.  

 

RESULTS

 

Descriptive statistics, t-tests comparisons and alpha coefficients for the ZKPQ

 

Table 1 shows descriptive statistics (Mean, standard deviation, Skewness, and Kurtosis), alpha coefficients and differences between calibration and validation samples. Table 1 shows no significant mean differences between the groups, nor were differences found in their standard deviations. Given the large sample size and thus high statistical power for these comparisons, it is quite unlikely that these non-significant results correspond to a Type-II error. Skewness and Kurtosis values were under 1 for the five dimensions. Alphas ranged between 0.74 and 0.86, and were quite similar in both groups.  Additionally, descriptive statistics for the Infrequency scale indicate that the test validity was adequate.  This table suggests that both samples can be properly compared.

 

                                                                               Table 1 

Descriptive statistics (Mean, Standard Deviation, Skewness, and Kurtosis), alpha coefficients, t-tests and

 effect size  between calibration and validation sample.

 

 

 

Calibration sample (N=2,322)

Validation sample (N=2,299)

 

 

 

Items

M

SD

S

K

a

M

SD

a

S

K

t

p<

ES

N-Anx

19

8.83

4.78

0.18

-0.88

0.85

8.79

4.78

0.86

0.18

-0.88

0.28

0.781

0.01

ImpSS

19

9.62

4.19

-0.06

-0.63

0.80

9.71

4.34

0.80

-0.09

-0.77

-0.71

0.477

-0.02

Act

17

7.63

3.70

-0.35

-0.48

0.76

7.77

3.62

0.77

-0.36

-0.48

-1.35

0.477

-0.04

Sy

17

9.48

3.76

0.20

-0.74

0.76

9.56

3.73

0.74

0.12

-0.67

-0.71

0.177

-0.02

Agg-Host

17

7.80

3.53

0.10

-0.59

0.74

7.69

3.58

0.75

0.12

-0.62

1.05

0.292

0.03

Inf

10

1.39

1.49

1.54

3.62

0.55

1.46

1.51

0.53

1.25

1.74

-1.65

0.100

-0.05

(a)    Note: Neuroticism-Anxiety (N-Anx), Impulsive-Sensation Seeking (ImpSS), Activity (Act), Sociability (Sy), Aggression-Hostility (Agg-Host), and Infrequency (Inf). ES: Effect size

 

 

 

Exploratory Factor Analysis (EFA)

 

       Table 2 shows the five factor principal components (PC) solution with orthogonal (Varimax) rotation obtained in the calibration sample. The Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy was 0.87, and Bartlett's Test of Sphericity (BTS) yielded approx. Chi-Square=44,523.30; d.f.: 3,972 (p<0.001).  The KMO measure of sampling adequacy is an index which examines the appropriateness of factor analysis. It should be 0.50, and the higher the better. This measure of sampling adequacy compares magnitude of correlations with the magnitude of partial correlation coefficients. Small values indicate that correlations cannot be explained by other variables, and factor analysis may be inappropriate. Additionally, a principal axis (PA) with direct oblimin rotation solution was obtained in the calibration sample. Tucker’s Congruency coefficients between the latter and the principal components solution were 0.99, 0.99, 0.99, .099, 0.98, for N-Anx, ImpSS, Act, Sy, and Agg-Host, respectively; overall, global congruence was 0.99. Given the virtual equality of both solutions, the PC-Varimax solution was selected since this procedure was the one used in original work on ZKPQ structure (Zuckerman, et al., 1993). Also, it should be noted that an orthogonal solution is more consistent with Zuckerman’s theoretical conceptualization of his five factor model. As can be seen in Table 2, a total of 80 items (ImpSS: 20; N-Anx: 19; Act: 15; Sy: 12 and Agg-Host: 14) had loadings equal to or higher than 0.30 on their own factor, and lower on the remaining factors. These 80 items were employed for the CFA’s described below. Items deleted from further analysis at this stage are underlined in Table 2.

 

                                           Table 2

 

                                Principal Components factorial matrix and

                                Varimax rotation (calibration sample)

 

 

 

 

I

II

III

IV

V

Z1

 

ImpSS

.06

.39

-.20

.14

-.01

Z2

 

N-Anx

-.45

.12

-.05

.08

-.04

Z3

 

Agg-Host

.07

.16

-.06

.04

.29

Z5

 

Act

.02

-.12

.51

.10

-.02

Z6

 

ImpSS

.03

-.40

.16

-.05

-.05

Z7

 

N-Anx

.51

.06

-.23

.08

-.13

Z8

 

Agg-Host

.16

.12

-.01

-.05

.49

Z9

 

Sy

-.17

.23

.18

-.38

.16

Z11

 

Agg-Host

.06

.12

-.13

-.11

.43

Z12

 

Sy

.02

.11

.06

.46

.01

Z13

 

Act

-.03

.11

.41

-.04

.07

Z14

 

ImpSS

.05

.52

.07

.01

.14

Z15

 

N-Anx

.45

.21

.05

.02

.11

Z16

 

Agg-Host

-.02

-.12

.06

.12

-.27

Z17

 

Sy

-.05

.18

-.01

.53

-.01

Z18

 

Act

-.14

-.01

.39

.22

-.09

Z19

 

ImpSS

-.06

.33

-.19

.13

-.02

Z20

 

N-Anx

.33

-.05

.00

-.07

.17

Z21

 

Agg-Host

-.16

-.12

.07

.05

-.42

Z22

 

Sy

-.03

.14

.05

-.50

-.01

Z23

 

Act

.29

.07

-.31

.11

.03

Z24

 

ImpSS

-.10

.47

.10

-.13

.00

Z25

 

N-Anx

.52

.02

.01

.09

.10

Z27

 

Sy

-.08

.22

.15

-.18

.20

Z28

 

Act

-.20

.15

.41

.05

-.03

Z29

 

ImpSS

.01

-.42

.27

-.10

-.02

Z30

 

N-Anx

.58

.00

-.02

.05

.18

Z31

 

Agg-Host

-.04

.13

.09

-.02

-.35

Z33

 

Act

.07

.07

.64

-.17

-.03

Z34

 

ImpSS

-.01

.46

-.02

.02

-.04

Z35

 

N-Anx

.59

-.09

-.01

.03

.05

Z36

 

Agg-Host

.15

.06

.05

.00

.24

Z37

 

Sy

-.09

-.16

-.04

.44

.01

Z38

 

Act

-.05

.06

-.47

.10

.01

Z39

 

ImpSS

-.14

.57

.13

-.08

.02

Z41

 

N-Anx

.49

-.17

-.05

-.04

-.01

Z42

 

Agg-Host

-.20

.06

.13

-.05

.48

Z43

 

Sy

.28

-.17

-.09

.47

-.09

Z44

 

Act

-.09

.03

-.63

.13

.01

Z45

 

ImpSS

.04

.48

-.02

-.15

.09

Z46

 

N-Anx

.55

-.03

-.05

-.02

.08

Z47

 

Agg-Host

-.21

.00

.11

-.04

.45

Z48

 

Sy

-.14

.29

.15

-.51

.10

Z49

 

Act

.02

.14

-.19

-.08

.04

Z50

 

ImpSS

.22

.34

-.05

.03

.07

Z51

 

N-Anx

.56

.05

-.11

.08

-.11

Z53

 

Sy

-.01

.38

-.09

-.25

.14

Z54

 

Act

.23

.04

.37

-.01

.11

Z55

 

ImpSS

-.03

.52

.00

-.11

.07

Z56

 

N-Anx

.42

.02

-.03

-.01

.07

Z57

 

Agg-Host

-.04

-.15

.16

.16

-.40

Z58

 

Sy

.04

.01

-.03

-.13

-.01

Z59

 

Act

-.14

.14

.37

-.04

-.07

Z60

 

ImpSS

.01

.39

.19

-.05

.03

Z61

 

N-Anx

.62

.01

-.23

.06

-.06

Z62

 

Agg-Host

-.03

.21

.05

-.07

-.36

Z63

 

Sy

.01

.18

-.02

.53

.01

Z64

 

Act

-.05

.13

.38

.06

.04

Z65

 

ImpSS

-.04

.43

.19

-.03

.03

Z66

 

N-Anx

.55

-.08

.10

-.06

.06

Z67

 

Agg-Host

.11

.11

.09

.02

.45

Z68

 

Sy

.12

.01

.01

.58

.04

Z70

 

ImpSS

-.02

.48

.06

-.20

.15

Z71

 

N-Anx

.50

.07

-.13

-.09

-.05

Z72

 

Agg-Host

.14

.10

.10

.05

.53

Z74

 

Act

-.04

-.02

.56

.01

-.11

Z75

 

ImpSS

-.14

.32

.20

.26

-.03

Z76

 

N-Anx

.47

-.01

.02

.10

.10

Z77

 

Agg-Host

.00

.04

.01

.07

.56

Z78

 

Sy

-.17

.20

.18

-.53

.04

Z79

 

ImpSS

.02

.46

-.01

-.09

.07

Z80

 

N-Anx

.55

-.02

.00

.00

.07

Z82

 

Sy

.24

.10

.12

-.29

.05

Z83

 

Act

.12

.09

.68

-.15

-.05

Z84

 

ImpSS

.10

.46

.14

-.02

.07

Z85

 

N-Anx

-.48

.12

.04

.01

-.12

Z86

 

Agg-Host

-.02

.03

.08

.01

-.52

Z87

 

Sy

-.01

-.04

.10

.63

.03

Z88

 

Act

.13

.01

-.32

-.08

-.01

Z89

 

ImpSS

.05

.44

.12

-.03

.23

Z90

 

N-Anx

.59

.06

.06

.16

.06

Z91

 

Agg-Host

.14

.14

.05

.10

.44

Z92

 

Sy

.06

.30

-.02

-.36

.09

Z94

 

Act

-.16

.02

.46

-.12

-.06

Z95

 

ImpSS

-.12

.38

.07

-.33

.14

Z96

 

N-Anx

.46

.06

-.03

-.01

-.01

Z97

 

Agg-Host

.07

.05

-.06

-.09

.49

Z98

 

Sy

-.07

.24

.12

-.26

.08

Z99

 

Act

.28

.06

.28

.01

.19

% variance

7.53

6.93

4.45

3.63

3.15

                                Note: F-I: N-Anx; F-II:ImpSS; F:-III: Act; F-IV: Sy; F-V: Agg-Host.

 

 

Confirmatory Factor Analysis (CFA)

 

A CFA was performed in the validation sample on the variance-covariance matrix of the 80 items described above.  This analysis employed the AMOS 4.01 statistical package (Arbuckle, 1999).  The estimation method was Maximum Likelihood, which seems warranted given the size of the sample and the apparent normality of the variables (see Table 1).  Model identification was achieved by fixing regression coefficients of the error terms over the endogenous variables and also the variance of factors to 1 (MacCallum, Browne, & Sugawara, 1996).  Each item was linked to a single factor.  Note that only item 53 loaded on a different factor (ImpSS instead of Sy).  Table 4 shows the fit indices for both orthogonal and oblique solutions for these 80 items. The AMOS procedure was used to examine the correlation of the error component between the 80 items.  This analysis showed that several item pairs were highly to moderately correlated, with Modification Indices (MIs) higher than 100.  The following 25 item pairs with MIs higher than 100 are ordered by the MIs from the largest to smallest (inter-item correlations are in brackets and the item number corresponds to the long form of the ZKPQ): 17-63 (0.66), 57-11 (-0.57), 14-89 (0.59), 1-29 (-0.45), 42-47 (0.43), 19-29 (-0.42), 7-61 (0.51), 9.48 (0.47), 18-28 (0.34), 6-29 (0.36), 6-1 (-0.34), 2-66 (-0.43), 68-87 (0.48), 1-19 (0.34), 51-61 (0.49), 43-48 (-0.43), 45-55 (0.43), 24-55 (0.44), 7-61 (0.43), 9-78 (0.40), 6-19 (-0.31), 2-85 (0.40), 67-91 (0.36), 18-75 (0.21), and 25-76 (0.39).

 

Examination of these items revealed within-pair redundancy, and as recommended elsewhere (Byrne, 1993; Yadama, & Drake, 1995), one item was deleted from each pair. Within all but two of the above pairs, the item with the lowest loading was deleted. Following this procedure, all ZKPQ scales were composed of 10 or more items, excepting Sy. Two item pairs on this scale (43-48 and 68-87) were strongly correlated, but no item was deleted in order to test all of them through the standardized regression weights. A CFA model was performed on the 57 items remaining after the deletions described above. Again, analysis was performed with the AMOS 4.01 statistical package with Maximum Likelihood estimation. Based on the standardized regression weights, those items with the lowest values were removed until 10 items per scale remained.  Note that all weights were significant. No item from the Sy scale was removed, because the standardized regression weights of this scale were acceptable (ranging between 0.33 and 0.61) and similar to those obtained in the remaining four scales (see Table 3). With these modifications, the questionnaire was reduced to 50 items (10 per scale). These items appear in the appendix, henceforth referred to as the Zuckerman-Kuhlman Personality Questionnaire Cross Cultural 50-item version (ZKPQ-50-CC).

 

The results of a CFA (Amos, Maximum Likelihood) performed on these 50 items are given in Table 4. Firstly, the differences in the RMSEA were significant between the 80 and the 50 item models. The ECVI, an index to discern among several related models, was considerably lower for the 50-item than for the 80-item model, and the only model with a c2/d.f. ratio lower than 5 was the oblique 50-item model. Also, the GFI, AGFI, improved greatly from 80 to 50 items. However, for both 50 and 80-item analyses, the NFI, TLI, and CFI fell below the usual cut-off value (0.90; Hu, & Bentler, 1999). Differences between orthogonal and oblique models are minimal. This finding is not surprising, since there were no secondary loadings on the EFA solution. Correlations between the latent variables for oblique models were (50/80-item model): ImpSS/N-Anx: -0.11/-0.04; ImpSS/Agg-Host: 0.31/0.34, ImpSS/Act: 0.19/0.14, ImpSS/Sy: -0.40/-0.36, N-Anx/Agg-Host: 0.28/0.24, N-Anx/Act: -0.05/-0.08, N-Anx/Sy: 0.17/0.19, Agg-Host/Act: 0.04/0.03, Agg-Host/Sy: -0.08/-0.09 and Act-Sy: -0.18/-0.19.

 

Table 3

 Standardized Regression Weights (SRW) for the five dimensions (validation sample) 

N-Anx

ImpSS

Sy

Agg-Host

Act

Item

SRW

Item

SRW

Item

SRW

Item

SRW

Item

SRW

25

0.50

14

0.44

12

0.40

8

0.47

5

0.48

30

0.61

34

0.43

22

-0.46

11

0.42

13

0.33

35

0.58

39

0.57

37

0.33

21

-0.40

33

0.72

41

0.51

55

0.56

43

0.50

31

-0.28

38

-0.40

46

0.55

60

0.43

48

-0.49

42

0.34

44

-0.69

61

0.54

65

0.41

63

0.38

67

0.44

59

0.32

66

0.50

70

0.55

68

0.56

72

0.49

64

0.28

80

0.58

79

0.45

78

-0.49

77

0.49

74

0.44

85

-0.50

84

0.44

87

0.61

86

-0.44

83

0.78

90

0.52

95

0.42

92

-0.35

97

0.50

94

0.30

                  

Note: Neuroticism-Anxiety (N-Anx), Impulsive-Sensation Seeking (ImpSS), Activity (Act),

                          Sociability (Sy),   Aggression-Hostility (Agg-Host).

 

Table 4

 Fit indices of the ZKPQ 80-item, and the ZKPQ 50-item models (validation sample)

 

Model (a)

c2

d.f.

c2/d.f(b)

GFI

AGFI

NFI

TLI

CFI

RMSEA

LO

HI

ECVI

Orth

Null model 80

42594.57

3160

13.48

0.48

0.47

--

--

--

0.074

0.073

0.074

18.16

Null model 50

21545.270

1225

17.59

0.58

0.56

--

--

--

0.085

0.084

0.086

9.42

 

 

 

 

 

 

 

 

 

 

 

 

 

ZKPQ-80

18645.14

3080

6.03

0.78

0.77

0.56

0.60

0.60

0.047

0.046

0.048

8.25

ZKPQ-50

6323.87

1175

5.30

0.89

0.88

0.71

0.74

0.75

0.043

0.042

0.044

2.79

 

Obli

 

 

 

 

 

 

 

 

 

 

 

 

 

ZKPQ-80

18079.87

3070

5.89

0.79

0.78

0.58

0.61

0.62

0.046

0.045

0.047

8.19

ZKPQ-50

5664.66

1165

4.86

0.90

0.89

0.74

0.77

0.78

0.040

0.040

0.042

2.56

 

(a)      c2: Chi-Square. d.f.: Degrees of Freedom.  GFI: Goodness of Fit Index. AGFI: Adjusted Goodness of Fit Index. NFI: Normed Fit Index. TLI: Tucker Lewis Index. CFI: Comparative Fit Index. RMSEA: Root Mean Square Error of Approximation. The LO and HI columns contain the lower and upper limit of a 90% confidence interval on the population value of RMSEA. ECVI: Expected Cross-Validation Index.

(b)      The associated p values were always lower than .0001.

 

 

Using the same CFA procedure described above, five models were evaluated, one for each of the separate factors of the ZKPQ-50-CC. This procedure analyses the construct validity of each scale when the effect of the others is removed. The resulting fit indices are given in Table 5, which shows very good values for N-Anx, ImpSS, Acty, and Agg-Host, although slightly lower ones for Sy. With regard to Sy, it should be noted that this scale has two pairs of highly correlated items. Overall, these results show good consistency for four out of five factors in the 50-item model. The standardized regression coefficients obtained with the 50-item model also support the use of the five scales, although future studies could improve the Sy scale by replacing one item of each redundant pair with new items that correlate with the theoretical construct of Sy but are less redundant in relation to other items in the scale. Correlations in the total sample between the scores obtained with the original ZKPQ (89-items) and the ZKPQ-50-CC were 0.90, 0.87, 0.94, 0.95, and 0.92 for the N-Anx, ImpSS, Sy, Agg-Host, and Act scales, respectively.  Thus, the scores obtained with the 50-item instrument are quite comparable to those obtained with the longer version.  The correlations between ZKPQ factor-derived scales for the 50-item version were: ImpSS/N-Anx: 0.05; ImpSS/Agg-Host: 0.19, ImpSS/Act: 0.14, ImpSS/Sy: 0.20, N-Anx/Agg-Host: 0.18, N-Anx/Act: -0.09, N-Anx/Sy -0.09, Agg-Host/Act: -0.01, Agg-Host/Sy: 0.08 and Act-Sy: 0.14. Congruent with Zuckerman's orthogonal model, correlations are quite low.

 

Table 5

 Fit indexes of each dimension in the ZKPQ 50-item version (validation sample).

Model (a) 

c2

d.f.  

c2/d.f(b)

GFI 

AGFI 

NFI 

TLI

CFI

RMSEA

ECVI

N-Anx

265.99

35

7.60

0.98

0.96

0.94

0.95

0.95

0.05

0.13

ImpSS

257.09

35

7.35

0.98

0.96

0.91

0.90

0.92

0.05

0.13

Act

427.23

35

12.20

0.96

0.94

0.90

0.88

0.90

0.07

0.24

Sy

703.96

35

20.11

0.93

0.89

0.78

0.73

0.79

0.09

0.32

Agg-Host

194.76

35

5.56

0.98

0.97

0.91

0.90

0.93

0.04

0.10

(a) c2 : Chi Square. d.f.: Degrees of Freedom.  GFI: Goodness of Fit Index. AGFI: Adjusted Goodness of Fit Index. NFI: Normed Fit Index. TLI: Tucker  Lewis Index. CFI: Comparative Fit Index. RMSEA: Root Mean Square Error of Approximation. ECVI: Expected Cross-Validation Index.

(b) The associated p values were always lower  than .0001.

 

 

Cross-cultural comparisons of the ZKPQ-50-CC

 

 Table 6 shows the descriptive statistics (Mean, Standard deviation, Skewness, and Kurtosis), and alphas of the ZKPQ-50-CC for each country. All scales have satisfactory alpha coefficients above .70 in each country, except for the Agg-Host scale in Germany, Spain and Switzerland, and the Sy scale in Germany. However, these latter alpha coefficients were only slightly lower (.60-.68). Scores show a normal distribution. Only the N-Anx scale in the American, German and Swiss samples and the Act scale in Spain show a slightly high kurtosis. Table 6 also shows correlations between the five factors and age for all countries except the United States. On average over the five dimensions and the three countries, age accounts for 1.24 % (d = .20) of the total variance. Thus, the global effect of age is small (Cohen, 1969). In Germany, correlations range from -.09 to -.19 and age accounts on average for 1.90% (d = .26) of the total variance. In Spain, correlations range from -.03 to -.16 and age accounts on average for 1.31% (d = .20) of the total variance, and in Switzerland, correlations range from -.01 to     -.11 and age accounts on average for 0.52% (d = .12) of the total variance.

 

Table 6 

Descriptive statistics (Mean, Standard deviation, Skewness, and Kurtosis) and alphas by country,

and correlations with the age variable.

 

 

 

 

 

 

 

 

Age (a,b)

 

 

M

S.D.

S

K

Alpha

r

p

America

N-Anx

5.158

2.50

-.03

-1.11

0.80

--

--

(N=2.378)  

ImpSS

5.940

2.16

-.28

-.68

0.72

--

--

 

Act

4.150

2.60

.31

-.82

0.74

--

--

 

Sy

6.464

2.53

-.62

-.35

0.74

--

--

 

Agg-Host

5.474

2.56

-.11

-.83

0.72

--

--

Germany

N-Anx

4.768

2.52

.11

-1.15

0.82

-.14

***

(N = 517)

ImpSS

4.186

2.24

.28

-.62

0.73

-.19

***

 

Act

4.812

2.77

.11

-.97

0.74

-.09

*

 

Sy

5.284

2.34

-.35

-.83

0.67

-.13

**

 

Agg-Host

4.789

2.30

.23

-.64

0.60

-.12

**

Spain

N-Anx

4.18

2.23

.51

-.73

0.79

-.16

***

(N = 962)

ImpSS

5.27

2.35

-.29

-.80

0.73

-.14

***

 

Act

4.89

2.84

-.04

-1.10

0.79

-.03

 

 

Sy

6.51

2.49

-.60

-.42

0.74

-.12

***

 

Agg-Host

4.86

2.42

.10

-.75

0.66

-.07

*

Switzerland

N-Anx

4.87

2.62

.18

-1.08

0.83

-.11

**

(N = 764)

ImpSS

5.38

2.33

-.16

-.79

0.74

-.08

*

 

Act

3.76

2.60

.44

-.75

0.76

-.01

 

 

Sy

5.67

2.42

-.89

-.69

0.71

-.08

*

 

Agg-Host

4.72

2.44

.06

-.82

0.68

-.03

 

(a)     

          Correlations with age can not be computed for the American sample.

(b)      * p < 0.05; ** p < 0.01; *** p > 0.001

   Note: Underlined effect sizes correspond to non-signifcant differences between the two countries being compared.

 

 

It might be important to consider the gender variable because differences in personality traits between males and females are well established in the literature (v.g., Lynn, & Martin, 1997). Regarding the ZKPQ, such differences are mainly observed for ImpSS (males score higher), and N-Anx (females score higher) (Zuckerman, 1994; 2002). A two-way ANOVA on N-Anx with country and gender as factors indicated that there was a significant country effect, F(3,4613) = 12.73, p < .001 (d = .18), a significant gender effect, F(1,4613) = 386.36, p < .001 (d = .58), and a significant interaction effect, F(3,4613) = 12.85, p < .001 (d = .18). Only the gender effect was associated with a d higher than .20. Women scored globally higher than men on this scale. For ImpSS, there was a significant country effect, F(3,4613) = 69.83, p < .001 (d = .43), and a significant gender effect, F(1,4613) = 44.57, p < .001 (d = .20), but no significant interaction effect, F(3,4613) = .16, p = .93 (d < .01). Country and gender effects were associated with a d higher than .20.  The American sample scored particularly high and the German sample particularly low on this scale (see Table 6). Moreover, women scored lower than men on this scale. For Act, there was a significant country effect, F(3,4613) = 31.93, p < .001 (d = .28), and a significant gender effect, F(1,4613) = 18.50, p < .001 (d = .12), but no significant interaction effect, F(3,4613) = .38, p = .77 (d < .01). Only the country effect was associated with a d higher than .20. The Spanish sample scored particularly high and the Swiss sample particularly low on this scale. For Sy, there was a significant country effect, F(3,4613) = 44.16, p < .001 (d = .35), and a significant gender effect, F(1,4613) = 15.44, p < .001 (d = .10), but no significant interaction effect, F(3,4613) = 1.99, p = .11 (d = .06). Only the country effect was associated with a d higher than .20. The American and the Spanish samples scored particularly high and the German and the Swiss samples particularly low on this scale. For Agg-Host, there was a significant country effect, F(3,4613) = 38.40, p < .001 (d = .30), a significant gender effect, F(1,4613) = 4.42, p = .04 (d = .06), and a significant interaction effect, F(3,4613) = 11.74, p < .001 (d = .18). Only the country effect was associated with a d higher than .20. The American sample scored particularly high on this factor compared to the three other samples. Globally, the country factor accounted for 2.5% of the total variance, the gender variable for 1.9% of the total variance, and the interaction term for 0.3% of the total variance. Finally, since the age variable also plays a role in personality mean-level (Eysenck, & Eysenck, 1985), it should be controlled. Specifically for the ZKPQ, ImpSS and N-Anx decrease with age (Zuckerman, 1994). When controlling for age, the country variable, excluding the American sample, accounted for 1.5% of the total variance, the gender variable for 2.1% of the total variance, and the interaction term for 0.4% of the total variance. Gender and age group means by country are available upon request from the first author.

 

 

         Finally, a principal component with Varimax solution over the 50-item version was obtained separately for each country. Table 7 shows the loadings per item and factor, as well as the congruence indexes between each pair of countries. Congruence coefficients were computed following the Orthogonal Procustes method used by McCrae, Zonderman, Costa, Bond, and Paunonen (1996)[1]. The Scree plot supported a five factor solution in the four countries. The KMO was between 0.80 and 0.86, and the variance accounted for by the five factors was around 34% in all cases.  The 50 items loaded as expected, except for item 48 (Sy) in the German sample (0.11), item 92 (Sy) in both the German (-0.08) and Swiss (-0.01) samples, and item 3 (Agg-Host) in the Swiss sample (0.29) (Again, item number is with regard to the original ZKPQ). Note that total congruencies were higher than 0.90 for all comparisons across countries. To reinforce these analyses, a multi-group CFA was conducted. The oblique 50-item model was simultaneously fitted in the four countries. This model obtained a c2 of 9602.629 (p < .001; d.f.= 4660). The AGFI and the CFI were similar to the model presented in table 3 (.83, and .77, respectively). Also, the c2/d.f. (2.06) and the RMSEA (0.022) obtained good values. These data suggest that this structure is invariant across the four countries.

 

 

DISCUSSION

 

            The main aim of this study was to obtain a ZKPQ version with acceptable psychometric properties in four languages. In this way, a 50-item version (10 per scale) of the ZKPQ       (ZKPQ-50-CC) was developed using several multivariate techniques such as Exploratory and Confirmatory Factor Analysis. This short version of the ZKPQ presents an equivalent factor structure in the four languages, since all scales obtained high congruence indexes across the four languages and multi-group CFA results were satisfactory.  As regards reliability, the mean of the five scales was higher than 0.70 in the four countries, and all indexes were similar to those obtained for the original version. 

 

The results of this study represent, therefore, a double contribution to the ZKPQ literature: 1) demonstrating the cross-cultural validity of Zuckerman’s Alternative Five Personality Model, and 2) developing a short version with good psychometric and structural properties in four different languages (English, French, German, and Spanish). The cross-cultural design and the use of multivariate statistical procedures in its development give this short version the edge over the 35, and 69-item ZKPQ versions, developed with American and Spanish samples, respectively.

 

            Developing short versions of personality questionnaires is a common practice in personality assessment (Buchanan, et al., 2005). Some instances are the Eysenck Personality Questionnaire (EPQ-R, Eysenck, Eysenck, & Barrett, 1985), the NEO-PI-R (Aluja, García, Rossier, & García, 2005; McCrae, & Costa, 2004), the Sensation Seeking Scale, form V (Aluja, García, & García, 2004b; Hoyle, Stephenson, Palmgreen, Lorch, & Donohew, 2002), the Big Five Goldberg’s adjectives (García, Aluja, & García, 2004; Goldberg, 1992), the STAXI-CA (del Barrio, Aluja, & Spielberger, 2004). These short versions can reduce the administration time for the scales at little cost in terms of reduced reliability. The decision as to the number of items of these short versions varies depending on the authors, but it is usually a data driven procedure based on statistical criteria such as, for instance, classical theory indexes or factor loadings. In the present study, we have conducted a similar procedure to that used by Aluja and colleagues, (2003a). Following this procedure, the Sy scale would have 8 items (MI’s > 100). However, we decided to retain 10 items for this scale for several reasons: a) to maintain the same number of items for all scales, b) all standardized regression weights of the Sy scale were high which gives support to the construct validity and dimensionality of the scale, c) the internal consistency of the 10-item scale in the four countries was acceptable, and d) there was a high correlation between the original and the 10-item Sy scales.

 

Fabrigar, Wegener, Maccallum and Strahan (1999) claimed that Principal Components (PC) does not distinguish between common, unique and error variance, and the components extracted can not be equated to common factors. If the goal is to arrive at a parsimonious representation of the associations among measured variables, the PC is not appropriate. In these cases, EFA extraction methods, such as Principal Axis (PA), are strongly recommended. This recommendation is reinforced when communalities are low (v.g. < 0.40), a pattern usually found in factor analysis at the item level. Also, most studies have performed an orthogonal rotation. Since psychological variables usually correlate, oblique rotation methods are preferable to orthogonal ones. However, no sharp differences between PC and PA, or between orthogonal and oblique solutions, were found in the present study. Moreover, the ZKPQ five-factor structure was mainly orthogonal in the four countries, since not many secondary loadings appeared, and correlations between factors were low.

 

The usefulness of confirmatory factor analysis for personality research has been criticized (Raykov, 1998; Vassend, & Skrondal, 1995, 1997).  It has been argued that: a) fit indexes are usually poor; b) there are too many parameters to be estimated, and c) there are a great deal of secondary loadings and highly correlated items. In spite of these limitations, the CFA is a useful tool for analysing questionnaires and the selection of items, and for testing the factorial validity of scores from a measurement instrument (Byrne, 2001; pp. 104-119). Following this idea, fit indexes, multi-group analysis and standardized regression weights were used in the present study. The results strongly support the construct and cross-cultural validity of the items selected for each scale. Although fit indexes could be improved if the number of items was reduced to five per factor, this strategy would result in limited content diversity and reduce the reliability of the scale.

 

Alpha reliability coefficients were similar to those of the original 89-item version. Moreover, correlations between the short form of the scale and the original versions were around 0.90. This is especially interesting in the case of the ImpSS scale, since the new scale includes only 2 items of the impulsivity facet. However, the remaining 8 items also reflect a kind of impulsivity expressed in spontaneous types of sensation seeking without reflection on possible risks or consequences. Markon, Krueger and Watson (2005) maintain that an "Unconscientious Disinhibition" factor, represented by the ImpSS scale in the ZKPQ, is one of four primary factors found in a hierarchal structure common to normal and abnormal personality. The 10-item ImpSS scale presents a robust one-factor structure, as can be seen in Table 7.

 

The effect sizes of the mean level comparisons across countries show only slight differences between Americans, German, Spanish, and Swiss mean scores (d ≤ 0.43). The largest differences may be observed between the American and German samples. Globally the country variable accounted for 2.5% of the total variance, which corresponds to a d-value of .32. Age differences between samples could explain this pattern, especially for the ImpSS scale. Indeed, the impact of the country variable decreased to 1.5% of the total variance after controlling for age (d = .24). The gender differences were similar to those usually observed using the ZKPQ (Zuckerman, 2002). Interestingly, no interaction between gender and country with a d-value higher than .20 was observed.  However, it should be remarked that this study is mainly focused on the structural validity of the ZKPQ-50-CC across cultures, and the results support the structure developed in the four countries.

 

Summing up, the present results support the equivalence of the short version (ZKPQ-50-CC) across the four languages and countries: English (United States), French (Switzerland), German (Germany), and Spanish (Spain). If the validation process had been conducted separately for each language, it is possible that different items would have been selected. Our procedure, in contrast, faciltates the simultaneous selection of the best items in all languages, and tests the resulting factor structure within each one. The ZKPQ-50-CC is, therefore, a useful instrument for assessing personality traits involved in Zuckerman's alternative five-factor model, and facilitates cross-cultural research since the same items are used in all languages. Nevertheless, the cross-cultural convergent validity of this short scale still needs to be tested, by demonstrating that it correlates equally with expected criteria across cultures.


 


[1]We thank Robert R. McCrae for providing us with the SPSS version of the program that performs the Orthogonal Procrustes rotation.

 

 

Table 7

Factor loadings and percentage of variance accounted for by the factors(a) by country, and factor congruence coefficients between countries.

 

America

Germany

Spain

Switzerland

Factor Congruence Coefficients  between countries

 

F-I

F-II

F-III

F-IV

F-V

F-I

F-II

F-III

F-IV

F-V

F-I

F-II

F-III

F-IV

F-V

F-I

F-II

F-III

F-IV

F-V

SP-SW

SP-AM

SP-GE

SW-AM

SW-GE

AM-GE

Z35

.66

.01

-.06

.02

-.04

.57

.01

-.07

.01

.32

.64

.01

-.08

-.02

.09

.62

.00

-.06

-.04

.07

1

.98

.96

.99

.94

.88

Z30

.67

.00

.01

.09

.13

.41

.02

-.10

-.03

.53

.61

-.09

.13

.08

.09

.66

-.01

.04

.07

.08

.98

.97

.71

.99

.72

.78

Z80

.63

-.04

.02

.00

.01

.63

-.15

.06

-.08

.12

.60

.00

.07

.04

.03

.62

-.02

.03

.05

.04

1

.99

.95

1

.94