Abstracts
Abstract
A procedure for developing and testing measurement scales for use in cross-cultural comparative management research is described. The procedure emphasizes the combination of adequate instrument design if a new instrument is used or adequate adaptation procedures if working with an existing instrument and state-of-the-art statistical analyses (notably multigroup confirmatory factor analysis) to test the adequacy of the scales in all groups. The procedure is illustrated in a study of competitive orientation among French, Mexican, US and Italian employees of multinational corporations.
Keywords:
- comparative research,
- measurement equivalence,
- scale development procedure
Résumé
Nous décrivons une procédure qui permet de développer et tester des échelles de mesure dans le contexte de recherches comparatives inter-culturelles en management. Cette procédure englobe des principes de conception des items dans le cas de création d’échelles, ou d’adaptation, en cas d’utilisation d’instruments existants, ainsi que des analyses statistiques (et notamment l’analyse factorielle confirmatoire multigroupes) pour tester la pertinence des échelles dans tous les groupes. Cette procédure est illustrée dans une étude de l’esprit de compétition auprès de salariés français, mexicains, américains et italiens travaillant dans des entreprises multinationales.
Mots-clés :
- recherche comparative,
- équivalence de mesure,
- procédure de création d’échelles de mesure
Resumen
En este articulo, se describe un procedimiento para desarrollar y probar escalas de medida, en el contexto de la investigación comparativa transcultural en gestión. Este procedimiento incluye los principios de elaboración en el caso de creación de escalas, o los principios de adaptación, en caso de uso de instrumentos existentes, y análisis estadísticos (incluyendo el análisis factorial confirmatorio multigrupo) para poner a prueba la pertinencia de las escalas en todos los grupos. Este procedimiento se ilustra en un estudio sobre el espíritu competitivo aplicado a una muestra de empleados franceses, mexicanos, italianos y americanos de empresas multinacionales.
Palabras clave:
- investigación comparativa intercultural,
- la equivalencia de medición,
- elaboración de escalas de medición
Appendices
Bibliographie
- Adler, N. J. (1983). “A typology of management studies involving culture.” Journal ofInternational Business Studies, Vol. 14, No. 2, pp. 29-47.
- Asparouhov, T., & Muthén, B. (2009). “Exploratory structural equation modeling.” Structural Equation Modeling, Vol. 16, pp. 397-438.
- Bagozzi, R. P., Yi, Y., & Phillips, L. W. (1991). “Assessing construct validity in organizational research.” Administrative Science Quarterly, Vol. 36, No. 3, pp. 421-458.
- Barnette, J. J. (2000). “Effects of stem and Likert response option reversals on survey internal consistency: If you feel the need, there is a better alternative to using those negatively worded stems.” Educational and Psychological Measurement, Vol. 60, No. 3, pp. 361-370
- Berry, J. W. (1989). “Imposed etics-emics-derived etics: The operationalization of a compelling idea.” International Journal of Psychology, Vol. 24, No. 6, pp. 721-735.
- Billiet, J. B., & McClendon, M. J. (2000). “Modeling acquiescence in measurement models for two balanced sets of items.” Structural Equation Modeling, Vol.7, No.4, pp.608-628.
- Boddewyn, J. (1965). “The comparative approach to the study of business administration.” Academy of Management Journal, Vol. 8, No. 4, pp. 261-267.
- Bolino, M. C., & Turnley, W. H. (1999). “Measuring impression management in organizations: A scale development based on the Jones and Pittman taxonomy.” Organizational Research Methods, Vol. 2, No. 2, pp. 187-206.
- Brislin, R. W. (1986). “The wording and translation of research instruments.” In W. J. Lonner & J. W. Berry (Eds.), Fields methods in cross-cultural research (Vol. 8, pp. 291-324). Beverly Hills, CA: Sage.
- Byrne, B. M. (2001). Structural equation modeling with AMOS - Basic concepts, applications, and programming. Mahwah, NJ, USA: Lawrence Erlbaum Associates.
- Byrne, B. M. (2004). “Testing for multigroup invariance using AMOS graphics: A road less traveled.” Structural Equations Modeling, Vol. 11, No. 4, pp. 272-300.
- Byrne, B. M., Shavelson, R. J., & Muthen, B. (1989). “Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement equivalence.” Psychological Bulletin, Vol. 105, No. 3, pp. 456-466.
- Byrne, B. M., & Campbell, T. L. (1999). “Cross-cultural comparisons and the presumption of equivalent measurement and theoretical structure: A look beneath the surface.” Journal of Cross-Cultural Psychology, Vol. 30, No. 5, pp. 555-574.
- Byrne, B. M., & Watkins, D. (2003). “The issue of measurement invariance revisited.” Journal of Cross-Cultural Psychology, Vol. 34, No. 2, pp. 155-175.
- Campbell, D. T., & Fiske, D. W. (1959). “Convergent and discriminant validation by the multitrait-multimethod matrix.” Psychological Bulletin, Vol. 56, pp. 81-105.
- Cavusgil, S. T., & Das, A. (1997). “Methodological issues in empirical cross-cultural research: A survey of the management literature and a framework.” Management International Review, Vol. 37, No. 1, pp. 71-96.
- Chen, F.F. (2007). “Sensitivity of goodness of fit indexes to lack of measurement.” Structural Equation Modeling, Vol. 14, pp. 464-504
- Cheung, G. W., & Rensvold, R. B. (2002). “Evaluating goodness-of-fit indexes for testing measurement invariance.” Structural Equation Modeling, Vol. 9, No. 2, pp. 233-255.
- Cheung, F. M., vandeVijver, F. J. R., & Leong, F. T. L. (2011). “Toward a new approach to the study of personality in culture.” American Psychologist. Advance online publication.
- Churchill, G. A. (1979). “A paradigm for developing better measures of marketing constructs.” Journal of Marketing Research, Vol. 16, No. 1, pp. 64-73.
- Davidson, A. R., Jaccard, J. J., Triandis, H. C., Morales, M. L., & Diaz-Guerrero, R. (1976). “Cross-cultural model testing: Toward a solution of the etic-emic dilemma.” International Journal of Psychology, Vol. 11, No. 1, pp. 1-13.
- Dawis, R. V. (1987). “Scale construction.” Journal of Counselling Psychology, Vol. 34, No.4, pp. 481-489.
- DeVellis, R. F. (2003). Scale development, theory and applications (Vol. 26). Thousand Oaks, CA: Sage.
- DeWinter, J., Dodou, D., & Wieringa, P. (2009). “Exploratory factor analysis with small sample sizes”. Multivariate Behavioral Research, Vol. 44, pp. 147–181.
- Gerbing, D. W., & Anderson, J. C. (1996). “An updated paradigm for scale development incorporating unidimensionality and its assessment.” Journal of Marketing Research, Vol. 25, No. 5, pp. 186-192.
- Hair Jr., J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2006). Multivariate data analysis (6th ed.). Upper Saddle River, NJ: Pearson.
- Hambleton, R. K. (2001). “The next generation of the ITC test translation and adaptation guidelines.” European Journal of Psychological Assessment, Vol. 17, No. 3, pp. 164-172.
- Hardesty, D. M., & Bearden, W. O. (2004). “The use of expert judges in scale development: Implications for improving face validity of measures of unobservable constructs.“ Journal of Business Research, Vol. 57, pp. 98-107.
- Harkness, J. (2003). “Questionnaire translation.” In J. A. Harkness, F. J. R. Van de Vijver & P. P. Mohler (Eds.), Cross-cultural survey methods. Hoboken, NJ: Wiley.
- Harkness, J., VandeVijver, F. J. R., & Johnson, T. P. (2003). “Questionnaire design in comparative research.” In J. A. Harkness, F. J. R. Van de Vijver & P. P. Mohler (Eds.), Cross-cultural survey methods. Hoboken, NJ: Wiley.
- Hinkin, T. R. (1995). “A review of scale development practices in the study of organizations.” Journal of Management, Vol. 21, No. 5, pp. 967-988.
- Hofstede, G. (2001). Culture’s consequences - comparing values, behaviors, institutions and organizations across nations (2nd ed.). Thousand Oaks, CA: Sage.
- Hui, C. H., & Triandis, H. C. (1985). “Measurement in cross-cultural psychology.” Journal of Cross-Cultural Psychology, Vol. 16, No. 2, pp. 131-152.
- Johnson, T. P. (1998). “Approaches to equivalence in cross-cultural and cross-national survey research.” ZUMA-Nachrichten spezial, Vol.3, pp. 1-40.
- Labouvie, E., & Ruetsch, C. (1995). “Testing for equivalence of measurement scales: Simple structure and metric invariance reconsidered.” Multivariate Behavioral Research, Vol. 30, No. 1, pp. 63-76
- Laroche, M., Ueltschy, L. C., Abe, S., Cleveland, M., & Yannopoulos, P. (2004). “Service quality perceptions and customer satisfaction: Evaluating the role of culture.” Journal of International Marketing, Vol. 12, No. 3, pp. 58-85.
- Little, T. D., Slegers, D. W., & Card, N. A. (2006). “A non-arbitrary method of identifying and scaling latent variables in SEM and MACS models.” Structural Equation Modeling, Vol. 13, No. 1, pp. 59-72.
- Lytle, A. L., Brett, J. M., Barsness, Z. I., Tinsley, C. H., & Janssens, M. (1995). “A paradigm for confirmatory cross-cultural research in organizational behavior.” Research in Organizational Behavior, Vol. 17, pp. 167-214.
- MacCallum, R., Roznowski, M., & Necowitz, L. (1992). “Model modifications in covariance structure analysis: The problem of capitalization on chance.” Psychological Bulletin, Vol. 111, No. 3, pp. 490-504.
- Marsh, H.W., Nagengast, B., Morin, A.J.S., Parada, R.H., Craven, R.G., & Hamilton,
- L.R. (2011). “Construct validity of the multidimensional structure of bullying and victimization: An application of exploratory structural equation modeling.” Journal of Educational Psychology, Vol.103, pp. 701-732.
- Mavondo, F., Gabbott, M., & Tsarenko, Y. (2003). “Measurement invariance of marketing instruments: An implication across countries.” Journal of Marketing Management, Vol.19, No.5/6, pp. 523-540.
- McDonald, R.P. (1970). “Theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis.” British Journal of Mathematical & Statistical Psychology, No 23, pp. 1-21
- Meade, A.W, Johnson, E., & Braddy, P. (2008). “Power and sensitivity of alternative fit indices in tests of measurement invariance.” Journal of Applied Psychology, Vol. 93, No. 3, pp. 568-592.
- Meade, A.W, Michels, L., & Lautenschlager, G. (2007). “Are internet and paper-and-pencil personality tests truly comparable? An experimental design measurement invariance study.” Organizational Research Methods, Vol. 10, No. 2, pp. 322-345.
- Meade, A. W., & Bauer, D. J. (2007). “Power and precision in confirmatory factor analyic tests of measurement invariance.” Structural Equation Modeling, Vol. 14, No. 4, pp. 611-635.
- Meade, A. W., & Lautenschlager, G. J. (2004a). “A comparison of item response theory and confirmatory factor analytic methodologies for establishing measurement equivalence/invariance.” Organizational Research Methods, Vol. 7, No. 4, pp. 361-388.
- Meade, A. W., & Lautenschlager, G. J. (2004b). “A Monte-Carlo study of confirmatory factor analytic tests of measurement equivalence/invariance.” Structural Equation Modeling, Vol. 11, No.1, pp. 60-72.
- Meiring, D., VandeVijver, F.J.R., & Rothmann, S. (2006). “Bias in an adapted version of the 15FQ+ in South Africa.” South African Journal of Psychology, Vol.36, pp. 340-356.
- Meredith, W. (1993). “Measurement invariance, factor analysis, and factorial invariance.” Psychometrika, Vol. 58, No. 4, pp. 525-543.
- Millsap, R. E. (2011). Statistical approaches to measurement invariance. New York, NY: Routledge.
- Morden, T. (1999). “Models of national culture - a management review.” Cross Cultural Management, Vol. 6, No. 1, pp. 19-44.
- Mullen, M. R. (1995). “Diagnosing measurement equivalence in cross-national research.” Journal of International Business Studies, Vol. 26, No. 3, pp. 573-596.
- O’Connor, B. P. (2000). “SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test.” Behavior Research Methods, Vol. 32, No. 3, pp. 396-402.
- Osborne, J. W., & Costello, A. B. (2009). “Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis.” Pan-Pacific Management Review, Vol. 12, No. 2, pp. 131-146.
- Peng, T. K., Peterson, M. F., & Shyi, Y. P. (1991). “Quantitative methods in cross-national management research: Trends and equivalence issues.” Journal of Organizational Behavior, Vol.12, No.2, pp. 87-107.
- Peter, J. P. (1981). “Construct validity: A review of basic issues and marketing practices.” Journal of Marketing Research, 18, 133-145. Poortinga, Y. H. (1989). Equivalence of cross-cultural data: An overview of basic issues. International Journal of Psychology, Vol. 24, pp. 737-756.
- Poortinga, Y. H. (1989). “Equivalence of cross-cultural data: An overview of basic issues. International Journal of Psychology, Vol.24, pp.737-756.
- Raju, N. S., Byrne, B. M., & Laffitte, L. J. (2002). “Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory.” Journal of Applied Psychology, Vol. 87, pp. 517-529.
- Reise, S. P., Widaman, K. F., & Pugh, R. H. (1993). “Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance.” Psychological Bulletin, Vol. 114, No. 3, pp. 552-566.
- Riordan, C. M., & Vandenberg, R. J. (1994). “A central question in cross-cultural research: Do employees of different cultures interpret work-related measures in a equivalent manner?” Journal of Management, Vol. 20, No. 3, pp. 643-673.
- Schaffer, B. S., & Riordan, C. M. (2003). “A review of cross-cultural methodologies for organizational research: A best-practices approach.” Organizational Research Methods, Vol. 6, No. 2, pp. 169-216.
- Sijtsma, K. (2009). “On the use, the misuse, and the very limited usefulness of Cronbach’s Alpha.” Psychometrika, Vol. 74, No. 1, pp.107-120.
- Singh, J. (1995). “Measurement issues in cross-national research.” Journal of International Business Studies, Vol. 26, No. 3, pp. 597-619.
- Smith, T. W. (2003). “Developing comparable questions in cross-national surveys”. In J. A. Harkness, F. J. R. Van de Vijver & P. P. Mohler (Eds.), Cross-cultural survey methods (pp. 69-92). Hoboken, NJ: Wiley.
- Steenkamp, J.-B. E. M., & Baumgartner, H. (1998). “Assessing measurement invariance in cross-national consumer research”. The Journal of Consumer Research, Vol. 25, No. 1, pp. 78-90.
- Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Washington, DC: American Psychological Society.
- Usunier, J.-C. (1998). International & cross-cultural management research. Thousand Oaks, CA: Sage.
- VandeVijver, F. J. R. (1998). “Towards a theory of bias and equivalence.” In J. Harkness (Ed.), ZUMA-Nachrichten Spezial No.3. Cross-Cultural Survey Equivalence. Mannheim, Germany: ZUMA.
- VandeVijver, F. J. R., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage.
- Vandenberg, R. J. (2002). “Toward a further understanding of and improvement in measurement invariance methods and procedures.” Organizational Research Methods, Vol. 5, No. 2, pp. 139-158.
- Vandenberg, R. J., & Lance, C. E. (2000). “A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research.” Organizational Research Methods, Vol. 3, No.1, pp. 4-70.
- Wasti, S. A., Bergman, M. E., Glomb, T. M., & Drasgow, F. (2000). “Test of the generalizability of a model of sexual harassment.” Journal of Applied Psychology, Vol. 85, No. 5, pp. 766-778.
- Worthington, R. L., & Whittaker, T. A. (2006). “Scale development research: A content analysis and recommendations for best practices.” The Counseling Psychologist, Vol. 34, pp. 806-838.
- Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005). “Cronbach’s α, Revelle’s β, and Mcdonald’s ω: Their relations with each other and two alternative conceptualizations of reliability.” Psychometrika, Vol.70, No.1, pp. 1-11.