Beyond Composite Scores and Cronbach’s Alpha: Advancing Methodological Rigor in Recreation Research
Keywords:Cronbach’s alpha, applied statistics, applied research methods, factor analysis, parental involvement, PCIS, competition climbing
AbstractCritically examining common statistical approaches and their strengths and weaknesses is an important step in advancing recreation and leisure sciences. To continue this critical examination and to inform methodological decision making, this study compared three approaches to determine how alternative approaches may result in contradictory conclusions in the interpretation of the psychometric properties of a scale and in response to a given research question. To this end, this study explored what factors best predicted parental endorsement of competition climbing in a sample of 184 parents of youth competition climbers. The study findings suggest that the three distinct approaches provided meaningfully different conclusions regarding the adapted psychometric properties of the questionnaire, but offered no meaningful differences in the primary finding of the study: Parent–coach relationship quality is the best predictor of parental endorsement of competition climbing. The results suggest that deeper examination of self-report questionnaire data may advance our understanding of complex recreation and leisure constructs beyond what can be understood with less advanced analytic techniques.Subscribe to JOREL
Babbie, E. R. (2013). The basics of social research. Boston, MA: Cengage Learning.
Bremer, K. L. (2012). Parental involvement, pressure, and support in youth sport: A narrative
literature review. Journal of Family Theory & Review, 4(3), 235-248.
Byrne, B. (2006). Structural equation modeling with EQS. (2nd ed.). New York, NY: Psychology Press.
Chin, W. W. (1998). The partial least squares approach for structural equation modeling. In G. A. Marcoulides (Ed.), Modern methods for business research (pp. 295-236). London: Lawrence Erlbaum Associates.
Coffman, D. L., & MacCallum, R. C. (2005). Using parcels to convert path analysis models into latent variable models. Multivariate behavioral research, 40(2), 235-259.
Cohen, J., Cohen, P., West, S. G. & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). New York, NY: Routledge.
Corrigan, A. (2002). Parent-teacher involvement questionnaire: Parent version
(Fast Track Project Technical Report). Retrieved from http://www.fasttrackproject.org
Côté, J. (1999). The influence of the family in the development of talent in sport. The sport
psychologist, 13(4), 395-417.
DiStefano, C., Zhu, M., & Mindrila, D. (2009). Understanding and using factor scores: Considerations for the applied researcher. Practical Assessment, Research & Evaluation, 14(20), 1-11.
Dorsch, T. E., Smith, A. L., & McDonough, M. H. (2009). Parents' perceptions of child-to-parent
socialization in organized youth sport. Journal of Sport and Exercise Psychology, 31(4), 444-468.
Dukes, R. L., & Coakley, J. (2002). Parental commitment to competitive swimming. Free Inquiry in Creative Sociology, 30(2), 185-198.
Dunn, C. R, Dorsch, T. E., King, M. Q., & Rothlisberger, K. J. (2016). The impact of family financial investment on perceived parent pressure and child enjoyment and commitment in organized youth sport. Family Relations, 65(2), 287-299.
Eisinga, R., Grotenhuis, M., & Pelzer, B. (2012). The reliability of a two item scale: Pearson, Cronbach, or Spearman-Brown? International Journal of Public Health, 58(4), 637-642.
Enders, C. K. (2001). The performance of the full information maximum likelihood estimator in multiple regression models with missing data. Educational and Psychological Measurement, 61(5), 713-740.
Field, A. (2013). Discovering statistics using IBM SPSS Statistics. (4th ed.). Thousand Oaks, CA: SAGE Publications.
Fornell, C. & Larker, D. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18, 39-50.
Freire, T., & Caldwell, L. L. (2013). Afterthoughts on leisure and future research directions. In T. Freire (Ed.), Positive leisure science: From subjective experience to social contexts (pp. 213-223). New York, NY: Springer.
Frigge, M., Hoaglin, D. C., & Iglewicz, B. (1989). Some implementations of the boxplot. The American Statistician, 43(1), 50-54.
Gagnon, R. J., Stone, G. A., Brookover, B., Garst, B. A., & Mowery, S. M. (2017). The business of lifestyle sport. In D. Turner and S. Carnicelli (Eds.), Lifestyle sports and public policy (pp. 27-42). Abington, UK: Routledge.
Gagnon R. J., Stone, G. A., Garst, B. A., & Arthur-Banning, S. (2016). Competition climbing: From leisure pursuit to lifestyle sport. Journal of Unconventional Parks, Recreation, and Tourism Studies, 6(1), 2-12.
Garst, B. A., & Gagnon R. J. (2016). A structural model of camp director practices and outcomes: Does intention toward program outcomes matter? Journal of Park and Recreation Administration, 34(4), 51-65.
Graham, J.W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549-576.
Holt, N. L., Tamminen, K. A., Black, D. E., Sehn, Z. L., & Wall, M. P. (2008). Parental involvement in competitive youth sport settings. Psychology of Sport and Exercise, 9, 663-685.
Hurley, A., Scandra, T., Schriesheim, C., Brannick, M., Seers, A., Vandenberg, R., & Williams, L. (1997). Exploratory and confirmatory factor analysis: Guidelines, issues, and alternatives. Journal of Organizational Behavior, 18, 667-683.
Jowett, S., & Cockerill, I. (2001). Incompatibility in the coach-athlete relationship. In I.M.
Cockerill (Ed.), Solutions in sport psychology (pp. 16-31). London: Thomson Learning.
Jowett, S., & Timson-Katchis, M. (2005). Social networks in sport: Parental influence on the
coach-athlete relationship. The Sport Psychologist, 19(3), 267-287.
Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). New York, NY: The Guilford Press.
Kohl, G. O., Lengua, L. J., & McMahon, R. J. (2000). Parent involvement in school: Conceptualizing multiple dimensions and their relations with family and demographic risk factors. Journal of School Psychology, 38(6), 501-523.
Ledgerwood, A., & Shrout, P. E. (2011). The trade-off between accuracy and precision in latent variable models of mediation processes. Journal of Personality and Social Psychology, 101(6), 1174-1188.
Little, R. J. A. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198-1202.
Mautone, J. A., Marcelle, E., Tresco, K. E., & Power, T. J. (2015). Assessing the quality of parent-teacher relationships for students with ADHD. Psychology in the Schools, 52(2), 196-207.
Miller-Johnson, S., & Maumary-Gremaud, A. (1995). Parent-teacher involvement: Parent version (Fast Track Project Technical Report). Retrieved from
Popper, K. (1981). Science, pseudo-science, and falsifiability. Scientific thinking, 92-99.
Schlomer, G. L., Bauman, S., & Card, N. A. (2010). Best practices for missing data management in counseling psychology. Journal of Counseling Psychology, 57(1), 1-10.
Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8(4), 350- 353.
Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74(1), 107-120.
Smoll, F. L., Cumming, S. P., & Smith, R. E. (2011). Enhancing coach-parent relationships in youth sports: Increasing harmony and minimizing hassle. International Journal of Sports Science & Coaching, 6(1), 13-26.
Stephenson, M. T., & Holbert, R. L. (2003). A Monte Carlo simulation of observable versus latent variable structural equation modeling techniques. Communication Research, 30(3), 332-354.
Stein, G. L., Raedeke, T. D., & Glenn, S. D. (1999). Children's perceptions of parent
involvement: it's not how much, but to what degree that's important. Journal of Sport Behavior, 22(4), 591-601.
Streiner, D. L. (2003). Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment, 80(1), 99-103.
Tabachnick, B. G., & Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). New York, NY: Harper Collins.
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of
Medical Education, 2, 53-55.
USA Climbing. (2017). About USA Climbing. Retrieved from
Walters, E. (2001). Parent-teacher involvement questionnaire: Parent version (Fast Track
Project Technical Report). Retrieved from http://www.fasttrackproject.org
Wheeler, S. & Green, K. (2014). Parenting in relation to children’s sports participation:
Generational changes and potential implications. Leisure Studies, 33(3), 267-284.
Wolfenden, L. E., & Holt, N. L. (2005). Talent development in elite junior tennis: Perceptions of
players, parents, and coaches. Journal of Applied Sport Psychology, 17, 108-126.
Yong, A. G., & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79-94.
Sagamore Publishing LLC (hereinafter the “Copyright Owner”)
Journal Publishing Copyright Agreement for Authors
PLEASE REVIEW OUR POLICIES AND THE PUBLISHING AGREEMENT, AND INDICATE YOUR ACCEPTANCE OF THE TERMS BY CHECKING THE ‘AGREE TO THE TERMS OF THIS COPYRIGHT NOTICE’ CHECKBOX BELOW.
I understand that by submitting an article to Journal of Outdoor Recreation, Education, and Leadership, I am granting the copyright to the article submitted for consideration for publication in Journal of Outdoor Recreation, Education, and Leadership to the Copyright Owner. If after consideration of the Editor of the Journal of Outdoor Recreation, Education, and Leadership, the article is not accepted for publication, all copyright covered under this agreement will be automatically returned to the Author(s).
THE PUBLISHING AGREEMENT
Assignment of Copyright
I hereby assign to the Copyright Owner the copyright in the manuscript I am submitting in this online procedure and any tables, illustrations or other material submitted for publication as part of the manuscript in all forms and media (whether now known or later developed), throughout the world, in all languages, for the full term of copyright, effective when the article is accepted for publication.
Reversion of Rights
Articles may sometimes be accepted for publication but later be rejected in the publication process, even in some cases after public posting in “Articles in Press” form, in which case all rights will revert to the Author.
Retention of Rights for Scholarly Purposes
I understand that I retain or am hereby granted the Retained Rights. The Retained Rights include the right to use the Preprint, Accepted Manuscript, and the Published Journal Article for Personal Use and Internal Institutional Use.
All journal material is under a 12 month embargo. Authors who would like to have their articles available as open access should contact Sagamore-Venture for further information.
In the case of the Accepted Manuscript and the Published Journal Article, the Retained Rights exclude Commercial Use, other than use by the author in a subsequent compilation of the author’s works or to extend the Article to book length form or re-use by the author of portions or excerpts in other works.
Published Journal Article: the author may share a link to the formal publication through the relevant DOI.
- The Article I have submitted to the journal for review is original, has been written by the stated author(s) and has not been published elsewhere.
- The Article was not submitted for review to another journal while under review by this journal and will not be submitted to any other journal.
- The Article contains no libelous or other unlawful statements and does not contain any materials that violate any personal or proprietary rights of any other person or entity.
- I have obtained written permission from copyright owners for any excerpts from copyrighted works that are included and have credited the sources in the Article.
- If the Article was prepared jointly with other authors, I have informed the co-author(s) of the terms of this Journal Publishing Agreement and that I am signing on their behalf as their agent, and I am authorized to do so.