Re-examining the Relationship Between Indicators of Program Quality and Learning Leadership at NOLS
DOI:
https://doi.org/10.18666/JOREL-2023-11833Keywords:
youth programs, outdoor adventure education, multi-level modelingAbstract
Creating high-quality programming is essential for fostering learning and development among youth. Outdoor adventure education programs have long been associated with the development of important transferable skills, such as leadership. This study used multi-level modeling to examine the association between six program quality indicators—reflection, sense of empowerment, sense of belonging, instructor-student relationships, group safety, and group functioning—and perceived leadership learning among NOLS students using the revised NOLS Outcome Instrument (NOI 2.0) which built upon the original NOI (see Sibthorp et al., 2007) and assesses more recent NOLS leadership outcomes. Results, from the 891 youth who participated in one of 105 multi-week NOLS courses, indicated that all of the modeled program quality indicators predicted leadership learning. Specifically, providing opportunities for reflection, facilitating a sense of empowerment, promoting a sense of belonging, cultivating positive instructor-student relationships, fostering group safety, and aiding group functioning remain desirable qualities of OAE programs.
References
Akiva, T. (2005). Turning training into results: The new youth program quality assessment. High/Scope Resource, 24(2), 21-24.
Asfeldt, M., & Hvenegaard, G. (2014). Perceived learning, critical elements and lasting impacts on university-based wilderness educational expeditions. Journal of Adventure Education & Outdoor Learning, 14(2), 132-152. doi: http://dx.doi.org/10.1080/14729679.2013.789350
Berkel, C., Mauricio, A. M., Sandler, I. N., Wolchik, S. A., Gallo, C. G., & Brown, C. H. (2018).
The cascading effects of multiple dimensions of implementation on program outcomes: A test of a theoretical model. Prevention Science, 19(6), 782-794. doi: 10.1007/s11121-017-0855-4
Collins, R., Sibthorp, J., Gookin, J., & Schumann, S. (2012). The Role and importance of
program quality in outdoor adventure programs for youth: Examining program quality indicators as predictors of outcome achievement among NOLS participants. Research in Outdoor Education 11, 28-46. doi:10.1353/roe.2012.0004.
Cooley, S. J., Burns, V. E., & Cumming, J. (2015). The role of outdoor adventure education in
facilitating groupwork in higher education. Higher Education, 69(4), 567-582. doi: http://dx.doi.org/10.1007/s10734-014-9791-4
Daniel, B., Bobilya, A. J., Kalisch, K. R., & McAvoy, L. H. (2014). Autonomous student
experiences in outdoor and adventure education. Journal of Experiential Education, 37(1), 4-17. doi: 10.1177/1053825913518892
Eccles, J. S., & Gootman, J. A. (2002). Community programs to promote youth
development. National Academies Press.
Furman, N., & Sibthorp, J. (2014). The development of prosocial behavior in adolescents: A
mixed methods study from NOLS. Journal of Experiential Education, 37(2), 160-175. doi: http://dx.doi.org/10.1177/1053825913489105
Goldenberg, M., McAvoy, L., & Klenosky, D. B. (2005). Outcomes from the components of an Outward Bound experience. Journal of Experiential Education, 28(2), 123-146. doi: http://dx.doi.org/10.1177/105382590502800206
Hattie, J., Marsh, H. W., Neill, J. T., & Richards, G. E. (1997). Adventure education and Outward Bound: Out-of-class experiences that make a lasting difference. Review of educational research, 67(1), 43-87. doi: http://dx.doi.org/10.3102/00346543067001043
Kolb, D.A. (1984). Experiential learning: experience as the source of learning and development. Prentice-Hall.
Lerner, R. M. (2004). Liberty: Thriving and civic engagement among America's youth. Sage.
McKenzie, M. (2003). Beyond “the Outward Bound process:” Rethinking student
learning. Journal of Experiential Education, 26(1), 8-23. doi:
http://dx.doi.org/10.1177/105382590302600104
Meerts-Brandsma, L., Sibthorp, J., & Rochelle, S. (2019). Learning transfer in socioeconomically differentiated outdoor adventure education students. Journal of Experiential Education. doi: http://dx.doi.org/10.1177/1053825919846154
Orson, C. N., McGovern, G., & Larson, R. W. (2020). How challenges and peers contribute to social-emotional learning in outdoor adventure education programs. Journal of Adolescence, 81, 7-18. doi: http://dx.doi.org/10.1016/j.adolescence.2020.02.014
Overholt, J. R., & Ewert, A. (2015). Gender matters: Exploring the process of developing resilience through outdoor adventure. Journal of Experiential Education, 38(1), 41-55. doi: http://dx.doi.org/10.1177/1053825913513720
Paisley, K., Sibthorp, J., Furman, N., Schumann, S., Gookin, J., & McAvoy, L. H. (2008).
Predictors of Participant Development Through Adventure Programs: Replication and Extension of Previous Findings from NOLS. Research in Outdoor Education, 9(1), 60-74.
Povilaitis, V., Riley, M., DeLange, R., Verkouw, A. J., Macklin, K., & Hodge, C. J. (2019).
Instructor impacts on outdoor education participant outcomes: A systematic review. Journal of Outdoor Recreation, Education, and Leadership, 11(3), 222-238. doi: http://dx.doi.org/10.18666/JOREL-2019-V11-I3-9581
Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., Congdon, R. T., du Toit, M. (2011). HLM 7:
Hierarchical linear and nonlinear modeling. Scientific Software International.
Richmond, D., Sibthorp, J., Gookin, J., Annarella, S., & Ferri, S. (2018). Complementing classroom learning through outdoor adventure education: Out-of-school-time experiences that make a difference. Journal of Adventure Education and Outdoor Learning, 18(1), 36-52. doi: http://dx.doi.org/10.1080/14729679.2017.1324313
Schmidt, A. M., & Bobilya, A. J. (2022). Engaging Youth as Community Leaders in Outdoor
Education Research, Program Design, and Evaluation. Journal of Outdoor Recreation, Education, and Leadership, 14(1). doi: http://dx.doi.org/10.18666/JOREL-2022-V14-I1-11124
Sibthorp, J. (2003). An empirical look at Walsh and Golins' adventure education process model: Relationships between antecedent factors, perceptions of characteristics of an adventure education experience, and changes in self-efficacy. Journal of Leisure Research, 35(1), 80-106. doi: http://dx.doi.org/10.18666/jlr-2003-v35-i1-611
Sibthorp, J., Furman, N., Paisley, K., Gookin, J., & Schumann, S. (2011). Mechanisms of
learning transfer in adventure education: Qualitative results from the NOLS transfer survey. Journal of Experiential Education, 34(2), 109-126. https://doi.org/10.1177/105382591103400202
Sibthorp, J., & Jostad, J. (2014). The social system in outdoor adventure education programs. Journal of Experiential Education, 37(1), 60-74. doi: http://dx.doi.org/10.1177/1053825913518897
Sibthorp, J., Paisley, K., Gookin, J., & Furman, N. (2008). The Pedagogic Value of Student
Autonomy in Adventure Education. Journal of Experiential Education, 31(2), 136–151. https://doi.org/10.1177/105382590803100203
Sibthorp, J., Paisley, K. P., & Gookin, J. (2007). Exploring participant development through
adventure based programming: A model from the National Outdoor Leadership School. Leisure Sciences, 29(1), 1-18. doi: http://dx.doi.org/10.1080/01490400600851346
Shooter, W., Paisley, K., & Sibthorp, J. (2011). Trust Development in Outdoor
Leadership. Journal of Experiential Education, 33(3), 189-207. https://doi.org/10.1177/105382590113300301
Warner, R. P., Sibthorp, J., Wilson, C., Browne, L. P., Barnett, S., Gillard, A., & Sorenson, J.
(2021). Similarities and differences in summer camps: A mixed methods study of lasting outcomes and program elements. Children and Youth Services Review, 120, 105779.
doi: https://doi.org/10.1016/j.childyouth.2020.105779
Yohalem, N., Wilson-Ahlstrom, A. (2010). Inside the black box: Assessing and improving
quality in youth programs. American Journal of Community Psychology, 45, 350–357 doi: https://doi.org/10.1007/s10464-010-9311-3
Yu, D., Yang, P. J., Michaelson, L. E., Geldhof, G. J., Chase, P. A., Gansert, P. K., ... & Lerner,
R. M. (2021). Understanding child executive functioning through use of the Bornstein specificity principle. Journal of Applied Developmental Psychology, 73, 101240. doi: https://doi.org/10.1016/j.appdev.2021.101240
Downloads
Published
Issue
Section
License
Sagamore Publishing LLC (hereinafter the “Copyright Owner”)
Journal Publishing Copyright Agreement for Authors
PLEASE REVIEW OUR POLICIES AND THE PUBLISHING AGREEMENT, AND INDICATE YOUR ACCEPTANCE OF THE TERMS BY CHECKING THE ‘AGREE TO THE TERMS OF THIS COPYRIGHT NOTICE’ CHECKBOX BELOW.
I understand that by submitting an article to Journal of Outdoor Recreation, Education, and Leadership, I am granting the copyright to the article submitted for consideration for publication in Journal of Outdoor Recreation, Education, and Leadership to the Copyright Owner. If after consideration of the Editor of the Journal of Outdoor Recreation, Education, and Leadership, the article is not accepted for publication, all copyright covered under this agreement will be automatically returned to the Author(s).
THE PUBLISHING AGREEMENT
Assignment of Copyright
I hereby assign to the Copyright Owner the copyright in the manuscript I am submitting in this online procedure and any tables, illustrations or other material submitted for publication as part of the manuscript in all forms and media (whether now known or later developed), throughout the world, in all languages, for the full term of copyright, effective when the article is accepted for publication.
Reversion of Rights
Articles may sometimes be accepted for publication but later be rejected in the publication process, even in some cases after public posting in “Articles in Press” form, in which case all rights will revert to the Author.
Retention of Rights for Scholarly Purposes
I understand that I retain or am hereby granted the Retained Rights. The Retained Rights include the right to use the Preprint, Accepted Manuscript, and the Published Journal Article for Personal Use and Internal Institutional Use.
All journal material is under a 12 month embargo. Authors who would like to have their articles available as open access should contact Sagamore-Venture for further information.
In the case of the Accepted Manuscript and the Published Journal Article, the Retained Rights exclude Commercial Use, other than use by the author in a subsequent compilation of the author’s works or to extend the Article to book length form or re-use by the author of portions or excerpts in other works.
Published Journal Article: the author may share a link to the formal publication through the relevant DOI.
Author Representations
- The Article I have submitted to the journal for review is original, has been written by the stated author(s) and has not been published elsewhere.
- The Article was not submitted for review to another journal while under review by this journal and will not be submitted to any other journal.
- The Article contains no libelous or other unlawful statements and does not contain any materials that violate any personal or proprietary rights of any other person or entity.
- I have obtained written permission from copyright owners for any excerpts from copyrighted works that are included and have credited the sources in the Article.
- If the Article was prepared jointly with other authors, I have informed the co-author(s) of the terms of this Journal Publishing Agreement and that I am signing on their behalf as their agent, and I am authorized to do so.