Understanding Leisure-Related Program Effects by Using Process Data in the HealthWise South Africa Project
Keywords:
Adolescents, implementation fidelity, leisure motivation, prevention, process dataAbstract
As the push for evidence-based programming gathers momentum, many human services programs and interventions are under increased scrutiny to justify their effectiveness across different conditions and populations. Government agencies and the public want to be assured that their resources are being put to good use on programs that are effective and efficient. Thus, programs are increasingly based on theory and evaluated through randomized control trials using longitudinal data. Despite this progress, hypothesized outcomes are often not detected and/or their effect sizes are small. Moreover, findings may go against intuition or “gut feelings” on the part of project staff. Given the need to understand how program implementation issues relate to outcomes, this study focuses on whether process measures that focus on program implementation and fidelity can shed light on associated outcomes. In particular, we linked the process evaluation of the HealthWise motivation lesson with outcomes across four waves of data collection. We hypothesized that HealthWise would increase learners’ intrinsic and identified forms of motivation, and decrease amotivation and extrinsic motivation. We did not hypothesize a direction of effects on introjected motivation due to its conceptual ambiguity. Data came from youth in four intervention schools (n = 902, 41.1%) and five control schools (n = 1291, 58.9%) who were participating in a multi-cohort, longitudinal study. The schools were in a township near Cape Town, South Africa. For each cohort, baseline data are collected on learners as they begin grade 8. We currently have four waves of data collected on the first cohort, which is the focus of this paper. The mean age of the sample at wave 3 was 15.0 years (SD = .86) and 51% of students were female. Results suggested that there was evidence of an overall program effect of the curriculum on amotivation regardless of fidelity of implementation. Compared to the control schools, all treatment school learners reported lower levels of amotivation in wave 4 compared to wave 3, as hypothesized. Using process evaluation data to monitor implementation fidelity, however, we also conclude that the school with better trained teachers who also reported higher levels of program fidelity had better outcomes than the other schools. We discuss the implications of linking process data with outcome data and the associated methodological challenges in linking these data.?Downloads
Published
Issue
Section
License
Sagamore Publishing LLC (hereinafter the “Copyright Owner”)
Journal Publishing Copyright Agreement for Authors
PLEASE REVIEW OUR POLICIES AND THE PUBLISHING AGREEMENT, AND INDICATE YOUR ACCEPTANCE OF THE TERMS BY CHECKING THE ‘AGREE TO THE TERMS OF THIS COPYRIGHT NOTICE’ CHECKBOX BELOW.
I understand that by submitting an article to Journal of Park and Recreation Administration, I am granting the copyright to the article submitted for consideration for publication in Journal of Park and Recreation Administration to the Copyright Owner. If after consideration of the Editor of the Journal of Park and Recreation Administration, the article is not accepted for publication, all copyright covered under this agreement will be automatically returned to the Author(s).
THE PUBLISHING AGREEMENT
Assignment of Copyright
I hereby assign to the Copyright Owner the copyright in the manuscript I am submitting in this online procedure and any tables, illustrations or other material submitted for publication as part of the manuscript in all forms and media (whether now known or later developed), throughout the world, in all languages, for the full term of copyright, effective when the article is accepted for publication.
Reversion of Rights
Articles may sometimes be accepted for publication but later be rejected in the publication process, even in some cases after public posting in “Articles in Press” form, in which case all rights will revert to the Author.
Retention of Rights for Scholarly Purposes
I understand that I retain or am hereby granted the Retained Rights. The Retained Rights include the right to use the Preprint, Accepted Manuscript, and the Published Journal Article for Personal Use and Internal Institutional Use.
All journal material is under a 12 month embargo. Authors who would like to have their articles available as open access should contact Sagamore-Venture for further information.
In the case of the Accepted Manuscript and the Published Journal Article, the Retained Rights exclude Commercial Use, other than use by the author in a subsequent compilation of the author’s works or to extend the Article to book length form or re-use by the author of portions or excerpts in other works.
Published Journal Article: the author may share a link to the formal publication through the relevant DOI.
Author Representations
- The Article I have submitted to the journal for review is original, has been written by the stated author(s) and has not been published elsewhere.
- The Article was not submitted for review to another journal while under review by this journal and will not be submitted to any other journal.
- The Article contains no libelous or other unlawful statements and does not contain any materials that violate any personal or proprietary rights of any other person or entity.
- I have obtained written permission from copyright owners for any excerpts from copyrighted works that are included and have credited the sources in the Article.
- If the Article was prepared jointly with other authors, I have informed the co-author(s) of the terms of this Journal Publishing Agreement and that I am signing on their behalf as their agent, and I am authorized to do so.