Hostname: page-component-76d6cb85b7-hqrjx Total loading time: 0 Render date: 2026-07-12T14:17:06.582Z Has data issue: false hasContentIssue false
  • English
  • Français

The Impact of Class-Level Variables on the Effectiveness of a Middle School Social and Emotional Learning Program: A Multilevel Analysis

Published online by Cambridge University Press:  27 October 2017

Vitor Alexandre Coelho  and
Vanda Sousa
Vitor Alexandre Coelho*
Affiliation:
Project Positive Attitude, Académico de Torres Vedras, Portugal
Vanda Sousa
Affiliation:
Project Positive Attitude, Académico de Torres Vedras, Portugal
*
ADDRESS FOR CORRESPONDENCE: Vitor Alexandre Coelho, Project Positive Attitude, Académico de Torres Vedras, Travessa do Quebra-Costas, 9, 2560–703 Torres Vedras, Portugal. Email: vitorpcoelho@gmail.com
Get access

Abstract

This study investigated the impact of class-level variables on the effectiveness of a universal middle school social and emotional learning (SEL) program, as reported by students (7th to 9th grade) and their teachers. There were 746 participants (M age = 13.38; SD = 1.36), comprising 576 in the intervention groups and 170 in the control groups. Results from both self- and teacher reports identified positive intervention gains in social awareness and self-control. According to both types of informants, rural school students benefitted more in social awareness, whereas teacher reports attributed bigger gains in social awareness to 7th- and 8th-graders. These results highlight the importance of class-level variables when analysing the effectiveness of SEL programs.

Keywords

social and emotional learningprogram effectivenessschool locationmultilevel analysis

Information

Type
Special Issue: Social and Emotional Learning
Information
Journal of Relationships Research , Volume 8 , 2017 , e21
Copyright
Copyright © The Author(s) 2017 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Achenbach, T.M., Becker, A., Dopfner, M., Heiervang, E., Roessner, V., Steinhausen, H-C., & Rothenberger, A. (2008). Multicultural assessment of child and adolescent psychopathology with ASEBA and SDQ instruments: Research findings, applications, and future directions. Journal of Child Psychology and Psychiatry, 49, 251–275. doi:10.1111/j.1469-7610.2007.01867.x.Google Scholar
Anderman, E.M. (2002). School effects on psychological outcomes during adolescence. Journal of Educational Psychology, 94, 795–809. doi:10.1037//0022-0663.94.4.795 Google Scholar
Arens, A.K., Yeung, A.S., Craven, R.G., Watermann, R., & Hasselhorn, M. (2013). Does the timing of transition matter? Comparison of German students’ self-perceptions before and after transition to secondary school. International Journal of Educational Research, 57, 1–11. doi:10.1016/j.ijer.2012.11.001 Google Scholar
Belfield, C., Bowden, B., Klapp, A., Levin, H., Shand, R., & Zander, S. (2015). The economic value of social and emotional learning. New York, NY: Center for Benefit-Cost Studies in Education.Google Scholar
Bowles, T., Jimerson, S., Haddock, A., Nolan, J., Jablonski, S., Czub, M., & Coelho, V. (2017). A review of the provision of social and emotional learning in Australia, the United States, Poland, and Portugal. Journal of Relationships Research, 8, e16. doi:10.1017/jrr.2017.16 Google Scholar
Castillo, R., Salguero, J.M., Fernández-Berrocal, P., & Balluerka, N. (2013). Effects of an emotional intelligence intervention on aggression and empathy among adolescents. Journal of Adolescence, 36, 883–892. doi:10.1016/j.adolescence.2013.07.001 CrossRefGoogle ScholarPubMed
Coelho, V., & Figueira, A. (2011). Project ‘Positive Attitude’: promoting school success through social and emotional abilities development. Design for elementary and middle school students, in Portugal. Interamerican Journal of Psychology, 45, 185–192.Google Scholar
Coelho, V., Sousa, V., & Figueira, A.P. (2014). The impact of a school-based social and emotional learning program on the self-concept of middle school students. Revista de Psicodidactica, 19, 347–365. doi:10.1387/RevPsicodidact.10714 Google Scholar
Coelho, V., Marchante, M., & Sousa, V. (2015a). Social and emotional competencies evaluation questionnaire — Teacher's version: Validation of a short form. Psychological Reports, 116, 221–236. doi:10.1177/0033294116656617 Google Scholar
Coelho, V., Marchante, M., & Sousa, V. (2015b). ‘Positive Attitude’: A multilevel model analysis of the effectiveness of a social and emotional learning program for Portuguese middle school students. Journal of Adolescence, 43, 29–38. doi:10.1016/j.adolescence.2015.05.009 Google Scholar
Coelho, V., Marchante, M., & Sousa, V. (2016). Positive Attitude Program's impact upon self-concept across childhood and adolescence. Revista de Psicodidactica, 21, 261–280. doi:10.1387/RevPsicodidact.15129 Google Scholar
Coelho, V.A., Sousa, V. (2017). Comparing two low middle school social and emotional learning program formats: A multilevel effectiveness study. Journal of Youth and Adolescence, 46, 656–667. doi:10.1007/s10964-016-0472-8 Google Scholar
Collaborative for Academic, Social, and Emotional Learning (CASEL). (2012). 2013 CASEL guide: Effective social and emotional learning programs (Preschool and elementary school edition). Chicago, IL: Author.Google Scholar
Conduct Problems Prevention Research Group. (2011). The effects of the ‘fast track’ preventive on the development of conduct disorder across childhood. Child Development, 82, 331–345. doi:10.11117/j.1467-8624.2010.01558.x Google Scholar
Diseth, A., Meland, E., & Breidablik, H.J. (2014). Self-beliefs among students: Grade level and gender differences in self-esteem, self-efficacy and implicit theories of intelligence. Learning and Individual Differences, 35, 1–8. doi:10.1016/j.lindif.2014.06.003 Google Scholar
Dodge, K.A., Bierman, K.L., Coie, J.D., Greenberg, M.T., Lochman, J.E., McMahon, R.J., & Pinderhughes, E.E. (2014). Impact of early intervention on psychopathology, crime, and well-being at age 25. American Journal of Psychiatry, 172, 59–70. doi:10.1176/appi.ajp.2014.13060786 Google Scholar
Domitrovich, C., Cortes, R., & Greenberg, M. (2007). Improving young children's social and emotional competence: A randomized trial of the preschool ‘PATHS’ curriculum. The Journal of Primary Prevention, 28, 67–91. doi:10.1007/s10935-007-0081-0 Google Scholar
Durlak, J., Weissberg, R., Dymnicki, A., Taylor, R., & Schellinger, K. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405–432. doi:10.1111/j.1467-8624.2010.01564.x Google Scholar
Eurostat. (2012). Key data on education 2012. Brussels: Education, Audiovisual and Culture Executive Agency.Google Scholar
Ferreira, C., & Rocha, A. (2004). BAS-3: Bateria de Socialização (Auto-Avaliação). Lisboa, Portugal: CEGOC.Google Scholar
Finn, J.D., Panozzo, G.M., & Achilles, C.M. (2003). The ‘why's’ of class size: Student behavior in small classes. Review of Educational Research, 73, 321–368. doi:10.3102/00346543073003321 Google Scholar
Fontaine, A.M. (1991). Desenvolvimento do conceito de si próprio e realização escolar na adolescência. Psychologica, 5, 13–31.Google Scholar
Hahn, R., Fuqua-Whitley, D., Wethington, H., Lowy, J., Crosby, A., Fullilove, M., . . . Dahlberg, L. (2007). Effectiveness of universal school-based programs to prevent violent and aggressive behavior: A systematic review. American Journal of Preventive Medicine, 33 (Suppl. 1), S114–S129. doi:10.1016/j.amepre.2007.04.012 Google Scholar
Hardré, P.L., Sullivan, D.W., & Crowson, H.M. (2009). Student characteristics and motivation in rural high schools. Journal of Research in Rural Education, 24 (16).Google Scholar
Heck, R.H., Thomas, S.L., & Tabata, L.N. (2013). Multilevel and longitudinal modeling with IBM SPSS (2nd ed.). London, UK: Routledge; 2013.CrossRefGoogle Scholar
Humphrey, N., Kalambouka, A., Lendrum, A., Wigelsworth, M., Lennie, C., & Farrell, P. (2010). New beginnings: Evaluation of a short social–emotional intervention for primary-aged children. Educational Psychology, 30, 513–532.Google Scholar
Jones, S.M., Brown, J.L., & Aber, J.L. (2011). Two-year impacts of a universal school-based social-emotional and literacy intervention: An experiment in translational developmental research. Child Development, 82, 533–554. doi:10.1111/j.1467-8624.2010.01560 Google Scholar
Kimber, B., & Sandell, R. (2009). Prevention of substance use among adolescents through social and emotional training in school: A latent-class analysis of a five-year intervention in Sweden. Journal of Adolescence, 32, 1403–1413. doi:10.1016/j.adolescence, 2009.10.005 Google Scholar
Klem, A., & Connell, J. (2004). Relationships matter: Linking teacher support to student engagement and achievement. Journal of School Health, 74, 262–273. doi:10.1111/j.1746-1561.2004.tb08283.x Google Scholar
Marsh, H.W., Relich, J.D., & Smith, I.D. (1983). Self-concept: The construct validity of interpretations based upon SDQ. Journal of Personality and Social Psychology, 45, 173–187. doi:10.1037/0022-3514.49.5.1360 Google Scholar
McCoy, D.C., Morris, P.A., Connors, M.C., Gomez, C.J., & Yoshikawa, H. (2016). Differential effectiveness of Head Start in urban and rural communities. Journal of Applied Developmental Psychology, 43, 29–42.Google Scholar
Nansel, T.R., Overpeck, M., Pilla, R.S., Ruan, W.J., Simons-Morton, B., & Scheidt, P. (2001). Bullying behaviors among US youth: Prevalence and association with psychosocial adjustment. Journal of the American Medical Association, 285, 2094–2100.Google Scholar
Olweus, D. (1993). Bullying at school. Oxford and Cambridge: Blackwell.Google Scholar
Rivers, S.E., Brackett, M.A., Reyes, M.R., Elbertson, N.A., & Salovey, P. (2012). Improving the social and emotional climate of classrooms: A clustered randomized controlled trial testing the RULER approach. Prevention Science, 14, 77–87. doi:10.1007/s11121-012-0305-2.Google Scholar
Schonert-Reichl, K.A., Smith, V., Zaidman-Zait, A., & Hertzman, C. (2012). Promoting children's prosocial behaviors in school: Impact of the ‘Roots of Empathy’ program on the social and emotional competence of school-aged children. School Mental Health, 4, 1–21. doi:10.1007/s12310-011-9064-7 Google Scholar
Shapiro, J., Burgoon, J., Welker, C., & Clough, J. (2002). Evaluation of the Peacemakers program: School-based violence prevention for students in grade through eight. Psychology in the Schools, 39, 87–100. doi:10.1002/pits.10040 Google Scholar
Silva, F., & Martorell, M.C. (1989). BAS-3 - Batería de Socialización. Madrid, Spain: TEA.Google Scholar
Sklad, M., Diekstra, R., DeRitter, M., Ben, J. & Gravesteijn, C. (2012). Effectiveness of school-based universal social, emotional, and behavioral programs: Do they enhance students’ development in the area of skill, behavior and adjustment? Psychology in the Schools, 49, 892–909. doi:10.1002/pits.216412.Google Scholar
Taylor, R.D., Oberle, R., Durlak, J.A., & Weissberg, R.P. (2017). Promoting positive youth development through school-based social and emotional learning interventions: A meta-analysis of follow-up effects. Child Development, 88, 1156–1171. doi:10.1111/cdev.12864 Google Scholar
U.S. Department of Health and Human Services. (2005). National survey of children's health 2003. Rockville, MD: Author.Google Scholar
Weissberg, R.P., Durlak, J.A., Domitrovich, C.E., & Gullotta, T.P. (2015). Social and emotional learning: Past, present, and future. In Durlak, J.A., Domitrovich, C.E., Weissberg, R.P., & Gullotta, T.P. (Eds.), Handbook of social and emotional learning: Research and practice (pp. 3–19). New York, NY: Guilford.Google Scholar
Wigelsworth, M., Humphrey, N., Lendrum, A., & Kalambouka, A. (2010). A review of key issues in the measurement of children's social and emotional skills. Educational Psychology in Practice, 26, 173–186. doi:10.1080/02667361003768526 Google Scholar
Wigelsworth, M., Lendrum, A., Oldfield, J., Scott, A., tenBokkel, I., Tate, K., & Emery, C. (2016). The impact of trial stage, developer involvement and international transferability on universal social and emotional learning programme outcomes: A meta-analysis. Cambridge Journal of Education, 46, 347–376. doi:10.1080/0305764X.2016.1195791 Google Scholar