1-6 of 6 Results

  • Keywords: systematic review x
Clear all

Article

An Analysis of COVID-19 Student Learning Loss  

Harry Patrinos, Emiliana Vegas, and Rohan Carter-Rau

The coronavirus disease 2019 (COVID-19) pandemic led to school closures around the world, affecting almost 1.6 billion students. This caused significant disruption to the global education system. Even short interruptions in a child’s schooling have significant negative effects on their learning and can be long lasting. The capacities of education systems to respond to the crisis by delivering remote learning and support to children and families have been diverse and uneven. In response to this disruption, education researchers are beginning to analyze the impact of these school closures on student learning loss. The term learning loss is commonly used in the literature to describe declines in student knowledge and skills. Early reviews of the first wave of lockdowns and school closures suggested significant learning loss in a few countries. A more recent and thorough analysis of recorded learning loss evidence documented since the beginning of the school closures between March 2020 and March 2022 found even more evidence of learning loss. In 36 identified robust studies, the majority identified learning losses that amount to, on average, 0.17 of a standard deviation (SD), equivalent to roughly a one-half school year’s worth of learning. This confirms that learning loss is real and significant and has continued to grow after the first year of the COVID-19 pandemic. Most studies observed increases in inequality where certain demographics of students experienced more significant learning losses than others. The longer the schools remained closed, the greater were the learning losses. For the 19 countries for which there are robust learning loss data, average school closures were 15 weeks, leading to average learning losses of 0.18 SD. Put another way, for every week that schools were closed, learning declined by an average of 0.01 SD. However, there are also outliers—countries that managed to limit the amount of loss. In Nara City, Japan, for example, the initial closures had brought down test scores, but responsive policies largely overcame this decline. In addition, a decreased summer vacation helped. In Denmark, children received good home support and their reading behavior improved significantly. In Sweden, where primary schools did not close during the pandemic, there were no reported learning losses. Further work is needed to increase the quantity of studies produced, particularly in low- and middle-income countries, and to ascertain the reasons for learning loss. Finally, the few cases where learning loss was mitigated should be further investigated to inform continued and future pandemic responses.

Article

Systematic Reviews and Meta-Analyses of Crime Prevention Evaluations  

Anthony Petrosino, Claire Morgan, and Trevor Fronius

Systematic reviews and meta-analyses have become a focal point of evidence-based policy in criminology. Systematic reviews use explicit and transparent processes to identify, retrieve, code, analyze, and report on existing research studies bearing on a question of policy or practice. Meta-analysis can combine the results from the most rigorous evaluations identified in a systematic review to provide policymakers with the best evidence on what works for a variety of interventions relevant to reducing crime and making the justice system fairer and more effective. The steps of a systematic review using meta-analysis include specifying the topic area, developing management procedures, specifying the search strategy, developing eligibility criteria, extracting data from the studies, computing effect sizes, developing an analysis strategy, and interpreting and reporting the results. In a systematic review using meta-analysis, after identifying and coding eligible studies, the researchers create a measure of effect size for each experimental versus control contrast of interest in the study. Most commonly, reviewers do this by standardizing the difference between scores of the experimental and control groups, placing outcomes that are conceptually similar but measured differently (e.g., such as re-arrest or reconviction) on the same common scale or metric. Though these are different indices, they do measure a program’s effect on some construct (e.g., criminality). These effect sizes are usually averaged across all similar studies to provide a summary of program impact. The effect sizes also represent the dependent variable in the meta-analysis, and more advanced syntheses explore the role of potential moderating variables, such as sample size or other characteristics related to effect size. When done well and with full integrity, a systematic review using meta-analysis can provide the most comprehensive assessment of the available evaluative literature addressing the research question, as well as the most reliable statement about what works. Drawing from a larger body of research increases statistical power by reducing standard error; individual studies often use small sample sizes, which can result in large margins of error. In addition, conducting meta-analysis can be faster and less resource-intensive than replicating experimental studies. Using meta-analysis instead of relying on an individual program evaluation can help ensure that policy is guided by the totality of evidence, drawing upon a solid basis for generalizing outcomes.

Article

Experimental and Intervention Studies of Couples and Family Planning in Low- and Middle-Income Countries: A Systematic Review  

Stan Becker and Dana Sarnak

The vast majority of births in the world occur within marriages or stable partnerships. Yet family planning programs have largely ignored the male partner. One justification for this nearly exclusive focus on women has been that almost all of the modern contraceptive methods are female-oriented. In contrast, studies of fertility preferences within couples that included a later follow-up have shown that men’s fertility preferences are important for predicting subsequent births. Interspousal communication can be key to resolving differences in desired family size and for promoting open contraceptive use. Experimental studies with couples on family planning education and/or counseling show higher contraceptive prevalence or continuation in the couples groups than in the women-only groups, though the differences are not always significant statistically. Other intervention studies have varying designs and mixed results. The purpose of this systematic review is to summarize the research findings on interventions with couples on reproductive health from experimental and pre–post observational studies. An important conclusion is that couples education and counseling are critical components for involving male partners. There is a need for systematic research on couples using a standardized intervention and fixed follow-up times and including analyses of cost-effectiveness.

Article

A Review of the Validity of Juvenile Risk Assessment Across Race/Ethnicity  

Christina Campbell and William Miller

Juvenile risk assessment instruments have provided juvenile courts with the opportunity to make standardized decisions concerning sentences and intervention needs. Risk assessments have replaced the reliance on professional decision-making practices in which court officials relied on their hunches or previous experience to determine what to do with youth once they became involved in corrections. A primary goal of juvenile risk assessment is to improve case management and help courts focus resources on juveniles who exhibit the greatest intervention needs. Further, juvenile risk assessments play a critical role in estimating which juveniles will likely reoffend by identifying factors that increase the propensity of future offending. Although some researchers believe that the implementation of standardized juvenile risk assessments is a good strategy for reducing biased decision-making for racial/ethnic minorities, other researchers have called into question the extent to which risk assessments overestimate risk for certain juveniles, especially those in minority groups who have a history of being marginalized due to their race, culture, or ethnicity. This article provides an overview of how well juvenile risk assessment instruments predict future delinquency across race and ethnicity. The review suggests that in general, risk assessments do a good job in predicting recidivism across racial/ethnic groups for diverse populations inside and outside the United States. However, there is still some room for improvement concerning the assessment of risk and needs for ethnic minorities. In addition, while there are some studies that do not report the predictive validity of risk assessment scores across race/ethnicity, risk assessments overall seem to be a promising effort to correctly classify and/or identify juveniles who are at greatest risk for future recidivism.

Article

Social Interactions in Health Behaviors and Conditions  

Ana Balsa and Carlos Díaz

Health behaviors are a major source of morbidity and mortality in the developed and much of the developing world. The social nature of many of these behaviors, such as eating or using alcohol, and the normative connotations that accompany others (i.e., sexual behavior, illegal drug use) make them quite susceptible to peer influence. This chapter assesses the role of social interactions in the determination of health behaviors. It highlights the methodological progress of the past two decades in addressing the multiple challenges inherent in the estimation of peer effects, and notes methodological issues that still need to be confronted. A comprehensive review of the economics empirical literature—mostly for developed countries—shows strong and robust peer effects across a wide set of health behaviors, including alcohol use, body weight, food intake, body fitness, teen pregnancy, and sexual behaviors. The evidence is mixed when assessing tobacco use, illicit drug use, and mental health. The article also explores the as yet incipient literature on the mechanisms behind peer influence and on new developments in the study of social networks that are shedding light on the dynamics of social influence. There is suggestive evidence that social norms and social conformism lie behind peer effects in substance use, obesity, and teen pregnancy, while social learning has been pointed out as a channel behind fertility decisions, mental health utilization, and uptake of medication. Future research needs to deepen the understanding of the mechanisms behind peer influence in health behaviors in order to design more targeted welfare-enhancing policies.

Article

A Systematic Meta-Review of Internet-Based Cognitive Behavioral Therapy (ICBT)  

Quincy J. J. Wong, Alison L. Calear, and Helen Christensen

Internet-based cognitive behavioral therapy (ICBT) is the provision of cognitive behavioral therapy (CBT) using the Internet as a platform for delivery. The advantage of ICBT is its ability to overcome barriers to treatment associated with traditional face-to-face CBT, such as poor access, remote locations, stigmas around help-seeking, the wish to handle the problem alone, the preference for anonymity, and costs (time and financial). A large number of randomized controlled trials (RCTs) have tested the acceptability, efficacy, and cost-effectiveness of ICBT for anxiety disorders, mood disorders, and associated suicidality. A meta-review was conducted by searching PsycINFO and PubMed for previous systematic reviews and meta-analyses of ICBT programs for anxiety, depression, and suicidality in children, adolescents, and adults. The results of the meta-review indicated that ICBT is effective in the treatment and prevention of mental health problems in adults and the treatment of these problems in youth. Issues of adherence and privacy have been raised. However, the major challenge for ICBT is implementation and uptake in the “real world.” The challenge is to find the best methods to embed, deliver, and implement ICBT routinely in complex health and education environments.