Improving the academic performance of at-risk high school students has proven difficult, often calling for an extended day, extended school year, and other expensive measures. Here we report the results of a program for at-risk 9th and 10th graders in Binghamton, New York, called the Regents Academy that takes place during the normal school day and year. The design of the program is informed by the evolutionary dynamics of cooperation and learning, in general and for our species as a unique product of biocultural evolution. Not only did the Regents Academy students outperform their comparison group in a randomized control design, but they performed on a par with the average high school student in Binghamton on state-mandated exams. All students can benefit from the social environment provided for at-risk students at the Regents Academy, which is within the reach of most public school districts.
Citation: Wilson DS, Kauffman RA Jr, Purdy MS (2011) A Program for At-Risk High School Students Informed by Evolutionary Science. PLoS ONE 6(11): e27826. https://doi.org/10.1371/journal.pone.0027826
Editor: Robert DeSalle, American Museum of Natural History, United States of America
Received: August 19, 2011; Accepted: October 26, 2011; Published: November 16, 2011
Copyright: © 2011 Wilson et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Improving the performance of at-risk students is difficult at any age, but especially for at-risk teenagers, whose life challenges, personal habits, and social networks are often firmly entrenched , . The problems posed by age are illustrated by the Promise Academy, a school associated with the Harlem Children's Zone, which started in 2004 with an incoming 1st grade and 6th grade class . The students were selected by lottery, so they represented an at-risk community but not necessarily the most at-risk students within the community. Intensive efforts to improve academic performance, based on the same educational principles, succeeded for the 1st graders but failed for the 6th graders. The Promise Academy has since improved its success with the older students, but only with an intensive effort that includes an extended day, extended school year, meal and healthcare programs, and so on . Other successful school programs for at-risk teenagers are similarly intensive (e.g., –).
Here we report a program for at-risk 9th and 10th graders in Binghamton, New York called the Regents Academy (RA). Students must have failed at least three of five courses during their previous year to qualify for the program, so they represent the most at-risk students within the community of Binghamton, rather than students selected by lottery from an at-risk community. The program is self-contained, with its own principal and teaching staff, and the cost per student is slightly greater than for the regular high school, but it takes place during the normal school day and year and similar programs are feasible for most public school districts. We present the results from the first year of the program, where RA students not only performed better than a comparison group that experienced the normal high school routine in a randomized control design, but they performed on a par with the average high school student.
Using Evolutionary Science to Inform Educational Practice
Educational practices are informed by a variety of formal theories and informal rationales that are poorly integrated with each other –. The principles that inform the Regents Academy begin with the fact that schools are social groups whose members must cooperate with each other to achieve certain objectives. To design a successful school environment, it is important to understand how any social group achieves shared objectives, whatever they might be. In other words, educational practice must draw upon general theories of human social behavior.
The last few decades have witnessed a renaissance of theory and research on human social behavior , . Many academic disciplines have taken part, but they converge upon three facts. First, the problem of how to cooperate to achieve shared goals is not restricted to the human species. It is encountered throughout nature. We must understand cooperation as a general evolutionary problem before we can properly understand it in our own species . Economics has contributed to this synthesis as much as evolutionary biology, especially through the development of evolutionary game theory (e.g., , ).
Second, the human capacity for cooperation is based on our own evolutionary history, in addition to general evolutionary principles. We are uniquely cooperative among primates and unique among all species in our ability to cooperate among unrelated individuals. These distinctive abilities evolved by biocultural evolution, based on certain selective pressures, and resulted in a complex array of psychological mechanisms, including many that take place beneath conscious awareness. Our species-typical abilities to cooperate must be understood from both an ultimate (functional) and proximate (mechanistic) evolutionary perspective –.
Third, knowledge derived from general evolutionary principles and our own evolutionary history can be used to enhance cooperation in real-world situations, such as a program for at-risk high school students. There is nothing static about cooperation. It succeeds under some environmental conditions and fails under others. We therefore evolved to be highly conditional in our willingness to cooperate with others, based on both conscious and unconscious psychological mechanisms. Since we are a cultural species that lives largely in a physical and mental world of our own making, we have tremendous latitude to construct social environments that favor cooperation as an evolutionarily successful strategy—but only if we make use of our knowledge .
One body of knowledge that we drew upon to design the Regents Academy is based on the work of Elinor Ostrom , , who received the Nobel Prize for economics in 2009. Ostrom is a political scientist by training but has become part of the evolutionary science community. Working primarily with groups attempting to manage common pool resources, she identified eight design features that contributed to the success of each group, which can also be used by groups attempting to achieve other shared objectives. Briefly, the design features are: 1) a strong group identity, including understanding and agreeing with the group's purpose; 2) benefits proportional to costs, so that the work does not fall unfairly on some individuals and unearned benefits on others; 3) consensus decision-making, since most people dislike being told what to do but will work hard to achieve their own goals; 4) low-cost monitoring, so that lapses of cooperation can be easily detected; 5) graduated sanctions to correct misbehaviors, which begin with friendly reminders and escalate only as needed; 6) conflict resolution that is fast and perceived as fair by group members; 7) sufficient autonomy for the group to make its own decisions without interference from other groups; 8) relations among groups that embody the same principles as the relations among individuals within the group. These design features are consilient with the general evolutionary dynamics of cooperation and the social environment of small-scale human societies throughout our own history as a species. Any educational program, including one for at-risk high school students, can potentially benefit from implementing these design features.
A second body of knowledge that we drew upon concerns development and psychological functioning, e.g., in benign vs. harsh environments –. The dysfunctions that arise from harsh environments are often interpreted as breakdowns of normal development and psychological functioning. While this is sometimes the case, evolutionary science offers an alternative possibility. Humans, like all species, are adapted to cope with harsh environments, but these adaptations involve tradeoffs with respect to long-term individual welfare and conduct toward others. Learning and cooperation to achieve long-term goals are eclipsed by the need to survive and reproduce over the short term. Some adaptations to harsh environments operate early in life and are difficult to reverse, such as the insecure attachment styles first documented by pioneering evolutionary psychologist John Bowlby , which has led to an extensive body of recent research . Other mechanisms operate in response to immediate circumstances and can be modified by providing a safer and more secure environment , . Most at-risk adolescents have experienced hardship throughout their lives, making it difficult for them to adapt to a safe and secure environment. Moreover, even if such an environment can be provided at school, the rest of their lives often remain harsh. Providing a safe and secure school environment might therefore not be sufficient, but it is surely necessary for at-risk students to cooperate and to achieve long-term goals.
A third body of knowledge that we drew upon concerns basic principles of learning that apply to many species , along with more specific adaptations for learning and cultural transmission in human groups , –. In a longitudinal study of students who were identified as gifted at the beginning of high school, Csikszentmihalyi et al.  examined the factors that led some to fulfill their promise and others to become merely average by the end of high school. It was primarily those who enjoyed what they were doing over the short term that developed their talents. The prospect of a long-term benefit, such as a career in science, was not sufficient to sustain day-to-day activities that were unrewarding. If this is true for the most gifted students, then it applies with even greater force for the most at-risk students . If cooperation and learning outcomes aren't rewarding over the short term (what B.F. Skinner called “selection by consequences” ), positive outcomes cannot be expected over the long term. In addition, human groups evolved adaptations for social learning and spreading information for thousands of years before the advent of any formal school program. In modern times, complex bodies of information are culturally transmitted in hunter gatherer and many traditional societies largely without formal instruction . Knowing how this occurs can help teachers shape their curriculum, instruction, and assessment to better maximize their students' natural tendencies to learn, and to make learning and teaching more spontaneous and self-organizing in modern classroom environments , .
Implementing the Design Features
It is important to distinguish between the functional design of a program and the implementation of the design in a real-world situation. Every design feature, such as creating a group identity, can be implemented in a number of ways, and the implementation that works best often depends upon local circumstances. In Ostrom's work on common pool resource groups, she was unable to predict performance outcomes in an analysis based on specific implementations, but she was able to predict performance outcomes in an analysis based on the presence or absence of design features . The reason is easy to understand: if a particular design feature can be implemented in many ways, then the correlation between any single implementation and a successful outcome will be weak. When they are recognized as implementations of the same design feature, the correlation between the implementation of the design feature and a successful outcome can be strong.
Table 1 lists some ways that we attempted to implement the design features outlined in the previous section (for cooperative groups, psychological functioning in design vs. harsh environments, and basic principles of learning). Briefly, making the RA a self-contained program with its own principal, teaching staff and physical location helped to give it a group identity and provided a large degree of autonomy. Every effort was made to create a safe and nurturing environment. Students were consulted to establish the norms and practices of the school as much as possible. The principal was a large presence in the lives of the students, as a caring individual who also quickly enforced the rules. Short-term incentives were provided for cooperating and learning. Basic skills were taught to make up for the deficit of previous years. The schedule was designed to balance work with play to keep the school day enjoyable and to learn in the context of play. The material taught included, but did not obsessively focus upon, the state-mandated Regent exams. Parents and guardians of the students were engaged as much as possible, especially to praise the students for their positive performance.
Of the 117 9th and 10th graders who qualified for the RA by failing three or more courses during the previous year, 56 were randomly chosen to enter the program and the others were tracked as they experienced the normal routine at Binghamton's single high school (BHS). For all participants, the school district provided year in school, sex, ethnicity, class grades, Regents exam scores, and attendance records. All students were in either 9th (Freshman) or 10th grade (Sophomores) so year in school was coded as a dichotomous variable (“1” = Sophomore); sex was coded as a dichotomous variable (“1” = Female); and as BHS does not differentiate between Whites and Hispanics, and both the RA and comparison group were composed entirely of Blacks and Whites, ethnicity was coded as a dichotomous variable (“1” = Black); school attended (Regents Academy or Comparison Group) was coded as a dichotomous variable (“1” = Regents Academy).
The outcome variables included quarterly grades in each core subject (math, science, English, and global studies) and the grades for all state-mandated Regents exams taken by the students at the end of the year, which include Algebra, Living Environment, Comprehensive English, and Global Studies. The Algebra and Living Environment exams were taken by all 9th grade students and by the 10th graders who had failed the exams during the previous year. English and Global Studies were taken by 10th graders only. Class grades and exam scores range from 0 to 100. Class grades are not strictly comparable because the RA students and comparison group experienced different curricula and the grading standards might have been different. Regents exam grades therefore provide a more rigorous basis of comparison and are provided for the Binghamton High school as a whole in addition to the RA students and the comparison group.
It was not possible to assess each component of the RA, especially during its first year when the best implementations of the design features were being worked out. We do have preliminary data on the effects of absenteeism and a “fun club,” designed to engage the interests of the RA students, on academic performance (quarter averages). Absence rates were calculated as the sum of classes missed during the third and fourth quarters; participation in fun club was coded as a dichotomous variable (“1” = Participated in Fun Club).
We use an alpha level of 0.05 for all statistical tests. All missing data were excluded listwise from the analysis; running the analysis with imputed data did not affect the results. Three RA students and four BHS students in the comparison group were excluded from the analysis because they left partway through the year to attend an alternative education program (e.g. home schooling or BOCES, a trade-school alternative program); final N = 110.
Two RA and ten BHS students in the comparison group dropped out of school during the year, a difference that was statistically significant (χ2110 = 5.06, p = .024). Drop-outs were excluded from further analysis.
For the students who completed the school year, grades in the different class subjects were not significantly different within either the RA or BHS comparison groups (2×4 ANOVA, F(3, 378) = 2.29, p = .078), so we report the combined grade point averages as our outcome variable. Quarterly scores were used to calculate cumulative grade point averages, with the fourth quarter cumulative grade (i.e., the final average) being the overall performance indicator for the year. Table 2 displays the results of a sequential regression, analyzing the effects of demographic predictors (year in school, sex, and ethnicity), then treatment group, and then absence rate on student performance. Grade level, sex, and ethnicity did not significantly predict cumulative averages in any of the models (see table for values). An analysis of variance showed there to be no interaction between school (RA or BHS comparison group) and grade level (F(1,81) = 1.15, p = .287), sex (F(1,81)<.01, p = .949), or ethnicity (F(1, 81) = 2.70, p = .104) on cumulative averages, therefore, the average scores of 9th and 10th graders, males and females, and black and white students were not significantly different in either the RA or BHS comparison group.
Adding school to the model resulted in the significant prediction of cumulative averages (R2 = .628 (R2 change = 0.610), F (4, 78) = 32.934, p<.001), where the students in the RA had averages that were 28 points higher than their BHS counterparts (B = 28.09, SE = 2.48, p<.001). This pattern of results suggests that over 60% of the variability in student scores is predicted by whether they were in the RA or comparison group.
Grades during the previous year were not significantly different between the RA (M = 54.97, SD = 17.31) and BHS comparison group (M = 52.58, SD = 15.47), as expected on the basis of the randomized design (Figure 1); t (95) = −.72, p = .476. A large difference emerged by the first quarter and continued throughout the year, resulting in a mean final grade of 78.61 (SD = 12.61) for the RA students and 45.46 (SD = 16.06) for the BHS comparison group, t(95) = 11.345, p<.001. An analysis of GPA for each quarter shows that the highest grades were achieved during the first quarter and declined over the course of the year for both groups.
Grades during the previous year were not significantly different between the RA (M = 54.97, SD = 17.31) and BHS comparison group (M = 52.58, SD = 15.47); t(95) = −7.16, p = .476. Compared to the previous year, Regents Academy students increased their grades during the first quarter (M = 83.58, SD = 10.41; t(41) = −12.791, p <.001) but not the comparison group (M = 52.83, SD = 17.01; t(47) = −.095, p = .925). Grades decline slightly during the rest of the year. For both groups, the differences between the first and second quarter and the third and fourth quarter are statistically significant (paired sample t-test, p<.05).
The regression analysis in Table 2 demonstrates that 9th and 10th graders, boys and girls, and whites and blacks benefitted equally from the RA. Although the Binghamton City School District records do not distinguish Hispanics as an ethnic category, within the RA, Hispanics (M = 84.78, SD = 6.35)) performed as well as other whites (M = 79.63, SD = 12.46) and blacks (M = 76.43, SD = 13.51); F(2,47) = 1.03, p = .366.
The state-mandated Regents exams allow a rigorous comparison between the RA students, their comparison group, and Binghamton High School as a whole. In terms of pass rate, not only did the RA students outperform their comparison group, but they performed on a par with the average BHS student in all subjects (Figure 2: see figure caption for results of chi-square analyses). In terms of numerical grades, the RA students scored lower than the average BHS student in Living Environment (RA: M = 66.83, SD = 10.29; BHS: M = 77.34, SD = 13.09; t(368) = −4.28, p<.001) and Global Studies (RA: M = 59.12, SD = 14.94; BHS: M = 66.85, SD = 16.25; t(432) = −2.37, p = .018), but there was no significant difference in numerical grades for Algebra (RA: M = 67.79, SD = 10.86; BHS: M = 68.83, SD = 11.426; t(345) = −.53, p = .596) and English (RA: M = 75.61, SD = 10.31; BHS: M = 74.79, SD = 14.08; t(361) = .807, p = .807).
Regents Academy (RA) students surpassed the passing rate of the comparison group on all subjects; Algebra: χ2 (1, N = 64) 18.33, p<.001; Living Environment: χ 2 (1, N = 44) = 6.92, p = .017; English: χ 2 (1, N = 31) = 9.19, p = .004; Global Studies: χ 2 (1, N = 38) = 5.22, p = .030). There were no significant differences between the passing rates of RA students and the Binghamton High School (BHS) as a whole; Algebra: χ 2 (1, N = 347) = .195, p = .711; Living Environment: χ 2 (1, 370) = .673, p = .274; English: χ 2 (1, 363) = 1.90, p = .218; Global Studies: χ 2 (1, N = 434) = 1.19, p = .311. Students from the RA were more likely to attend the Global Studies exam than students from both the comparison group (χ 2 (1, 41) = 5.61, p = .043) and BHS (χ 2 (1, 565) = 8.226, p = .001). Attendance rates for the other exams did not differ.
Analysis of Design Components
Although the RA clearly succeeds as a whole program, it was not possible to assess each component, especially during the first year when the best implementations of the design features were being worked out. However, we do have preliminary data on the effects of absenteeism and a “fun club” designed to engage the interests of the RA students.
Figure 3 shows the effect of absenteeism on class grades for both RA students and the BHS comparison group. There is a strong negative correlation between absence rates and grades for both groups, but this does not explain the difference between the groups, since RA students did not have a lower absenteeism rate. When absence rate is entered into the regression model shown in table 1, it accounts for 15.2% of the variance and the total amount of variance explained by the model increases to 78% (R2 = .780, R2 change = .152, F = 54.60, p<.001).
Entering absence rates into the regression model identified attendance to be a predictor of academic performance (β = −.418, t = −7.291, p<.001; R2 = .78, R2 change = .152, F = 54.60, p = .000). While there is a strong negative correlation between absence rates and grades for both schools (r = −.278, n = 83, p = .011), this does not explain the difference between the two groups, since there is no correlation between attendance rate and experimental group (r = .119, p = .286), as RA students (M = 96.91, SD = 60.36) did not miss more classes in the third and fourth quarters than the comparison group (M = 102.19, SD = 77.74); t (86) = −.36, p = .724. Furthermore, controlling for the variability due to absences strengthened the correlation between school and academic success (r = .790, p <.001).
The fun club was initiated after the first quarter at the request of the students, who reported that they frequently couldn't relate to the class material and wanted to do things more closely aligned with their own interests. The teachers agreed to give up half of their class periods every Friday, providing a half-day for a “fun club”. The fact that they could make such a decision illustrates the importance of local autonomy (design principle #7). The students nominated a list of activities, illustrating our effort to include them in consensus decision-making as much as possible (design principle #3). We subsequently created a mosaic art class (thanks to a local artist who volunteered her services) and a “games group”, which provided an opportunity for students to learn how to juggle and play games that taught cognitive skills (offered by the 2nd author of this paper). The school was only able to provide a limited set of extracurricular programs during fun club, allowing some students to engage in activities aligned with their individual interests, while the others used the time to catch up on their work, go to the gym, or socialize.
When these two groups within the Regents Academy are compared (figure 4), they did not differ in their grades during the previous year (t(39) = −0.966, p = 0.340) or first quarter (t(40) = 1.519, p = 0.137), before fun club was implemented, but a widening gap appeared in the second quarter and continued through the rest of the school year (see figure caption for details). The results of this quasi-experiment can be interpreted in a number of ways, but most of the interpretations point to the importance of making the school day fun and relevant to the interests of the students. The students who joined fun club had less time for studying their basic subjects, but earned higher grades for those subjects by virtue of their engagement with school.
These two groups within the Regents Academy did not differ in their grades during the previous year (t(39) = −0.966, p = 0.340) or first quarter (t(40) = 1.519, p = 0.137), before fun club was implemented, but a widening gap appeared in the second quarter and continued through the rest of the school year; Qtr 2: t(40) = 2.37, p = .020; Qtr 3: t(40) = 2.46, p = .017; Qtr 4: t(40) = 3.21, p = .002.
Improving the academic performance of at-risk adolescents seems so difficult that it is sometimes regarded as a lost cause. One possibility is that academic performance has a large genetic basis , , . Another possibility is that deficits that occur early in life are difficult or impossible to reverse . Both of these cases imply that improvement is either impossible or requires heroic effort.
Evolutionary science presents a third possibility: The objective of school is to learn skills that will benefit the individual over the long term and society as a whole. This is a cooperative endeavor. Cooperation is an evolutionary strategy that succeeds under some circumstances and fails under others. Humans evolved to be facultative cooperators. Provide the wrong conditions, and cooperation becomes as difficult as if we had the wrong genes or have become permanently stunted. Provide the right conditions, and it becomes difficult to prevent people from cooperating.
Of course, environmental interventions for increasing the academic performance of at-risk adolescents have been proposed for decades, but they typically don't work , , which is why the problem appears so difficult. None of the design features that make up the RA are unusual, but evolutionary science provides a theoretical framework for bringing them together in a way that led to an unusual degree of success.
It is important to clarify how evolutionary science succeeded in identifying an effective collection of practices, where many other perspectives have failed. All educational practices have a surface logic; otherwise, no one would be tempted to implement them. If students aren't learning their basic subjects, it makes sense to concentrate more on the 3 R's and cut back on activities that seem superfluous, such as play, art, and sports. It seems efficient to create a school environment in which students interact primarily with others of the same age. It makes sense to implement no-touch rules to avoid the problem of sexual harassment. It makes sense to implement practices designed by experts without consulting the students. It makes sense to standardize practices and limit the opportunity of teachers to implement their own strategies. It makes sense to use monetary payment as an incentive to improve grades. It makes sense to quantify school and student performance in the form of test scores. All of these practices have a surface logic, but they don't always lead to positive outcomes. Worse, the unforeseen consequences of the practices are often diffuse and indirect, and therefore difficult to trace back to their source. Another problem with current educational policies is that they originate from many academic disciplines that are poorly integrated with each other. Even successful policies have difficulty spreading beyond their particular disciplinary boundaries.
Most experts who formulate educational policy accept evolution and assume that their ideas are consistent with current evolutionary science. Yet, only a few are actively drawing upon evolutionary science to formulate educational policy. One advantage of an explicitly evolutionary perspective is a single conceptual framework that transcends disciplinary boundaries. Once an educational program for at-risk youth is seen as a group that must cooperate to achieve a certain set of objectives, the general evolutionary dynamics of cooperation and the particular evolutionary history of our species become relevant. Insights from an academic discipline that is seldom associated with education (political science), involving groups that must cooperate to achieve very different objectives (managing common pool resources), become relevant to the general conceptual framework and available for a given application such as a school program for at-risk youth.
Using the general conceptual framework to formulate educational policy does not automatically result in a single set of practices guaranteed to work. Instead, it alters the perception of what appears reasonable or unreasonable. Some current practices continue to make sense but others, such as restricting play, causing children to interact primarily with others of the same age, no-touch rules, and rules imposed without regard to consensus decision-making, begin to appear problematic. New practices, or new combinations of old practices, become reasonable and even obvious in retrospect, although they were obscure from other perspectives. The new ideas that emerge from an explicitly evolutionary perspective are not guaranteed to work. Like all hypotheses, they must be tested in real-world applications. Science is always a dialectic between hypothesis formation and testing, and evolutionary science is no different.
Another insight from evolutionary science is that a well-functioning group is much like a well-functioning organism , . Just as an organism has many organs and will die if any one of them is removed, a well-functioning group has numerous design features and will become dysfunctional if any one of them is removed. An educational program that includes most but not all of the design features is not good enough. This might explain the poor track record of environmental interventions that are not explicitly informed by evolutionary science.
The Regents Academy appears to have all the necessary “organs” to function well as a group. Each design feature makes intuitive sense, and it might seem that evolution isn't required to appreciate their utility—yet, they are frequently lacking in the average American high school social environment, especially from the perspective of at-risk students.
Even we didn't expect the RA to succeed so well that students who failed three or more classes during the previous year performed on a par with the average Binghamton high school student. This suggests an impressive degree of resilience in human development, such that adolescents who experienced hardship for most of their lives can still respond to an appropriately structured environment when it is provided, even for only one aspect of their lives (see also ).
Although the program as a whole was rigorously assessed in a randomized control design, future research will be required to assess its various components. According to the principal and teachers who work daily with the RA students, the most important ingredient is the provision of a safe, caring environment . Once the students begin to regard school as a safe haven, they can switch from “survival” mode to “broaden and build” mode , , even when the rest of their lives remains harsh.
In addition to providing a safe haven, school must also provide short-term rewards for cooperating and learning skills that will be useful over the long term. Most species are extremely poor at learning tasks in which the costs are immediate and the benefits are deferred , . Educational practice must reflect this basic fact about learning. Educational policies that make the school day less rewarding on a day-to-day basis in an effort to teach core skills are likely to backfire. Our results indicate that even half a day per week reserved for fun activities attuned to the students' interests can increase core academic performance.
Attendance had a strong effect on academic performance but does not explain the difference between the RA and comparison group. It is important to stress that attending school is not just a matter of wanting to for many at-risk high school students, who frequently skip school to earn money, care for siblings, and so on. Increasing attendance rate is an important future priority for both the RA and Binghamton High School as a whole.
A few other programs for at-risk high school students appear to have success rates approaching that of the Regents Academy, including the Sudbury Valley School , , Morningside Academy in Seattle ,the Juniper Gardens Projects in Kansas City, Kansas , , a natural randomized-controlled study of London high schools by Rutter et al. (), and a high school version of the Good Behavior Game , which was originally developed for elementary school classes . A review of these programs reveals that they have largely converged on the practices that we have derived from an evolutionary perspective. These programs have not been widely copied, despite the fact that they work. Providing a general theoretical framework for why they work can help best practices spread faster.
The per student cost of the RA is slightly greater than for the average Binghamton high school student, but well within reach of the average public school district, especially when such positive outcomes can be expected. Indeed, the total societal benefit/cost ratio of a program that increases the academic performance of at-risk teenagers, measured in financial or any other terms, would be huge. In addition, the same design features that work for at-risk students can enhance the educational environment for all students. The limiting factor is not money but the lack of a clear sense of what to do. Evolutionary science can provide the entire field of education with a clearer sense of how to better manage the learning environment.
We thank the Binghamton City School District for the opportunity to advise the Regents Academy and its IT staff for providing data for our analysis. We thank Sally O'Malley and the RA teachers, Jamie Ash, Alvin Delgado, Mark Fish, and Carolyn Wilczynski, for their talents and dedication to the program. The evolutionary science that was used to inform the RA was developed by the Evolution Institute (http://evolution-institute.org/), including a workshop on education held in 2008 and additional contributions by Tony Biglan, Bruce Ellis, Dennis Embry, and Peter Gray. Daniel T. O'Brien consulted on both the design of the program and statistical analysis. Susan Seibold-Simpson consulted on statistical analysis. Jim DeVona and other members of EvoS, Binghamton University's evolutionary studies program, provided important conceptual and logistic support. Special thanks to Emily Jablon for volunteering to teach the fun club's mosaic art class. Most of all, we thank the students of the RA for having faith in the RA and themselves.
Conceived and designed the experiments: DSW RAK MSP. Performed the experiments: RAK MSP. Analyzed the data: DSW RAK. Contributed reagents/materials/analysis tools: DSW RAK MSP. Wrote the paper: DSW RAK.
- 1. Montague M, Enders C, Cavendish W, Castro M (2011) Academic and behavioral trajectories for at-risk adolescents in urban schools. Behav Disorders 36(2): 141–156.
- 2. Somers CL, Owens D, Piliawsky M (2009) A study of high school dropout prevention and at-risk ninth graders: Role models and motivations for school completion. Education 130(2): 348.
- 3. Tough P (2008) Whatever it takes: Geoffrey Canada's quest to change Harlem and America. Boston: Mariner Books. 310 p.
- 4. Whitehurst GJ, Croft M (2010) The Harlem Children's Zone, promise neighborhoods, and the broader, bolder approach to education. Brown Center on Education Policy at Brookings. Available: http://www.brookings.edu/reports/2010/0720_hcz_whitehurst.aspx. Accessed 2011 Aug 18.
- 5. Angrist JD, Dynarski SM, Kane TJ, Pathak PA, Walters CR (2010) Who benefits from KIPP? NBER Working Paper 15740. Available: http://www.nber.org/papers/w15740.pdf. Accessed 2011 Aug 18.
- 6. Henig JR (2008) What do we know about the outcomes of KIPP schools? East Lansing: Great Lakes Center for Education Research and Practice. 26 p.
- 7. Hoagwood KE, Olin SS, Kerker BD, Kratochwill TR, Crowe M, et al. (2007) Empirically based school interventions target at academic and mental health functioning. J Emot Behav Disord 15: 66–94.
- 8. Wilson DS, Lieberman J, Berch DB, Biglan A, Bjorklund DF, et al. (2009) Learning from mother nature about teaching our children: Ten simple truths about childhood education from an evolutionary perspective. Available: http://evolution-institute.org/files/Ten-Truths-Aug-27-2009.pdf. Accessed 2011 Aug 18.
- 9. Hart LA (1975) The assault on the brain called education. In: Hart LA, editor. How the Brain Works: A New Understanding of Human Learning, Emotion, and Thinking. New York: Basic Books, Inc. pp. 198–216.
- 10. Doran RL (1974) Hammer or sponge? TST 41(2): 34–35.
- 11. Gintis H, Bowles S, Boyd R, Fehr E, editors. (2005) Moral sentiments and material interests: The foundations of cooperation in economic life. Cambridge: MIT Press. 416 p.
- 12. Wilson DS (2011) The neighborhood project: Using evolution to improve my city, one block at a time. New York: Little, Brown. 448 p.
- 13. Wilson DS, Wilson EO (2007) Rethinking the theoretical foundation of sociobiology. Q Rev Biol 82: 327–348.
- 14. Bowles S (2003) Microeconomics: Behavior, institutions, and evolution. Princeton: Princeton University Press. 608 p.
- 15. Gintis H (2009) Game theory evolving. Princeton, NJ: Princeton University Press. 408 p.
- 16. Richerson PJ, Boyd R (2005) Not by genes alone: How culture transformed human evolution. Chicago: University of Chicago Press. 332 p.
- 17. Jablonka E, Lamb MJ (2006) Evolution in four dimensions: Genetic, epigenetic, behavioral, and symbolic variation in the history of life. Cambridge, MA: MIT Press. 472 p.
- 18. Tomasello M (2009) Why we cooperate. Boston: MIT Press. 112 p.
- 19. Ostrom E (1990) Governing the commons: The evolution of institutions for collective action. Cambridge, UK: Cambridge University Press. 298 p.
- 20. Ostrom E (2005) Understanding institutional diversity. Princeton: Princeton University Press. 376 p.
- 21. Ellis BJ, Figueredo AJ, Brumbach BH, Schlomer GL (2009) Fundamental dimensions of environmental risk: The impact of harsh versus unpredictable environments on the evolution and development of life history strategies. Hum Nature-Int Bios 20: 204–268.
- 22. Ellis BJ, Del Guidice M, Dishion TJ, Figueredo AJ, Gray P, et al. (2011) Evolution and risky adolescent behavior. Dev Psychol. In press.
- 23. Belsky J (2010) Childhood experience and the development of reproductive strategies. Psicothema 22: 28–34.
- 24. Bowlby J (1969) Attachment: Attachment and loss, vol. 1. New York: Basic Books. 428 p.
- 25. Ellis BJ, Bjorklund DF, editors. (2005) Origins of the social mind: Evolutionary psychology and child development. New York: Guilford Press. 540 p.
- 26. Biglan A, Brennan PA, Foster SL, Holder HD, Miller TL, et al., editors. (2004) Helping adolescents at risk: Prevention of multiple problem behaviors. New York: Guilford. 318 p.
- 27. Frederickson BL (2009) Positivity: Top-notch research reveals the 3 to 1 ratio that will change your life. New York: Three Rivers Press. 288 p.
- 28. Staddon JER (1983) Adaptive behavior and learning. Cambridge, UK: Cambridge University Press. 572 p.
- 29. Nisbett RE (2009) Intelligence and how to get it: Why schools and cultures count. New York: W. W. Norton & Company. 304 p.
- 30. Hayes SC, Barnes-Holmes D, Roche B, editors. (2001) Relational frame theory: A post-Skinnerian account of human language and cognition. New York: Springer. 285 p.
- 31. Berch DB (2007) Instructing evolved minds: Pedagogically primary strategies for promoting biologically secondary learning. In: Carlson JS, Levnin JR, editors. Educating the Evolved Mind: Vol. 2, Psychological Perspectives on Contemporary Educational Issues. Greenwich: Information Age. pp. 109–118.
- 32. Geary DC (2007) Educating the evolved mind: Conceptual foundations for an evolutionary educational psychology. In: Carlson JS, Levin JR, editors. Educating the Evolved Min: Vol. 2, Psychological Perspectives on Contemporary Educational Issue. Greenwich: Information Age. pp. 1–99.
- 33. Bjorklund DF, Bering JM (2002) The evolved child: Applying evolutionary developmental psychology to modern schooling. Learn Individ Differ 12: 347–373.
- 34. Bjorklund DF (2007) The most educable of animals. In: Carlson JS, Levin JR, editors. Educating the Evolved Min: Vol. 2, Psychological Perspectives on Contemporary Educational Issues. Greenwich: Information Age. pp. 119–129.
- 35. Csikszentmihalyi M, Rathunde K, Whalen S (1993) Talented teenagers: The roots of success and failure. Cambridge: Cambridge University Press. 320 p.
- 36. Finn JD (1993) School engagement and students at risk. Washington DC: National Center for Education Statistics. 103 p.
- 37. Skinner BF (1981) Selection by consequences. Science 213(4507): 501–504.
- 38. Gray P (2009) Play as the foundation for hunter-gatherer social existence. Am J Play 1: 476–522.
- 39. Gray P, Chanoff D (1986) Democratic schooling: What happens to young people who have charge of their own education? Am J Educ 94: 182–213.
- 40. Gray P, Feldman J (2004) Playing in the zone of proximal development: Qualities of self-directed age mixing between adolescents and young children at a democratic school. Am J Educ 110: 108–145.
- 41. Herrnstein R, Murray C (1994) The bell curve: Intelligence and class structure in american life. New York: Free Press. 912 p.
- 42. Murray C (2007) Intelligence in the classroom. Wall Street Journal 18: Available: http://www.opinionjournal.com/extra/?id=110009531. Accessed 2011 Aug.
- 43. Mooney CG (2009) Theories of attachment: An introduction to Bowlby, Ainsworth, Gerber, Brazelton, Kennell, and Klaus. St. Paul: Redleaf Press. 120 p.
- 44. Yoon JS (2002) Teacher characteristics as predictors of teacher-student relationships: Stress, negative affect, and self-efficacy. Soc Behav Personal 30: 485–493.
- 45. Kok DE, Catalino LI, Frederickson BL (2008) The broadening, building, buffering effects of positive emotions. In: Lopez SJ, editor. Positive psychology: exploring the best of people: Vol 3 Capitalizing on the emotional experiences. Westport: Greenwood. pp. 1–19.
- 46. Stephens DW, Anderson D (2001) The adaptive value of preference for immediacy: When short-sighted rules have far-sighted consequences. Behav Ecol 12: 330–339.
- 47. Stephens JR, Stephens DW (2009) The adaptive nature of impulsivity. In: Madden GJ, Bickel WK, editors. Impulsivity: The behavioral and neurological science of discounting. Washington, DC: American Psychological Association. 456 p.
- 48. Johnson K (1997) Morningside academy. BSI 7: 31–35.
- 49. Greenwood CR (1991) Classwide peer tutoring: Longitudinal effects on the reading, language, and mathematics achievement of at-risk students. J Read Writ Learn Disabil Int 7: 105–123.
- 50. Greenwood CR (1991) Longitudinal analysis of time, engagement, and achievement in at-risk versus non-risk students. Except Children 57: 521–535.
- 51. Rutter M, Maughan B, Mortimore P, Ouston J, Smith A (1979) Fifteen thousand hours: Secondary schools and their effects on children. Cambridge: Harvard University Press. 296 p.
- 52. Kleinman KE, Saigh PA (2011) The effects of the good behavior game on the conduct of regular education New York City high school students. Behav Modif 35: 95–105.
- 53. Embry D (2002) The good behavior game: A best practice candidate as a universal behavioral vaccine. Clin Child Fam Psych 5: 273–297.
- 54. Luiselli JK, Putnam RF, Handler MW, Feinberg AB (2005) Whole-school positive behaviour support: Effects on student discipline problems and academic performance. Educ Psychol-UK 25(2-3): 183–198.
- 55. McCormick CM, Mathews IZ, Thomas C, Waters P (2010) Investigations of HPA function and the enduring consequences of stressors in adolescence in animal models. Brain Cognition 72(1): 73–85.
- 56. Embry D, Biglan A (2008) Evidence-based kernels: Fundamental units of behavioral influence. Clin Child Fam Psych 11(3): 75–113.
- 57. Embry D (2004) Community-based prevention using simple, low-cost, evidence-based kernels and behavior vaccines. J Community Psychol 32: 574–591.
- 58. Gaertner SL, Dovidio JF, Banker BS, Houlette M, Johnson KM, et al. (2000) Reducing intergroup conflict: From superordinate goals to decategorization, recategorization, and mutual differentiation. Group Dyn-Theor Res 4(1): 98–114.
- 59. Gaskell G, Smith P (1986) Group membership and social attitudes of youth: An investigation of some implications of social identity theory. Soc Behav 1(1): 67–77.
- 60. Sherif M (1958) Superordinate goals in the reduction of intergroup conflict. Am J Sociol 63: 349–356.
- 61. Dawes RM, Van De Kragt AJC, Orbell JM (1988) Not me or thee but we: The importance of group identity in eliciting cooperation in dilemma situations: Experimental manipulations. Acta Psychol 68: 83–97.
- 62. Bay-Hinitz AK, Peterson RF, Quilitch HR (1994) Cooperative games: A way to modify aggressive and cooperative behaviors in young children. J Appl Behav Anal 27(3): 435–446.
- 63. Zins JE, Weissberg RP, Wang MC, Walberg HJ (2004) Building academic success on social and emotional learning. New York: Teachers College Press. 264 p.
- 64. Domitrovich CE, Bradshaw CP, Greenberg MT, Embry D, Poduska JM, et al. (2010) Integrated models of school-based prevention: Logic and theory. Psychol Schools 47(1): 71–88.
- 65. Beersma B, Hollenbeck JR, Humphrey SE, Moon H, Conlon DE, et al. (2003) Cooperation, competition, and team performance: Toward a contingency approach. Acad Manage J 46(5): 572–590.
- 66. Hoigaard R, Safvenbom R, Tonnessen FE (2006) The relationship between group cohesion, group norms, and perceived social loafing in soccer teams. Small Gr Res 37(3): 217–232.
- 67. Koffman DM, Lee JW, Hopp JW, Emont SL (1998) The impact of including incentives and competition in a workplace smoking cessation program on quit rates. Am J Health Promot 13(2): 105–111.
- 68. Barrish H, Saunders M, Wolf M (1969) Good behavior game: Effects of individual contingencies for group consequences on disruptive behavior in a classroom. J Appl Behav Anal 2: 119–124.
- 69. Poduska JM, Kellam SG, Wang W, Brown CH, Ialongo NS, et al. (2008) Impact of the good behavior game, A universal classroom-based behavior intervention, on young adult service use for problems with emotions, behavior, or drugs or alcohol. Drug Alcohol Depen 95S: S29–S44.
- 70. Cavalier AR, Ferretti RP, Hodges AE (1997) Self-management within a classroom token economy for students with learning disabilities. Res Dev Disabil 18(3): 167–178.
- 71. Gaertner SL, Mann J, Murrell A, Dovidio JF (1989) Reducing intergroup bias: The benefits of recategorization. J Pers Soc Psychol 57(2): 239–249.
- 72. Aronson J, Fried CB, Good C (2002) Reducing the effects of stereotype threat on african american college students by shaping theories of intelligence. J Exp Soc Psychol 38(2): 113–125.
- 73. Glew GM, Fan MY, Katon W, Rivara FP, Kernic MA (2005) Bullying, psychosocial adjustment, and academic performance in elementary school. Arch Pediat Adol Med 159(11): 1026–1031.
- 74. Slavin RE (1983) When does cooperative learning increase student achievement? Psychol Bull 94(3): 429–445.
- 75. Conyers C, Miltenberger R, Romaniuk C, Kopp B, Himle M (2003) Evaluation of DRO schedules to reduce disruptive behavior in a preschool classroom. Child Fam Behav Ther 25(3): 1–6.
- 76. Abramowitz AJ, O'Leary SG (1991) Behavioral interventions for the classroom: Implications for students with ADHD. School Psychol Rev 20: 220–234.
- 77. Harrison RG, Schaeffer RW (1975) Another test of the Premack principle. B Psychonomic Soc 6(6): 565–568.
- 78. Aldwin CM (2007) Stress, coping, and development: An integrative perspective. New York: Guilford Press. 432 p.
- 79. Finn JD (1999) Tennessee's class size study: Findings, implications, misconceptions. Educ Eval Policy An 21(2): 97–109.
- 80. Hanushek EA (1998) The evidence on class size. Rochester: W.A. Wallis Institute Occasional Paper 981. Available: www.wallis.rochester.edu/WallisPapers/wallis_10.pdf. Accessed: 2011 Aug.
- 81. Goldstein H, Blatchford P (1998) Class Size and educational achievement: A review of methodology with particular reference to study design. Brit Educ Res J 24(3): 255–268.
- 82. Krueger A, Whitmore DM (2001) The effect of attending small class in early grades on college test-taking and middle school test results: Evidence from project STAR. Econ J 111: 1–28.
- 83. Leblanc MP, Ricciardi JN, Luiselli JK (2005) Improving discrete trial instruction by paraprofessional staff through an abbreviated performance feedback intervention. Educ Treat Child 28(1): 76–82.
- 84. Van Houten R, Hill S, Parsons M (1975) An analysis of a performance feedback system: The effects of timing and feedback, public posting, and praise upon academic performance and peer interaction. J Appl Behav Anal 8(4): 449–457.
- 85. Lowe TO, McLaughlin EC (1974) The use of verbal reinforcement by paraprofessionals in the treatment of underachieving elementary school students. J Stud Pers Assoc Teach Educ 12(3): 95–101.
- 86. Scott S, Spender Q, Doolan M, Jacobs B, Aspland H (2001) Multicentre controlled trial of parenting groups for childhood antisocial behaviour in clinical practice. Brit Med J 323: 194–201.
- 87. Hitz R, Driscoll A (1989) Praise in the classroom. Urbana: ERIC Clearinghouse on Elementary and Early Childhood Education. 6 p.
- 88. Acker MM, O'Leary SG (1987) Effects of reprimands and praise on appropriate behavior in the classroom. J Abnorm Child Psych 15(4): 549–557.
- 89. Aase H, Sagvolden T (2006) Infrequent, but not frequent, reinforcers produce more variable responding and deficient sustained attention in young children with attention-deficit/hyperactivity disorder (ADHD). J Child Psychol Psyc 47(5): 457–471.
- 90. Edwards KA, Johnston R (1977) Increasing greeting and farewell responses in high school students by a bus driver. Educ Treat Child 1(1): 9–18.
- 91. Ferguson CA (1976) The structure and use of politeness formulas. Lang Soc 5(2): 137–151.
- 92. Diego MA, Field T, Hernandez-Reif M, Shaw JA, Rothe EM, et al. (2002) Aggressive adolescents benefit from massage therapy. Adolescence 37: 597–607.
- 93. Field TM (1998) Touch therapy effects on development. Int J Behav Dev 22(4): 779–797.
- 94. Restak R, Kim S (2010) The playful brain: The surprising science of how puzzles improve your mind. New York: Penguin Group, Inc. 294 p.
- 95. National Research Council (NRC) (2000) How people learn. Washington DC: National Academy Press. 366 p.
- 96. Duit R (1991) On the role of analogies and metaphors in learning science. Sci Educ 75: 649–672.
- 97. Carroll L (1958) Symbolic logic and the game of logic (both books bound as one). New York: Dover. 295 p.
- 98. Abramowitz AJ, O'Leary SG, Rosen LA (1987) Reducing off-task behavior in the classroom: A comparison of encouragement and reprimands. (2): J Abnorm Child Psych. pp. 153–163.
- 99. Abramowitz AJ, O'Leary SG, Futtersak MW (1988) The relative impact of long and short reprimands on children's off-task behavior in the classroom. Behav Ther 19(2): 243–247.
- 100. Houghton S, Wheldall K, Jukes R, Sharpe A (1990) The effects of limited private reprimands and increased private praise on classroom behaviour in four british secondary school classes. Brit J Educ Psychol 60(3): 255–265.
- 101. Jackson NC, Mathews RM (1995) Using public feedback to increase contributions to a multipurpose senior center. J Appl Behav Anal 28: 449–455.
- 102. Ragnarsson RS, Bjorgvinsson T (1991) Effects of public posting on driving speed in icelandic traffic. J Appl Behav Anal 24: 53–58.
- 103. Van Houten R, Van Houten J (1977) The performance feedback system in the special education classroom: An analysis of public posting and peer comments. Behav Ther 8(3): 366–376.
- 104. Parsons HM (1992) Hawthorne: An early OBM experiment. J Organ Behav Manage 12(1): 27–43.
- 105. Parsons HM (1982) More on the Hawthorne effect. Am Psychol 37: 856–857.
- 106. Ackerman PL, Heggestad ED (1997) Intelligence, personality, and interests: Evidence for overlapping traits. Psychol Bull 121: 219–245.
- 107. Lucas B, Claxton G (2010) New kinds of smart: How the science of learnable intelligence is changing education. Maidenhead: Open University Press. 215 p.
- 108. Gardner H (1983) Frames of mind: The theory of multiple intelligences. New York: Basic Books. 496 p.
- 109. Brown S, Vaughan C (2010) Play: How it shapes the brain, opens the imagination, and invigorates the soul. New York: Penguin Group. 229 p.
- 110. Bratton SC, Ray D, Rhine T, Jones L (2005) The efficacy of play therapy with children: A meta-analytic review of treatment outcomes. Prof Psychol-Res Pr 36(4): 376–390.
- 111. Ridgway A, Northup J, Pellegrin A, LaRue R, Hightsoe A (2003) Effects of recess on the classroom behavior of children with and without attention-deficit hyperactivity disorder. School Psychol Quart 18(3): 253–268.
- 112. Pellegrini AD, Dupuis D, Smith PK (2007) Play in evolution and development. Dev Rev 27: 261–276.
- 113. Pellegrini AD, Bohn CM (2005) The role of recess in Children's cognitive performance and school adjustment. Am Educ Res J 34: 13–19.
- 114. Bateson PPG (2005) Play and its role in the development of great apes and humans. In: Pellegrini AD, Smith PK, editors. Growing Points in Ethology (Vol 2). London: Plenum. pp. 165–188.
- 115. National Board for Professional Teaching Standards (NBPTS) (2002) What teachers should know and be able to do. Washington, DC: NBPTS Press. 22 p.
- 116. Catsambis S (2001) Expanding knowledge of parental involvement in Children's secondary education: Connections with high school seniors' academic success. Soc Psychol Educ 52(2): 149–177.
- 117. Stormshak EA, Connell AM, Véronneau MH, Myers MW, Dishion TJ, et al. (2011) An ecological approach to promoting early adolescent mental health and social adaptation: Family-centered intervention in public middle schools. Child Dev 82(1): 209–225.
- 118. Fan X, Chen M (2001) Parental involvement and students' academic achievement: A meta-analysis. Educ Psychol Rev 12(1): 1–22.
- 119. Yun M, Kusum S (2008) Parents' relationships and involvement: Effects on students' school engagement and performance. RMLE Online 31(10): 1–11.
- 120. Bjorklund DF (2006) Mother knows best: Epigenetic inheritance, maternal effects, and the evolution of human intelligence. Dev Rev 26(2): 213–242.
- 121. American Association for the Advancement of Science (AAAS) (1990) Science for all Americans. New York: Oxford University Press. 272 p.
- 122. American Association for the Advancement of Science (AAAS) (1993) Benchmarks for science literacy. New York: Oxford University Press. 418 p.
- 123. National Council for Social Studies (NCSS) (2010) National curriculum standards for social studies: A framework for teaching, learning, and assessment. Waldorf: NCSS Publications. 171 p.
- 124. National Council of Teachers of Mathematics (NCTM) (2000) Principles and standards for school mathematics. Reston: National Council of Teachers of Mathematics Press. 402 p.
- 125. National Research Council (NRC) (2011) A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. Washington, DC: National Academies Press. 270 p.
- 126. Crime Victims Assistance Center (CVAC) (n.d.) Girls circle program. Available: http://www.cvac.us/girlscircle.htm. Accessed 2011 Aug 18.
- 127. Farmer TW, Hamm JV, Petrin RA, Robertson D, Murray RA, et al. (2010) Supporting early adolescent learning and social strengths: Promoting productive contexts for students at-risk for EBD during the transition to middle school. Exceptionality 18: 94–106.
- 128. Linares LO, Rosbruch N, Stern MB, Edwards ME, Walker G, et al. (2005) Developing cognitive-social-emotional competencies to enhance academic learning. Psychol Schools 42: 405–417.
- 129. National Research Council (NRC) (2000) Inquiry and the national science education standards. Washington DC: National Academy Press. 224 p.
- 130. O'Brien T (2010) Brain-powered science: Teaching and learning with discrepant events. Arlington: National Science Teachers Association Press. 386 p.
- 131. O'Brien T (2011) Even more brain-powered science: Teaching and learning with discrepant events. Arlington: National Science Teachers Association Press. 296 p.
- 132. O'Brien T (2011) More brain-powered science: Teaching and learning with discrepant events. Arlington: National Science Teachers Association Press. 330 p.
- 133. Rice GE, Young MB (1998) Meaning in education: The constructivist teacher. Intl Forum Logother 21: 91–99.
- 134. Windschitl M (2003) Inquiry projects in science teacher education: What can investigative experiences reveal about teacher thinking and eventual classroom practice? Sci Educ 87(1): 112–143.
- 135. Capon N, Kuhn D (2004) What's so good about problem-based learning? Cognition Instruct 22: 61–79.
- 136. Haydon T, Borders C, Embury D, Clarke L (2009) Using effective instructional delivery as a classwide management tool. Beyond Behav 18: 12–17.
- 137. Kwon UJ, Lee JK, Shin DH, Jeong JS (2009) Changes in brain activation induced by the training of hypothesis generation skills: An fMRI study. Brain Cognition 69: 391–397.
- 138. Chen XP, Komorita SS (1994) The effects of communication and commitment in a public goods social dilemma. Organ Behav Hum Dec 60: 367–386.
- 139. Deshler DD, Palincsar AS, Biancarosa G, Nair M (2007) Informed choices for struggling adolescent readers: A research-based guide to instructional programs and practices. New York: Carnegie Corporation. 264 p.
- 140. Billmeyer R (1995) Teaching reading in the content areas: If not me, then who? Colorado: McREL Institute. 172 p.
- 141. McComas WF (1996) Ten myths of science: Reexamining what we think we know about the nature of science. School Sci Math 96(1): 10–16.
- 142. Okilwa NSA (2010) The effects of peer tutoring on academic performance of students with disabilities in grades 6 through 12: A synthesis of the Literature. Rem Spec Educ 31(6): 450–463.
- 143. Stevens RJ, Slavin RE, Farnish AM (1991) The effects of cooperative learning and direct instruction in reading comprehension strategies on mean idea identification. J Educ Psychol 83: 8–16.
- 144. Armendariz F, Umbreit J (1999) Using active responding to reduce disruptive behavior in a general education classroom. J Post Behav Interv 1: 152–158.
- 145. Shernoff DJ, Csikszentmihalyi M, Schneider B, Shernoff ES (2003) Student engagement in high school classrooms from the perspective of flow theory. School Psychol Quart 18: 158–176.
- 146. Dewey J (1938) Experience and education. New York: Simon & Schuster. 91 p.
- 147. Jyoti DF, Frongillo EA, Jones SJ (2005) Food insecurity affects school children's academic performance, weight gain, and social skills. J Nutr 135: 2831–2839.
- 148. National Research Council (NRC) (2001) Knowing what students know: The science and design of educational assessment. Washington DC: National Academy Press. 366 p.
- 149. Bybee RW, Taylor JA, Gardner A, Van Scotter P, Carlson J, et al. (2006) The BSCS 5E instructional model: Origins, effectiveness, and applications. Available: http://www.bscs.org/pdf/5EFull Report.pdf. Accessed 2011 Aug 18.
- 150. Musheno BV, Lawson AE (1999) Effects of learning cycle and traditional text on comprehension of science concepts by students at differing reasoning levels. J Res Sci Teach 36(1): 23–37.
- 151. Albridge BG (1996) Scope, sequence, and coordination: A framework for high school science education. Arlington: National Science Teachers Association. 202 p.
- 152. Lewin L, Shoemaker BJ (1998) Great performances: Creating classroom-based assessment tasks. Alexandria: Association for Supervision and Curriculum Development. 216 p.
- 153. Fontana D, Fernandes M (1994) Improvements in mathematics performance as a consequence of self-assessment in portuguese primary school pupils. Brit J Educ Psychol 64(3): 407–417.
- 154. Duckworth A, Seligman M (2005) Self-discipline outdoes IQ in predicting academic performance of adolescents. Pyschol Sci 16(2): 939–944.
- 155. Jennings PA, Greenberg MT (2009) The prosocial classroom: Teacher social and emotional competence in relation to student and classroom outcomes. Am Educ Res J 79(1): 491–525.
- 156. Rickards-Schlichting KA, Kehle TJ, Bray MA (2004) A self-modeling intervention for high school students with public speaking anxiety. J Appl School Psychol 20(2): 47–60.
- 157. Quitadamo IJ, Faiola CL, Johnson JE, Kurtz MJ (2008) Community-based inquiry improves critical thinking in general education biology. (7): CBE- Life Sci. pp. 327–337.
- 158. Dewey J (1900) The school and society. Chicago: University of Chicago Press. 164 p.
- 159. Hayes SC, Strosahl KD, Wilson KG (1999) Acceptance and commitment therapy: An experiential approach to behavior change. New York: The Guilford Press. 304 p.
- 160. Hayes SC, Smith S (2005) Get out of your mind and into your life: The new acceptance and commitment therapy. Oakland: New Harbinger Publications. 206 p.
- 161. Biegel GM, Brown KW, Shapiro SL, Schubert CM (2009) Mindfulness-based stress reduction for the treatment of adolescent psychiatric outpatients: A randomized clinical trial. J Consult Clin Psych 77(5): 855–866.
- 162. Holt LJ, Bry BH, Johnson VL (2008) Enhancing school engagement in at-risk, urban minority adolescents through a school-based, adult mentoring intervention. Child Fam Behav Ther 30(4): 297–318.
- 163. Bybee RW, Powell JC, Ellis JD, Giese JR, Parisi L, et al. (1991) Integrating the history and nature of science and technology in science and social studies curriculum. Sci Educ 75: 143–155.