Show Summary Details

Page of

Printed from Oxford Research Encyclopedias, Psychology. Under the terms of the licence agreement, an individual user may print out a single article for personal use (for details see Privacy Policy and Legal Notice).

Subscriber: null; date: 28 March 2025

Development of Judgment, Decision Making, and Rationalitylocked

Development of Judgment, Decision Making, and Rationalitylocked

  • Maggie ToplakMaggie ToplakYork University, Department of Psychology
  • , and Jala RizeqJala RizeqYork University, Department of Psychology

Summary

There is a long tradition of studying children’s reasoning and thinking in cognitive development and education. The initial studies in the cognitive development of reasoning were motivated by Piagetian models, and developmental age was thought to bring the gradual onset of logical thinking. The introduction of heuristics and biases tasks in adults and dual process models have provided new perspectives for understanding the development of reasoning, judgment, and decision-making skills. These heuristics and biases tasks provided a way to operationalize the systematic errors that people make in their judgments. Dual process models have advanced our understanding of the basic processes implicated in both optimal and non-optimal responders on several types of paradigms, including heuristics and biases tasks and classic reasoning paradigms. Importantly, these skills and competencies are generally separable from the types of higher cognition assessed on measures of intelligence and executive function task performance.

Given the history of the study of reasoning in cognitive development, there is a need to integrate our understanding across these somewhat separate literatures. This is especially true given the opposite predictions that seem to be suggested in these different research traditions. Specifically, there is a focus on increasing logical development in the classic cognitive developmental literature and alternatively, there has been a focus on systematic errors in judgment and decision-making in the study of reasoning in adults. This article provides an integration of the two aforementioned perspectives that are rooted in different empirical and historical traditions. These considerations are addressed by drawing upon their research traditions and by summarizing more recent developmental work that has investigated these paradigms.

Subjects

  • Psychology and Other Disciplines

Defining Judgment, Decision-Making, and Rational Thinking

Classic developmental perspectives assume that children who demonstrate better judgment and decision-making by the end of adolescence are those who have made considerable gains in several cognitive competencies over the course of development. Cognitive abilities continue to differentiate and develop well into adolescence (Shing, Lindenberger, Diamond, Li, & Davidson, 2010), but increasing theoretical and empirical research in the adult literature has demonstrated that cognitive abilities are conceptually and empirically separable from judgment, decision-making, and rational thinking skills (Stanovich, 1999, 2009a, 2009b; Stanovich, West, & Toplak, 2016). Similar theoretical arguments and data patterns have been demonstrated in developmental samples (Kokis, Macpherson, Toplak, West, & Stanovich, 2002; Stanovich, Toplak, & West, 2008; Stanovich, West, & Toplak, 2012).

Judgment has been defined as the evaluation of one or more possibilities based on specific evidence and goals, and a decision has been defined as a choice of action (Baron, 2000). Rational thinking is defined as the individual’s pursuit of truth, holding relevant goals and beliefs in mind and acting on them (Stanovich, 1999, 2009a, 2011; Stanovich et al., 2016). Rationality specifically poses questions about the optimality and normativity of specific responses on judgment and decision-making tasks, and accuracy of performance is based on these parameters (Stanovich, 1999). On the other hand, measures of intelligence and executive function task performance assess efficiency and accuracy of performance, where the examiner has clearly set out the purpose and goals of the task (Stanovich, 2009b). Confusion regarding terminology arises when, for example, the term “reasoning” is often subsumed as part of general cognitive abilities and intelligence, such as in developmental samples (van der Sluis, de Jong, & van der Leij, 2007), when in fact the study of “human reasoning” connotates a very specific literature and empirical study of tasks that constitute a unique domain of cognitive competence (e.g., Evans, Newstead, & Byrne, 1993).

In this article, the terms judgment and decision-making are used to refer to this literature. The guiding assumption for this article is that judgment and decision-making performance can also be evaluated in developmental samples, and that these data patterns can inform conclusions about the emergence of rational thought in children and youth. For each task and paradigm, careful consideration must be given to whether children and youth are engaging in rational consideration, as previously defined. Considerable progress has been made in understanding judgment and decision-making performance in adults, especially given the extensive study of heuristics and biases tasks, originally studied by Kahneman and Tversky in the 1970s, and the experimental work in human reasoning, such as the classic work on the Wason selection task (Evans, 2017). That people make systematic errors in judgment was one of the early observations made in the heuristics and biases literature (Kahneman, 2011). These literatures have provided a diverse set of paradigms and tasks that have contributed to modern dual process theories to explain judgment and decision-making performance (Ackerman & Thompson, 2017; De Neys, 2012; Evans, 2007; Pennycook, Fugelsang, & Koehler, 2015; Stanovich, 1999, 2009a, 2011, 2018).

In the field of educational research, these competencies are captured by the term critical thinking, which broadly refers to fostering “good thinking” skills in educational contexts (Halpern, 1997; Halpern & Riggio, 2003; Kuhn, 2005; Kuhn, Hemberger, & Khait, 2016). However, the operationalization of what constitutes “good thinking” is often not defined for educators, besides a general reference to more deliberation, reflection, and evaluation when making judgments and decisions. Although “thinking” is not a domain of knowledge (Toplak, West, & Stanovich, 2012), educators are expected to guide students to think better (Adams, 1993). The concept of critical thinking is relevant and is included as part of the study of judgment and decision-making (Toplak et al., 2012). That is, insights from the judgment and decision-making field will inform educational efforts to improve critical thinking education in schools.

A Developmental Lens for Judgment and Decision-Making

The initial studies of the development of reasoning were motivated by Piagetian models, and development was thought to bring the gradual onset of logical thinking (Markovits, 2013a). There seemed to be an implicit assumption that developmental changes would translate into better performance on many tasks. This assumption appeared to underlie Piagetian, Neo-Piagetian, information processing, and social-cultural (Vygotskian) perspectives (Flavell, Miller, & Miller, 1993). However, this implicit assumption was contested by the fact that Neo-Piagetian researchers were surprised to observe that some children seemed to exhibit higher competence than expected and that some adolescents and adults did not reach some of the cognitive developmental milestones at later stages, such as at the formal operational period (i.e., abstract thinking; Flavell et al., 1993). These findings challenged developmental theorists to characterize what seemed to be unexpected levels of competence early in development followed by a lack of competence later in development. Such findings also raised questions about how developing processes could give rise to both better logical thinking and belief-biased thinking (Markovits, 2013a). One developmental model that has attempted to resolve what seemed like contradictions from these perspectives was fuzzy-trace theory (see Reyna & Brainerd, 1994, for a review of how Piagetian and information processing models have shaped models of the development of probability judgment). At around this time, dual process models were also beginning to take shape in the adult literature (Evans & Over, 1996; Sloman, 1996; Stanovich, 1999), which highlight individual differences in adult performance on reasoning problems and heuristics and biases tasks (Stanovich, 1999). Many of the tasks that constitute this literature originated from the classic heuristics and biases literature (Gilovich, Griffin, & Kahneman, 2002; Kahneman, Slovic, & Tversky, 1982) and the human reasoning literature (Evans et al., 1993). It is important to note here that the types of paradigms and tasks studied under the category of “reasoning” differ considerably according to the Piagetian and adult literatures, which is part of the challenge for integrating these perspectives in order to draw conclusions about the development of reasoning. The focus of this article will be on the paradigms assessed in the adult literature, as many of these paradigms have been extended and studied in developmental samples.

Dual Process Models of Reasoning From the Adult Literature

The study of heuristics and biases in adults has led to several important insights about human reasoning. First, typically developing individuals display systematic errors in their thinking that are attributable to the “design of the machinery” as opposed to the “corruption of thought by emotion” (Kahneman, 2011). One of the important characteristics of many heuristics and biases tasks is that there is a conflict between two types of process that involve different levels of deliberation and awareness, Type 1 and Type 2. The defining feature of Type 1 processes is autonomy, that these processes are necessarily executed in the presence of triggering stimuli (Stanovich, 1999, 2009a, 2011; Stanovich & Toplak, 2012). These processes also tend not to put a heavy load on central processing capacities. Examples of these processes include behavioral and emotional regulation, encapsulated modules for solving specific adaptive problems that have been suggested by evolutionary psychologists, and overlearned associations. Alternatively, Type 2 processes operate serially, and are generally slower and more computationally expensive. It is important to note that Type 1 and Type 2 processes may each lead to correct or incorrect responses (Evans & Stanovich, 2013). However, the design of several heuristics and biases tasks is to create a conflict between Type 1 and Type 2 processes, where Type 1 processes lead to an incorrect response and Type 2 processes lead to a correct response. In these instances, the purpose of Type 2 processes is to compute a better response when the response derived from Type 1 processes needs to be overridden. Type 1 processes often provide input for optimal responses in typically experienced situations, but in unique and novel situations, Type 1 processes only provide a ballpark estimate, requiring the hypothetical simulation of analytic processes to compute a better response (Stanovich, 2011). In order to engage Type 2 processes, the capacity to interrupt and suppress the Type 1 processes must be available to engage processes of hypothetical reasoning. Optimal performance on several of these tasks requires successful override of Type 1 processes in order to avoid a miserly, incorrect response. It is important to note that some participants may not experience this conflict and are able to immediately generate a correct normative response (Bago & De Neys, 2017) if they have consolidated the knowledge that becomes autonomously activated when performing these tasks (Stanovich, 2018; Stanovich et al., 2016).

It is the conflict between Type 1 and Type 2 processes that makes these heuristics and biases tasks particularly difficult for many participants, and it is this distinction between these two types of responses that has also formed the basis for modern dual process models of reasoning (Evans, 2003, 2008, 2010; Evans & Stanovich, 2013; Stanovich, 2009a, 2011). The manner in which these two sets of processes or systems interact has been discussed extensively (Evans, 2003, 2008, 2010; Evans & Stanovich, 2013; Stanovich, 2009a, 2011; Stanovich & West, 2008b). Type 1 and Type 2 processes have also been referred to as System 1/System 2 processes (Evans, 2008; Evans & Stanovich, 2013) and heuristic and analytic processes (e.g., Klaczynski, 2001), the latter most often used in the developmental literature.

The findings from the heuristics and biases literature on adults have consistently shown that many adults tend to demonstrate less than rational responding, often attributable to failing to recognize when an alternative response may be needed and/or a failure to override a dominant response generated by a Type 1 process (Stanovich, 2009a, 2011; Stanovich & West, 2008b). The distinction between Type 1 and Type 2 processes in the adult literature provides a useful way to characterize how different responses occur in these tasks.

Given historical perspectives on the development of reasoning from Piagetian models and advances in the understanding of adult reasoning based on the heuristics and biases tradition, there is much work to be done to further articulate and understand how these processes originate and develop in child and youth samples. Importantly, in order to advance a developmental taxonomy for understanding judgment and decision-making performance, several issues will need to be taken into consideration: (a) the stimulus equivalence problem; (b) confusions with terminology and predictions from dual process models; and (c) the use of multiple indicators of cognitive sophistication.

The Stimulus Equivalence Problem

The heuristics and biases literature with adults has been hugely influential for informing models of rational thinking; however, the stimuli that have been used in adult studies have perhaps created considerable complexity for developmentalists. In particular, there are important issues with respect to the acquisition and consolidation of knowledge required for these tasks and whether child participants experience the conflict between competing Type 1 and Type 2 processes (as has been described in adult samples).

Several judgment and decision-making tasks require specific knowledge, such as numeracy, probabilistic and statistical thinking, and scientific thinking (Stanovich et al., 2016). For example, individual differences in numeracy have been found to predict performance on rational thinking and decision-making in adults (Peters, 2012; Peters et al., 2006; Sinayev & Peters, 2015; Weller et al., 2013). It has been suggested that even before children enter school, they demonstrate a functional understanding of probability (Schlottmann & Wilkening, 2011). In particular, children as young as four years of age may be able to represent the certainty and uncertainty of events (Byrnes & Beilin, 1991). However, several judgment and decision-making tasks require understanding of more complex types of knowledge. For example, demonstration of the conjunction effect presumes an understanding that the probability of the intersection of two elements is statistically less likely than the probability of a single element. Therefore the degree and complexity of specific knowledge required for several heuristics and biases tasks vary, which will have implications for whether certain tasks are suitable and measurable in developmental samples.

As previously described, an important feature of several judgment and decision-making tasks is the conflict between Type 1 processes that may lead to an incorrect response and Type 2 processes that may lead to a correct response. Resolving conflict of competing responses can be illustrated with the classic Stroop test. A sample of a typical Stroop task is presented in Table 1. In Part 1, participants are asked to name the color of each rectangle. In Part 2, participants are asked to read the words (which name the colors). In Part 3, participants are asked to name the color of each word, which in each case is printed in a different color font than the name of the word (interference condition). The interference condition is the hardest condition, as it is difficult for participants to name the color of the font when they have well-developed reading skills. That is, participants must resist reading the word in order to retrieve the name of the font color of the word. Since children have well-developed basic reading skills by around ages eight to nine, or grade three (Chall, 1983), children will likely experience a conflict or interference between naming the colors and reading the words. The reasons that the Stroop task is usable and measurable across children and adults is because across these developmental periods, both groups will experience the conflict that they must override in order to correctly complete this task.

The same issue of experiencing and overriding conflict as in the Stroop task is also relevant for the measurement of judgment and decision-making tasks in children and adults. The design of several heuristics and biases tasks is such that there is meant to be a conflict between a response that is easily elicited by Type 1 processes (that will lead to an incorrect response) and the opportunity to generate a less easily elicited response that can be generated by Type 2 processes (that will lead to a correct response). That easily elicited Type 1 process also requires some overlearned or consolidated knowledge, and whether children in developmental samples have acquired and overlearned that knowledge on some of these tasks is unclear. In addition, the design and administration of the Stroop test makes the conflict between these responses very salient. During the administration of the Stroop task, it is obvious that the participants respond more slowly in the interference condition than in the other conditions. Moreover, participants often make errors that demonstrate that this conflict has occurred, such as accidentally reading the word instead of naming the color, but then quickly self-correcting their response. All of these observations demonstrate the conflict created by the incongruent nature of the interference condition. The presence of this type of conflict is not apparent on judgment and decision-making tasks. In addition, the examiner does not signal to the participant in the instructions as to what is optimal performance on the judgment and decision-making tasks. Even in adult samples, inferences are made regarding whether there has been a conflict between different processes on these tasks, but it is even less clear when such conflict arises in developmental samples. Understanding the development of Type 1 and Type 2 processes is fundamental for properly characterizing different responses on heuristics and biases tasks in child and youth samples (Stanovich, West, & Toplak, 2011b).

Table 1. Sample Stroop Task

Translating Predictions From Dual Process Models in the Adult Literature: Avoiding the Confusions

Some of the confusions that occur in the developmental literature are parallel to those that have occurred in the adult literature. Evans (2008; Evans & Stanovich, 2013) has pointed out that analytic processes (or Type 2 processes) have mistakenly been equated with normatively correct responding and that heuristic processing (Type 1 processes) has been mistakenly equated with non-normative incorrect responding. Instead, both types of processes can often lead to normative correct responding. It is just statistically more likely for Type 2 processes to provide the correct response on the types of heuristics and biases tasks that have been under study because they are designed to elicit Type 1 processes that lead to incorrect responding (Stanovich et al., 2011b). Individual differences in knowledge may also explain findings that have shown that some participants may initially and easily generate a correct response (Bago & De Neys, 2017) if they have overlearned the knowledge required for the task.

These confusions between processes and responses have also pervaded the developmental literature. In particular, this has been perpetuated by the use of the terms “analytic” (Type 2) and “heuristic” (Type 1) responding, instead of characterizing these as analytic and heuristic processes that may lead to correct/normative or incorrect/non-normative responses. Not all Type 1 processes lead to biased, incorrect responses and not all Type 2 processes lead to correct responses (Evans, 2012; Evans & Stanovich, 2013; Stanovich & West, 2008b). However, on heuristics and biases tasks, these tasks are designed to produce conflicting responses and Type 2 engagement is needed to override the response that is championed by Type 1 processes in order to derive a normatively correct response. Both Type 1 and Type 2 processes develop during childhood. Type 2 processes do not replace Type 1 processes and Type 1 processes do not replace Type 2 processes (Brainerd & Reyna, 2001; Markovits, 2013a; Stanovich et al., 2011b), an issue that has been referred to as the “illusion of replacement” (Brainerd & Reyna, 2001).

More Than Age Differences: Using Multiple Indicators of Cognitive Sophistication

In some developmental work, the concept of cognitive sophistication has been used to generate testable hypotheses regarding the development of judgment and decision-making performance (Toplak, West, & Stanovich, 2014b). Specifically, cognitive sophistication poses the following general question: “Do individuals with more complex cognition tend to give a disproportionate amount of normative responses on reasoning tasks?” (Stanovich, 2011). Specifically, individuals who fully understand the normative issues presented in a decision will be more likely to accept the correct normative model, also called the understanding/acceptance assumption. In addition, more cognitively sophisticated individuals will be more likely to derive a correct normative response. That is, individuals with increased cognitive abilities and dispositional tendencies toward open-mindedness and persistence in thinking will be more likely to generate normative responses on these tasks.

Developmentally, cognitive sophistication can be empirically examined in three ways: (a) developmental age differences, (b) correlations with cognitive abilities, and (c) correlations with dispositional tendencies toward open-mindedness and persistence in thinking (Kokis et al., 2002; Toplak et al., 2014b). Developmental differences have been assessed by comparing performance on judgment and decision-making tasks in different age groups of children and youth. Cognitive abilities include the assessment of accuracy and processing efficiency on highly structured tasks where the goals and objectives are provided by the examiner (Stanovich, 2009b), such as measures of intelligence and executive function tasks (Miyake & Friedman, 2012; Reyna, 1995; Salthouse, Atkinson, & Berish, 2003). Thinking dispositional tendencies, or cognitive styles, refer to metacognitive strategies that also support optimal choices on judgment and decision-making tasks (Sinatra & Pintrich, 2003; Stanovich, 2009a, 2011; Sternberg, 2003). For example, the tendency to evaluate beliefs based on new evidence (actively open-minded thinking), persistence in considering alternatives (need for cognition or deliberative thinking), and consideration of future consequences (or future orientation) have been positively correlated with optimal performance on judgment and decision-making tasks in adults (Cacioppo, Petty, Feinstein, & Jarvis, 1996; Stanovich, 2011; Stanovich & West, 1997; Stanovich et al., 2016; Strathman, Gleicher, Boninger, & Edwards, 1994). Overall, it has been reported that increased cognitive sophistication also tends to lead to more optimal responding on judgment and decision-making tasks in developmental samples (Kokis et al., 2002; Toplak et al., 2014b). That is, older children and youth tend to perform better on judgment and decision-making tasks than younger children. Individuals who display higher cognitive abilities tend to perform better on judgment and decision-making tasks. Thinking tendencies that promote evaluation and persisting in thinking will also tend to improve performance on judgment and decision-making tasks. These different indicators of cognitive sophistication provide separable empirical tests and strategies to examine convergence and consistencies in understanding the development of judgment and decision-making performance. Exclusive reliance on any one of these indicators makes it challenging to understand and make sense of unexpected findings, such as developmental reversals (Weldon, Corbin, & Reyna, 2014).

Towards Developing a Taxonomy for Assessing Judgment and Decision-Making in Children and Youth

Several measurement paradigms to assess judgment and decision-making from the heuristics and biases literature on adults have been examined in the developmental literature (see Toplak, West, & Stanovich, 2013 for a review). In order to most coherently integrate developmental perspectives with the empirical literature with adults, it would be most prudent to focus on the paradigms that have been commonly studied in developmental and adult samples, as opposed to focusing on paradigms that were studied based on the Piagetian literature. Admittedly, the developmental patterns of each of these paradigms that were adapted from stimuli used with adults are yet to be fully understood. Some of these paradigms have been shown to display trends toward better performance with more advanced development, but some of the patterns are less clear. Table 2 displays an example of how judgment and decision-making tasks may be categorized in terms of the relative involvement of process and knowledge in order to support task performance (see Stanovich et al., 2016). The categorization of tasks in Table 2 is based on what is known from the adult literature in terms of understanding cognitive failures in rational thinking performance.

Table 2 includes four broad categories of judgment and decision-making tasks: (a) tasks for which performance relies heavily on resistance to miserly information processing; (b) tasks for which performance relies heavily on specific knowledge or mindware; (c) tasks for which performance relies heavily on resistance to miserly information processing and specific knowledge or mindware; and (d) tasks where performance is affected by unhelpful mindware (or contaminated mindware).

Tasks that rely heavily on resistance to miserly information processing refer to paradigms where there is typically a conflict between Type 1 and Type 2 processes. On these tasks, the individual must recognize that the response autonomously generated from Type 1 processes is inadequate, and that Type 2 processes can generate better alternative responses. These tasks also vary on a continuum with respect to the degree that they directly or indirectly assess rational thinking skills (Stanovich et al., 2016). That is, tasks such as syllogistic reasoning with belief bias, ratio bias, and cognitive reflection are strong indicators of the tendency to resist miserly processing tendencies and are less direct measures of rational thinking. Alternatively, tasks such as framing, temporal discounting, and myside bias also require resistance to miserly processing but also tend to more directly assess rational thinking tendencies. This distinction between types of resistance to miserly information processing tasks is shown in Table 2. It is important to note that several of the miserly information processing tasks also require some knowledge or relevant mindware, but performance on these tasks will be more heavily determined by process than by knowledge or mindware.

Some tasks more purely assess specific knowledge, such as practical numeracy, sensitivity to expected value, knowledge of scientific reasoning (no conflict tasks), and financial literacy. Many judgment and decision-making tasks require both resistance to miserly processing and specific knowledge. These include tasks that assess sensitivity to base rates, conjunction effects, the gambler’s fallacy, importance of sample size tasks, and scientific reasoning (conflict tasks). Finally, some types of knowledge or mindware may have evaluation-disabling tendencies (Stanovich, 2011), such as paranormal beliefs, conspiracy beliefs, and anti-science attitudes (Stanovich et al., 2016). That is, not all accumulated mindware is helpful or provides a supporting role in generating alternative solutions.

It has been acknowledged in the adult literature that many of these tasks are determined by multiple processes (Stanovich, 2009a, 2018). In the case of development, the role of requisite knowledge and whether this knowledge is available at different periods of development is a much more challenging issue to address in developmental than in adult samples. The contribution of process and knowledge are deeply intertwined, as overlearned knowledge may become part of processes that are autonomously signaled (Stanovich, 2018; Stanovich et al., 2016), making it challenging to experimentally parse these processes from knowledge and draw inferences based on response tendencies. Thus, different degrees of knowledge at different periods of development may impact the likelihood of miserly processing tendencies, including both the strength of Type 1 processing signals and the likelihood of override, each of which may lead to incorrect or correct responding.

Table 2. Measurement Paradigms to Assess the Development of Judgment of Decision-Making

Tasks where performance relies heavily on resistance to miserly information processing

Tasks that primarily assess resistance to miserly information processing:

-

Syllogistic reasoning with belief bias

-

Ratio bias (or denominator neglect)

-

Cognitive Reflection Test or reflection versus intuition

Tasks where resistance to miserly information processing is more directly related to rational thinking:

-

Framing tasks

-

Temporal discounting

-

Delay of gratification

-

Emotion regulation by reward

-

Myside bias

-

Overconfidence or knowledge calibration

Tasks where performance relies heavily on specific knowledge or mindware

-

Practical numeracy

-

Sensitivity to expected value

-

Knowledge of scientific reasoning (no conflict tasks)

-

Financial literacy

Tasks where performance relies heavily on resistance to miserly information processing and specific knowledge or mindware

-

Sensitivity to probabilities and appreciating base rates

-

Conjunction effects

-

Gambler’s fallacy

-

Importance of sample size

-

Scientific reasoning (conflict tasks)

Tasks where performance is affected by unhelpful mindware (or contaminated mindware)

-

Paranormal beliefs

-

Conspiracy beliefs

-

Anti-science attitudes

(Adapted from Toplak, 2018)

Resistance to Miserly Information Processing

Several of the judgment and decision-making tasks in the literature vary in the extent to which successful performance requires overriding miserly information processing (Stanovich, 2009a, 2011; Stanovich, West, & Toplak, 2011a). Of the tasks where performance is primarily determined by miserly information processing, one of the most well-studied paradigms in the developmental literature has been syllogisms with belief bias content. Belief bias syllogisms represent a special category of deductive conditional reasoning where the believability of the conclusion conflicts with the logical structure of the syllogism, which are typically called inconsistent or conflict problems. Children require basic competence in conditional reasoning skills to successfully solve consistent or no conflict problems. There is an extensive literature on the age-related development of conditional reasoning skills on concrete and abstract problems that are consistent or have no conflict (Markovits, 2013b, 2018; Markovits & Lortie-Forgues, 2011; Markovits & Thompson, 2008; Markovits & Vachon, 1990; Markovits et al., 1996). In studies that have examined performance on belief bias syllogisms in developmental samples, there is a fair amount of convergence to suggest that older children tend to outperform younger children (De Neys & van Gelder, 2009; Evans & Perry, 1995; Handley, Capon, Beveridge, Dennis, & Evans, 2004; Kokis et al., 2002; Markovits & Bouffard-Bouchard, 1992; Steegen & De Neys, 2012; Toplak et al., 2014b), rather than studies that have not (Morsanyi & Handley, 2008). Children who endorsed more actively open-minded thinking and who performed better on cognitive abilities were also more likely to perform better on belief bias syllogisms (Kokis et al., 2002; Toplak et al., 2014b).

Optimal performance on ratio bias tasks (also termed denominator neglect and attribute substitution) also requires overriding miserly processes. Specifically, miserly processes tend to cue an incorrect response towards selecting the bowl with more marbles (visually appears correct) over the better selection, which is a bowl that has a higher probability of winning (statistically the better option). This task originated from the adult literature (Denes-Raj & Epstein, 1994; Kirkpatrick & Epstein, 1992). Some numerical competence or knowledge is required in order to compare the ratios or probabilities of each bowl. In order to offload the knowledge demands of this task in developmental samples, some studies have explicitly provided the ratios on cue cards so that children do not have to compute the probabilities (Kokis et al., 2002; Toplak et al., 2014b). Some studies suggest that ratio bias performance seems to improve with age (Klaczynski, 2001; Toplak et al., 2014b). Better performance on ratio bias tasks has also been associated with more endorsement of actively open-minded thinking and higher cognitive abilities in developmental samples (Kokis et al., 2002; Toplak et al., 2014b).

In framing problems, participants are asked to make choices in parallel situations where the problem is “framed” differently, such as either positively versus negatively or as gains versus losses. Participants who make different choices based on these re-descriptions are demonstrating a context effect. The classic framing problems used in the heuristics and biases literature involved gain and loss frames (Kahneman & Tversky, 1984, 2000). In developmental studies, children have typically been presented with scenarios involving small prizes that the children receive instead of imaginary deaths. These problems do not seem to require particular mindware, however, consideration needs to be given to understanding how responding to risks and losses unfolds developmentally. This literature in developmental samples has been more complex and inconsistent. Studies have reported framing effects in young children (Schlottmann & Tring, 2005) and in adolescents (Chien, Lin, & Worthley, 1996). Some studies have reported no developmental trends for framing effects (Levin & Hart, 2003; Levin, Weller, Pederson, & Harshman, 2007), but six- to eight-year-old children were found to be more risk averse for gains than for losses in the manner that prospect theory predicts. Reyna and Ellis (1994) reported that four-year-olds displayed no framing effect, eight-year-olds displayed a reverse framing effect, and 11-year-olds displayed a mixture of framing effects. Alternatively, Toplak et al. (2014b) used attribute framing problems in a developmental sample. Older youth were less likely to display framing effects than younger youth and resistance to framing was found to be associated with higher cognitive abilities and endorsement of actively open-minded thinking. Similarly, Weller, Levin, Rose, and Bossard (2012) examined resistance to framing in a preadolescent sample using both gain/loss problems and attribute framing problems. They found that resistance to framing was associated with higher ratings of inhibitory control (a subscale of effortful control) by the preadolescents and their parents.

Temporal discounting and delay of gratification tasks assess a prudent attitude toward the future (Basile & Toplak, 2015; Stanovich, 2009a, 2011; Toplak, Hosseini, & Basile, 2016). These tasks generally involve a choice between the opportunity for a higher gain in the future over a lower immediate gain in the present. Delay of gratification paradigms were studied before temporal discounting in developmental samples. The delay of gratification paradigm was first introduced in developmental samples by Walter Mischel (Mischel, 1973, 2014; Mischel & Ebbesen, 1970), and since that time the research on this paradigm has become well documented and popularized (Mischel, 2014). Temporal discounting paradigms have also been studied extensively in developmental samples (e.g., Steinberg et al., 2009). Temporal discounting paradigms involve multiple trials, unlike the delay of gratification paradigms, and thus have provided the opportunity to better understand performance variability and developmental differences. Temporal discounting tasks require participants to make multiple choices between a small reward immediately versus a larger constant reward available after a delay (Rachlin, Raineri, & Cross, 1991). The size of the immediate reward and length of the delay are varied across trials in temporal discounting tasks. Studies with developmental samples have reported that older youth tend to prefer the larger delayed reward than younger youth (Green, Fry, & Myerson, 1994; Prencipe et al., 2006; Steinberg et al., 2009). The preference for a larger delayed reward has been shown to be positively correlated with performance on intelligence and executive function tasks (Prencipe et al., 2006; Steinberg et al., 2009). Delay of gratification paradigms seem to display a parallel trend; delay ability in preschoolers has been shown to significantly predict academic achievement (SAT scores) in adolescents (Mischel, Shoda, & Peake, 1988).

Another domain of miserly information processing emerges from how our emotions regulate our sensitivity to rewards and punishments. This has been indexed with the well-known Iowa Gambling Task (IGT) that has been studied extensively in adults, as well as in developmental samples. Poor performance on the IGT has been attributed to dysregulation of somatic markers (Damasio, 1994, 1996, 1999). Namely, individuals who perform poorly on this task purportedly have weaker somatic or physiological cues to guide risky choices (Damasio, 1994, 1996, 1999). Somatic markers, or emotions, are suggested to assist by constraining the decision-making space, giving various alternatives preferential availability over other alternatives (Oatley, 1999). While critiques have been written regarding explanations of performance on the IGT and the details of the somatic marker hypothesis (Dunn, Dalgleish, & Lawrence, 2006), the literature on the IGT provided a measurable paradigm to conceptualize how input from emotional modules impact judgment and decision-making (Stanovich et al., 2016). Several developmental studies have demonstrated that older youth tend to make more advantageous selections than children on adapted versions of this task (Crone & van der Molen, 2004; Garon & Moore, 2004; Hongwanishkul, Happaney, Lee, & Zelazo, 2005; Hooper, Luciana, Conklin, & Yarger, 2004; Lamm, Zelazo, & Lewis, 2006; Prencipe et al., 2006). Advantageous selections in this task have also been reported to show modest positive correlations with some executive function tasks (Lamm et al., 2006; Prencipe et al., 2006). However, one study has reported a curvilinear relationship, suggesting an increase in performance between preadolescence and mid-adolescence (10–16-year-olds) and a decrease in performance between mid-adolescence and adulthood (16–30-year-olds; Steinberg, 2010).

There are several other domains of judgment and decision-making tasks indicated in Table 2 that rely heavily on resistance to miserly information processing that have been examined in developmental samples. For instance, myside bias refers to the tendency to test hypotheses in a way that is biased towards one’s own opinions and beliefs (Baron, 1995; Perkins, Farady, & Bushey, 1991; Stanovich, 2011; Toplak & Stanovich, 2003). The myside bias has been shown to be unrelated to cognitive abilities in adults (Stanovich & West, 2007, 2008a). Age effects have not been associated with myside bias in adolescent and young adult samples (Baron, Granato, Spranca, & Teubal, 1993; Klaczynski & Lavallee, 2005; Klaczynski & Narasimham, 1998), but the number of otherside reasons given in a myside bias task has been found to be associated with age in a sample of children and young adolescents (Toplak et al., 2014b). The Cognitive Reflection Test (CRT) has primarily been characterized as a measure indicating miserly information processing (Toplak, West, & Stanovich, 2011, 2014a), but basic numerical competence has also been shown to be an important predictor of task performance (Liberali, Reyna, Furlan, Stein, & Pardo, 2012). Some studies have used CRT items as part of a numeracy scale (Weller et al., 2012), as numeracy skills are required for successful completion of CRT items, but resistance to miserly information processing is additionally required for successful performance on the CRT (Toplak et al., 2011). The CRT has been less well studied in developmental samples, likely attributable to the fact that performance is generally quite low in adult samples (Frederick, 2005; Toplak et al., 2014a). One study has reported that young adults outperformed adolescents on an expanded version of the CRT (Primi, Morsanyi, Chiesi, Donati, & Hamilton, 2015). Overconfidence paradigms have been used to measure performance calibration. For example, better calibration (or less overconfidence) in a sample of preadolescents has been associated with higher ratings of attentional focus and inhibitory control by the preadolescents and their parents (Weller et al., 2012). Older children also tend to provide more accurate estimations of their abilities and competence compared with younger children on other cognitive estimation tasks (Desoete & Roeyers, 2006; Lipko, Dunlosky, & Merriman, 2009; Newman, 1984; Schneider, Visé, Lockl, & Nelson, 2000). Other paradigms that primarily require resistance to miserly information processing have been studied in the adult literature, such as anchoring and outcome bias (Stanovich et al., 2016), but these have been less well studied in developmental samples (Klaczynski, 2001; Smith, 1999).

Reliance on Specific Knowledge or Mindware

Some measures of judgment and decision-making rely heavily on the acquisition of specific mindware or knowledge. The acquisition and consolidation of specific knowledge will make available other potential responses. In order for these responses to be generated or selected, the need for an alternative response must be recognized and adequate cognitive resources must be available to inhibit and sustain cognitive decoupling operations (Stanovich & West, 2008b). Basic practical numeracy skills are critical for many judgment and decision-making tasks, including on some of the tasks that rely most heavily on resisting miserly information processing that have already been discussed. There are individual differences in practical numeracy skills among U.S. children, including basic proficiency with percentages, fractions, and probabilities (Reyna & Brainerd, 2007). Individual differences in numeracy have been found to predict performance on rational thinking and decision-making in adults (Peters, 2012; Peters et al., 2006; Sinayev & Peters, 2015; Weller et al., 2013).

Sensitivity to expected value is another domain of mindware relevant to judgment and decision-making performance (Jasper, Bhattacharya, Levin, Jones, & Bossard, 2013). The “cups” task has been used to examine risky decision-making in developmental samples (Levin et al., 2007; Weller, Levin, & Denburg, 2011). In this task, three variables were manipulated: gain versus loss trials, different levels of probability for the risky choices (0.20, 0.33, 0.50), and different levels of outcomes. Each trial required a choice between a certain or risky option. For example, participants choose between a sure gain of 25 cents or a 20% chance of winning 50 cents. The risky option offered either a higher or lower expected value than the certain option. Feedback was given following each choice, and the accumulated money earned was received at the conclusion of the experiment. It was found that adults were more likely to select the options that offered more favorable expected values than children (Levin et al., 2007; Weller et al., 2011).

Scientific thinking and financial concepts are more specialized types of knowledge that are also important for successful performance on several judgment and decision-making tasks (Stanovich et al., 2016). For example, knowledge about how to test and revise theories, design proper controls for extraneous variables, and objectively evaluate evidence are key concepts of scientific thinking (Zimmerman, 2007). Understanding the need for experimental controls, such as isolating variables and inclusion of control conditions, has been shown to increase with age in children (Klahr, Fay, & Dunbar, 1993; Klahr & Nigam, 2004; Masnick & Morris, 2008; Tschirgi, 1980). Older children are also more likely to take covariation among variables into account and resist inappropriate causal inferences than younger children (Klaczynski, 2001; Koslowski, Condry, Sprague, & Hutt, 1996; Koslowski, Okagaki, Lorenz, & Umbach, 1989; Richardson, 1992). Several developmental studies have examined direct knowledge of these principles. However, if these tasks are designed such that knowledge of the scientific reasoning principle conflicts with an intuitive incorrect response, then the task is better categorized as relying heavily on resisting miserly processing and requiring specific mindware.

Financial literacy involves basic knowledge about saving and investing money (e.g., stocks versus savings accounts), knowledge of economics concepts (e.g., supply and demand), and recognizing sunk costs. Admittedly, issues of knowledge become important in developmental samples, as many children and youth may have a limited understanding of many financial concepts. It may not be developmentally suitable to examine many of these concepts in children. In the limited work that has been done with developmental samples, older participants have demonstrated higher levels of financial literacy and more economic thinking than younger participants (Mandell, 2009; Thompson & Siegler, 2000). Empirical findings on sunk cost effects with developmental samples have been more mixed (Baron et al., 1993; Klaczynski, 2001; Morsanyi & Handley, 2008; Strough, Mehta, McFall, & Schuller, 2008).

Resistance to Miserly Information Processing and Reliance on Specific Knowledge or Mindware

Many judgment and decision-making tasks rely heavily on resisting miserly information processing and specific mindware for successful performance (see Stanovich, 2009a, table 12.1). While cognitive failures on some judgment and decision-making tasks may be largely attributable to miserly information processing or missing mindware, performance on some problems may be attributable to either or both of these difficulties. Attribute substitution problems (Fong, Krantz, & Nisbett, 1986; Stanovich et al., 2008), also referred to as vividness effects, require knowledge of base rates (that large sample information is more diagnostic than single-case testimonies), and the tendency to select the vivid, salient personal testimony must be overridden in order to derive an optimal response. Several studies have reported that increasing age is associated with more reliance on base rates and less reliance on salient vivid cases in older youth than in younger children (Davidson, 1995; Klaczynski, 2001; Kokis et al., 2002; Toplak et al., 2014b). Cognitive ability has also been reported to be significantly positively associated with base rate usage (Kokis et al., 2002; Toplak et al., 2014b). However, some studies have reported increased reliance on salient vivid cases in older participants when social stereotypes are involved (Davidson, 1995; De Neys & Vanderputte, 2011; Jacobs & Potenza, 1991).

Conjunction effects, the gambler’s fallacy, and sample size problems are other examples of these types of problems that require specific mindware and resistance to miserly processing. Conjunction effects refer to the tendency to select options that suggest that the conjunction of two events is statistically more likely than the individual event. The gambler’s fallacy refers to a violation of the principal of independence in probability theory, that a coin is statistically more likely to land on tails after five tosses than recognizing that the probability of each outcome (heads or tails) is statistically equal on all tosses. In sample size problems, outcomes based on larger samples should be recognized as providing more diagnostic information than smaller sample sizes. Older youth have been shown to outperform younger youth on the gambler’s fallacy and sample size problems (Chiesi, Primi, & Morsanyi, 2011). However, the findings for conjunction problems with developmental samples have been mixed (Chiesi et al., 2011; Davidson, 1995; Fishbein & Schnarch, 1997; Klaczynski, 2001; Morsanyi & Handley, 2008). The understanding of the conjunction effect involves sophisticated knowledge for developmental samples. Notably, the conjunction effect using within-subject designs has not been consistently associated with individual differences in cognitive abilities in adult samples (Stanovich & West, 1998). These types of tasks, as assessed in the Probabilistic and Statistical Thinking and Scientific Thinking subtests of the Comprehensive Assessment of Rational Thinking (CART) (Stanovich et al., 2016), have been the most robust predictors of overall judgment and decision-making performance.

When Mindware Interferes With Judgment and Decision-Making Performance

The concept of contaminated mindware was first described by Stanovich (2004), which was later described as the “problem of contaminated mindware” (Stanovich, 2009a; Stanovich et al., 2008). Stanovich introduced the constituents of contaminated mindware within the framework of memetic theory, whereby a meme—the cultural unit analogous to a gene (Dawkins, 1976)—is a selfish replicator that exists for its own propagation across culture, regardless of its validity and in the absence of benefit to the person that holds it. Specifically, contaminated mindware refers to the accumulation of misinformation and unwarranted beliefs, some of which may stop individuals from engaging in reflection and considering alternatives (Stanovich, 2009a). A goal of rational thinking is to base our decisions and actions on what we know to be true of the world and accurate beliefs, called epistemic rationality (Stanovich, 2016; Stanovich et al., 2016). Pseudoscientific and unwarranted beliefs contribute to individuals’ accumulation of contaminated mindware, and if relied upon can hinder one’s critical thought processes and in turn lead to poor judgments and decisions (Evans & Stanovich, 2013). There are many categories to contaminated mindware, but three that have been studied empirically in the judgment and decision-making literature include paranormal, conspiracy, and anti-science beliefs and attitudes (Stanovich et al., 2016).

These domains have been examined relatively less in children than in adults, but the construct of superstitious thinking has been examined in some developmental studies. These studies have indicated relatively mixed findings, with some studies suggesting negative trends or associations with age (Kokis et al., 2002; Toplak et al., 2014b) and other studies suggesting positive associations with age (Eve & Dunn, 1990; Preece & Baxter, 2000). One study indicated no association between age and magical thinking (Bolton, Dearsley, Madronal-Luque, & Baron-Cohen, 2002). This is an important and interesting area for continued study in developmental samples, to determine how acquired mindware emerges to potentially interfere with judgment and decision-making performance.

Paranormal phenomena generally violate the principles of science or current scientific understanding (Broad, 1953; Tobacyk & Milford, 1983). Paranormal beliefs include a belief in Psi (e.g., psychokinesis), witchcraft (e.g., spells and black magic), superstition (e.g., lucky numbers), spiritualism (e.g., communication with the deceased), precognition (e.g., astrology predicting the future), extraordinary life forms (e.g., the abominable snowman of Tibet), and supernatural phenomena (Lindeman & Aarnio, 2007; Lindeman & Svedholm, 2012). Among paranormal beliefs, superstitious thinking and beliefs have been most well studied in developmental samples. Some empirical studies have reported a negative association between judgment and decision-making performance and endorsement of superstitious beliefs. Specifically, in a sample of children in grades five, six, and eight, endorsement of superstitious thinking was negatively correlated with deductive reasoning, cognitive ability, and actively open-minded thinking (Kokis et al., 2002). In a sample of children in grades two through nine, endorsement of superstitious thinking was negatively associated with cognitive ability, actively open-minded thinking, and performance on several other judgment and decision-making measures (Toplak et al., 2014b). Similarly, in a sample of children in grades two through eight, superstitious thinking was negatively correlated with cognitive ability, need for cognition, and probabilistic reasoning (Chiesi et al., 2011). Further, in samples of adolescents, superstitious beliefs correlated positively with an intuitive style of thinking and negatively with a rational style of thinking (Marks, Hine, Blore, & Phillips, 2008) and was predictive of gambling behavior (Donati, Chiesi, & Primi, 2013).

Paranormal phenomena have been more extensively studied in childhood and adolescence relative to other domains of contaminated mindware (e.g., Eder, Turic, Milasowszky, Van Adzin, & Hergovich, 2011; Hergovich, Schott, & Arendasy, 2008). One potential explanation for the disproportionate attention given to paranormal beliefs early in development as compared with other domains of contaminated mindware is that paranormal beliefs are observed early in development and manifest in magical and supernatural thought and superstitious rituals (e.g., Bolton et al., 2002; Kokis et al., 2002; Preece & Baxter, 2000). On the other hand, conspiracy and anti-science beliefs become relevant by adolescence, as individuals gain better understanding of science and societal concerns, such as conspiratorial thinking.

Conspiracy theories attribute the cause of an event to secret plots by powerful groups or forces (Douglas & Sutton, 2008; Goertzel, 1994; McCauley & Jacques, 1979). These theories are resistant to falsification and lack evidence of their validity (Sutton & Douglas, 2014), despite sometimes being true. A general conspiracist belief reflects “the unnecessary assumption of conspiracy when other explanations are more probable” (Aaronovitch, 2009, p. 5). Conspiracist belief rejects and deflects criticism, labeling any criticism as part of the conspiracy, further confirming the conspiracist belief system (Boudry & Braeckman, 2012). There is evidence for the prominence of conspiracy beliefs as early as adolescence (e.g., Bogart & Thorburn, 2006; Thorburn & Bogart, 2005). Thorburn and Bogart (2005) discuss the role of sociocultural and historical factors in creating a distrust in the government and medical institutions, which precedes and reinforces conspiracy beliefs as early as adolescence. Anti-science beliefs refer to the rejection of and opposition to the scientific method (Holton, 1992, 1993). General anti-science attitudes and beliefs include seeing science as possessing low credibility (Hartman, Dieckmann, Sprenger, Stastny, & DeMarree, 2017), with a preference for intuition and instinct (Stanovich et al., 2016). Similar rates of endorsement of conspiracy and anti-science beliefs across adolescence and young adults have been demonstrated (Rizeq, Flora, & Toplak, in press).

Future Directions and Conclusions

The developmental literature on judgment and decision-making performance has been shaped by the adult literature on these tasks. Many of the tasks that constitute this literature originated from the classic heuristics and biases literature (Gilovich et al., 2002; Kahneman et al., 1982) and the human reasoning literature (Evans et al., 1993). There have been both advantages and disadvantages of having the adult literature as a reference point for understanding the development of judgment and decision-making. The advantage of course is that the developmental literature has benefitted greatly from the theoretical basis of these models and empirical studies. One major disadvantage has been the stimulus equivalence problem. Perhaps parallel to the same issue as a tailor trying to alter a coat that was made for an adult in order to fit a child, it is not simply a matter of shortening the sleeves and shortening the length of the jacket. Similarly, the most salient aspect of heuristics and biases tasks is the knowledge required for several of these tasks, but there are implications not only of the acquisition of knowledge, but also of the degree of consolidation of the knowledge and whether it has been overlearned to create conflict on several of these tasks. One strategy to address the issue of knowledge is to explicitly assess whether children and youth display evidence of having acquired the relevant knowledge for a given task, but other methods will need to be considered to examine the consolidation or overlearning of knowledge. There are likely age differences in the acquisition and consolidation of specific knowledge structures, but also individual differences within ages in the acquisition and consolidation of these skills. Second, progress in our understanding of development of judgment and decision-making performance may also be impacted by some of the confusions that have needed to be specified further in dual process models in the adult literature (Evans & Stanovich, 2013; Pennycook, De Neys, Evans, Stanovich, & Thompson, 2018). For example, it is equally important in the developmental literature as in the adult literature to be precise about processes (Type 1 or Type 2) versus responses (correct or incorrect), and not to equate types of processes with specific responses (Evans & Stanovich, 2013). Similarly, it is important to recognize that there are important individual differences in the degree of conflict among participants, depending on how well they have consolidated their knowledge (Stanovich, 2018), which may explain why some participants seem to easily generate a correct response on problems that may necessitate override by other participants (Bago & De Neys, 2017).

In addition to continuing to study developmental differences on judgment and decision-making tasks, it is also important to include multiple indicators of cognitive sophistication, such as cognitive abilities and thinking dispositions. For example, it is possible to infer the development of Type 2 processes based on the participants’ selection of correct responses on heuristics and biases tasks, but Type 2 processes may also be indexed by cognitive abilities and thinking dispositions (Toplak et al., 2014b). Overall, children tend to display an increase in cognitive capacities that enable override and hypothetical simulation, such as intelligence and working memory (Evans, 2011), which has been supported in several studies (Brydges, Fox, Reid, & Anderson, 2014; Brydges, Reid, Fox, & Anderson, 2012; Davidson, Amso, Anderson, & Diamond, 2006; Salthouse & Davis, 2006). There is convergence to suggest that cognitive abilities, which support the engagement of Type 2 processes, become increasingly available and sophisticated over the course of development.

Alternatively, Type 1 processes have been described as a “grab-bag,” as these processes still encompass a very broad set of types of processes, including innately specified processing modules and experiential associations that have been learned to automaticity (Stanovich et al., 2011b). In the developmental literature, it is possible to make inferences regarding the availability of these different types of processes at different periods of development. For those Type 1 processes that come from evolutionary modules, such as affective cues from autonomous processes, these processes may be available very early in development. However, Type 1 processes acquired from experiential or learned associations are a more complex domain given the considerations described previously, regarding the acquisition and consolidation of knowledge. In adults, it may be presumed with some confidence that some types of knowledge have been tightly compiled to automaticity. However, in children, some of the specific knowledge or mindware needed to derive an optimal response may not have been learned or consolidated. As children get older, they will learn more relevant knowledge or mindware that will become increasingly consolidated, and this mindware will begin to behave like Type 1 processes to support rational responding on some tasks (Stanovich et al., 2011b). For example, knowledge of probability and base rates will be acquired, and if this knowledge is consolidated, it can support rational responding. Other types of knowledge, such as knowledge of stereotypes, also become consolidated and autonomously triggered but may interfere with rational responding.

Younger children will have less mindware available, which has been acknowledged by others in the literature (De Neys & van Gelder, 2009). Thinking dispositions support the detection of the need for override, and cognitive abilities (such as fluid intelligence) support the cognitive decoupling to generate an alternative response (Stanovich, 2011). There is some evidence to suggest that detection failures are more likely in younger than older children (De Neys, 2013; De Neys & Feremans, 2013). There is also some evidence to suggest the emergence of thinking dispositions relevant to judgment and decision-making in developmental samples (Kokis et al., 2002; Toplak et al., 2014b). With development and with increases in cognitive capacities and dispositions, older children will be more likely to engage Type 2 processes and have available compiled mindware that may lead to more normative responding (Stanovich et al., 2011b). Figure 1 provides a visual schematic identifying sources of individual differences for judgment and decision-making tasks: recognizing emotional signals, cognitive abilities (intelligence and executive function task performance), cognitive and thinking dispositions, and specific knowledge. There is work to be done to determine at what point in development each of these foundation skills are well developed, but the staggered organization of each of these foundation skills is meant to imply that there may be differences when these foundations are available at different periods of development. Identifying the precursor skills and abilities that underlie judgment and decision-making performance in children and youth will provide a way to further operationalize the necessary skills and abilities for these tasks.

It may be the case that development of judgment and decision-making is not a paradox of emerging competence and individual differences in normative responding in adult samples. It is quite possible that both are the case: there is considerable cognitive growth and potential to derive more complex responses and solutions to judgment and decision-making problems, but these competencies do not guarantee successful performance on several of these tasks. It is important to note that the presence of sophisticated cognitive abilities does not guarantee their use (Morsanyi & Handley, 2013; Stanovich et al., 2011b), but cognitive sophistication generally does increase the likelihood of normative correct responding on several heuristics and biases tasks. It will be important to continue to derive testable hypotheses to examine performance on all types of judgment and decision-making tasks and to examine converging patterns of performance with other measures in order to work towards models of rational thinking in developmental samples.

Figure 1. Foundations for the development of judgment and decision-making: sources of individual differences in performance.

References

  • Aaronovitch, D. (2009). Voodoo histories: The role of the conspiracy theory in shaping modern History. London, UK: Jonathan Cape.
  • Ackerman, R., & Thompson, V. (2017). Meta-reasoning: Monitoring and control of thinking and reasoning. Trends in Cognitive Sciences, 21(8), 607–617.
  • Adams, D. (1993). Defining educational quality. Educational Planning, 9(3), 3–18.
  • Bago, B., & De Neys, W. (2017). Fast logic? Examining the time course assumption of dual process theory. Cognition, 158, 90–109.
  • Baron, J. (1995). Myside bias in thinking about abortion. Thinking and Reasoning, 1, 221–235.
  • Baron, J. (2000). Thinking and deciding (3rd ed.). Cambridge, UK: Cambridge University Press.
  • Baron, J., Granato, L., Spranca, M., & Teubal, E. (1993). Decision making biases in children and early adolescents: Exploratory studies. Merrill-Palmer Quarterly, 39, 22–46.
  • Bogart, L. M., & Thorburn, S. (2006). Relationship of African Americans’ sociodemographic characteristics to belief in conspiracies about HIV/AIDS and birth control. Journal of the National Medical Association, 98(7), 1144.
  • Bolton, D., Dearsley, P., Madronal-Luque, R., & Baron-Cohen, S. (2002). Magical thinking in childhood and adolescence: Development and relation to obsessive compulsion. British Journal of Developmental Psychology, 20, 479–494.
  • Boudry, M., & Braeckman, J. (2012). How convenient! The epistemic rationale of self-validating belief systems. Philosophical Psychology, 25(3), 341–364.
  • Brainerd, C. J., & Reyna, V. F. (2001). Fuzzy-trace theory: Dual processes in memory, reasoning, and cognitive neuroscience. In H. W. Reese & R. Kail (Eds.), Advances in child development and behavior (Vol. 28, pp. 41–100). San Diego, CA: Academic Press.
  • Broad, C. D. (1953). Religion, philosophy, and psychical research. New York, NY: Harcourt, Brace.
  • Brydges, C. R., Fox, A. M., Reid, C. L., & Anderson, M. (2014). Predictive validity of the N2 and P3 ERP components to executive functioning in children: A latent-variable analysis. Frontiers in Human Neuroscience, 8, 80.
  • Brydges, C. R., Reid, C. L, Fox, A. M., & Anderson, M. (2012). A unitary executive function predicts intelligence in children. Intelligence, 40(5), 458–469.
  • Byrnes, J. P., & Beilin, H. (1991). The cognitive basis of uncertainty. Human Development, 34(4), 189–203.
  • Cacioppo, J. T., Petty, R. E., Feinstein, J., & Jarvis, W. (1996). Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. Psychological Bulletin, 119, 197–253.
  • Chall, J. S. (1983). Stages of reading development. New York, NY: McGraw-Hill.
  • Chien, Y. C., Lin, C., & Worthley, J. (1996). Effect of framing on adolescents’ decision making. Perceptual and Motor Skills, 83, 811–819.
  • Chiesi, F., Primi, C., & Morsanyi, K. (2011). Developmental changes in probabilistic reasoning: The role of cognitive capacity, instructions, thinking styles, and relevant knowledge. Thinking & Reasoning, 17(3), 315–350.
  • Crone, E. A., & van der Molen, M. W. (2004). Developmental changes in real life decision making: Performance on a gambling task previously shown to depend on the ventromedial prefrontal cortex. Developmental Neuropsychology, 25, 251–279.
  • Damasio, A. R. (1994). Descartes’ error. New York, NY: Putnam.
  • Damasio, A. R. (1996). The somatic marker hypothesis and the possible functions of the prefrontal cortex. Philosophical Transactions of the Royal Society (London), 351, 1413–1420.
  • Damasio, A. R. (1999). The feeling of what happens. New York, NY: Harcourt Brace.
  • Davidson, D. (1995). The representativeness heuristic and the conjunction fallacy effect in children’s decision making. Merrill-Palmer Quarterly, 41, 328–346.
  • Davidson, M. C., Amso, D., Anderson, L. C., & Diamond, A. (2006). Development of cognitive control and executive functions from 4 to 13 years: Evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia, 44(11), 2037–2078.
  • Dawkins, R. (1976). The selfish gene. New York, NY: Oxford University Press.
  • De Neys, W. (2012). Bias and conflict: A case for logical intuitions. Perspectives on Psychological Science, 7(1), 28–38.
  • De Neys, W. (2013). Heuristics, biases, and the development of conflict detection during reasoning. In H. Markovits (Ed.), The developmental psychology of reasoning and decision making (pp. 130–147). Hove, UK: Psychology Press.
  • De Neys, W., & Feremans, V. (2013). Development of heuristic bias detection in elementary school. Developmental Psychology, 49(2), 258.
  • De Neys, W., & van Gelder, E. (2009). Logic and belief across the lifespan: The rise and fall of belief inhibition during syllogistic reasoning. Developmental Science, 12(1), 123–130.
  • De Neys, W., & Vanderputte, K. (2011). When less is not always more: Stereotype knowledge and reasoning development. Developmental Psychology, 47, 432–441.
  • Denes-Raj, V., & Epstein, S. (1994). Conflict between intuitive and rational processing: When people behave against their better judgment. Journal of Personality and Social Psychology, 66, 819–829.
  • Desoete, A., & Roeyers, H. (2006): Metacognitive macroevaluations in mathematical problem solving. Learning and Instruction, 16, 12–25.
  • Donati, M. A., Chiesi, F., & Primi, C. (2013). A model to explain at-risk/problem gambling among male and female adolescents: Gender similarities and differences. Journal of Adolescence, 36(1), 129–137.
  • Douglas, K. M., & Sutton, R. M. (2008).The hidden impact of conspiracy theories: Perceived and actual influence of theories surrounding the death of Princess Diana. Journal of Social Psychology, 148, 210–222.
  • Dunn, B. D., Dalgleish, T., & Lawrence, A. D. (2006). The somatic marker hypothesis: A critical evaluation. Neuroscience and Biobehavioral Reviews, 30(2), 239–271.
  • Eder, E., Turic, K., Milasowszky, N., Van Adzin, K., & Hergovich, A. (2011). The relationships between paranormal belief, creationism, intelligent design and evolution at secondary schools in Vienna (Austria). Science & Education, 20(5–6), 517–534.
  • Evans, J. S. B. T. (2003). In two minds: Dual-process accounts of reasoning. Trends in Cognitive Sciences, 7, 454–459.
  • Evans, J. S. B. T. (2007). On the resolution of conflict in dual process theories of reasoning. Thinking & Reasoning, 13(4), 321–339.
  • Evans, J. S. B. T. (2008). Dual-processing accounts of reasoning, judgment and social cognition. Annual Review of Psychology, 59, 255–278.
  • Evans, J. S. B. T. (2010). Thinking twice: Two minds in one brain. Oxford, UK: Oxford University Press.
  • Evans, J. S. B. T. (2011). Dual-process theories of reasoning: Contemporary issues and developmental applications. Developmental Review, 31, 86–102.
  • Evans, J. S. B. T. (2012). Dual-process theories of reasoning: Facts and fallacies. In K. J. Holyoak & R. G. Morrison (Eds.), The Oxford handbook of thinking and reasoning (pp. 115–133). New York, NY: Oxford University Press.
  • Evans, J. S. B. T. (2017). A brief history of the Wason selection task. In N. Galbraith, E. Lucas, & D. E. Over (Eds.), The thinking mind: A festschrift for Ken Manktelow (pp. 1–14). New York, NY: Routledge/Taylor & Francis Group.
  • Evans, J. S. B. T., Newstead, S. E., & Byrne, R. M. J. (1993). Human reasoning: The psychology of deduction (pp. 137–162). Hillsdale, NJ: Lawrence Erlbaum.
  • Evans, J. S. B. T., & Over, D. E. (1996). Rationality and reasoning. Hove, UK: Psychology Press.
  • Evans, J. S. B. T., & Perry, T. (1995). Belief bias in children’s reasoning. Cahiers de Psychologie Cognitive, 14, 103–115.
  • Evans, J. S. B. T., & Stanovich, K. E. (2013). Dual-process theories of higher cognition: Advancing the debate. Perspectives on Psychological Science, 8, 223–241.
  • Eve, R. A., & Dunn, D. (1990). Psychic powers, astrology & creationism in the classroom? Evidence of pseudoscientific beliefs among high school biology & life science teachers. The American Biology Teacher, 52(1), 10–21.
  • Fishbein, E., & Schnarch, D. (1997). The evolution with age of probabilistic, intuitively-based misconceptions. Journal for Research in Mathematics Education, 28, 96–105.
  • Flavell, J. H., Miller, P. H. & Miller, S. A. (1993). Cognitive development (3rd ed.). Englewood Cliffs, NJ: Prentice Hall.
  • Fong, G. T., Krantz, D. H., & Nisbett, R. E. (1986). The effects of statistical training on thinking about everyday problems. Cognitive Psychology, 18, 253–292.
  • Frederick, S. (2005). Cognitive reflection and decision making. Journal of Economic Perspectives, 19, 25–42.
  • Garon, N., & Moore, C. (2004). Complex decision-making in early childhood. Brain and Cognition, 55, 158–170.
  • Gilovich, T., Griffin, D., & Kahneman, D. (2002). Heuristics and biases: The psychology of intuitive judgment. Cambridge, UK: Cambridge University Press.
  • Goertzel, T. (1994). Belief in conspiracy theories. Political Psychology, 15, 731–742.
  • Green, L., Fry, A. F., & Myerson, J. (1994). Discounting of delayed rewards: A life-span comparison. Psychological Science, 5(1), 33–36.
  • Halpern, D. F. (1997). Critical thinking across the curriculum: A brief edition of thought and knowledge. Mahwah, NJ: Lawrence Erlbaum.
  • Halpern, D. F., & Riggio, H. R. (2003). Thinking critically about critical thinking (4th ed.). Mahwah, NJ: Lawrence Erlbaum.
  • Handley, S. J., Capon, A., Beveridge, M., Dennis, I., & Evans, J. S. B. T. (2004). Working memory, inhibitory control and the development of children’s reasoning. Thinking and Reasoning, 10, 175–195.
  • Hartman, R. O., Dieckmann, N. F., Sprenger, A. M., Stastny, B. J., & DeMarree, K. G. (2017). Modeling attitudes toward science: Development and validation of the credibility of science scale. Basic and Applied Social Psychology, 39(6), 358–371.
  • Hergovich, A., Schott, R., & Arendasy, M. (2008). On the relationship between paranormal belief and schizotypy among adolescents. Personality and Individual Differences, 45(2), 119–125.
  • Holton, G. (1992). How to think about the anti-science phenomenon. Public Understanding of Science, 1, 103–128.
  • Holton, G. J. (1993). Science and anti-science. Cambridge, MA: Harvard University Press.
  • Hongwanishkul, D., Happaney, K. R., Lee, W. S. C., & Zelazo, P. D. (2005). Assessment of hot and cool executive function in young children: Age-related changes and individual differences. Developmental Neuropsychology, 28, 617–644.
  • Hooper, C. J., Luciana, M., Conklin, H. M., & Yarger, R. S. (2004). Adolescents’ performance on the Iowa Gambling Task: Implications for the development of decision making and ventromedial prefrontal cortex. Developmental Psychology, 40, 1148–1158.
  • Jacobs, J. E., & Potenza, M. (1991). The use of judgment heuristics to make social and object decisions: A developmental perspective. Child Development, 62, 166–178.
  • Jasper, J. D., Bhattacharya, C., Levin, I. P., Jones, L., & Bossard, E. (2013). Numeracy as a predictor of adaptive risky decision making. Journal of Behavioral Decision Making, 26(2), 164–173.
  • Kahneman, D. (2011). Thinking, fast and slow. New York, NY: Farrar, Straus & Giroux.
  • Kahneman, D., Slovic, P., & Tversky, A. (1982). Judgment under uncertainty: Heuristics and biases. Cambridge, UK: Cambridge University Press.
  • Kahneman, D., & Tversky, A. (1984). Choices, values, and frames. American Psychologist, 39, 341–350.
  • Kahneman, D., & Tversky, A. (Eds.). (2000). Choices, values, and frames. Cambridge, UK: Cambridge University Press.
  • Kirkpatrick, L., & Epstein, S. (1992). Cognitive-experiential self-theory and subjective probability: Evidence for two conceptual systems. Journal of Personality and Social Psychology, 63, 534–544.
  • Klaczynski, P. A. (2001). Analytic and heuristic processing influences on adolescent reasoning and decision making. Child Development, 72, 844–861.
  • Klaczynski, P. A., & Lavallee, K. L. (2005). Domain-specific identity, epistemic regulation, and intellectual ability as predictors of belief-based reasoning: A dual-process perspective. Journal of Experimental Child Psychology, 92, 1–24.
  • Klaczynski, P. A., & Narasimham, G. (1998). Development of scientific reasoning biases: Cognitive versus ego-protective explanations. Developmental Psychology, 34, 175–187.
  • Klahr, D., Fay, A. L., & Dunbar, K. (1993). Heuristics for scientific experimentation: A developmental study. Cognitive Psychology, 25, 111–146.
  • Klahr, D., & Nigam, M. (2004). The equivalence of learning paths in early science instruction: Effects of direct instruction and discovery learning. Psychological Science, 15, 661–667.
  • Kokis, J., Macpherson, R., Toplak, M., West, R. F., & Stanovich, K. E. (2002). Heuristic and analytic processing: Age trends and associations with cognitive ability and cognitive styles. Journal of Experimental Child Psychology, 83, 26–52.
  • Koslowski, B., Condry, K., Sprague, K., & Hutt, M. (1996). Beliefs about covariation and causal mechanisms—Implausible as well as plausible. Experiment 4. In B. Koslowski (Ed.), Theory and evidence: The development of scientific reasoning (pp. 111–120). Cambridge, MA: MIT Press.
  • Koslowski, B., Okagaki, L., Lorenz, C., & Umbach, D. (1989). When covariation is not enough: The role of causal mechanism, sampling method, and sample size in causal reasoning. Child Development, 60, 1316–1327.
  • Kuhn, D. (2005). Education for thinking. Cambridge, MA: Harvard University Press.
  • Kuhn, D., Hemberger, L. & Khait, V. (2016). Argue with me: Argument as a path to developing students’ thinking and writing (2nd ed.). New York, NY: Routledge.
  • Lamm, C., Zelazo, P. D., & Lewis, M. D. (2006). Neural correlates of cognitive control in childhood and adolescence: Disentangling the contributions of age and executive function. Neuropsychologia, 44(11), 2139–2148.
  • Levin, I. P., & Hart, S. S. (2003). Risk preferences in young children: Early evidence of individual differences in reaction to potential gains and losses. Journal of Behavioral Decision Making, 16, 397–413.
  • Levin, I. P., Weller, J. A., Pederson, A. A., & Harshman, L. A. (2007). Age-related differences in adaptive decision making: Sensitivity to expected value in risky choice. Judgment and Decision Making, 2(4), 225–233.
  • Liberali, J. M., Reyna, V. F., Furlan, S., Stein, L. M., & Pardo, S. T. (2012). Individual differences in numeracy and cognitive reflection, with implications for biases and fallacies in probability judgment. Journal of Behavioral Decision Making, 25(4), 361–381.
  • Lindeman, M., & Aarnio, K. (2007). Superstitious, magical, and paranormal beliefs: An integrative model. Journal of Research in Personality, 41, 731–744.
  • Lindeman, M., & Svedholm, A. M. (2012). What’s in a term? Paranormal, superstitious, magical and supernatural beliefs by any other name would mean the same. Review of General Psychology, 16(3), 241.
  • Lipko, A. R., Dunlosky, J., & Merriman, W. E. (2009). Persistent overconfidence despite practice: The role of task experience in preschoolers’ recall predictions. Journal of Experimental Child Psychology, 103, 152–166.
  • McCauley, C., & Jacques, S. (1979). The popularity of conspiracy theories of presidential assassination: A Bayesian analysis. Journal of Personality and Social Psychology, 37(5), 637.
  • Mandell, L. (2009). The financial literacy of young American adults. Washington, DC: JumpStart Coalition for Personal Financial Literacy.
  • Markovits, H. (2013a). Introduction. In H. Markovits (Ed.), The developmental psychology of reasoning and decision-making (pp. 1–4). London, UK: Psychology Press.
  • Markovits, H. (2013b). How to develop a logical reasoner: A hierarchical model of the role of divergent thinking in the development of conditional reasoning. In H. Markovits (Ed.), The developmental psychology of reasoning and decision-making (pp. 148–164). London, UK: Psychology Press.
  • Markovits, H. (2018). The development of logical reasoning. In L. J. Ball & V. A. Thompson (Eds.), The Routledge international handbook of thinking and reasoning (pp. 383–400). London, UK: Routledge.
  • Markovits, H., & Bouffard-Bouchard, T. (1992). The belief-bias effect in the reasoning: The development and activation of competence. British Journal of Developmental Psychology, 10, 269–284.
  • Markovits, H., & Lortie-Forgues, H. (2011). Conditional reasoning with false premises facilitates the transition between familiar and abstract reasoning. Child Development, 82(2), 646–660.
  • Markovits, H., & Thompson, V. (2008). Different developmental patterns of simple deductive and probabilistic inferential reasoning. Memory & Cognition, 36(6), 1066–1078.
  • Markovits, H., & Vachon, R. (1990). Conditional reasoning, representation, and level of abstraction. Developmental Psychology, 26(6), 942–951.
  • Markovits, H., Venet, M., Janveau-Brennan, G., Malfait, N., Pion, N., & Vadeboncoeur, I. (1996). Reasoning in young children: Fantasy and information retrieval. Child Development, 67, 2857–2872.
  • Marks, A. D., Hine, D. W., Blore, R. L., & Phillips, W. J. (2008). Assessing individual differences in adolescents’ preference for rational and experiential cognition. Personality and Individual Differences, 44(1), 42–52.
  • Masnick, A. M., & Morris, B. J. (2008). Investigating the development of data evaluation: The role of data characteristics. Child Development, 79(4), 1032–1048.
  • Mischel, W. (1973). Toward a cognitive social learning reconceptualization of personality. Psychological Review, 80, 252–283.
  • Mischel, W. (2014). The marshmallow test: Why self-control is the engine of success. New York, NY: Little, Brown.
  • Mischel, W., & Ebbesen, E. B. (1970). Attention in delay of gratification. Journal of Personality and Social Psychology, 16, 329–337.
  • Mischel, W., Shoda, Y., & Peake, P. K. (1988). The nature of adolescent competencies predicted by preschool delay of gratification. Journal of Personality and Social Psychology, 54(4), 687–696.
  • Miyake, A., & Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: Four general conclusions. Current Directions in Psychological Science, 21(1), 8–14.
  • Morsanyi, K., & Handley, S. J. (2008). How smart do you need to be to get it wrong? The role of cognitive capacity in the development of heuristic-based judgment. Journal of Experimental Child Psychology, 99, 18–36.
  • Morsanyi, K. & Handley, S. J. (2013). Heuristics and biases: Insights from developmental studies. In P. Barrouillet & C. Gauffroy (Eds.), The development of thinking and reasoning (pp. 122–149). London, UK: Psychology Press.
  • Newman, R. S. (1984). Children’s numerical skill and judgments of confidence in estimation. Journal of Experimental Child Psychology, 37, 107–123.
  • Oatley, K. (1999). Why fiction may be twice as true as fact: Fiction as cognitive and emotional simulation. Review of General Psychology, 3, 101–117.
  • Pennycook, G., De Neys, W., Evans, J., Stanovich, K. E., & Thompson, V. A. (2018). The mythical dual-process typology. Trends in Cognitive Sciences, 22(8), 667–668.
  • Pennycook, G., Fugelsang, J. A., & Koehler, D. J. (2015). What makes us think? A three-stage dual-process model of analytic engagement. Cognitive Psychology, 80, 34–72.
  • Perkins, D. N., Farady, M., & Bushey, B. (1991). Everyday reasoning and the roots of intelligence. In J. Voss, D. Perkins, & J. Segal (Eds.), Informal reasoning and education (pp. 83–105). Hillsdale, NJ: Erlbaum.
  • Peters, E. (2012). Beyond comprehension: The role of numeracy in judgments and decisions. Current Directions in Psychological Science, 21(1), 31–35.
  • Peters, E., Västfjäll, D., Slovic, P., Mertz, C. K., Mazzocco, K., & Dickert, S. (2006). Numeracy and decision making. Psychological Science, 17, 407–413.
  • Preece, P. F. W., & Baxter, J. H. (2000). Scepticism and gullibility: The superstitious and pseudo-scientific beliefs of secondary school students. International Journal of Science Education, 22(11), 1147–1156.
  • Prencipe, A., Kesek, A., Cohen, J., Lamm, C., Lewis, M. D., & Zelazo, P. D. (2006). Development of hot and cool executive function during the transition to adolescence. Journal of Experimental Child Psychology, 108, 621–637.
  • Primi, C., Morsanyi, K., Chiesi, F., Donati, M. A., & Hamilton, J. (2015). The development and testing of a new version of the Cognitive Reflection Test applying item response theory (IRT). Journal of Behavioral Decision Making, 29(5), 453–469.
  • Rachlin, H., Raineri, A., & Cross, D. (1991). Subjective probability of delay. Journal of The Experimental Analysis of Behavior, 55, 233–244.
  • Reyna, V. F. (1995). Interference effects in memory and reasoning: A fuzzy-trace theory analysis. In F. N. Dempster & C. J. Brainerd (Eds.), Interference and inhibition in cognition (pp. 29–59). San Diego, CA: Academic Press.
  • Reyna, V. F., & Brainerd, C. J. (1994). The origins of probability judgment: A review of data and theories. In G. Wright & P. Ayton (Eds.), Subjective probability (pp. 239–272). New York, NY: Wiley.
  • Reyna, V. F., & Brainerd, C. J. (2007). The importance of mathematics in health and human judgment: Numeracy, risk communication, and medical decision making. Learning and Individual Differences, 17(2), 147–159.
  • Reyna, V. F., & Ellis, S. (1994). Fuzzy-trace theory and framing effects in children’s risky decision making. Psychological Science, 5, 275–279.
  • Richardson, K. (1992). Covariation analysis of knowledge representation: Some developmental studies. Journal of Experimental Child Psychology, 53, 129–150.
  • Rizeq, J., Flora, D. B., & Toplak, M. E. (in press). Contaminated mindware in adolescence: Correlations and developmental comparisons.
  • Salthouse, T. A., Atkinson, T. M., & Berish, D. E. (2003). Executive functioning as a potential mediator of age-related cognitive decline in normal adults. Journal of Experimental Psychology: General, 132(4), 566.
  • Salthouse, T. A., & Davis, H. P. (2006). Organization of cognitive abilities and neuropsychological variables across the lifespan. Developmental Review, 26, 31–54.
  • Schlottmann, A., & Tring, J. (2005). How children reason about gains and losses: Framing effects in judgement and choice. Swiss Journal of Psychology, 64(3), 153–171.
  • Schlottmann, A., & Wilkening, F. (2011). Judgment and decision making in young children. In M. K. DhamiA. Schlottmann, & M. Waldmann (Eds.), Judgement and decision making as a skill: Learning, development, and evolution (pp. 55–83). Cambridge, UK: Cambridge University Press.
  • Schneider, W., Visé, M., Lockl, K., & Nelson, R. O. (2000). Developmental trends in children’s memory monitoring: Evidence from a judgment-of-learning task. Cognitive Development, 15, 115–134.
  • Shing, Y. L., Lindenberger, U., Diamond, A., Li, S.-C., & Davidson, M. C. (2010). Memory maintenance and inhibitory control differentiate from early childhood to adolescence. Developmental Neuropsychology, 35(6), 679–697.
  • Sinatra, G. M., & Pintrich, P. R. (Eds.). (2003). Intentional conceptual change. Mahwah, NJ: Erlbaum.
  • Sinayev, A., & Peters, E. (2015). Cognitive reflection versus calculation in decision making. Frontiers in Psychology, 6, 532.
  • Sloman, S. A. (1996). The empirical case for two systems of reasoning. Psychological Bulletin, 119, 3–22.
  • Smith, L. (1999). Necessary knowledge in number conservation. Developmental Science, 2, 23–27.
  • Stanovich, K. E. (1999). Who is rational? Studies of individual differences in reasoning. Mahwah, NJ: Lawrence Erlbaum.
  • Stanovich, K. E. (2004). The robot’s rebellion: Finding meaning in the age of Darwin. Chicago, IL: University of Chicago Press.
  • Stanovich, K. E. (2009a). What intelligence tests miss: The psychology of rational thought. New Haven, CT: Yale University Press.
  • Stanovich, K. E. (2009b). Distinguishing the reflective, algorithmic, and autonomous minds: Is it time for a tri-process theory? In J. Evans & K. Frankish (Eds.), In two minds: Dual process and beyond (pp. 55–88). Oxford, UK: Oxford University Press.
  • Stanovich, K. E. (2011). Rationality and the reflective mind. New York, NY: Oxford University Press.
  • Stanovich, K. E. (2016). The comprehensive assessment of rational thinking. Educational Psychologist, 51(1), 23–34.
  • Stanovich, K. E. (2018). Miserliness in human cognition: The interaction of detection, override and mindware. Thinking & Reasoning, 24(4), 423–444.
  • Stanovich, K. E., & Toplak, M. E. (2012). Defining features versus incidental correlates of Type 1 and Type 2 processing. Mind & Society, 11, 3–13.
  • Stanovich, K. E., Toplak, M. E., & West, R. F. (2008). The development of rational thought: A taxonomy of heuristics and biases. Advances in Child Development and Behavior, 36, 251–285.
  • Stanovich, K. E., & West, R. F. (1997). Reasoning independently of prior belief and individual differences in actively open-minded thinking. Journal of Educational Psychology, 89, 342–357.
  • Stanovich, K. E., & West, R. F. (1998). Individual differences in framing and conjunction effects. Thinking and Reasoning, 4, 289–317.
  • Stanovich, K. E., & West, R. F. (2007). Natural myside bias is independent of cognitive ability. Thinking & Reasoning, 13(3), 225–247.
  • Stanovich, K. E., & West, R. F. (2008a). On the failure of intelligence to predict myside bias and one-sided bias. Thinking & Reasoning, 14, 129–167.
  • Stanovich, K. E., & West, R. F. (2008b). On the relative independence of thinking biases and cognitive ability. Journal of Personality and Social Psychology, 94, 672–695.
  • Stanovich, K. E., West, R. F., & Toplak, M. E. (2011a). Intelligence and rationality. In R. J. Sternberg & S. B. Kaufman (Eds.), Cambridge handbook of intelligence (pp. 784–826). New York, NY: Cambridge University Press.
  • Stanovich, K. E., West, R. F., & Toplak, M. E. (2011b). The complexity of developmental predictions from dual process models. Developmental Review, 31, 103–118.
  • Stanovich, K. E., West, R. F., & Toplak, M. E. (2012). Judgment and decision making in adolescence: Separating intelligence from rationality. In V. F. Reyna, S. Chapman, M. Dougherty, & J. Confrey (Eds.), The adolescent brain: Learning, reasoning, and decision-making. Washington, DC: American Psychological Association.
  • Stanovich, K. E., West, R. F., & Toplak, M. E. (2016). The rationality quotient (RQ): Toward a test of rational thinking. Cambridge, MA: MIT Press.
  • Steegen, S., & De Neys, W. (2012). Belief inhibition in children’s reasoning: Memory-based evidence. Journal of Experimental Child Psychology, 112, 231–242.
  • Steinberg, L. (2010). A dual systems model of adolescent risk-taking. Developmental Psychobiology, 52, 216–224.
  • Steinberg, L., Graham, S., O’Brien, L., Woolard, J., Cauffman, E., & Banich, M. (2009). Age differences in future orientation and delay discounting. Child Development, 80, 28–44.
  • Sternberg, R. J. (2003). Wisdom, intelligence, and creativity synthesized. Cambridge, UK: Cambridge University Press.
  • Strathman, A., Gleicher, F., Boninger, D. S., & Edwards, S. (1994). The consideration of future consequences: Weighing immediate and distant outcomes of behavior. Journal of Personality and Social Psychology, 66, 742–752.
  • Strough, J., Mehta, C. M., McFall, J. P., & Schuller, K. L. (2008). Are older adults less subject to the sunk-cost fallacy than younger adults? Psychological Science, 19, 650–652.
  • Sutton, R. M., & Douglas, K. M. (2014). Examining the monological nature of conspiracy theories. In J. W. van Prooijen & P. A. M. van Lange (Eds.), Power, politics, and paranoia: Why people are suspicious of their leaders (pp. 254–273). Cambridge, UK: Cambridge University Press.
  • Thompson, D. R., & Siegler, R. S. (2000). Buy low, sell high: The development of an informal theory of economics. Child Development, 71, 660–677.
  • Thorburn, S., & Bogart, L. M. (2005). Conspiracy beliefs about birth control: Barriers to pregnancy prevention among African Americans of reproductive age. Health Education & Behavior, 32(4), 474–487.
  • Tobacyk, J., & Milford, G. (1983). Belief in paranormal phenomena: Assessment instrument development and implications for personality functioning. Journal of Personality and Social Psychology, 44(5), 1029.
  • Toplak, M. E. (2018). The development of rational thinking: Insights from the heuristics and biases literature and dual process models. In L. J. Ball & V. A. Thompson (Eds.), The Routledge international handbook of thinking and reasoning (pp. 542–558). London, UK: Routledge.
  • Toplak, M. E., Hosseini, A., & Basile, A. G. (2016). Temporal discounting and associations with cognitive abilities and ADHD-related difficulties in a developmental sample. In M. E. Toplak & J. Weller (Eds.), Individual differences in judgment and decision making: A developmental perspective (pp. 95–116). London, UK: Psychology Press.
  • Toplak, M. E., & Stanovich, K. E. (2003). Associations between myside bias on an informal reasoning task and amount of post-secondary education. Applied Cognitive Psychology, 17(7), 851–860.
  • Toplak, M. E., West, R. F., & Stanovich, K. E. (2011). The Cognitive Reflection Test as a predictor of performance on heuristics and biases tasks. Memory & Cognition, 39, 1275–1289.
  • Toplak, M. E., West, R. F., & Stanovich, K. E. (2012). Education for rational thought. In J. Kirby & M. Lawson (Eds.), Enhancing the quality of learning: Dispositions, instruction, and learning processes (pp. 51–92). New York, NY: Cambridge University Press.
  • Toplak, M. E., West, R. F., & Stanovich, K. E. (2013). Assessing the development of rationality. In H. Markovits (Eds.), Understanding the development of reasoning and decision-making (pp. 7–35). New York, NY: Psychology Press.
  • Toplak, M. E., West, R. F., & Stanovich, K. E. (2014a). Assessing miserly processing: An expansion of the Cognitive Reflection Test. Thinking & Reasoning, 20, 147–168.
  • Toplak, M. E., West, R. F., & Stanovich, K. E. (2014b). Rational thinking and cognitive sophistication: Development, cognitive abilities, and thinking dispositions. Developmental Psychology, 50, 1037–1048.
  • Tschirgi, J. E. (1980). Sensible reasoning: A hypothesis about hypotheses. Child Development, 51, 1–10.
  • van der Sluis, S., de Jong, P. F., & van der Leij, A. (2007). Executive functioning in children, and its relations with reasoning, reading, and arithmetic. Intelligence, 35(5), 427–449.
  • Weldon, R. B., Corbin, J. C., & Reyna, V. F. (2014). Gist processing in judgment and decision making: Developmental reversals predicted by fuzzy-trace theory. In H. Markovits (Ed.), The developmental psychology of reasoning and decision-making (pp. 36–62). New York, NY: Psychology Press.
  • Weller, J. A., Dieckmann, N. F., Tusler, M., Mertz, C. K., Burns, W. J., & Peters, E. (2013). Development and testing of an abbreviated numeracy scale: A Rasch Analysis approach. Journal of Behavioral Decision Making, 26(2), 198–212.
  • Weller, J. A., Levin, I. P., & Denburg, N. L. (2011). Trajectory of risky decision making for potential gains and losses from ages 5 to 85. Journal of Behavioral Decision Making, 24, 331–344.
  • Weller, J. A., Levin, I. P., Rose, J. P., & Bossard, E. (2012). Assessment of decision-making competence in preadolescence. Journal of Behavioral Decision Making, 25(4), 414–426.
  • Zimmerman, C. (2007). The development of scientific thinking skills in elementary and middle school. Developmental Review, 27, 172–223.