Arsaythamby Veloo and Ruzlan Md-Ali
This is an advance summary of a forthcoming article in the Oxford Research Encyclopedia of Education. Please check back later for the full article.
Educational assessment modes and practices will change in the 21st century due to the advancement of technology in education. Consequently, this creates high expectations among stakeholders who are directly involved with assessment administration as well as professional responsibilities in assessment administration. Accountability of assessment administration includes maintaining assessment security and integrity. Assessments must be aligned with learning outcomes and instruction. Assessment administration policies should be aligned with an institution’s assessment policies. Hence, assessment administrators collaborate with the institutions to develop and unify assessment standards and practices toward the enhancement of accessing students’ overall competence. Optimum performance and typical performance covers cognitive, affective, and psychomotor aspects.
For example, in Malaysia, Integrated Cumulative Grade Point Average has been introduced in assessing higher education students’ holistic performance, an extension from the implementation of School-based Assessment in Malaysian schools beginning in the year 2011. Previous assessment practices that focused more on cognitive aspects only involved paper and pencil tests. Thus, there were not many issues pertaining to assessment administration. However, to overcome the challenges in the new direction of assessment in the 21st century, it is important to pay particular attention to the accountability of assessment administration. There is also a need to accommodate and modify assessment administration according to the needs of current assessment mode and practices. We cannot wholly depend on standardized procedures all the time, because the nature of assessment may differ according to students’ ability, the types and venues of assessment, and national agendas.
Assessment administrators are accountable to ensure that honesty, integrity, due care, validity, reliability, and fairness are observed and maintained during the assessment. The administration of educational assessment generally involves three major phases, namely preassessment administration, assessment during administration, and postassessment administration. There are standardized documented rules and procedures that assessment administrators need to follow when administering educational assessment to ensure that standards of accountability are upheld.
This is an advance summary of a forthcoming article in the Oxford Research Encyclopedia of Education. Please check back later for the full article.
Herein the term Action Research is addressed by reflecting upon two words, action and research, united within this century to create something quite useful and commonplace. The word research, which has a long and traceable evolution, has been linked to seeking and to action, which is certainly the opposite of inaction. Upon closer examination, it is the action that can be either covert or overt, since thinking can be an action. When used together Action Research presents an opportunity to seek, pursue, and track one’s actions to arrive at a target. Yet how a person decides to seek provides context. Regardless of the path taken, Action Research involves certain steps, such as reflection, that are focused, strategic, and seeking within a social context to move forward.
Action Research is malleable, flexible, and therefore can be many things depending upon how the terms are demarcated. However, herein Action Research is both a strategy and orderly process that supports those who may seek to examine, to change, and/or to improve. Action Research is a commitment and an approach from within that provides a structure that can simplify and guide an inquiry. Action Research (AR) can meet the needs of the individual or a group as it supports self-inquiry and group-inquiry equally, while unfolding in a series of steps and phases. The action step may include either cognitive and/or psycho-motor acts; the reflection step includes efforts to look back and within, whereas the third step, revision, demands that an action researcher plan for their next step. This AR process may include additional steps; however, AR remains cyclical and recursive and at times piecemeal as steps may overlap, accelerate, and challenge the action researcher over time, since theory and practice can be quite disparate.
Chester Chun Seng Kam and Xitao Fan
Survey has been a widely used data collection method for a variety of purposes in educational research. Although response styles have the potential to contaminate survey results, educational researchers often do little to control for such negative effects. Under discussion are five common response issues, their impact on survey data, and the methods that may be used to minimize the negative impact of these response issues on survey data. The five response issues in question are acquiescence (including disacquiescence), careless responding, extreme response, social desirability, and item-keying effect. Acquiescence (disacquiescence) refers to a respondent’s general tendency to agree (or disagree) with an item regardless of its content. This response style can distort item and construct correlations, compromising the results of factor analytic and correlational findings. Careless responding refers to a respondent’s tendency to pay insufficient attention to item content before responding, which can also lead to a biased estimation of relationships. Extreme response refers to the tendency of selecting extreme response options (e.g., strongly agree or strongly disagree) over middle options (e.g., neutral). Social desirability refers to a respondent’s tendency to rate him- or herself in an overly positive light. Finally, item-keying effect refers to a respondent’s differential responses to regular-keyed and reverse-keyed items. This effect often creates the illusion that items with opposite keying directions measure distinct constructs even when they may not.
A growing amount of research has been done on how to control for the negative impact of these response styles, although the research may be limited and uneven for different response issues. A variety of approaches and methods exist for handling these response issues in research practice. Different response issues may require considerations at different stages of research. For example, effective handling of acquiescence response may require steps in both survey construction (e.g., including a hidden measure of acquiescence) and survey data analytic treatment (partial correlation technique), while controlling for item-keying effect may require more sophisticated modeling techniques (e.g., multitrait-multimethod confirmatory factor analysis).
Kim H. Koh
Authentic tasks replicate real-world challenges and standards of performance that experts or professionals typically face in the field. The term “authentic assessment” was first coined by Grant Wiggins in K‒12 educational contexts. Authentic assessment is an effective measure of intellectual achievement or ability because it requires students to demonstrate their deep understanding, higher-order thinking, and complex problem solving through the performance of exemplary tasks. Hence authentic assessment can serve as a powerful tool for assessing students’ 21st-century competencies in the context of global educational reforms. The review begins with a detailed explanation of the concept of authentic assessment. There is a substantial body of literature focusing on the definitions of authentic assessment. However, only those that are original and relevant to educational contexts are included.. Some of the criteria for authentic assessment defined by the authors overlap with each other, but their definitions are consistent. A comparison of authentic assessment and conventional assessment reveals that different purposes are served, as evidenced by the nature of the assessment and item response format. Examples of both types of assessments are included. Three major themes are examined within authentic assessment research in educational contexts: authentic assessment in educational or school reforms, teacher professional learning and development in authentic assessment, and authentic assessment as tools or methods used in a variety of subjects or disciplines in K‒12 schooling and in higher education institutions. Among these three themes, most studies were focused on the role of authentic assessment in educational or school reforms. Future research should focus on building teachers’ capacity in authentic assessment and assessment for learning through a critical inquiry approach in school-based professional learning communities or in teacher education programs. To enable the power of authentic assessment to unfold in the classrooms of the 21st century, it is essential that teachers are not only assessment literate but also competent in designing and using authentic assessments to support student learning and mastery of the 21st-century competencies.
Autoethnography is an increasingly popular form of postpositivist narrative inquiry that has recently begun to appear in educational contexts. The multiple lineages of autoethnography include the insider accounts of early anthropologists, literary approaches to life history and autobiography, responses to the ontological/epistemological challenges of postmodern philosophies, feminist and postcolonial insistence on including narratives of the marginalized, performance and communication scholarship, and the interest in personal stories of contemporary therapeutic and trauma cultures. Approaches vary widely from fragmented, experimental, performative, and multimodal texts through to realist tales. Advocates claim that autoethnography enables us to live more reflective, more meaningful, and more just lives.
The Common Core State Standards (CCSS) are part of a third wave of school reform in the United States. With accompanying tests, these standards combine calls for increased academic rigor, beginning in the 1980s, with more recent efforts to hold schools, teachers, and students accountable for learning outcomes in publicly funded schools. Origins of CCSS can be traced to the 1996 National Education Summit where the National Governors Association (NGA), philanthropic foundations, and business leaders founded Achieve to broker rigorous high school graduation requirements. In 2009, Achieve became the project manager for the construction of CCSS. In 2010, implementation began with incentives from the Obama administration and funding from the Gates Foundation.
Advocates choose among a variety of rationales: faltering American economic competitiveness, wide variability among state standards and educational outcomes, highly mobile student populations, and/or a growing income achievement gap. Critics cite federal intrusion in states’ rights, a lack of an evidentiary base, an autocratic process of CCSS production, and/or a mis-framing of problems facing public schools. With the reauthorization of the Elementary and Secondary Education Act (ESEA) as the Every Student Succeeds Act of 2015, federal advocacy of CCSS ended officially.
This is an advance summary of a forthcoming article in the Oxford Research Encyclopedia of Education. Please check back later for the full article.
Over the past 30 years, a growing field of scholarship has explored the relationship between education and the media. Scholars within this field have explored representations of education, schooling, teachers’ work, and students in print and other news media, utilizing approaches that include critical discourse analysis, news framing analysis, and more recently, corpus-assisted discourse analysis. The relationship between these representations, public understandings of education, and education policy has also been explored in the research literature, with a focus on the complex interplay between media discourses and public policy around education. The emergence of social media and the engagement of both educators and members of the general public on social media around issues related to education have seen this relationship shift in recent years. This, along with the growth of computer-assisted research approaches (including corpus-assisted analysis and network analysis, for example), has brought new theoretical and methodological possibilities to bear on the field.
The European Commission launched a renewed agenda for adult learning with the objective of ensuring access to high-quality educational opportunities to adult learners for the promotion of their personal and professional development. Thus, European researchers in this field are paying attention to lifelong learning actions in order to address this challenge. Studies in this area are exploring how adult education can strengthen adults’ skills, in particular those required in the current knowledge society (information and communication technologies, problem solving, foreign languages, etc.). Simultaneously, some investigations focus in depth on the role that adult education can play in overcoming social exclusion for the most underserved groups. This paper describes the contributions of these investigations as well as the steps carried out by programs and theories that have contributed the most to adult learning. Lastly, future developments and challenges on this field are explained.
Transnational flows of educational knowledge and research are fundamentally guided by the global geopolitics of knowledge—the historically constituted relations of power born out of the continuing legacy of modernity/coloniality. In the early nation-building stage of the 19th century, state-funded education was at the core of states’ pursuit for economic and social progress. Newly formed nation states actively sought new educational knowledge from countries considered more advanced in the global race toward modernity and industrialization. The transnational lesson drawing in education at the time was guided by the view of modernity as originating in and diffusing from the West. This created the unidirectional flow of educational influence from advanced economies of the West to the rest of the world. Central to the rise of modernity in Western state formation is the use of education as a technology of social regulations. Through the expansion of state-funded education, people were turned into the people, self-governing citizens, and then the population that was amenable to a state’s social and economic calculation and military deployment. But this development was embedded in the geopolitical context of the time, in which Western modernity was deeply entangled with its underside, coloniality in the rest of the world. Various uses of education as a social control were tested out first in colonial peripheries and then brought back to the imperial centers.
Today, the use of education for the modernist pursuit of perfecting society has been intensified through the constitution of the globalized education policy space. International organizations such as the World Bank and the Organisation for Economic Co-operation and Development (OECD) act as the nodes through which transnational networks of education policy actors are formed, where the power of statistics for social and educational progress is widely shared. Both developed and developing countries are increasingly incorporated into this shared epistemological space, albeit through different channels and due to different factors. The rise of international academic testing such as OECD’s Programme for International Student Assessment (PISA) has certainly changed the traditional pattern of education research and knowledge flows, and more lesson drawing from countries and regions outside the Anglo-European context is pursued. And yet, the challenges that PISA poses to the Eurocentric pattern of educational knowledge and research flows are curtailed by the persistence of the colonial legacy. This most clearly crystalizes in the dismissive and derogatory characterization of East Asian PISA high achievers in the recent PISA debate. Hence, the current globalization of education knowledge and research remains entangled with the active legacy of coloniality, the uneven global knowledge structure.
Interviews are frequently used in ethnographic research, but it is argued that they pose particular difficulties in interpretation. While ethnographers are interested in understanding how people construct and interpret cultures in their natural settings, interviews are based on rules that counteract most normal interactions. Thus interviews in ethnography can only be interpreted within the context of that wider ethnography and the data generated has to be tested against other data generated by different means and data generated in other interviews.
Although some ethnographers avoid the use of interviews, others use a range of different forms of interviews. It is argued that Basil Bernstein’s concepts of classification and framing can be used to clarify the range of forms and to highlight the potential relationships between the form of interview and class, gender, and ethnicity.
In the context of offenders who have learning difficulties, autism, and/or social, emotional, and mental health problems, their families, and professionals who work with them, caring and ethical research processes can be explored via fieldnotes. Conducting life story interviews and recording fieldnotes within qualitative criminological, education, and sociological research have long since been used to document and analyze communities and institutions and the private and public spheres. They richly tell us about specific research contexts, or everyday lives and relationships, that interview transcripts alone perhaps overlook. It is in the process of recording and reflecting upon research relationships that we can see and understand care-full research. But caring and ethical research works in an interdependent and relational way. Therefore, the participant and the researcher are at times vulnerable, and recognition of this is critical in considering meaningful and healthy research practices. However, the acknowledgment of the fact that particular types of research can be messy, chaotic, and emotional is necessary in understanding caring research.
Clive Beck, Clare Kosnik, and Elizabeth Rosales
The longitudinal study of teachers gives a time perspective on the life and work of teachers, instead of just a snapshot at a particular point. The time period in question may be just a few intense months, as in some ethnographic research, or several decades, as in some life-history research. Longitudinal research is useful in exploring such topics as how teachers change and grow over their careers, changes in teachers’ professional satisfaction over the years, patterns of teacher retention and drop-out, the impact of teachers on their students over time, and the influence of preservice and/or in-service teacher education on teachers.
Continuous study of the same teachers over many years is challenging and accordingly not common. It is typically expensive and time-consuming, and extends beyond the time span of most research funding; moreover, many participants either leave the profession or move to other locations, making it difficult to keep in touch with them. Accordingly, additional ways to do longitudinal research need to be found: for example, studying teachers intensively for a shorter period; asking teachers to recall earlier phases in their life and/or career; or studying different cohorts of teachers at various career points (as in the classic Huberman study and parts of the U.K. VITAE research). Each of these methods has limitations but maintains the valuable outcome of providing a time perspective.
Where it can be arranged, however, interviewing the same teachers at intervals over several years has the advantage of enabling researchers to get to know the participants well. As a result, the researchers are in a better position to understand what the participants are saying in the interviews, and assess the veracity of their self-reporting about their views and practices, past and present. Also, a degree of trust is established such that the teachers are more likely to be frank about their feelings, challenges, and concerns. But one danger of the emerging relationship is that the support the relationship it provides may positively impact the teachers’ experience (e.g., helping them fine-tune their practice and maintain their morale to an unusually high level). This limitation has to be weighed against the advantages in deciding whether or not to use this approach to the longitudinal study of teachers.
David Ian Walker and Stephen J. Thoma
At core, moral and character education aims to develop the moral person. How this end state develops has been hindered by interest from different theoretical positions, differences between practitioners and theoreticians, different assumptions about how far character is educable, and associated measurement problems. Traditionally, moral education is concerned with the interpretation and strategies one uses to understand moral phenomenon and defines the moral person as a predominantly thinking entity, whereas character education emphasizes the development of habits and dispositions as a precondition for the moral person. Current interest is in finding commonalities across these traditions towards the achievement of human flourishing. These points of intersection have often been overlooked, but current work is demonstrating the importance of interdisciplinary and multidisciplinary approaches for practitioners, researchers and policymakers.
Koji Matsunobu and Liora Bresler
From rites of passage to closer community bonding, the practice, enjoyment, exchange, and transmission of music—regardless of the setting—is an integral element of the history of human civilization. While the field of music education research has long focused on school music and institutional teaching, it is increasingly reaching out to the wider community, in the process involving people at different life stages who are operating in a variety of societal contexts. Consequently, research in music education explores a broad spectrum of musical engagements (including composition and improvisation, in addition to singing, playing, and listening) and a wide-ranging repertoire (including jazz, popular music, folk, and world music), together with diverse pedagogies both inspired by and borrowed from these genres. This process reveals how these forms of musical transmission can, on the one hand, create new meanings and experiences at individual levels, and, on the other, shape collective identity formation through the facilitation of cultural sustainability and transformation. By means of quantitative, qualitative, historical, and philosophical methods, and typically drawing on the fields of—among others—psychology, sociology, and anthropology, music education researchers have addressed social, cultural, pedagogical, and ethical issues of music teaching and learning.
Jane Abbiss and Eline Vanassche
Teacher education has been a matter of concern among policymakers for decades. For just as long, there have been attempts to understand and improve teacher education by studying it empirically. Disenchanted by the progress made by scholarly experts who produced knowledge in “scientific” research “on” teacher education with the aim that findings be implemented in practice settings, teacher educators themselves started researching teacher education. The resulting practice-focused research provides insight into the kinds of research that teacher educators themselves find useful to guide their work and practice in the preparation of teachers.
Broadly speaking, research conducted by teacher educators for teacher educators serves a twofold purpose: to inform the improvement of local practice but also to contribute to the development of a public knowledge base in teacher education. The warrants for knowledge for teacher educator research on teacher education practices derive from a range of qualitative research methodologies, and the authority of this research relates generally to questions of relevance and rigor in qualitative research. Research conducted by teacher educators for teacher educators presents challenges for teacher educators in achieving a balance between goals for local relevance and making a theoretical contribution to the field.
There are, though, also challenges for teacher educator researchers in understanding the field within which they work. What seems like a relatively simple mission—to provide an overview of qualitative research that focuses on teacher education practice and the preparation of student teachers—proves to be quite a difficult task. Challenges relate to matters of definition, concerning who “qualifies” as teacher educators in times of rapid change and variation in initial teacher education provision internationally, and what constitutes research on teacher education practices. Also, challenges derive from matters of scope in the publication of research by teacher educators. Publication of such research extends beyond that which appears in top tier international journals and which tends to provide an American-centric and Global North view of teacher education. These challenges in themselves raise questions about who gets to define the field of practice-focused research in initial teacher education and how this field is defined by the research practices it entails.
Marginalized populations are by definition composed of people who have fewer possibilities and options in their lives than those studying them. This fact has to be reflected before, during, and after the research itself. There are many facets of this basic assumption. One of them is, how are marginalized perceived by the researcher? Are they helpless victims, or people who are able to tell their own stories? Another relevant detail is the personality of the researcher. When the researcher comes from outside the marginalized group, the key question is, which methodology can be best applied to give a voice to those who are marginalized? On the other hand, when the researcher is a member of the group being studied, the key question is how to achieve the distance necessary for analysis. There could be many more such relevant facets, but the quality of the final research product is partially determined by any number of decisions that are made during the planning of the research and the conducting of the research.
All of these decisions have methodological consequences. There are a wide range of qualitative research approaches, such as participatory research, autoethnographic research, narrative and biographical research, or traditional qualitative research based on interviews with representatives of marginalized groups. In the early 21st century, there has been a shift away from a top-down, outsider perspective that sees the marginalized as helpless victims and toward more participatory research designs that promote and give a space to the marginalized voice.
The common denominator of all these decisions is whose voice is being heard—does it belong to the marginalized group or to the outside world? Is it possible to overcome the boundaries between these two worlds? And what role does methodology play in this story?
The role of theory in qualitative data analysis is a shifting feast, and current researchers have many possibilities to select among. Since the 1970s the dynamic and inclusive nature of qualitative research has allowed the entry of many interested disciplines into the field. These various discipline groups have brought in new theoretical orientations and practices from their own fields and have encouraged a wide diversity of applications to the analysis of data. In addition, the shifts and changes in broader theoretical orientations through the advent of postmodernism, poststructuralism, post-postmodernism, mixed methods, and the crossing of theoretical divisions between quantitative and qualitative now seen in performative research have also added further options for researchers to consider. This diversity of choice has shifted the field light years away from dogmatic direction to researcher decision, researcher justification, and transparency of process.
Emerging in the learning sciences field in the early 1990s, qualitative design-based research (DBR) is a relatively new methodological approach to social science and education research. As its name implies, DBR is focused on the design of educational innovations, and the testing of these innovations in the complex and interconnected venue of naturalistic settings. As such, DBR is an explicitly interventionist approach to conducting research, situating the researcher as a part of the complex ecology in which learning and educational innovation takes place.
With this in mind, DBR is distinct from more traditional methodologies, including laboratory experiments, ethnographic research, and large-scale implementation. Rather, the goal of DBR is not to prove the merits of any particular intervention, or to reflect passively on a context in which learning occurs, but to examine the practical application of theories of learning themselves in specific, situated contexts. By designing purposeful, naturalistic, and sustainable educational ecologies, researchers can test, extend, or modify their theories and innovations based on their pragmatic viability. This process offers the prospect of generating theory-developing, contextualized knowledge claims that can complement the claims produced by other forms of research.
Because of this interventionist, naturalistic stance, DBR has also been the subject of ongoing debate concerning the rigor of its methodology. In many ways, these debates obscure the varied ways DBR has been practiced, the varied types of questions being asked, and the theoretical breadth of researchers who practice DBR. With this in mind, DBR research may involve a diverse range of methods as researchers from a variety of intellectual traditions within the learning sciences and education research design pragmatic innovations based on their theories of learning, and document these complex ecologies using the methodologies and tools most applicable to their questions, focuses, and academic communities.
DBR has gained increasing interest in recent years. While it remains a popular methodology for developmental and cognitive learning scientists seeking to explore theory in naturalistic settings, it has also grown in importance to cultural psychology and cultural studies researchers as a methodological approach that aligns in important ways with the participatory commitments of liberatory research. As such, internal tension within the DBR field has also emerged. Yet, though approaches vary, and have distinct genealogies and commitments, DBR might be seen as the broad methodological genre in which Change Laboratory, design-based implementation research (DBIR), social design-based experiments (SDBE), participatory design research (PDR), and research-practice partnerships might be categorized. These critically oriented iterations of DBR have important implications for educational research and educational innovation in historically marginalized settings and the Global South.
Begoña Vigo Arrazola
Educational policies have long recognized the importance of family participation and involvement in schools to facilitate school success for all students, and both research and policy have highlighted the role of research and research feedback as important for improving family involvement. However, in practice feedback is given in very different ways with different intended functions and effects. From a positivist and also reconstructed positivist perspective, for instance, feedback is used primarily as a strategy for improving research validity, while from a critical perspective the intention is to induce deeper and sustained levels of participation and critique and influence. From a philosophical foundation concerning the significance of not only understanding contemporary educational empirical reality under neoliberal forms of capitalism, but also developing critical consciousness for the transcendence and transformation of this condition, research feedback sets out to engage teachers and parents as co-researchers and reflective agents capable of understanding and changing education, not only being recipients of it. Change is encouraged, moreover, both within the framework of the investigation and with respect to broader social relations. This use of research feedback may enhance critical awareness and social transformation. Different examples of research feedback, in research on the participation of families in schools, show details concerning the use of feedback for processes of engagement, social critique, and educational change.
Aaron M. Kuntz
Conventional approaches to qualitative research seek to distill and capture meaning through a sequence of determined, progressive methodological steps that serve to synthesize difference toward a series of overarching claims regarding human experience. This approach reifies contemporary neoliberal values and, as a consequence, short-circuits any possibility for progressive social change. Through conventional research practices, the principles of security, schizoid, and statistical society accelerate, extending normalizing processes of governmentality, and producing a docile citizenry adverse to key elements of an engaged democracy. In such circumstance, risk is identified as the production of findings that are ambiguously defined, not attending to values of certainty and generalizable outcomes. As a consequence, conventional methodological practices fail to engage the postmodern condition—fragmented experiences with inconclusive outcomes are displaced by methodologies bent on merging difference into foreclosed meaning.
Contrary to conventional approaches to research, post-foundational orientations emphasize relational logics that maintain difference within the inquiry project itself. A provocative example of this extends from newly materialist approaches to qualitative inquiry that emphasizes the productive possibilities inherent in difference and, as such, displace the simplified dialectical reasoning of conventional approaches in favor of more dialogic recognition of diffractive patterning. In this sense, open-ended difference makes possible previously unrecognized (even unthought) possibilities for being otherwise. As such, newly materialist approaches to inquiry manifest alternative ontological and epistemological practices that are not available to the conventional methodologist; they make possible an open-ended vision of the future that is necessary for radical democratic action. Furthermore, the fluid nature of such methodologies align well with Foucault’s explication of parrhesia, a means of truth-making that creates new possibilities for becoming otherwise. The intersection of newly materialist methodologies with parrhesia challenges methodologists to risk the very relations that secure their expertise, establishing a moral challenge to the impact of past practice on the possibilities inherent in the future.