Arsaythamby Veloo and Ruzlan Md-Ali
This is an advance summary of a forthcoming article in the Oxford Research Encyclopedia of Education. Please check back later for the full article.
Educational assessment modes and practices will change in the 21st century due to the advancement of technology in education. Consequently, this creates high expectations among stakeholders who are directly involved with assessment administration as well as professional responsibilities in assessment administration. Accountability of assessment administration includes maintaining assessment security and integrity. Assessments must be aligned with learning outcomes and instruction. Assessment administration policies should be aligned with an institution’s assessment policies. Hence, assessment administrators collaborate with the institutions to develop and unify assessment standards and practices toward the enhancement of accessing students’ overall competence. Optimum performance and typical performance covers cognitive, affective, and psychomotor aspects.
For example, in Malaysia, Integrated Cumulative Grade Point Average has been introduced in assessing higher education students’ holistic performance, an extension from the implementation of School-based Assessment in Malaysian schools beginning in the year 2011. Previous assessment practices that focused more on cognitive aspects only involved paper and pencil tests. Thus, there were not many issues pertaining to assessment administration. However, to overcome the challenges in the new direction of assessment in the 21st century, it is important to pay particular attention to the accountability of assessment administration. There is also a need to accommodate and modify assessment administration according to the needs of current assessment mode and practices. We cannot wholly depend on standardized procedures all the time, because the nature of assessment may differ according to students’ ability, the types and venues of assessment, and national agendas.
Assessment administrators are accountable to ensure that honesty, integrity, due care, validity, reliability, and fairness are observed and maintained during the assessment. The administration of educational assessment generally involves three major phases, namely preassessment administration, assessment during administration, and postassessment administration. There are standardized documented rules and procedures that assessment administrators need to follow when administering educational assessment to ensure that standards of accountability are upheld.
This is an advance summary of a forthcoming article in the Oxford Research Encyclopedia of Education. Please check back later for the full article.
Herein the term Action Research is addressed by reflecting upon two words, action and research, united within this century to create something quite useful and commonplace. The word research, which has a long and traceable evolution, has been linked to seeking and to action, which is certainly the opposite of inaction. Upon closer examination, it is the action that can be either covert or overt, since thinking can be an action. When used together Action Research presents an opportunity to seek, pursue, and track one’s actions to arrive at a target. Yet how a person decides to seek provides context. Regardless of the path taken, Action Research involves certain steps, such as reflection, that are focused, strategic, and seeking within a social context to move forward.
Action Research is malleable, flexible, and therefore can be many things depending upon how the terms are demarcated. However, herein Action Research is both a strategy and orderly process that supports those who may seek to examine, to change, and/or to improve. Action Research is a commitment and an approach from within that provides a structure that can simplify and guide an inquiry. Action Research (AR) can meet the needs of the individual or a group as it supports self-inquiry and group-inquiry equally, while unfolding in a series of steps and phases. The action step may include either cognitive and/or psycho-motor acts; the reflection step includes efforts to look back and within, whereas the third step, revision, demands that an action researcher plan for their next step. This AR process may include additional steps; however, AR remains cyclical and recursive and at times piecemeal as steps may overlap, accelerate, and challenge the action researcher over time, since theory and practice can be quite disparate.
Abraham P. DeLeon
What is anarchist theory and practice? What does it mean when anarchists engage with qualitative research? Anarchism has a long-standing history within radical political action that has been enacted at particular historical times and spaces. The Spanish Civil War, Paris 1968, and the so-called Battle of Seattle in 1999 saw the potential of anarchism as both a mode of critique and way(s) in which to think about direct political action. However, little has been done within the critical qualitative research project to engage with the ideas and critiques that anarchism offers researchers to think about and inform their own work.
Resisting hierarchies and their arrangements, challenging domination and relationships of power, rethinking praxis and direct action in qualitative research, and envisioning a utopian social and political imagination have been just a few of the political and epistemological projects that anarchists have undertaken that have direct implications for qualitative researchers. In thinking about future potentials, it has become imperative that critical qualitative researchers engage with anarchist theory and its critiques to better inform its own assumptions when thinking about the roles that qualitative research plays in resisting and altering oppressive social, political, and economic conditions.
Chester Chun Seng Kam and Xitao Fan
Survey has been a widely used data collection method for a variety of purposes in educational research. Although response styles have the potential to contaminate survey results, educational researchers often do little to control for such negative effects. Under discussion are five common response issues, their impact on survey data, and the methods that may be used to minimize the negative impact of these response issues on survey data. The five response issues in question are acquiescence (including disacquiescence), careless responding, extreme response, social desirability, and item-keying effect. Acquiescence (disacquiescence) refers to a respondent’s general tendency to agree (or disagree) with an item regardless of its content. This response style can distort item and construct correlations, compromising the results of factor analytic and correlational findings. Careless responding refers to a respondent’s tendency to pay insufficient attention to item content before responding, which can also lead to a biased estimation of relationships. Extreme response refers to the tendency of selecting extreme response options (e.g., strongly agree or strongly disagree) over middle options (e.g., neutral). Social desirability refers to a respondent’s tendency to rate him- or herself in an overly positive light. Finally, item-keying effect refers to a respondent’s differential responses to regular-keyed and reverse-keyed items. This effect often creates the illusion that items with opposite keying directions measure distinct constructs even when they may not.
A growing amount of research has been done on how to control for the negative impact of these response styles, although the research may be limited and uneven for different response issues. A variety of approaches and methods exist for handling these response issues in research practice. Different response issues may require considerations at different stages of research. For example, effective handling of acquiescence response may require steps in both survey construction (e.g., including a hidden measure of acquiescence) and survey data analytic treatment (partial correlation technique), while controlling for item-keying effect may require more sophisticated modeling techniques (e.g., multitrait-multimethod confirmatory factor analysis).
Arts-based research encompasses a range of research approaches and strategies that utilize one or more of the arts in investigation. Such approaches have evolved from understandings that life and experiences of the world are multifaceted, and that art offers ways of knowing the world that involve sensory perceptions and emotion as well as intellectual responses. Researchers have used arts for various stages of research. It may be to collect or create data, to interpret or analyze it, to present their findings, or some combination of these. Sometimes arts-based research is used to investigate art making or teaching in or through the arts. Sometimes it is used to explore issues in the wider social sciences. The field is a constantly evolving one, and researchers have evolved diverse ways of using the communicative and interpretative tools that processes with the arts allow. These include ways to initially bypass the need for verbal expression, to explore problems in physically embodied as well as discursive ways, to capture and express ambiguities, liminalities, and complexities, to collaborate in the refining of ideas, to transform audience perceptions, and to create surprise and engage audiences emotionally as well as critically. A common feature within the wide range of approaches is that they involve aesthetic responses.
The richness of the opportunities created by the use of arts in conducting and/or reporting research brings accompanying challenges. Among these are the political as well as the epistemological expectations placed on research, the need for audiences of research, and perhaps participants in research, to evolve ways of critically assessing the affect of as well as the information in presentations, the need to develop relevant and useful strategies for peer review of the research as well as the art, and the need to evolve ethical awareness that is consistent with the intentions and power of the arts.
Kim H. Koh
Authentic tasks replicate real-world challenges and standards of performance that experts or professionals typically face in the field. The term “authentic assessment” was first coined by Grant Wiggins in K‒12 educational contexts. Authentic assessment is an effective measure of intellectual achievement or ability because it requires students to demonstrate their deep understanding, higher-order thinking, and complex problem solving through the performance of exemplary tasks. Hence authentic assessment can serve as a powerful tool for assessing students’ 21st-century competencies in the context of global educational reforms. The review begins with a detailed explanation of the concept of authentic assessment. There is a substantial body of literature focusing on the definitions of authentic assessment. However, only those that are original and relevant to educational contexts are included.. Some of the criteria for authentic assessment defined by the authors overlap with each other, but their definitions are consistent. A comparison of authentic assessment and conventional assessment reveals that different purposes are served, as evidenced by the nature of the assessment and item response format. Examples of both types of assessments are included. Three major themes are examined within authentic assessment research in educational contexts: authentic assessment in educational or school reforms, teacher professional learning and development in authentic assessment, and authentic assessment as tools or methods used in a variety of subjects or disciplines in K‒12 schooling and in higher education institutions. Among these three themes, most studies were focused on the role of authentic assessment in educational or school reforms. Future research should focus on building teachers’ capacity in authentic assessment and assessment for learning through a critical inquiry approach in school-based professional learning communities or in teacher education programs. To enable the power of authentic assessment to unfold in the classrooms of the 21st century, it is essential that teachers are not only assessment literate but also competent in designing and using authentic assessments to support student learning and mastery of the 21st-century competencies.
Autoethnography is an increasingly popular form of postpositivist narrative inquiry that has recently begun to appear in educational contexts. The multiple lineages of autoethnography include the insider accounts of early anthropologists, literary approaches to life history and autobiography, responses to the ontological/epistemological challenges of postmodern philosophies, feminist and postcolonial insistence on including narratives of the marginalized, performance and communication scholarship, and the interest in personal stories of contemporary therapeutic and trauma cultures. Approaches vary widely from fragmented, experimental, performative, and multimodal texts through to realist tales. Advocates claim that autoethnography enables us to live more reflective, more meaningful, and more just lives.
The Common Core State Standards (CCSS) are part of a third wave of school reform in the United States. With accompanying tests, these standards combine calls for increased academic rigor, beginning in the 1980s, with more recent efforts to hold schools, teachers, and students accountable for learning outcomes in publicly funded schools. Origins of CCSS can be traced to the 1996 National Education Summit where the National Governors Association (NGA), philanthropic foundations, and business leaders founded Achieve to broker rigorous high school graduation requirements. In 2009, Achieve became the project manager for the construction of CCSS. In 2010, implementation began with incentives from the Obama administration and funding from the Gates Foundation.
Advocates choose among a variety of rationales: faltering American economic competitiveness, wide variability among state standards and educational outcomes, highly mobile student populations, and/or a growing income achievement gap. Critics cite federal intrusion in states’ rights, a lack of an evidentiary base, an autocratic process of CCSS production, and/or a mis-framing of problems facing public schools. With the reauthorization of the Elementary and Secondary Education Act (ESEA) as the Every Student Succeeds Act of 2015, federal advocacy of CCSS ended officially.
Lesley Bartlett and Frances Vavrus
Case studies in the field of education often eschew comparison. However, when scholars forego comparison, they are missing an important opportunity to bolster case studies’ theoretical generalizability. Scholars must examine how disparate epistemologies lead to distinct kinds of qualitative research and different notions of comparison. Expanded notions of comparison include not only the usual logic of contrast or juxtaposition but also a logic of tracing, in order to embrace approaches to comparison that are coherent with critical, constructivist, and interpretive qualitative traditions. Finally, comparative case study researchers consider three axes of comparison: the vertical, which pays attention across levels or scales, from the local through the regional, state, federal, and global; the horizontal, which examines how similar phenomena or policies unfold in distinct locations that are socially produced; and the transversal, which compares over time.
This is an advance summary of a forthcoming article in the Oxford Research Encyclopedia of Education. Please check back later for the full article.
Over the past 30 years, a growing field of scholarship has explored the relationship between education and the media. Scholars within this field have explored representations of education, schooling, teachers’ work, and students in print and other news media, utilizing approaches that include critical discourse analysis, news framing analysis, and more recently, corpus-assisted discourse analysis. The relationship between these representations, public understandings of education, and education policy has also been explored in the research literature, with a focus on the complex interplay between media discourses and public policy around education. The emergence of social media and the engagement of both educators and members of the general public on social media around issues related to education have seen this relationship shift in recent years. This, along with the growth of computer-assisted research approaches (including corpus-assisted analysis and network analysis, for example), has brought new theoretical and methodological possibilities to bear on the field.
The European Commission launched a renewed agenda for adult learning with the objective of ensuring access to high-quality educational opportunities to adult learners for the promotion of their personal and professional development. Thus, European researchers in this field are paying attention to lifelong learning actions in order to address this challenge. Studies in this area are exploring how adult education can strengthen adults’ skills, in particular those required in the current knowledge society (information and communication technologies, problem solving, foreign languages, etc.). Simultaneously, some investigations focus in depth on the role that adult education can play in overcoming social exclusion for the most underserved groups. This paper describes the contributions of these investigations as well as the steps carried out by programs and theories that have contributed the most to adult learning. Lastly, future developments and challenges on this field are explained.
Transnational flows of educational knowledge and research are fundamentally guided by the global geopolitics of knowledge—the historically constituted relations of power born out of the continuing legacy of modernity/coloniality. In the early nation-building stage of the 19th century, state-funded education was at the core of states’ pursuit for economic and social progress. Newly formed nation states actively sought new educational knowledge from countries considered more advanced in the global race toward modernity and industrialization. The transnational lesson drawing in education at the time was guided by the view of modernity as originating in and diffusing from the West. This created the unidirectional flow of educational influence from advanced economies of the West to the rest of the world. Central to the rise of modernity in Western state formation is the use of education as a technology of social regulations. Through the expansion of state-funded education, people were turned into the people, self-governing citizens, and then the population that was amenable to a state’s social and economic calculation and military deployment. But this development was embedded in the geopolitical context of the time, in which Western modernity was deeply entangled with its underside, coloniality in the rest of the world. Various uses of education as a social control were tested out first in colonial peripheries and then brought back to the imperial centers.
Today, the use of education for the modernist pursuit of perfecting society has been intensified through the constitution of the globalized education policy space. International organizations such as the World Bank and the Organisation for Economic Co-operation and Development (OECD) act as the nodes through which transnational networks of education policy actors are formed, where the power of statistics for social and educational progress is widely shared. Both developed and developing countries are increasingly incorporated into this shared epistemological space, albeit through different channels and due to different factors. The rise of international academic testing such as OECD’s Programme for International Student Assessment (PISA) has certainly changed the traditional pattern of education research and knowledge flows, and more lesson drawing from countries and regions outside the Anglo-European context is pursued. And yet, the challenges that PISA poses to the Eurocentric pattern of educational knowledge and research flows are curtailed by the persistence of the colonial legacy. This most clearly crystalizes in the dismissive and derogatory characterization of East Asian PISA high achievers in the recent PISA debate. Hence, the current globalization of education knowledge and research remains entangled with the active legacy of coloniality, the uneven global knowledge structure.
Robert J. Sternberg
High-stakes assessment is playing an increasingly important role in higher education at the undergraduate, graduate, and postgraduate levels. Such assessments are sometimes used for group purposes—to assess how well a university is doing in educating its students—and other times for purposes of evaluating individuals.
High-stakes assessment at the undergraduate level generally involves assessments of learning and reasoning at the end of the college experience. Sometimes, pretests are also given to compare cognitive skills before and after the college experience. There are several different approaches to measuring learning and performance outcomes: (a) standardized instruments and inventories; (b) indirect methods that focus on students’ perceptions of learning and engagement; (c) authentic performance-based methods, such as portfolios; and (d) locally designed tests and inventories. Each of these methods of assessment has different advantages as well as disadvantages. For example, standardized tests are normed, and thus it is possible to compare the performance of students at, say, one university to those at another. But standardized tests also measure outcomes that some scholars feel are less meaningful than the outcomes measured by other kinds of assessments. Indirect measures, such as of student engagement, look at students’ level of engagement with college but tell less about cognitive gains than some other kinds of measures. Performance-based measures such as portfolios have the advantage of measuring outcomes presumably relevant to each individual student; they are harder to score than some other kinds of measures, however, and they do not lend themselves readily to comparisons across colleges and universities. Homemade tests produced by individual institutions can be tailored to the goals of those institutions but generally lack the standardization and generality of some other kinds of measures.
Assessments of graduate and postgraduate students are of a different ilk. Generally, graduate, postgraduate, and hiring institutions are looking for presumed research and teaching competence. Publication records as well as letters of recommendation serve as primary bases for evaluating students going onto the job market. It is possible to entertain more sophisticated measures than just counting publications, such as various measures based on citations in the scholarly literature.
Interviews are frequently used in ethnographic research, but it is argued that they pose particular difficulties in interpretation. While ethnographers are interested in understanding how people construct and interpret cultures in their natural settings, interviews are based on rules that counteract most normal interactions. Thus interviews in ethnography can only be interpreted within the context of that wider ethnography and the data generated has to be tested against other data generated by different means and data generated in other interviews.
Although some ethnographers avoid the use of interviews, others use a range of different forms of interviews. It is argued that Basil Bernstein’s concepts of classification and framing can be used to clarify the range of forms and to highlight the potential relationships between the form of interview and class, gender, and ethnicity.
In the context of offenders who have learning difficulties, autism, and/or social, emotional, and mental health problems, their families, and professionals who work with them, caring and ethical research processes can be explored via fieldnotes. Conducting life story interviews and recording fieldnotes within qualitative criminological, education, and sociological research have long since been used to document and analyze communities and institutions and the private and public spheres. They richly tell us about specific research contexts, or everyday lives and relationships, that interview transcripts alone perhaps overlook. It is in the process of recording and reflecting upon research relationships that we can see and understand care-full research. But caring and ethical research works in an interdependent and relational way. Therefore, the participant and the researcher are at times vulnerable, and recognition of this is critical in considering meaningful and healthy research practices. However, the acknowledgment of the fact that particular types of research can be messy, chaotic, and emotional is necessary in understanding caring research.
Clive Beck, Clare Kosnik, and Elizabeth Rosales
The longitudinal study of teachers gives a time perspective on the life and work of teachers, instead of just a snapshot at a particular point. The time period in question may be just a few intense months, as in some ethnographic research, or several decades, as in some life-history research. Longitudinal research is useful in exploring such topics as how teachers change and grow over their careers, changes in teachers’ professional satisfaction over the years, patterns of teacher retention and drop-out, the impact of teachers on their students over time, and the influence of preservice and/or in-service teacher education on teachers.
Continuous study of the same teachers over many years is challenging and accordingly not common. It is typically expensive and time-consuming, and extends beyond the time span of most research funding; moreover, many participants either leave the profession or move to other locations, making it difficult to keep in touch with them. Accordingly, additional ways to do longitudinal research need to be found: for example, studying teachers intensively for a shorter period; asking teachers to recall earlier phases in their life and/or career; or studying different cohorts of teachers at various career points (as in the classic Huberman study and parts of the U.K. VITAE research). Each of these methods has limitations but maintains the valuable outcome of providing a time perspective.
Where it can be arranged, however, interviewing the same teachers at intervals over several years has the advantage of enabling researchers to get to know the participants well. As a result, the researchers are in a better position to understand what the participants are saying in the interviews, and assess the veracity of their self-reporting about their views and practices, past and present. Also, a degree of trust is established such that the teachers are more likely to be frank about their feelings, challenges, and concerns. But one danger of the emerging relationship is that the support the relationship it provides may positively impact the teachers’ experience (e.g., helping them fine-tune their practice and maintain their morale to an unusually high level). This limitation has to be weighed against the advantages in deciding whether or not to use this approach to the longitudinal study of teachers.
David Ian Walker and Stephen J. Thoma
At core, moral and character education aims to develop the moral person. How this end state develops has been hindered by interest from different theoretical positions, differences between practitioners and theoreticians, different assumptions about how far character is educable, and associated measurement problems. Traditionally, moral education is concerned with the interpretation and strategies one uses to understand moral phenomenon and defines the moral person as a predominantly thinking entity, whereas character education emphasizes the development of habits and dispositions as a precondition for the moral person. Current interest is in finding commonalities across these traditions towards the achievement of human flourishing. These points of intersection have often been overlooked, but current work is demonstrating the importance of interdisciplinary and multidisciplinary approaches for practitioners, researchers and policymakers.
Koji Matsunobu and Liora Bresler
From rites of passage to closer community bonding, the practice, enjoyment, exchange, and transmission of music—regardless of the setting—is an integral element of the history of human civilization. While the field of music education research has long focused on school music and institutional teaching, it is increasingly reaching out to the wider community, in the process involving people at different life stages who are operating in a variety of societal contexts. Consequently, research in music education explores a broad spectrum of musical engagements (including composition and improvisation, in addition to singing, playing, and listening) and a wide-ranging repertoire (including jazz, popular music, folk, and world music), together with diverse pedagogies both inspired by and borrowed from these genres. This process reveals how these forms of musical transmission can, on the one hand, create new meanings and experiences at individual levels, and, on the other, shape collective identity formation through the facilitation of cultural sustainability and transformation. By means of quantitative, qualitative, historical, and philosophical methods, and typically drawing on the fields of—among others—psychology, sociology, and anthropology, music education researchers have addressed social, cultural, pedagogical, and ethical issues of music teaching and learning.
Jane Abbiss and Eline Vanassche
Teacher education has been a matter of concern among policymakers for decades. For just as long, there have been attempts to understand and improve teacher education by studying it empirically. Disenchanted by the progress made by scholarly experts who produced knowledge in “scientific” research “on” teacher education with the aim that findings be implemented in practice settings, teacher educators themselves started researching teacher education. The resulting practice-focused research provides insight into the kinds of research that teacher educators themselves find useful to guide their work and practice in the preparation of teachers.
Broadly speaking, research conducted by teacher educators for teacher educators serves a twofold purpose: to inform the improvement of local practice but also to contribute to the development of a public knowledge base in teacher education. The warrants for knowledge for teacher educator research on teacher education practices derive from a range of qualitative research methodologies, and the authority of this research relates generally to questions of relevance and rigor in qualitative research. Research conducted by teacher educators for teacher educators presents challenges for teacher educators in achieving a balance between goals for local relevance and making a theoretical contribution to the field.
There are, though, also challenges for teacher educator researchers in understanding the field within which they work. What seems like a relatively simple mission—to provide an overview of qualitative research that focuses on teacher education practice and the preparation of student teachers—proves to be quite a difficult task. Challenges relate to matters of definition, concerning who “qualifies” as teacher educators in times of rapid change and variation in initial teacher education provision internationally, and what constitutes research on teacher education practices. Also, challenges derive from matters of scope in the publication of research by teacher educators. Publication of such research extends beyond that which appears in top tier international journals and which tends to provide an American-centric and Global North view of teacher education. These challenges in themselves raise questions about who gets to define the field of practice-focused research in initial teacher education and how this field is defined by the research practices it entails.
Marginalized populations are by definition composed of people who have fewer possibilities and options in their lives than those studying them. This fact has to be reflected before, during, and after the research itself. There are many facets of this basic assumption. One of them is, how are marginalized perceived by the researcher? Are they helpless victims, or people who are able to tell their own stories? Another relevant detail is the personality of the researcher. When the researcher comes from outside the marginalized group, the key question is, which methodology can be best applied to give a voice to those who are marginalized? On the other hand, when the researcher is a member of the group being studied, the key question is how to achieve the distance necessary for analysis. There could be many more such relevant facets, but the quality of the final research product is partially determined by any number of decisions that are made during the planning of the research and the conducting of the research.
All of these decisions have methodological consequences. There are a wide range of qualitative research approaches, such as participatory research, autoethnographic research, narrative and biographical research, or traditional qualitative research based on interviews with representatives of marginalized groups. In the early 21st century, there has been a shift away from a top-down, outsider perspective that sees the marginalized as helpless victims and toward more participatory research designs that promote and give a space to the marginalized voice.
The common denominator of all these decisions is whose voice is being heard—does it belong to the marginalized group or to the outside world? Is it possible to overcome the boundaries between these two worlds? And what role does methodology play in this story?