Exploring the Utility of Sequential Analysis in Studying Informal Formative Assessment Practices

Published on Mar 1, 2017in Educational Measurement: Issues and Practice
· DOI :10.1111/EMIP.12143
Erin Marie Furtak22
Estimated H-index: 22
(CU: University of Colorado Boulder),
Maria Araceli Ruiz-Primo23
Estimated H-index: 23
(Stanford University),
Roger Bakeman55
Estimated H-index: 55
(GSU: Georgia State University)
Formative assessment is a classroom practice that has received much attention in recent years for its established potential at increasing student learning. A frequent analytic approach for determining the quality of formative assessment practices is to develop a coding scheme and determine frequencies with which the codes are observed; however, these frequencies do not necessarily reflect the temporal and sequential nature of teacher–student interactions. In this article, we explore the utility of sequential analysis as an alternative strategy to capture the nature of informal formative assessment interactions that take place in whole-classroom conversations as compared to frequencies alone. We coded transcriptions of video recordings of four middle school science teachers' whole-class discussions about density for different types of teacher statements associated with effective approaches to formative assessment, as well as the quality of the ideas students shared. Using sequential analysis, we then calculated transitional probabilities and odds ratios for those sequences. Results indicate that sequential analysis revealed differences across the four classrooms analyzed, particularly with respect to the way teachers responded to different kinds of student ideas. Recommendations are framed for the future use of sequential analysis in studying formative assessment classroom practice.
  • References (37)
  • Citations (4)
📖 Papers frequently viewed together
33 Citations
4 Authors (Paul Cobb, ..., K.P.E. Gravemeijer)
9 Citations
1 Author (David Clarke)
2 Citations
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Jennifer RichardsH-Index: 4
Last. Amy D. RobertsonH-Index: 6
view all 2 authors...
4 CitationsSource
#1Elizabeth B. Lewis (NU: University of Nebraska–Lincoln)H-Index: 7
#2Dale R. Baker (ASU: Arizona State University)H-Index: 14
Last. Brandon HeldingH-Index: 3
view all 3 authors...
This report outlines a 2-year investigation into how secondary science teachers used professional development (PD) to build scientific classroom discourse communities (SCDCs). Observation data, teacher, student, and school demographic information were used to build a hierarchical linear model. The length of time that teachers received PD was the exclusive predictor of change over time, whereas a schools’ percentage of low socioeconomic students predicted how PD concepts was initially implemented...
10 CitationsSource
Responsive teaching occurs when teachers take up and respond to their students’ ideas during instruction (J. L. Pierson, 2008). Although responsive teaching is gaining recognition as an effective strategy for encouraging student learning, few methods of analysis are capable of characterizing the different ways in which teachers take up their students’ ideas in the moment. This article presents and exemplifies a new methodological construct, the redirection, which provides researchers with a mean...
28 CitationsSource
#1Amelia Wenk Gotwals (MSU: Michigan State University)H-Index: 13
#2Joanne Philhower (MSU: Michigan State University)H-Index: 1
Last. Steven Bennett (MSU: Michigan State University)H-Index: 1
view all 4 authors...
Formative assessment practices, including eliciting a broad range of student ideas, noticing the nuances in students' ideas, using these ideas to guide instruction, and promoting student self-regulation of learning are key components of expert teaching. Given the inherent dialogical nature of formative assessment in the classroom, video can provide a powerful tool for capturing and analyzing teachers' formative assessment interactions with students. In this study, we provide a framework for exam...
18 CitationsSource
17 CitationsSource
Sociology is a discipline in which the idea of a multi-method research design has held credence for many years, far before the term mixed methods research was coined. This article charts the implementation and framing of this approach over time to better understand the place and state of mixed methods research in the discipline today. Several recent applications of mixed method research by sociologists are highlighted to demonstrate the range of projects being conducted. There are challenges to ...
44 CitationsSource
#1Janet E. Coffey (UMD: University of Maryland, College Park)H-Index: 6
#2David Hammer (Tufts University)H-Index: 33
Last. Terrance GrantH-Index: 1
view all 4 authors...
We raise concerns about the current state of research and development in formative assessment, specifically to argue that in its concentration on strategies for the teacher, the literature overlooks the disciplinary substance of what teachers and students assess. Our argument requires analysis of specific instances in the literature, and so we have selected four prominent publications for consideration as examples. These, we show, pay little attention to the student reasoning they depict, presum...
149 CitationsSource
This paper covers six interrelated issues in formative assessment (aka, ‘assessment for learning’). The issues concern the definition of formative assessment, the claims commonly made for its effectiveness, the limited attention given to domain considerations in its conceptualisation, the under-representation of measurement principles in that conceptualisation, the teacher-support demands formative assessment entails, and the impact of the larger educational system. The paper concludes that the ...
502 CitationsSource
This article describes methods for analysing classroom talk, comparing their strengths and weaknesses. Both quantitative and qualitative methods are described and assessed for their strengths and weaknesses, with a discussion of the mixed use of such methods. It is acknowledged that particular methods are often embedded in particular methodologies, which are based on specific theories of social action, research paradigms, and disciplines; and so a comparison is made of two contemporary methodolo...
139 CitationsSource
The existence of a plethora of empirical evidence documenting the improvement of educational outcomes through the use of formative assessment is conventional wisdom within education. In reality, a limited body of scientifically based empirical evidence exists to support that formative assessment directly contributes to positive educational outcomes. The use of formative assessments, or other diagnostic efforts within classrooms, provides information that should help facilitate improved pedagogic...
220 Citations
Cited By4
#1Vesal Dini (University of Massachusetts Boston)H-Index: 2
#2Hannah Sevian (University of Massachusetts Boston)H-Index: 14
Last. Raúl Orduña Picón (University of Massachusetts Boston)H-Index: 1
view all 4 authors...
1 CitationsSource
#1Pasi Nieminen (University of Jyväskylä)H-Index: 7
#2Markus Hähkiöniemi (University of Jyväskylä)H-Index: 5
Last. Jouni Viiri (University of Jyväskylä)H-Index: 12
view all 3 authors...
ABSTRACTThis case study examined teachers’ on-the-fly formative assessment conversations, that is, how teachers collect information from students’ thinking and use that information to support their...
#1Erika G. Offerdahl (WSU: Washington State University)H-Index: 9
#2Melody McConnell (NDSU: North Dakota State University)H-Index: 4
Last. Jeffrey Boyer (NDSU: North Dakota State University)H-Index: 2
view all 3 authors...
: For decades, formative assessment has been identified as a high-impact instructional practice that positively affects student learning. Education reform documents such as Vision and Change: A Call to Action expressly identify frequent, ongoing formative assessment and feedback as a key instructional practice in student-centered learning environments. Historically, effect sizes between 0.4 and 0.7 have been reported for formative assessment experiments. However, more recent meta-analyses have r...
4 CitationsSource
#1Erin Marie Furtak (CU: University of Colorado Boulder)H-Index: 22
#2Roger Bakeman (GSU: Georgia State University)H-Index: 55
Last. Jason Y. Buell (CU: University of Colorado Boulder)H-Index: 2
view all 3 authors...
Abstract Researchers have argued that teachers' knowledge can be evidenced by the ways they elicit and respond to student ideas. We analyze data from a four-year study of nine high school teachers who designed formative assessment tasks and learned about student thinking with a learning progression for natural selection. We coded teacher questions, student responses, and teacher feedback in classroom videos collected across four years. Through sequential analysis, we found that teachers came to ...
3 CitationsSource