Assessing Text-Based Writing of Low-Skilled College Students

Published on Mar 1, 2018
· DOI :10.1007/s40593-016-0122-z
Dolores Perin16
Estimated H-index: 16
(Columbia University),
Mark Lauterbach2
Estimated H-index: 2
(CUNY: City University of New York)
The problem of poor writing skills at the postsecondary level is a large and troubling one. This study investigated the writing skills of low-skilled adults attending college developmental education courses by determining whether variables from an automated scoring system were predictive of human scores on writing quality rubrics. The human-scored measures were a holistic quality rating for a persuasive essay and an analytic quality score for a written summary. Both writing samples were based on text on psychology and sociology topics related to content taught at the introductory undergraduate level. The study is a modified replication of McNamara et al. (Written Communication, 27(1), 57–86 2010), who identified several Coh-Metrix variables from five linguistic classes that reliably predicted group membership (high versus low proficiency) using human quality scores on persuasive essays written by average-achieving college students. When discriminant analyses and ANOVAs failed to replicate the McNamara et al. (Written Communication, 27(1), 57–86 2010) findings, the current study proceeded to analyze all of the variables in the five Coh-Metrix classes. This larger analysis identified 10 variables that predicted human-scored writing proficiency. Essay and summary scores were predicted by different automated variables. Implications for instruction and future use of automated scoring to understand the writing of low-skilled adults are discussed.
  • References (73)
  • Citations (2)
#1Neethu Robinson (BITS: Birla Institute of Technology and Science)H-Index: 6
#2Ali Danish Zaidi (University of Tübingen)H-Index: 2
Last.Ranganatha Sitaram (UC: Pontifical Catholic University of Chile)H-Index: 17
view all 7 authors...
#1Steve Graham (ASU: Arizona State University)H-Index: 51
#2Michael Hebert (NU: University of Nebraska–Lincoln)H-Index: 14
Last.Karen R. Harris (ASU: Arizona State University)H-Index: 56
view all 4 authors...
#1Charles A. MacArthur (UD: University of Delaware)H-Index: 36
#2Zoi A. Philippakos (UNCC: University of North Carolina at Charlotte)H-Index: 2
Last.Stephen Graham (ASU: Arizona State University)H-Index: 48
view all 3 authors...
#1Asad Abdi (Information Technology University)H-Index: 6
#2Norisma Idris (Information Technology University)H-Index: 9
Last.Ramiz M. Aliguliyev (ANAS: Azerbaijan National Academy of Sciences)H-Index: 16
view all 4 authors...
#1Timothy Shanahan (UIC: University of Illinois at Chicago)H-Index: 23
#1Joshua Wilson (UD: University of Delaware)H-Index: 7
#2Natalie G. Olinghouse (UConn: University of Connecticut)H-Index: 13
Last.Gilbert N. Andrada (Connecticut State Department of Education)H-Index: 3
view all 5 authors...
#1Barbara Carretti (UNIPD: University of Padua)H-Index: 25
#2Eleonora Motta (UNIPD: University of Padua)H-Index: 1
Last.Anna Maria Re (UNIPD: University of Padua)H-Index: 11
view all 3 authors...
View next paperIdentifying Indicators of Written Expression Proficiency for Middle School Students