Good text quality despite deficient transcription skills
An analysis of double dissociation
Keywords:
spelling, handwriting fluency, text quality, double dissociation, text-specific formulation skillsAbstract
Current writing models suppose that the production of a good-quality text is a complex interaction of low-level transcription skills (handwriting fluency and spelling) and higher-level cognitive and text-specific formulation skills (such as building cohesion and using diverse and appropriate vocabulary). Low-level transcription skills, albeit important for text quality, can only explain a small part of its variance. Therefore, in this paper we investigate whether there exist children who show discrepant achievements in text quality and low-level transcription skills and how they can be characterized in terms of higher-level text-specific formulation skills. A total of 186 native German-speaking 5th to 7th grade students had to complete transcription skills tests and write a narrative text. Text quality and text-specific formulation skills were measured. The following results were obtained: (1) Students with double dissociations (deficient transcription skills/ age-appropriate text quality or the reverse) could be identified; (2) these groups differed significantly in text-specific formulation skills, namely lexical diversity, correct sentence building, and local cohesion. Generally, children with the same low-level transcription skills (whether age-appropriate or deficient) who wrote better texts, achieved higher scores in these variables. The findings emphasize the importance of text-specific formulation skills and their consideration in writing instruction.
References
Abbott, R. D., & Berninger, V. W. (1993). Structural equation modeling of relationships among developmental skills and writing skills in primary- and intermediate-grade writers. Journal of Educational Psychology, 85(3), 478–508. https://doi.org/10.1037//0022-0663.85.3.478
Abbott, R. D., Berninger, V. W., & Fayol, M. (2010). Longitudinal relationships of levels of language in writing and between writing and reading in grades 1 to 7. Journal of Educational Psychology, 102(2), 281–298. https://doi.org/10.1037/a0019318
Alves, R. A., & Limpo, T. (2015). Progress in Written Language Bursts, Pauses, Transcription, and Written Composition Across Schooling. Scientific Studies of Reading, 19(5), 374–391. https://doi.org/10.1080/10888438.2015.1059838
Averintseva-Klisch, M. (2018). Textkohärenz (2nd ed.). Universitaetsverlag Winter GmbH. https://api.pageplace.de/preview/dt0400.9783825379780_a40046660/preview-9783825379780_a40046660.pdf
Barnett, A. L., Henderson, S. E., Scheib, B., & Schulz, J. (2007). The Detailed Assessment of Speed of Handwriting (DASH). Pearson Education.
Barnett, A. L., Henderson, S. E., Scheib, B., & Schulz, J. (2009). Development and standardization of a new handwriting speed test: The Detailed Assessment of Speed of Handwriting. British Journal of Educational Psychology, 2(6), 137–157. https://doi.org/10.1348/000709909x421937
Becker-Mrotzek, M., Grabowski, J [Joachim], Jost, J., Knopp, M., & Linnemann, M. (2014). Adressatenorientierung und Kohärenzherstellung im Text. Zum Zusammenhang kognitiver und sprachlicher realisierter Teilkompetenzen von Schreibkompetenz. Didaktik Deutsch. Halbjahresschrift für die Didaktik der deutschen Sprache und Literatur, 19(37), 21–43. https://doi.org/10.25656/01:17151
Beers, S. F., & Nagy, W. E. (2009). Syntactic complexity as a predictor of adolescent writing quality: Which measures? Which genre? Reading and Writing, 22(2), 185–200. https://doi.org/10.1007/s11145-007-9107-5
Bereiter, C., & Scardamalia, M. (1987). The psychology of written composition. Lawrence Erlbaum Associates.
Berman, R., & Nir-Sagiy, B. (2007). Comparing Narrative and Expository Text Construction Across Adolescence: A Developmental Paradox. Discourse Processes, 2(43), 79–120. https://doi.org/10.1080/01638530709336894
Berninger, V. W., Vaughan, K., Abbott, R. D., Begay, K., Coleman, K. B., Curtin, G., Hawkins, J. M., & Graham, S. (2002). Teaching spelling and composition alone and together: Implications for the simple view of writing. Journal of Educational Psychology, 94(2), 291–304. https://doi.org/10.1037//0022-0663.94.2.291
Berninger, V. W., & Winn, W. (2006). Implications of advancements in brain research and technology for writing development, writing instruction, and educational evolution. In C. A. MacArthur, S. Graham, & J. Fitzgerald (Eds.), Handbook of writing research (pp. 96–114). Guilford Press.
Boonen, N., Kloots, H., & Gillis, S. (2020). Rating the overall speech quality of hearing-impaired children by means of comparative judgements. Journal of Communication Disorders, 83, 105969. https://doi.org/10.1016/j.jcomdis.2019.105969
Breetvelt, I., van den Bergh, H., & Rijlaarsdam, G. (1994). Relations Between Writing Processes and Text Quality: When and How? Cognition and Instruction, 12(2), 103–123. https://doi.org/10.1207/s1532690xci1202_2
Cameron, C. A., Lee, K., Webster, S., Munro, K., Hunt, A. K., & Linton, M. J. (1995). Text cohesion in children’s narrative writing. Applied Psycholinguistics, 16(3), 257–269. https://doi.org/10.1017/s0142716400007293
Cordeiro, C., Limpo, T., Olive, T., & Castro, S. L. (2020). Do executive functions contribute to writing quality in beginning writers? A longitudinal study with second graders. Reading and Writing, 33(4), 813–833. https://doi.org/10.1007/s11145-019-09963-6
Cox, B. E., Shanahan, T., & Sulzby, E. (1990). Good and Poor Elementary Readers’ Use of Cohesion in Writing. Reading Research Quarterly, 25(1), 47. https://doi.org/10.2307/747987
Crossley, S. A., & McNamara, D. (2016). Say more and be more coherent: How text elaboration and cohesion can increase writing quality. Journal of Writing Research, 7(3), 351–370. https://doi.org/10.17239/jowr-2016.07.03.02
Crossley, S. A., & McNamara D. (2010). Cohesion, coherence, and expert evaluations of writing proficiency. Proceedings of the Annual Meeting of the Cognitive Science Society, 32(32), 351–370. https://escholarship.org/content/qt6n5908qx/qt6n5908qx.pdf
Feenstra, H. (2021). Assessing writing ability in primary education: On the evaluation of text quality and text complexity [Dissertation, University of Twente]. Research Information University of Twente. https://doi.org/10.3990/1.9789036537254
Fleckenstein, J., Meyer, J., Jansen, T., Keller, S., & Köller, O. (2020). Is a Long Essay Always a Good Essay? The Effect of Text Length on Writing Assessment. Frontiers in Psychology, 11, 562462. https://doi.org/10.3389/fpsyg.2020.562462
Gegenfurtner, K. R., Goldstein, E. B., & Cacciamani, L. (Eds.). (2022). Lehrbuch. Wahrnehmungspsychologie: Der Grundkurs (10. vollständig überarbeitete und aktualisierte Auflage). Springer. https://doi.org/10.1007/978-3-662-65146-9
Gómez Vera, G., Sotomayor, C., Bedwell, P., Domínguez, A. M., & Jéldrez, E. (2016). Analysis of lexical quality and its relation to writing quality for 4th grade, primary school students in Chile. Reading and Writing, 29(7), 1317–1336. https://doi.org/10.1007/s11145-016-9637-9
Graham, S. (1990). The role of production factors in learning disabled students’ compositions. Journal of Educational Psychology, 82(4), 781–791. https://doi.org/10.1037//0022-0663.82.4.781
Graham, S., Berninger, V. W., Abbott, R. D., Abbott, S. P., & Whitaker, D. (1997). Role of mechanics in composing of elementary school students: A new methodological approach. Journal of Educational Psychology, 89(1), 170–182. https://doi.org/10.1037//0022-0663.89.1.170
Graham, S., Gillespie, A., & McKeown, D. (2013). Writing: Importance, development, and instruction. Reading and Writing, 26(1), 1–15. https://doi.org/10.1007/s11145-012-9395-2
Graham, S., & Harris, K. R. (1997). It Can Be Taught, But It Does Not Develop Naturally: Myths and Realities In Writing Instruction. School Psychology Review, 26(3), 414–424. https://doi.org/10.1080/02796015.1997.12085875
Graham, S., & Harris, K. R. (2018). Evidence-Based Writing Practices: A Meta-Analysis of Existing Meta-Analyses. In R. Fidalgo, K. R. Harris, & M. Braaksma (Eds.), Studies in writing: volume 34. Design principles for teaching effective writing: Theoretical and empirical grounded principles (pp. 13–37). BRILL. https://doi.org/10.1163/9789004270480_003
Graham, S., Hebert, M., Paige Sandbank, M., & Harris, K. R. (2016). Assessing the Writing Achievement of Young Struggling Writers. Learning Disability Quarterly, 39(2), 72–82. https://doi.org/10.1177/0731948714555019
Graham, S., Kim, Y.‑S., Cao, Y., Lee, J. w., Tate, T., Collins, P., Cho, M., Moon, Y., Chung, H. Q., & Olson, C. B. (2023). A meta-analysis of writing treatments for students in grades 6–12. Journal of Educational Psychology, 115(7), 1004–1027. https://doi.org/10.1037/edu0000819
Graham, S., & Perin, D. (2007). Writing next: Effective strategies to improve writing of adolescents in middle and high schools: A report to Carnegie Corporation of New York. Alliance for Excellent Education. https://education.illinoisstate.edu/downloads/casei/5-15-writingnext.pdf
Graham, S., & Santangelo, T. (2014). Does spelling instruction make students better spellers, readers, and writers? A meta-analytic review. Reading and Writing, 27(9), 1703–1743. https://doi.org/10.1007/s11145-014-9517-0
Harsch, C., Neumann, A., Lehmann, R., & Schröder, K. (2007). Schreibfähigkeit. In E. Klieme & B. Beck (Eds.), Sprachliche Kompetenzen. Konzepte und Messungen. (pp. 42–62). Beltz. https://doi.org/10.25656/01:3232
Hayes, J. R. (2012). Modeling and Remodeling Writing. Written Communication, 29(3), 369–388. https://doi.org/10.1177/0741088312451260
Hayes, J. R., & Berninger, V. W. (2010). Relationships between idea generation and transcription: How the act of writing shapes what children write. In C. Bazerman, R. Krut, K. Lunsford, S. McLeod, S. Null, P. Rogers, & A. Stansell (Eds.), Traditions of Writing Research (pp. 166–180). Taylor & Francis/Routledge.
Hennes, A.‑K., Schmidt, B. M., Zepnik, S., Linnemann, M., Jost, J., Becker-Mrotzek, M., Rietz, C., & Schabmann, A. (2018). Schreibkompetenz diagnostizieren. Ein standardisiertes Testverfahren für die Klassenstufen 4-9 in der Entwicklung. Empirische Sonderpädagogik, 10(3), 294–310.
Hurschler Lichtsteiner, S., Wicki, W., & Falmann, P. (2018). Impact of handwriting training on fluency, spelling and text quality among third graders. Reading and Writing, 31(6), 1295–1318. https://doi.org/10.1007/s11145-018-9825-x
IBM Corp. (2023). IBM SPSS Statistics for Windows (Version 29.0.2.0) [Computer software]. IBM Corp.
Jones, I., Swan, M., & Pollitt, A. (2015). Assessing Mathematical Problem Solving Using Comparative Judgment. International Journal of Science and Mathematics Education, 13(1), 151–177. https://doi.org/10.1007/s10763-013-9497-6
Jones, L., & Karadeniz, I. (08.2016). An alternative approach to assessing achievement. Proceedings of the 2016 4th Conference of the International Group for the Psychology of Mathematics Education, Szeged, Hungary. https://repository.lboro.ac.uk/articles/an_alternative_approach_to_assessing_achievement/9373622/files/16984337.pdf
Kim, G. Y.‑S., & Graham, S. (2022). Expanding the Direct and Indirect Effects Model of Writing (DIEW): Reading-Writing Relations, and Dynamic Relations As a Function of Measurement/Dimensions of Written Composition. Journal of Educational Psychology, 114(2), 215–238. https://doi.org/10.1037/edu0000564
Klotz, P. (2022). Grammatik und Textualität. In H. Gornik (Ed.), Deutschunterricht in Theorie und Praxis Series. Sprachreflexion und Grammatikunterricht (2. überarbeitete und erweiterte Auflage, pp. 138–154). W. Verlag Bertelsmann GmbH & Co. KG.
Kultusministerkonferenz (Ed.). (2022). Bildungsstandards für das Fach Deutsch Erster Schulabschluss (ESA) und Mittlerer Schulabschluss (MSA). https://www.kmk.org/fileadmin/Dateien/veroeffentlichungen_beschluesse/2022/2022_06_23-Bista-ESA-MSA-Deutsch.pdf
Lesterhuis, M., Verhavert, S., Coertjens, L., Donche, V., & de Maeyer, S. (2017). Comparative Judgement as a Promising Alternative to Score Competences. In E. Cano & G. Ion (Eds.), Innovative Practices for Higher Education Assessment and Measurement (pp. 119–138). IGI Global. https://doi.org/10.4018/978-1-5225-0531-0.ch007
Limpo, T., & Alves, R. A. (2013). Modeling writing development: Contribution of transcription and self-regulation to Portuguese students’ text generation quality. Journal of Educational Psychology, 105(2), 401–413. https://doi.org/10.1037/a0031391
Limpo, T., & Alves, R. A. (2018). Tailoring Multicomponent Writing Interventions: Effects of Coupling Self-Regulation and Transcription Training. Journal of Learning Disabilities, 51(4), 381–398. https://doi.org/10.1177/0022219417708170
Limpo, T., Alves, R. A., & Connelly, V. (2017). Examining the transcription-writing link: Effects of handwriting fluency and spelling accuracy on writing performance via planning and translating in middle grades. Learning and Individual Differences, 53, 26–36. https://doi.org/10.1016/j.lindif.2016.11.004
Limpo, T., & Graham, S. (2020). The role of handwriting instruction in writers’ education. British Journal of Educational Studies, 68(3), 311–329. https://doi.org/10.1080/00071005.2019.1692127
Lindauer, N., & Sommer, T. (2018). Verfahren der Textbeurteilung. Merkmale und Vorzüge eines holistischen Benchmarkratings. Leseräume, 6(5), 1–14. https://doi.org/10.26041/fhnw-2043
Lindauer, T., & Schmellentin, C. (2017). Rechtschreibung: System, Kompetenzen und Erwerb. In M. Philipp (Ed.), Handbuch Schriftspracherwerb und weiterführendes Lesen und Schreiben (pp. 20–35). Beltz Juventa.
MacArthur, C. A., Jennings, A., & Philippakos, Z. A. (2019). Which linguistic features predict quality of argumentative writing for college basic writers, and how do those features change with instruction? Reading and Writing, 32(6), 1553–1574. https://doi.org/10.1007/s11145-018-9853-6
Mason, J. M., & Allen, J. (1986). A Review of Emergent Literacy with Implications for Research and Practice in Reading. In E. Rothkranz (Ed.), Review of research in education (Vol. 13, pp. 27–43). American Educational Research Association. https://doi.org/10.3102/0091732X013001003
Mathiebe, M. (2019). Wortschatzfähigkeiten in der Sekundarstufe I: Plädoyer für eine textorientierte Perspektive. Forschung Sprache, 7(3), 96–106.
May, P., Vieluf, U., & Malitzky, V. (2018). HSP+: Hamburger Schreib-Probe 1-10. Ernst Klett Verlag.
McCarthy, P. M. (2005). An assessment of the range and usefulness of lexical diversity measures and the potential of the measure of textual, lexical diversity (MTLD) (3199485) [Dissertation, The University of Memphis]. ProQuest Dissertations and Theses Global. https://search.proquest.com/openview/860b2901fa90c6e68e46cd9111bd2d1c/1?pq-origsite=gscholar&cbl=18750&diss=y
McCarthy, P. M., & Jarvis, S. (2010). Mtld, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment. Behavior Research Methods, 42(2), 381–392. https://doi.org/10.3758/BRM.42.2.381
McMahon, S., & Jones, I. (2015). A comparative judgement approach to teacher assessment. Assessment in Education: Principles, Policy & Practice, 22(3), 368–389. https://doi.org/10.1080/0969594X.2014.978839
McNamara, T., Knoch, U., & Fan, J. (2019). Fairness, Justice and Language Assessment. Oxford University Press.
Moats, L., Foorman, B., & Taylor, P. (2006). How Quality of Writing Instruction Impacts High-risk Fourth Graders’ Writing. Reading and Writing, 19(4), 363–391. https://doi.org/10.1007/s11145-005-4944-6
Moll, K., & Landerl, K. (2009). Double Dissociation Between Reading and Spelling Deficits. Scientific Studies of Reading, 13(5), 359–382. https://doi.org/10.1080/10888430903162878
Myford, C. M., & Wolfe, E. W. (2003). Detecting and Measuring Rater Effects Using Many-Facet Rasch Measurement: Part I. Journal of Applied Measurement, 4(4), 286–422.
National Commission on Writing. (2003). The neglected “r”: The need for a writing revolution. College Entrance Examination Board.
Neumann, A. (2017). Zugänge zur Bestimmung von Textqualität. In M. Becker-Mrotzek, J. Grabowski, & T. Steinhoff (Eds.), Forschungshandbuch empirische Schreibdidaktik (pp. 203–219). Waxmann.
Olinghouse, N. G., & Wilson, J. (2013). The relationship between vocabulary and writing quality in three genres. Reading and Writing, 26(1), 45–65. https://doi.org/10.1007/s11145-012-9392-5
Olive, T. (2014). Toward a parallel and cascading model of the writing system: A review of research on writing processes coordination. Journal of Writing Research, 6(2), 173–194. https://doi.org/10.17239/jowr-2014.06.02.4
Palincsar, A. S., & Klenk, L. (1993). Third Invited Response: Broader Visions Encompassing Literacy, Learners, and Contexts. Remedial and Special Education, 14(4), 19–25. https://doi.org/10.1177/074193259301400405
Philippek, J., Kreutz, R. M., Hennes, A.‑K., Schmidt, B. M., & Schabmann, A. (2024). The contributions of executive functions, transcription skills and text-specific skills to text quality in narratives. Reading and Writing, 1–20. https://doi.org/10.1007/s11145-024-10528-5
Pollitt, A. (2012a). Comparative judgement for assessment. International Journal of Technology and Design Education, 22(2), 157–170. https://doi.org/10.1007/s10798-011-9189-x
Pollitt, A. (2012b). The method of Adaptive Comparative Judgement. Assessment in Education: Principles, Policy & Practice, 19(3), 281–300. https://doi.org/10.1080/0969594X.2012.665354
R Core Team. (2022). R: A Language and Environment for Statistical Computing [Computer software]. https://www.R-project.org/.
Rocha, R. S., Castro, S. L., & Limpo, T. (2022). The role of transcription and executive functions in writing: A longitudinal study in the transition from primary to intermediate Grades. Reading and Writing, 35(8), 1911–1932. https://doi.org/10.1007/s11145-022-10256-8
Sadler, D. R. (2009). Indeterminacy in the use of preset criteria for assessment and grading. Assessment & Evaluation in Higher Education, 34(2), 159–179. https://doi.org/10.1080/02602930801956059
Santangelo, T., & Graham, S. (2016). A Comprehensive Meta-analysis of Handwriting Instruction. Educational Psychology Review, 28(2), 225–265. https://doi.org/10.1007/s10648-015-9335-1
Schwarz, M. (2001). Establishing Coherence in Text. Conceptual Continuity and Textworld Models. Logos and Language, 2(1), 15–24.
Sturm, A. (2017). Förderung hierarchieniedriger Schreibprozesse. In M. Philipp (Ed.), Handbuch Schriftspracherwerb und weiterführendes Lesen und Schreiben (pp. 266–284). Beltz Juventa.
Sturm, A., Nänny, R., & Wyss, S. (2017). Entwicklung hierarchieniedriger Schreibprozesse. In M. Philipp (Ed.), Handbuch Schriftspracherwerb und weiterführendes Lesen und Schreiben (pp. 84–104). Beltz Juventa.
Thurstone, L. L. (1927). A law of comparative judgement. Psychological Review, 34(4), 273–286. https://doi.org/10.1037/h0070288
van Daal, T., Lesterhuis, M., Coertjens, L., Donche, V., & Maeyer, S. de (2019). Validity of comparative judgement to assess academic writing: examining implications of its holistic character and building on a shared consensus. Assessment in Education: Principles, Policy & Practice, 26(1), 59–74. https://doi.org/10.1080/0969594X.2016.1253542
van Daal, T., Lesterhuis, M., Maeyer, S. de, & Bouwer, R. (2022). Editorial: Validity, reliability and efficiency of comparative judgement to assess student work. Frontiers in Education, 7, Article 1100095. https://doi.org/10.3389/feduc.2022.1100095
Verhavert, S., Bouwer, R., Donche, V., & Maeyer, S. de (2019). A meta-analysis on the reliability of comparative judgement. Assessment in Education: Principles, Policy & Practice, 26(5), 541–562. https://doi.org/10.1080/0969594X.2019.1602027
Weston, J. L., Crossley, S. A., McCarthy, P. M., & McNamara, D. (March 2011). Number of words versus number ideas: Finding a better predictor of writing quality. Twenty-Fourth International FLAIRS Conference, Florida, USA. https://cdn.aaai.org/ocs/2618/2618-11356-1-pb.pdf
Zifonun, G. (2000). Textkonstitutive Funktionen von Tempus, Modus und Genus Verbi. In K. Brinker (Ed.), Text- & Gesprächslinguistik (pp. 315–330). Walter de Gruyter. https://doi.org/10.1515/9783110194067-035
Published
Issue
Section
License
Copyright (c) 2025 Rebecca Maria Kreutz, Julie Philippek, Ann-Kathrin Hennes, Alfred Schabmann
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 Unported License.
