Prompting for scaffolding: A thematic analysis of K-12 students’ use of educational chatbots for writing support
DOI:
https://doi.org/10.17239/jowr-2026.17.03.04Keywords:
writing instruction, generative AI, educational technology, prompt engineering, ChatGPTAbstract
With the emergence of generative artificial intelligence, dialogue systems like chatbots are redefining traditional concepts of authorship and impacting critical aspects of writing. In educational contexts, previous research has pointed out new opportunities associated with using chatbots for writing instruction and support. This study involved 108 students across 10 classes in Norwegian K-12 education, examining how they employed educational chatbots as a support tool in L1 writing assignments. Through an inductive, data-driven thematic analysis of 895 student prompts, five recurring patterns emerged: information requests, structural guidance, example requests, content creation, feedback on text, and follow-up clarification. Aggregated results show that information requests were the most common pattern, particularly among younger students, whereas content creation and feedback on text were more prevalent among secondary and upper secondary students. Illustrative examples from the conversations revealed that generative AI extensively produced content on student’s behalf, even when students primarily sought scaffolding. The study proposes that effective scaffolding of writing through educational chatbots requires not only refining students' prompting strategies but also enhancing system designs that better support pedagogical use of generative AI.
References
Adeshola, I., & Adepoju, A. P. (2024). The opportunities and challenges of ChatGPT in education. Interactive Learning Environments, 32(10), 6159-6172. https://doi.org/10.1080/10494820.2023.2253858
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023). Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology, 15(3), 13, Article ep429. https://doi.org/10.30935/cedtech/13152
Albadarin, Y., Saqr, M., Pope, N., & Tukiainen, M. (2024). A systematic literature review of empirical research on ChatGPT in education. Discover Education, 3(1), 60. https://doi.org/10.1007/s44217-024-00138-2
Bakken, A. M., Burke, P., Steinrücke, J., Walgermo, B. R., Haeri, M. A., Teixeira, M., Amigo, Y. Á., & Roelofs, E. (2025). Cultivating Global Writers: The Role of AI in Creating Authentic Writing Situations for Young Learners. In DeHart, J.D., Abas, S., Mora, R.A., & Pyles D.G. (Eds.), Reimagining Literacy in the Age of AI (pp. 113-131). Chapman and Hall/CRC. https://doi.org/10.1201/9781003510635-9
Baron, N. S. (2023). Who Wrote This?: How AI and the Lure of Efficiency Threaten Human Writing. Stanford University Press. https://doi.org/10.1515/9781503637900
Belland, B. R. (2013). Scaffolding: Definition, current debates, and future directions. In Spector, M.J., Merril, M.D, Elen, J. & Bishop, M.J., Handbook of research on educational communications and technology (pp. 505-518). Springer. https://doi.org/10.1007/978-1-4614-3185-5_39
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, 610-623.
Benko, S. L. (2012). Scaffolding: An ongoing process to support adolescent writing development. Journal of Adolescent & Adult Literacy, 56(4), 291-300. https://doi.org/10.1002/JAAL.00142
Biagini, G. (2025). Towards an AI-Literate Future: A systematic literature review exploring education, ethics, and applications. International Journal of Artificial Intelligence in Education, 1-51. https://doi.org/10.1007/s40593-025-00466-w
Braun, V., & Clarke, V. (2012). Thematic analysis. In H. Cooper (Ed.), APA Handbook of Research Methods in Psychology (Vol. 2). American Psychological Association. https://doi.org/10.1037/13620-004
Bray, T. (2014). The javascript object notation (json) data interchange format (2070-1721).
Byrd, A. (2023). Truth-telling: Critical inquiries on LLMs and the corpus texts that train them. Composition Studies, 51(1), 135-142. https://compstudiesjournal.com/wp-content/uploads/2023/06/byrd.pdf
Cardon, P., Fleischmann, C., Aritz, J., Logemann, M., & Heidewald, J. (2023). The Challenges and Opportunities of AI-Assisted Writing: Developing AI Literacy for the AI Age. Business and Professional Communication Quarterly, 86(3), 257-295. https://doi.org/10.1177/23294906231176517
Casal-Otero, L., Catala, A., Fernández-Morante, C., Taboada, M., Cebreiro, B., & Barro, S. (2023). AI literacy in K-12: a systematic literature review. International Journal of STEM Education, 10(1), 29. https://doi.org/10.1186/s40594-023-00418-7
Coe, C. D. (2011). Scaffolded writing as a tool for critical thinking: Teaching beginning students how to write arguments. Teaching Philosophy, 34(1), 33-50. https://doi.org/10.5840/teachphil20113413
Cope, B., & Kalantzis, M. (Eds.). (1993). The powers of literacy: A genre approach to teaching writing. Routledge. https://doi.org/10.4324/9780203149812.
Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228-239. https://doi.org/10.1080/14703297.2023.2190148
Dale, R., & Viethen, J. (2021). The automated writing assistance landscape in 2021. Natural Language Engineering, 27(4), 511-518. https://doi.org/10.1017/S1351324921000164
Dhillon, P. S., Molaei, S., Li, J., Golub, M., Zheng, S., & Robert, L. P. (2024). Shaping human-AI collaboration: Varied scaffolding levels in co-writing with language models. Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems,
Doyle, L. (2019). An Overview of Mixed Methods Research – Revisited. In SAGE Mixed Methods Research. SAGE Publications, Inc., https://doi.org/10.4135/9781526498137.d3
Evmenova, A. S., Regan, K., Mergen, R., & Hrisseh, R. (2024). Improving Writing Feedback for Struggling Writers: Generative AI to the Rescue? Techtrends, 68(4), 790-802. https://doi.org/10.1007/s11528-024-00965-y
Farrokhnia, M., Banihashem, S. K., Noroozi, O., & Wals, A. (2024). A SWOT analysis of ChatGPT: Implications for educational practice and research. Innovations in Education and Teaching International, 61(3), 460-474. https://doi.org/10.1080/14703297.2023.2195846
Giray, L. (2023). Prompt Engineering with ChatGPT: A Guide for Academic Writers [Early Access]. Annals of Biomedical Engineering, 5. https://doi.org/10.1007/s10439-023-03272-4
Graham, S. (2024, Nov. 7). Why should we teach writing in the age of artificial intelligence? Medium.com. https://medium.com/inspired-ideas-prek-12/why-should-we-teach-writing-in-the-age-of-artificial-intelligence-c49c50300584
Graham, S., & Harris, K. R. (2006). Strategy instruction and the teaching of writing. Handbook of writing research, 5(2), 187-207.
Graham, S., MacArthur., C. A., & Hebert, M. (Eds.). (2013). Best practices in writing instruction (3 ed.). Guilford Press.
Guo, K., Wang, J., & Chu, S. K. W. (2022). Using chatbots to scaffold EFL students’ argumentative writing. Assessing Writing, 54, 100666. https://doi.org/10.1016/j.asw.2022.100666
Halliday, M. A. K. (1994). An introduction to functional grammar (2 ed.). Edward Arnold.
Harris, K. R., & Graham, S. (2009). Self-regulated strategy development in writing: Premises, evolution, and the future. British Journal of Educational Psychology, 2(6), 113-135. https://doi.org/10.1348/978185409X422542
He, J. K., Wallis, F. P., Gvirtz, A., & Rathje, S. (2024). Artificial intelligence chatbots mimic human collective behaviour. British Journal of Psychology. https://doi.org/10.1111/bjop.12764
Holmes, W., & Miao, F. (2023). Guidance for generative AI in education and research. UNESCO Publishing. https://doi.org/10.54675/EWZM9535
Huang, W. J., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning-Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1), 237-257. https://doi.org/10.1111/jcal.12610
Hwang, G. J., & Chang, C. Y. (2023). A review of opportunities and challenges of chatbots in education . Interactive Learning Environments, 31(7), 4099-4112. https://doi.org/10.1080/10494820.2021.1952615
Hwang, Y., Lee, J. H., & Shin, D. (2023). What is prompt literacy? An exploratory study of language learners' development of new literacy skill using generative AI. arXiv preprint arXiv:2311.05373. https://doi.org/10.48550/arXiv.2311.05373
Hyland, K. (2007). Genre pedagogy: Language, literacy and L2 writing instruction. Journal of second language writing, 16(3), 148-164. https://doi.org/10.1016/j.jslw.2007.07.005
Ironsi, C. S., & Ironsi, S. S. (2024). Experimental evidence for the efficacy of generative AI in improving students' writing skills [; Early Access]. Quality Assurance in Education, 16. https://doi.org/10.1108/qae-04-2024-0065
Jauhiainen, J. S., & Guerra, A. G. (2023). Generative AI and ChatGPT in School Children's Education: Evidence from a School Lesson. Sustainability, 15(18), 22, Article 14025. https://doi.org/10.3390/su151814025
Jauhiainen, J. S., & Guerra, A. G. (2024). Generative AI in education: ChatGPT-4 in evaluating students' written responses [; Early Access]. Innovations in Education and Teaching International, 15. https://doi.org/10.1080/14703297.2024.2422337
Johnson, G. P. (2023). Don’t act like you forgot: Approaching another literacy “crisis” by (re) considering what we know about teaching writing with and through technologies. Composition Studies, 51(1), 169-175. https://compstudiesjournal.com/wp-content/uploads/2023/06/johnson.pdf
Jurafsky, D., & Martin, J. H. (2025). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition (3 ed.). https://web.stanford.edu/~jurafsky/slp.
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T.,…Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education [Editorial Material]. Learning and Individual Differences, 103, 9, Article 102274. https://doi.org/10.1016/j.lindif.2023.102274
Kim, J., Yu, S., Detrick, R., & Li, N. (2025). Exploring students’ perspectives on Generative AI-assisted academic writing. Education and Information Technologies, 30(1), 1265-1300. https://doi.org/10.1007/s10639-024-12878-7
Kok, C. L., Ho, C. K., Koh, Y. Y., Thanh, N. T. C., & Teo, T. H. (2024). Collaborative Learning Environments Facilitated by AI Technologies. TENCON 2024-2024 IEEE Region 10 Conference (TENCON),
Kosmyna, N., Hauptmann, E., Yuan, Y. T., Situ, J., Liao, X.-H., Beresnitzky, A. V., Braunstein, I., & Maes, P. (2025). Your brain on chatgpt: Accumulation of cognitive debt when using an ai assistant for essay writing task. arXiv preprint arXiv:2506.08872. https://doi.org/10.48550/arXiv.2506.08872
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review . Education and Information Technologies, 28(1), 973-1018. https://doi.org/10.1007/s10639-022-11177-3
Kuiper, C., Smit, J., De Wachter, L., & Elen, J. (2017). Scaffolding tertiary students’ writing in a genre-based writing intervention. Journal of Writing Research, 9(1), 27-59. https://doi.org/doi.org/10.17239/jowr-2017.09.01.02
Labadze, L., Grigolia, M., & Machaidze, L. (2023). Role of AI chatbots in education: systematic literature review. International Journal of Educational Technology in Higher Education, 20(1), 56. https://doi.org/10.1186/s41239-023-00426-1
Lambert, J., & Stevens, M. (2024). ChatGPT and Generative AI Technology: A Mixed Bag of Concerns and New Opportunities . Computers in the Schools, 41(4), 559-583. https://doi.org/10.1080/07380569.2023.2256710
Langer, J. A., & Applebee, A. N. (1986). Reading and writing instruction: Toward a theory of teaching and learning. Review of research in education, 13(1), 171-194. https://doi.org/10.3102/0091732X013001171
Langer, J. A., & Applebee, A. N. (1987). How Writing Shapes Thinking: A Study of Teaching and Learning. NCTE Research Report No. 22. ERIC.
Lee, U., Jung, H., Jeon, Y., Sohn, Y., Hwang, W., Moon, J., & Kim, H. (2024). Few-shot is enough: exploring ChatGPT prompt engineering method for automatic question generation in english education. Education and Information Technologies, 29(9), 11483-11515. https://doi.org/10.1007/s10639-023-12249-8
Levine, S., Beck, S. W., Mah, C., Phalen, L., & PIttman, J. (2024). How do students use ChatGPT as a writing support? Journal of Adolescent & Adult Literacy. https://doi.org/10.1002/jaal.1373
Long, D., & Magerko, B. (2020). What is AI literacy? Competencies and design considerations. Proceedings of the 2020 CHI conference on human factors in computing systems, 1-16. https://doi.org/10.1145/3313831.3376727
MacKenzie, I. S. (2024). Human-computer interaction: An empirical research perspective (2nd ed.). Morgan Kaufmann. https://doi.org/10.1016/C2022-0-02755-0
Martin, J. R. (1992). English text: System and structure. John Benjamins.
Mathew, A. R., Al Hajj, A., & Al Abri, A. (2011). Human-computer interaction (HCI): An overview. 2011 IEEE international conference on computer science and automation engineering,
Mollick, E. (2024). Co-Intelligence. Living and working with AI. Random House UK.
Mollick, E., & Mollick, L. (2023). Assigning AI: Seven approaches for students, with prompts. arXiv preprint arXiv:2306.10052. https://doi.org/10.2139/ssrn.4475995
Monteith, S., Glenn, T., Geddes, J. R., Whybrow, P. C., Achtyes, E., & Bauer, M. (2024). Artificial intelligence and increasing misinformation. The British Journal of Psychiatry, 224(2), 33-35. https://doi.org/10.1192/bjp.2023.136
Naeem, M., Ozuem, W., Howell, K., & Ranfagni, S. (2023). A step-by-step process of thematic analysis to develop a conceptual model in qualitative research. International journal of qualitative methods, 22. https://doi.org/10.1177/16094069231205789
Ng, D. T. K., Leung, J. K. L., Chu, K. W. S., & Qiao, M. S. (2021a). AI literacy: Definition, teaching, evaluation and ethical issues. Proceedings of the association for information science and technology, 58(1), 504-509. https://doi.org/10.1002/pra2.487
Ng, D. T. K., Leung, J. K. L., Chu, S. K. W., & Qiao, M. S. (2021b). Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2, 100041. https://doi.org/10.1016/j.caeai.2021.100041
Norwegian Reading Centre. (2025, 04 Mar). AILIT: Scaffolding children's writing by creative use of AI and international collaboration. University of Stavanger. https://www.uis.no/en/norwegian-reading-centre/fostering-students-engagement-for-writing-through-international
Open Science Foundation. (2025). Writing support with educational chatbots [Data storage repository]. https://osf.io/jmgu5/?view_only=5f036d8218d841cf9810c51766300304
OpenAI. (2022, Nov. 30). Introducing ChatGPT. https://openai.com/index/chatgpt/
Rahman, M. M., & Watanobe, Y. (2023). ChatGPT for Education and Research: Opportunities, Threats, and Strategies. Applied Sciences-Basel, 13(9), 21, Article 5783. https://doi.org/10.3390/app13095783
Reeping, D., & Shah, A. (2024). Work-in-Progress: Students' Prompting Strategies When Solving an Engineering Design Task. 2024 IEEE Frontiers in Education Conference (FIE),
Rose, D., & Martin, J. R. (2012). Learning to write/reading to learn: Genre, knowledge and pedagogy in the Sydney school. University of Toronto Press.
Salles, A., Evers, K., & Farisco, M. (2020). Anthropomorphism in AI. AJOB neuroscience, 11(2), 88-95. https://doi.org/10.1080/21507740.2020.1740350
Salles, A., & Wajnerman Paz, A. (2024). Chapter Six - Anthropomorphism in social AIs: Some challenges. In M. Ienca & G. Starke (Eds.), Developments in Neuroethics and Bioethics (Vol. 7, pp. 101–118). Academic Press. https://doi.org/10.1016/bs.dnb.2024.02.007
Sawalha, G., Taj, I., & Shoufan, A. (2024). Analyzing student prompts and their effect on ChatGPT’s performance. Cogent Education, 11(1), 2397200. https://doi.org/10.1080/2331186X.2024.2397200
Selwyn, N. (2022). The future of AI and education: Some cautionary notes. European Journal of Education, 57(4), 620-631. https://doi.org/10.1111/ejed.12532
Selwyn, N. (2024). On the limits of artificial intelligence (AI) in education. Nordisk tidsskrift for pedagogikk og kritikk, 10(1), 3-14. https://doi.org/10.23865/ntpk.v10.6062
Sharples, M., & Pérez y Pérez, R. (2022). Story machines : How computers have become creative writers. Routledge. https://doi.org/10.4324/9781003161431
Sinha, G., Shahi, R., & Shankar, M. (2010). Human computer interaction. 2010 3rd International Conference on Emerging Trends in Engineering and Technology,
Steiss, J., Tate, T., Graham, S., Cruz, J., Hebert, M., Wang, J. L., Moon, Y., Tseng, W., Warschauer, M., & Olson, C. B. (2024). Comparing the quality of human and ChatGPT feedback of students' writing. Learning and Instruction, 91, 15, Article 101894. https://doi.org/10.1016/j.learninstruc.2024.101894
Stojanov, A. (2023). Learning with ChatGPT 3.5 as a more knowledgeable other: An autoethnographic study. International Journal of Educational Technology in Higher Education, 20(1), 35. https://doi.org/10.1186/s41239-023-00404-7
Tardy, C. M., Sommer-Farias, B., & Gevers, J. (2020). Teaching and researching genre knowledge: Toward an enhanced theoretical framework. Written Communication, 37(3), 287-321. https://doi.org/10.1177/0741088320916554
Trimbur, J. (2015). Revisiting ‘Literacy and the Discourse of Crisis’ in the Era of Neoliberalism. In L. C. Lewis (Ed.), Strategic Discourse: The Politics of (New) Literacy Crises. Computers and Composition Digital Press. https://ccdigitalpress.org/book/strategic/afterword.html
University of Oslo. (2025). GPT UiO In (Version 23.05.2025) [Large language model]. https://gpt.uio.no/
Van de Pol, J., Volman, M., & Beishuizen, J. (2010). Scaffolding in teacher–student interaction: A decade of research. Educational psychology review, 22(3), 271-296. https://doi.org/10.1007/s10648-010-9127-6
Van Wynsberghe, A. (2021). Sustainable AI: AI for sustainability and the sustainability of AI. AI and Ethics, 1(3), 213-218. https://doi.org/10.1007/s43681-021-00043-6
Vygotsky, L. S. (1978). Mind in society: the development of higher psychological processes. Harvard University Press. https://doi.org/10.2307/j.ctvjf9vz4
Walter, Y. (2024). Embracing the future of Artificial Intelligence in the classroom: the relevance of AI literacy, prompt engineering, and critical thinking in modern education. International Journal of Educational Technology in Higher Education, 21(1), 15. https://doi.org/10.1186/s41239-024-00448-3
Wang, C., & Tian, Z. (2025). Rethinking Writing Education in the Age of Generative AI. Taylor & Francis. https://doi.org/10.4324/9781003426936
Wang, C. Z., Aguilar, S. J., Bankard, J. S., Bui, E., & Nye, B. (2024). Writing with AI: What College Students Learned from Utilizing ChatGPT for a Writing Assignment. Education Sciences, 14(9), 16, Article 976. https://doi.org/10.3390/educsci14090976
Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., & Metzler, D. (2022). Emergent abilities of large language models. arXiv preprint arXiv:2206.07682. https://doi.org/10.48550/arXiv.2206.07682
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022). Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35, 24824-24837. https://doi.org/10.48550/arXiv.2201.11903
Wei, R., Li, K., & Lan, J. (2024). Improving collaborative learning performance based on LLM virtual assistant. 2024 13th International Conference on educational and information technology (ICEIT).
White, J., Fu, Q., Hays, S., Sandborn, M., Olea, C., Gilbert, H., Elnashar, A., Spencer-Smith, J., & Schmidt, D. C. (2023). A prompt pattern catalog to enhance prompt engineering with chatgpt. arXiv preprint arXiv:2302.11382. https://doi.org/10.48550/arXiv.2302.11382
Wikipedia. (2025). Microsoft Copilot [Archived version 31 July 2025]. Retrieved Aug, 04 from https://en.wikipedia.org/w/index.php?title=Microsoft_Copilot&oldid=1303516423
Wilkinson, I. A. G., & Gaffney, J. S. (2015). Literacy for schooling: Two-tiered scaffolding for learning and teaching. In L. Corno & E. M. Anderman (Eds.), Handbook of educational psychology (pp. 243–258). Routledge.
Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving. Journal of child psychology and psychiatry, 17(2), 89-100. https://doi.org/10.1111/j.1469-7610.1976.tb00381.x
Zhong, B., & Liu, X. (2025). Evaluating AI literacy of secondary students: Framework and scale development. Computers & Education, 227, 105230. https://doi.org/10.1016/j.compedu.2024.105230
Published
Issue
Section
License
Copyright (c) 2026 Jon Olav Sørhaug
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 Unported License.
