Examining the Relationship between Writing Habits, Digital Literacy, and Students’ Perceptions in AI Writing Feedback and Critical Writing Skills among Senior High School Students
DOI:
https://doi.org/10.65339/ijsair.V2.I2.209Keywords:
Artificial intelligence writing feedback, Critical writing skills, Digital literacy, Senior high school students, Structural equation modeling, Writing habitsAbstract
This study examined how writing habits mediate the relationship between digital literacy, students’ perceptions of AI writing feedback, and critical writing skills among senior high school students. Anchored in the sociocognitive theory of writing, the research explored the interaction of cognitive, behavioral, and technological factors in writing development. A descriptive correlational design was employed involving 167 Grade 11 Humanities and Social Sciences students from a private Catholic institution. Data were collected using validated Likert-scale questionnaires and a rubric-based writing task, and analyzed through descriptive statistics, multiple regression, and structural equation modeling (SEM). Findings revealed that students demonstrated high perceptions of AI writing tools in terms of usefulness and ease of use, but only moderate trust. Writing habits and digital literacy were rated high to very high, while critical writing skills were at an approaching proficient level across clarity, reasoning, analysis, and reflection. Results further showed that digital literacy and perceptions of AI significantly influence writing habits; however, these variables do not directly predict critical writing skills. The best-fitting structural model indicated that critical writing development is primarily associated with higher-order cognitive processes rather than routine writing practices alone. The study concludes that while AI tools and digital competence enhance writing engagement, the development of critical writing skills requires deliberate cognitive and instructional support. It recommends strengthening explicit instruction in higher-order thinking, integrating AI tools critically, and designing curricula that emphasize reasoning and reflection. The study aligns with SDG 4 (Quality Education) by promoting inclusive and effective digital learning practices. It contributes to sustainability by supporting responsible AI integration, strengthening institutional teaching practices, and developing critical competencies essential for academic success and future employability.
References
Abdelaty, M., et al. (2025). The impact of pre-writing planning strategies on second language writing performance. Journal of Language Teaching and Research, 16(1), 88–102.
Abrami, P. C., Bernard, R. M., Borokhovski, E., Waddington, D. I., Wade, C. A., & Persson, T. (2015). Strategies for teaching students to think critically: A meta-analysis. Review of Educational Research, 85(2), 275–314. https://doi.org/10.3102/0034654314551063
Afandi, A., Widodo, A., & Suryani, N. (2024). Digital literacy skills and student performance in technology-enhanced learning environments. Journal of Educational Technology Systems.
Aksakalli, A., & Daşer, A. (2025). Examining students’ engagement in functional and creative writing tasks in digital learning environments. Journal of Language and Education, 11(1), 45–60.
Alharthi, S. (2021). The impact of writing practice on developing writing skills among EFL learners. Arab World English Journal, 12(3), 178–192.
Anggraeni, C. W., Setiawan, W., & Nurkamto, J. (2025). Reflective revision practices in enhancing students’ writing performance. Journal of Language and Education, 11(2), 88–102.
Bandura, A. (1978). Reflections on self-efficacy. Advances in Behaviour Research and Therapy, 1(4), 237–269.
Bandura, A. (1997). Self-efficacy: The exercise of control. W. H. Freeman.
Brown, H. D. (2022). Principles of language learning and teaching (7th ed.). Pearson.
Bujang, M. A., Omar, E. D., & Baharum, N. A. (2024). A review on sample size determination for Cronbach’s alpha test: A simple guide for researchers. Malaysian Journal of Medical Sciences.
Campos, M. (2025). AI-assisted feedback in CLIL courses as a self-regulated language learning mechanism: Students’ perceptions and experiences. European Public & Social Innovation Review. https://doi.org/10.31637/epsir-2025-1568
Capinding, A. T. (2023). Descriptive correlational research design in education: Applications and implications. Journal of Educational Research and Practice, 13(1), 45–58.
Celik, I. (2023). Exploring the determinants of artificial intelligence (AI) literacy: Digital divide, computational thinking, cognitive absorption. Telematics and Informatics, 83, 102026. https://doi.org/10.1016/j.tele.2023.102026
Chen, C., & Gong, Y. (2025). The role of AI-assisted learning in academic writing: A mixed-methods study on Chinese as a second language students. Education Sciences, 15(2), 141. https://doi.org/10.3390/educsci15020141
Chen, L., Wang, Y., & Liu, H. (2026). Enhancing reflective thinking in academic writing through metacognitive strategies and AI-supported feedback. Computers & Education, 210, 104950.
Chen, X., Zhang, Y., & Liu, H. (2022). Students’ perceptions of AI feedback and the role of human judgment in writing evaluation. Journal of Educational Technology Research, 45(2), 123–138.
Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: The state of the field. International Journal of Educational Technology in Higher Education, 20(1), 22. https://doi.org/10.1186/s41239-023-00392-8
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008
Deng, L., & Yuen, A. H. K. (2021). Exploring the role of AI writing assistants in supporting student writing and learning. Computers and Education: Artificial Intelligence, 2, 100028. https://doi.org/10.1016/j.caeai.2021.100028
Dharmayanti, A., Putri, N., & Gunawan, A. (2024). Digital literacy and students’ academic writing performance in Indonesian higher education. Journal of Information Literacy, 18(1), 55–72.
Eccles, J. S., & Wigfield, A. (2020). From expectancy-value theory to situated expectancy-value theory: A developmental, social cognitive, and sociocultural perspective on motivation. Contemporary Educational Psychology, 61, 101859.
Escalante, L., Pack, A., & Barrett, A. (2023). Technology-assisted learning and student engagement in higher education. Computers & Education, 190, 104599. https://doi.org/10.1016/j.compedu.2022.104599
Fan, N. (2024). Effects of collaborative vs. individual pre-task planning on EFL learners’ L2 writing: Transferability of writing quality. Humanities and Social Sciences Communications, 11, 1365. https://doi.org/10.1057/s41599-024-03758-z
Francisco, R. (2024). The impact of Grammarly on proofreading habits of senior high school students in Manila. Philippine Journal of Education and Development Studies, 9(2), 75–89.
Fu, Q., Lin, C., & Zhang, Y. (2025). Developing digital competencies in higher education: Trends and implications for teaching and learning. Computers & Education, 200, 104802.
Gonsalves, T. (2024). Reflective writing and metacognition in higher education. Journal of Writing Research, 16(1), 23–42. https://doi.org/10.17239/jowr-2024.16.01.02
Grassini, S. (2023). Shaping the future of education: Exploring the potential and consequences of AI and ChatGPT in educational settings. Education Sciences, 13(7), 692. https://doi.org/10.3390/educsci13070692
Guo, Y., Wang, X., & Zhang, H. (2024). Artificial intelligence writing feedback and its influence on EFL students’ writing habits and performance. Computers & Education, 205, 104895. https://doi.org/10.1016/j.compedu.2023.104895
Holmes, W., Bialik, M., & Fadel, C. (2022). Artificial intelligence in education: Promises and implications for teaching and learning. Springer.
Kasneci, E., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274.
Khosravi, H., Kitto, K., & Knight, S. (2023). Learning analytics and metacognitive strategy development: A systematic review. British Journal of Educational Technology, 54(1), 15–36. https://doi.org/10.1111/bjet.13242
Kim, H., & Lee, J. (2023). Digital literacy and critical evaluation of online information among students. Computers & Education.
Li, Y., & Graves, B. (2020). Revision practices and their impact on writing development in second language learners. Journal of Second Language Writing, 47, 100710.
List, A., & Alexander, P. A. (2020). Learning from multiple texts: Effects of strategy instruction on sourcing and argumentation. Contemporary Educational Psychology.
Liu, F., & Stapleton, P. (2020). Counterargumentation and the cultivation of critical thinking in argumentative writing: Investigating students’ writing. Journal of Second Language Writing, 50, 100745.
Minh, T. (2024). ChatGPT in EFL writing lessons: Impacts on vocabulary, grammar, and argumentation. Journal of Language Teaching and Research, 15(1), 15–27.
Mohammed, A., & Mohammed, I. (2025). Nigerian postgraduate students’ use of AI tools in academic writing. African Journal of Education and Technology, 8(2), 102–118.
Nasution, S., Matondang, M., & Barus, D. (2025). AI tools and writing habit formation among university students. Journal of Educational Technology Studies, 15(1), 77–95.
National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research. (1979). The Belmont report: Ethical principles and guidelines for the protection of human subjects of research. U.S. Department of Health and Human Services. https://www.hhs.gov/ohrp/regulations-and-policy/belmont-report/read-the-belmont-report/index.html
Noroozi, O., Hatami, J., Bayat, A., van Ginkel, S., Biemans, H. J. A., & Mulder, M. (2020). Students’ online argumentative peer feedback, essay writing, and content learning: Does gender matter? Interactive Learning Environments, 28(6), 698–712. https://doi.org/10.1080/10494820.2018.1543200
Nunan, D., & Choi, J. (2023). Teaching writing: Balancing coherence, clarity, and linguistic accuracy. TESOL Quarterly, 57(1), 145–160.
Octaberlina, L. R., Febriyanti, E., & Hidayat, T. (2024). Risks of plagiarism and shallow engagement in AI-assisted academic writing. International Journal of Academic Research in Education, 10(1), 115–130.
Octaberlina, L. R., Muslimin, A. I., & Handayani, R. (2024). Over-reliance on AI tools and its effect on students’ higher-order thinking skills. Journal of Language and Education, 10(2), 55–67. https://doi.org/10.17323/jle.2024.223
Pathan, Z. H. (2025). Writing practice and learner engagement in ESL classrooms: A correlational study. International Journal of English Language Teaching, 13(2), 22–37.
Peng, H., & Bao, Y. (2023). The role of cognitive processes in academic writing tasks among EFL learners. System, 115, 103020. https://doi.org/10.1016/j.system.2023.103020
Pereles, D. A., Lockyer, J., & Fidler, H. (2024). Developing reflective practice through metacognitive strategies in education. Medical Education, 58(2), 210–220.
Pervaiz, S., Ahmad, R., & Khan, M. (2025). AI writing feedback and its impact on efficiency, clarity, and critical thinking. Journal of Educational Assessment, 17(2), 201–218.
Qin, X., Zhang, L. J., & Zhao, H. (2022). Metacognitive strategies and writing performance in second language learning. System, 105, 102728. https://doi.org/10.1016/j.system.2022.102728
Rusdin, N., Hassan, R., & Ismail, S. (2023). AI-supported reasoning in student writing: Potentials and pitfalls. International Journal of Educational Technology, 20(3), 189–206.
Sathyanarayana, S., & Mohanasundaram, K. (2024). Structural equation modeling: Model fit indices and applications in educational research. Educational Research Review, 41, 100541.
Shen, L., & Teng, F. (2024). Cognitive offloading and reflective writing through AI support. System, 119, 103867.
Shen, Q., & Teng, F. (2024). Artificial intelligence in academic writing: Benefits, risks, and the future of critical thinking. Language Teaching Research, 28(3), 456–474.
Sun, Y., Li, X., & Zhao, R. (2021). Trust and usage of AI-based feedback systems in academic writing tasks. Computers in Human Behavior, 119, 106719.
Teng, F., & Yue, M. (2022). Metacognitive writing strategies and self-regulated learning in EFL writing. System, 103, 102653. https://doi.org/10.1016/j.system.2021.102653
Teng, M. F., & Yue, M. (2023). Metacognitive writing strategies, critical thinking skills, and academic writing performance: A structural equation modeling approach. Metacognition and Learning, 18(1), 237–260.
Tinmaz, H., Fanea-Ivanovici, M., & Baber, H. (2023). A snapshot of digital literacy. Library Hi Tech News, 40(1), 20–23.
United Nations Department of Economic and Social Affairs. (2020). The sustainable development goals report 2020. United Nations. https://unstats.un.org/sdgs/report/2020/
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2020). Unified theory of acceptance and use of technology: A synthesis and the road ahead. Journal of the Association for Information Systems, 21(5), 1–54. https://doi.org/10.17705/1jais.00628
Wigfield, A., & Eccles, J. S. (2000). Expectancy–value theory of achievement motivation. Contemporary Educational Psychology, 25(1), 68–81. https://doi.org/10.1006/ceps.1999.1015
Yuan, R., et al. (2025). Digital competencies among higher education students: A systematic review. Educational Technology Research and Development, 73(1), 215–234.
Zhai, X. (2022). Artificial intelligence for education: A systematic review. Educational Technology & Society.
Zhai, X., & Wibowo, S. (2023). A systematic review of AI in education and its implications for teaching and learning. Computers and Education: Artificial Intelligence.
Zhang, Z. (2025). Assessing critical writing skills in second language learning: Development and validation of a rubric-based framework. Journal of Second Language Writing, 68, 101234. https://doi.org/10.1016/j.jslw.2025.101234
Zhao, L., Chen, M., & Wang, J. (2021). AI-assisted writing feedback and its impact on students’ revision practices and writing clarity. Journal of Writing Research, 13(2), 255–272.
Ziar, R. (2025). The risks of AI reliance in academic writing: Effects on student confidence and originality. Middle Eastern Journal of Education, 19(1), 101–119.
