Comparative Analysis of AI vs. Human Feedback Effects on IELTS Candidates' Writing Performance

Abstract

This study compares the effectiveness of artificial intelligence (AI)-generated feedback (specifically using ChatGPT) and human feedback in improving the writing performance of B2-level IELTS candidates. A mixed-methods approach was employed, combining quantitative and qualitative data to evaluate the impact of both types of feedback. A total of 100 B2-level English learners from various cities of Iran were selected through convenience sampling and then randomly assigned to two groups. Pre- and post-test assessments, using mock IELTS exams, provided quantitative data, while qualitative data were gathered through participant questionnaires. These findings reinforce the superiority of human feedback in enhancing higher-order writing skills; however, this study extends prior research by examining the effectiveness of AI-generated and human feedback within the specific context of Iranian IELTS candidates. Given the traditionally grammar-focused writing instruction in Iran, the results highlight the need for integrated feedback approaches that address coherence, cohesion, and argument development. The study also offers practical implications for IELTS preparation programs in non-native English-speaking countries, advocating for a structured combination of AI and human feedback to maximize writing proficiency. Learners valued the personalized guidance of human feedback, which fostered motivation and engagement. Conversely, AI-generated feedback excelled in correcting surface-level errors, such as grammar and vocabulary, offering immediacy and consistency. Nonetheless, AI's lack of interpretive depth limited its ability to address complex writing issues like argumentative development and cohesive flow. This study underscores the potential benefits of integrating AI and human feedback to enhance writing instruction for standardized assessments. Future research should investigate strategies to refine AI tools for better support of advanced writing skills.