AHFE Open AccessDoes the Automated Essay Scoring System Reduce Motivation to Learn English Writing? A Case Study of Chinese College Students
Abstract
Artificial intelligence technology has given rise to the Automated Essay Scoring (AES) system, which has greatly reduced the workload of English teachers. It can give overall scores, error feedback and writing suggestions in seconds, after students have uploaded their English essays. In China, the most widely used AES system is called Pigai, which has been shown to help improve English writing skills, but has caused resistance from some students who believe it reduces motivation and creativity in English writing. Using a case study approach, this study investigated 29 Chinese English learners who had used Pigai. Based on the Cognitive Process Theory of Writing, quantitative analyses were used to assess motivation in three writing stages: planning, translating and reviewing. The results showed that the negative impact on students' motivation occurred in the planning and translating stages for three main reasons: lack of interpretability, unsuitability of recommendation algorithms and inadequate feedback mechanisms. In addition, based on the results of the questionnaire and interviews, we made some design suggestions for the AES system to improve user experience.
Keywords: Automated Essay Scoring, Writing, Motivation, Pigai, User Experience Design
DOI: 10.54941/ahfe1003227
Cite this paper
More from this volume
- User Experience in Modern Cars – Definition, Relevance and Challenges of Digital Automotive Applications
- Understanding Trust in Automation: A Consideration of Human Factors Context
- User Experience and E-government Services: Lessons Learned about Developing a Benchmarking Survey
- Digital technologies in museums: Critical issues and opportunities for equal access to cultural heritage
- Microbial Resource Research Infrastructure for the 21st Century: usability analysis of the Collaborative Working Environment
- Comparing the impact of two common information architectures on the operational performance of mission planning systems
- School teachers' and students' behaviors and attitudes toward recycling waste paper - a focus group experience
- What role an agent could play at home? Exploring the social roles of smart home system based on a content analysis
- Quality analysis of images between expert and beginners taken by drone.
- Design and Research of Modular Monitoring and Disinfecting Connection Cabin in the Perspective of "Resilient City"
- User-centered design of an adaptively morphing human-machine interface
- Small program design of learning tools based on user experience- Take "i remember" as an example