In today’s AI era, a new technology has revolutionized how students write their assignments: AI writing assistants. With this unforeseen advancement of technology, a significant challenge arose for educators, properly evaluating their students’ work. Before the AI advancement educators were mostly concerned about whether the students were plagiarizing or ghostwriting their papers, but now they have to distinguish whether a student wrote their text independently or with AI assistance, which is not an easy task.
The old problems were difficult to solve, and realistically, they were never fully resolved. This new development presents the same challenge once again. How can teachers determine if a student wrote on their own? Are their suspicions justified? How can they prove their suspicions? Do AI detection tools work?
This article underscores the difficulty teachers face and how Mentafy can be their solution in verifying their suspicions and shedding light on the authenticity of students’ work.
The Difficulty of Detecting AI-Generated Text
Every day, these AI writing tools are getting better and so are the students, learning how to use and get the best outcome out of them. Here are some reasons why it is becoming increasingly difficult for teachers to distinguish AI-generated text.
Sophistication of AI Writing: AI writing tools like ChatGPT have become incredibly adept at mimicking human writing styles. They can generate nuanced, contextually relevant content nearly indistinguishable from human-written text. This makes it extremely difficult for teachers to detect AI use based mainly on intuition or stylistic cues.
Varying Prompts and Outputs: AI tools can generate different outputs from the same prompt or slightly varied prompts, resulting in unique texts each time leaving the teachers with the question: “Who actually wrote this?”. This variability means that even if a teacher suspects that a student used AI, the lack of a consistent pattern in the AI-generated content makes it hard to confirm those suspicions.
Real-World Evidence: Numerous articles such as this one, document cases where students used AI to write their papers or homework, passed successfully and their supervisors couldn’t tell a thing. These cases reinforce the effectiveness of AI tools in producing high-quality, seemingly authentic academic work.
Bias in Detection Tools: Existing AI detection tools often exhibit biases, particularly against non-native English speakers. Research shows that these tools disproportionately flag content from students whose first language isn’t English, leading to unfair disadvantages and potential misjudgments.
The Limitations of “Just Suspicion”
While teachers may suspect AI use based on inconsistencies in writing style or lack of critical thinking, they do not know how to prove it, but without concrete proof, these suspicions remain just that.
When it comes to traditional plagiarism checkers, they are not designed to identify AI-generated content, leaving a significant gap in detection capabilities.
Other platforms, that claim to detect AI, lead in most cases to a wrong answer, especially when it comes to a text that is mixed with AI. Some different studies and articles tried these different tools, with different texts such as human-written, AI-written, or 50/50. The results are more confusing than helpful. Making this situation even more confusing for the teachers, not knowing who to trust and wondering about their next actions on this matter.
Furthermore, what one teacher might consider suspicious, another might deem acceptable, leading to a lack of standardization in assessments. These subjective judgments lead to inconsistent evaluations, potentially resulting in unfair penalties.
Additionally, in all these situations teachers and students have found themselves in, are mostly focusing on punishment rather than fostering genuine learning and critical thinking in students. Accusing them of using AI without solid evidence, can create an environment of distrust and tension, undermining the educational mission.
Mentafy: Documentation for Decisive Insights
There should be given importance to evaluating the process of writing an academic paper rather than just evaluating based on the result one might receive from a Plagiarism/ AI-detection tool. To make such a thing possible the research and writing process should be documented for an evidence-based proof of students.
Mentafy offers a solution that goes beyond mere suspicion by providing comprehensive documentation of the writing process. Students can write their thesis or essay just as they normally would, e.g. in Microsoft Word, while Mentafy accompanies and records in the background to provide them feedback during writing and finally a data-based report to certify their genuine work.
Key features include:
Final Report: Mentafy tracks all changes made throughout the writing process, allowing teachers to see how a student’s work evolved. This transparency helps in assessing the student’s engagement and understanding of the material. Additionally, you can also generate interim reports to have insights during the project and support your students when necessary.
Writing Recorder: We have developed a writing pattern detection that flags suspicious patterns in student work, prompting further investigation alongside the documented writing process. Based on the writing pattern we differentiate, whether a text comes from the mind of a student, or whether it is simply copied from another source, e.g. generative AI. Combined with clear citation guidance we thereby help students to proactively cite those incidents correctly.
Research Recorder: This feature helps students stay organized and conduct accurate research. It records how and when external sources were used, ensuring proper citation practices and reducing the risk of plagiarism. By documenting the research process, Mentafy provides valuable context for the final submission. Teachers eventually get supervisor-friendly data about the research process, to gain insights for feedback and evaluation.
Conclusion
It is important to equip educators with the right tools they need to navigate the complexities of AI-generated content. By offering detailed documentation and insightful analysis, Mentafy helps teachers move beyond suspicion, ensuring a fair and educational approach to maintaining academic integrity. In an era where AI tools can produce high-quality academic work indistinguishable from student-written texts, Mentafy stands out as a critical resource for educators committed to fostering genuine learning and critical thinking skills.
