The use of generative AI in education and beyond remains controversial, particularly regarding authenticity and academic integrity. Some universities already have policies requiring the disclosure of all AI use, but without a control mechanism, one must hope for the honesty of the students.
The AI detectors sometimes do not work reliably (AI Detection Tools: When You Turn It In It’s Too Late!). Generative AI market leader OpenAI initially developed its own tool for analyzing the origin of text, but soon discontinued it due to a lack of accuracy (New AI classifier for indicating AI-written text).

It is therefore not surprising that attempts have been made to give the AI-generated texts a “watermark” for easy recognition and classification. The language model integrates a small bias in word selection (or technically correct “token selection”), i.e. the use of certain words to introduce a statistically specific, recognizable pattern to the text (A Watermark for Large Language Models). As a result, the text with a “watermark” will differ slightly from that without a watermark, as the words are not selected entirely freely – the quality of the text will generally be somewhat monotonous and rather poorer as a result.

OpenAI recently reported that this process works with a high recognition rate (Understanding the source of what we see and hear online). However, the same article also explains why this procedure will not be used on a regular basis. There are three ways to change the watermark pattern and thus prevent classification:

• Translate the text into another language and back again using translation software (a simple trick that fraudsters have already used successfully with Copy&Paste plagiarism).
• Have the text reworded by another language model.
• The language model itself can be ‘tricked’ when generating the text by instructing it via a prompt to insert specific words or characters between each word and then remove them afterwards with a simple ‘search & replace’. Therefore, bypassing the watermarking process is “trivial for malicious actors”.

Apart from that, a unilateral introduction of OpenAI would probably be seen as a competitive disadvantage compared to other language models such as Google’s Gemini or Anthropic’s Claude. After all, texts outside the academic context could then also be classified as AI-generated without the knowledge of the creators – which would possibly be interpreted to their disadvantage.
Furthermore, it is also not possible to differentiate between the type of use – for example, whether a text was developed and written by the author himself with arguments and ideas, and AI only provided the linguistic finishing touches at the end, or whether it comes from AI completely without a basis. This could put non-native speakers at a disadvantage, for example, if it were then assumed that there was no personal contribution.

Therefore, documenting the research and writing process still seems to be a much more reliable way of transparently and fairly assessing the extent to which the author contributed to the creation of the text.

In a world increasingly shaped by digital technologies, education is facing a paradigm shift. Artificial intelligence (AI), especially generative AI, is not only changing the education sector, but also opening up new horizons for individual learning and teaching methods. As an innovative company specializing in the development of software for the responsible and transparent use of AI, Mentafy is at the forefront of this transformation. In this blog post, we highlight the most significant opportunities and risks that AI brings to the education of the future and outline actions that should be taken to ensure that AI has a positive impact on our education and, ultimately, our society.

Opportunities through AI in education

1. Personalization of learning

AI has the potential to revolutionize learning by creating individual learning paths tailored to the specific needs and abilities of each student. Adaptive learning systems continuously analyze learning progress and adjust teaching methods and materials accordingly. This not only promotes more effective learning, but also motivates students as they can learn at their own pace and according to their own interests.

2. Accessibility and inclusion

One of the greatest strengths of AI is its ability to break down barriers and make education accessible to all. AI-powered platforms can provide learning materials in different formats, be it text, audio or video, facilitating access for students with different needs and abilities. In addition, these technologies enable the global sharing of knowledge by making learning resources available in regions that previously had limited access to quality education.

3. Efficiency and support for teachers

AI can automate a variety of administrative tasks that normally take a lot of time, such as grading exams or managing student data. This gives teachers more time to focus on the individual support and educational development of their students. AI can also support teachers in the creation of teaching materials and provide valuable insights into effective teaching strategies by analyzing learning data.

Risks posed by AI in education

1. Data protection and security

The collection and analysis of learning data by AI systems comes with a significant risk of misuse and inadequate security of personal information. Protecting student privacy must be a top priority to ensure trust in these technologies.

2. Dependency and loss of human capabilities

Over-reliance on AI could lead to both teachers and students neglecting their critical thinking skills and creativity. There is a risk of dehumanizing the educational process if interpersonal interaction is reduced in favor of automated systems.

3. Inequality and barriers to access

Access to AI-supported educational resources is often unevenly distributed, which could exacerbate existing educational inequalities. Regions with limited financial and infrastructural resources may struggle to keep pace with technological development.

Measures for a positive impact of AI on education and society

1. Promotion of digital skills and analog basics

To ensure the effective and critical use of AI in education, schools and educational institutions should implement digital literacy programs for teachers and students. This will ensure that all stakeholders can reap the benefits of the technology and understand its risks. At the same time preserve basic non-digital skills.

2. Creation of ethical guidelines and regulations

Clear ethical guidelines and regulations for the use of AI in education are essential to ensure data protection and prevent misuse. Transparency in data use and compliance with strict data protection standards should form the basis of any AI application in education.

3. Investment in research and infrastructure

Governments and educational institutions should invest in research to develop fair and inclusive AI systems and provide the necessary infrastructure to enable access to these technologies for all learners. These investments are crucial to ensure that no one is excluded from the benefits of AI.

Conclusion

Artificial intelligence offers immense opportunities to transform and improve education. Through personalized learning, increased accessibility and support for teachers, AI can create a more inclusive and effective learning environment. At the same time, however, we need to be mindful of the risks and take proactive measures to ensure the responsible use of these technologies. At Mentafy, we firmly believe that with the right balance and careful implementation of measures, AI can have a positive impact on education and society. Let’s shape the education of the future together – transparently, responsibly and inclusively.

Join Mentafy at LEARNTEC 2024: Revolutionizing Academic Integrity with AI

We’re excited to announce that Mentafy will be at LEARNTEC 2024 from June 4th to June 6th in Hall 2, Booth J26! Discover how our cutting-edge technology is transforming academic writing by helping students use AI safely and effectively.

Showcasing Our First Product: The Academic Paper Assistant

Our innovative platform assists students in creating academic papers while ensuring integrity and originality. Key features include:

• Writing Pattern Algorithm: This powerful tool detects potential misconduct, and prevents students from unintentional plagiarism, ghostwriting and particularly the usage of AI, ensuring that student work is authentic.
• Research Protocol: We help students with streamlining their research and a proper documentation, that seamlessly will become part of their writing diary.
• Writing Project Management: Students will get a helping hand in following the necessary steps to a great paper. Teachers can customize these according to their own guidelines.

Why Visit Us?

At our booth, you can:

• See Live Demonstrations: Experience our academic paper assistant in action and learn how it safeguards academic integrity.
• Meet Our Team: Connect with experts passionate about advancing education through technology.
• Get Exclusive Insights: Learn about upcoming features and enhancements.

Join us at LEARNTEC 2024, Hall 2, Booth J26, to explore how Mentafy is revolutionizing academic support with AI. Let’s shape the future of education together!

For more information, visit www.mentafy.com.

In an era where technology has infiltrated nearly every aspect of our lives, the use of Artificial Intelligence (AI) in the academic sphere presents both an opportunity and a challenge. A recent ruling by the Munich Administrative Court, which confirmed the exclusion of a student from applying to a master’s program at the Technical University of Munich (TUM) after he used AI – specifically ChatGPT – to write his essay, raises important questions about the use of AI in education.

The Problem for Students

This incident highlights a growing problem: the line between using AI as a tool to enhance learning and skill development and the risk of undermining academic integrity. While AI tools like ChatGPT have the potential to support students on their educational journey by offering new perspectives and inspirations, their use also carries the risk of fraud and deception.

The TUM’s decision and the subsequent court ruling demonstrate that academic institutions are increasingly able to identify the origin of a text using specialized software. In this case, the student’s essay was deemed “too perfect,” lacking the usual inconsistencies typical of student-written work. This level of perfection was ultimately a key factor in the suspicion that the text was created with the help of AI.

What Can Students Do?

What can Students Do?

For students, it is crucial to be aware of and respect the guidelines of their educational institutions. Transparency is the keyword here. It’s important for students who want to use AI tools to support their academic work to do so in a way that aligns with the ethical guidelines and requirements of their university.

One way to maintain integrity while also benefiting from the advantages of AI is by using platforms like Mentafy. Mentafy allows for the analysis of writing patterns to determine whether a text was independently written or if external tools like AI were used. The tool logs this information and creates a report that transparently lays out where AI was used, what was copied and cited, and what portion of the work was actually written independently.

By using such tools, students can ensure they don’t cross the line between using AI as a supportive tool and maintaining academic integrity. This approach not only promotes a deeper understanding and genuine engagement with the learning material but also enables students to benefit from AI without jeopardizing their academic career.

Conclusion

The case of the student excluded by TUM is a wake-up call for all involved in the educational sector. It highlights the need to find a balanced approach to handling AI technologies that leverages the innovative power of these tools while preserving academic integrity. By utilizing tools like Mentafy and adhering to the guidelines of their educational institutions, students can safely and ethically take advantage of AI to enhance their learning and academic development.

In today’s digital age, the proliferation of AI technologies has revolutionized various aspects of education, offering unprecedented opportunities for learning and innovation. However, with these advancements comes the challenge of maintaining academic integrity in an era where AI-driven plagiarism poses a significant threat to academic authenticity. Besides this landscape, many platforms are emerging as crucial allies in the fight against plagiarism, contract cheating as in ghostwriting or AI misuse. They provide students with the tools and support they need to uphold academic standards while embracing technological innovation responsibly.

Mentafy is more than just a software solution; it represents a commitment to promoting authentic writing practices and fostering a culture of integrity within educational institutions. At its core, Mentafy serves as a comprehensive academic writing assistant, empowering students to navigate the complexities of scholarly research and composition with confidence. By logging information thoroughly, including both human-written notes and automated records of file changes and the student’s writing progress, Mentafy offers students unparalleled insight into their writing process, facilitating self-reflection and improvement.

One of the key factor that sets Mentafy apart is concentrating more on the process rather than the final product. In an age where AI-generated content can easily be passed off as original work, Mentafy’s advanced algorithms are designed to identify potential instances in the process of writing before they escalate. By tracking sources and references and alerting students to missing citations, Mentafy serves as a vigilant guardian of academic integrity, helping students avoid unintentional breaches of academic ethics.

Moreover, Mentafy employs sophisticated algorithms to analyze data stored securely in cloud repositories, respecting users’ privacy. Without resorting to intrusive keystroke analysis, which is a serious privacy concerns, Mentafy’s methodology effectively detects patterns and irregularities, contributing to the prevention of plagiarism. This non-intrusive, proactive strategy not only discourages academic dishonesty but also promotes a comprehensive understanding of genuine writing practices among students.

In addition to its technological expertise, Mentafy embodies a philosophy of responsible AI usage, emphasizing the importance of maintaining the human element in academic writing. While AI technologies like ChatGPT offer unprecedented efficiency and convenience, they also raise ethical concerns regarding authenticity and originality. Moreover, students miss out on the experience of creating a scientific piece of text, which is a crucial component in developing critical thinking and learning how to properly research a topic. Mentafy seeks to address these concerns by serving as a bridge between technological advancements and traditional academic values, ensuring that the pursuit of knowledge remains both innovative and genuine.

As educators and policymakers contend with the challenges posed by AI-driven misconduct, platforms like Mentafy are poised to play a pivotal role in shaping the future of academic integrity. By empowering students to embrace technology responsibly and cultivate their writing skills with integrity and authenticity, Mentafy is paving the way for a new era of academic excellence.

In conclusion, Mentafy is an integral part in the fight against any academic misconduct, offering students the tools and guidance they need to navigate the complexities of academic writing with integrity and confidence. As we continue to harness the power of AI to enhance learning and innovation, let us not forget the importance of upholding the timeless values of honesty, integrity, and originality in scholarship.

Continuing from our earlier blog post where we discussed the opportunities and risks of AI in education, we would now like to present an overview of specific measures and the ongoing public discourse on this matter. What recommendations do education researchers offer? What insights do computer scientists provide regarding relevant technologies? And what initiatives are practitioners implementing in schools?

Measure A – AI Detection Software

In theory, it sounds promising. You press a button and receive information on whether the text in question was generated by an AI. However, unequivocally, this method is not yet reliable.

• Washington Post: Investigation of AI Detectors Shows Significant Flaws
  • In practical terms, the bottom line is that AI detectors simply aren’t effective enough yet. They produce too many false alarms and fail to detect numerous instances accurately.
• CNN: Company behind chatGPT halts its AI detection software development, due to ‘too little accuracy’
  • In essence, it appears that even the creator of the AI cannot develop a tool capable of reliably identifying its own use. While there could be other motives for discontinuing development, officially OpenAI expressed a desire to successfully create an AI detector.
• Finally, two distinct scientific studies independently arrive at the conclusion that AI detectors simply don’t work effectively and, in cases of uncertainty, may even exacerbate other issues related to discrimination:
  • Arxiv: Testing of Detection Tools for AI-Generated Text
  • Arxiv: GPT detectors are biased against non-native English writers

Measure B – Prohibit AI

In theory, this presents an elegant solution. The objective is to ensure that learners continue to develop the skill of independently creating texts. This is easily enforceable in scenarios where writing takes place under supervision. However, enforcing such a ban is likely to be challenging, particularly for texts generated at home. OpenAI, the company behind chatGPT, acknowledges this limitation:

• Gagadget: OpenAI believes that teachers will not be able to determine if students are using ChatGPT to complete homework assignments

Regardless of the enforceability or sustainability of such a ban, there is also the question of whether one should not integrate this technology—which will likely inevitably become prevalent in various professional domains—into education. A somewhat imperfect but valid comparison is the introduction of calculators in math classes. A comprehensive overview of why the use of generative language models can be highly beneficial for both teachers and learners can be found here:

• AIMultiple: ChatGPT Education Use Cases, Benefits & Challenges in 2023

Finally, it’s essential to note that one cannot learn how to deal with AI if its use is prohibited. The question arises whether this should not become a cultural skill: the ability to compose prompts correctly and effectively, understanding the limitations of AI, and knowing when and how one can enhance quality or overall productivity using it.

Measure C – Adjust assessments

There are undoubtedly various useful types of exams to assess learners’ knowledge and skills. The publication of ChatGPT, especially, puts all forms of ‘homework’ (essays, term papers, theses, etc.) under scrutiny. One approach to address the possibility that authors might use generative language models as a shortcut is to discontinue or severely limit these forms of examination. A notable suggestion comes from the Ministry of Education in Baden-Württemberg, where the Minister of Education proposes the introduction of more oral exams:

• The Limited Times: AI in schools: Minister wants more oral exams

This is indeed a viable approach to mitigate the use of AI in exam performance. However, what is overlooked, besides the fact that learners miss the opportunity to learn how to deal with AI, are the learning objectives achieved through ‘homework’: independent work, research skills, detailed critical evaluation of arguments, and the ability to compare them. There are compelling reasons why one might not want this type of assessment to be less prominent in the learning curriculum than it is today. Some insightful case studies illustrate how schools are adapting their exam formalities:

• Business Insider:College professors are considering creative ways to stop students from using AI to cheat
  •  Some of the solutions include using lockdown browsers, oral exams, case studies, machine learning techniques, and proctoring software.
• NYTimes: ChatGPT, the AI Chatbot That Can Write Anything, Unsettles Universities
  • Some universities are responding to the challenge of ChatGPT by revamping their courses to focus more on critical thinking, creativity, and originality.
• Leeds for Learning: ChatGPT, please write a homework policy which takes artificial intelligence into consideration
  • A homework policy that takes AI into consideration can help enhance learning outcomes, provide personalised feedback, and streamline grading.

Conclusion

Generative AIs are a challenge for education. They offer the opportunity for even more efficient and effective learning by supporting tasks of both learners and teachers. Equally, they pose the risk of learners cheating on assessments while failing to meet important learning objectives. In this balancing act, Mentafy sees the solution in guiding and documenting the creation of ‘homework’ with sufficient objectivity in the future. Our writing mentor makes it easier for authors to adopt and keep transparent the use of AI, so that in the end, there is a good performance whose academic integrity can be substantiated.