Demo of TurnItIn - New AI Detection Tool

Sarah Moore, Ph.D.
4 Apr 202303:12

TLDRIn the video, Dr. Moore from the University of Texas at Dallas demonstrates Turnitin's new AI detection tool by comparing AI-generated content to student writing. After submitting an AI-written memo on AI writers, Turnitin flags it with a 100% AI score, indicating potential academic misconduct. Dr. Moore emphasizes the tool's effectiveness in catching unauthorized AI use, which is considered cheating at their university, and encourages educators to adapt their assignments and rubrics to this new challenge.

Takeaways

  • 👨‍🏫 Dr. Moore, a faculty member at the University of Texas at Dallas, discusses Turnitin's new AI detection tool.
  • 📝 He tests the tool by using it on a memo assignment comparing AI writers, which he initially generated with Chat GPT.
  • 📈 The Turnitin similarity score for the memo was 45%, indicating a match with previously uploaded content.
  • 🔍 Turnitin did not flag the AI-generated content as problematic, but rather highlighted the sources included in the memo.
  • 🚨 A new feature in Turnitin flags AI-generated content with an 'AI 100' notice, prompting a review for potential academic misconduct.
  • 🤖 The video demonstrates that Turnitin's AI detection tool is effective in identifying AI-written essays, such as the one from Chat GPT.
  • 📚 Faculty members are advised to consider changing their rubrics and assignments to adapt to the new capabilities of Turnitin's AI detection tool.
  • 💡 The tool is expected to catch previously undetected instances of academic misconduct, particularly with the use of AI writing tools.
  • 🎓 At the University of Texas at Dallas, using Chat GPT to complete assignments is considered unauthorized and could be treated as cheating.
  • 📝 Dr. Moore critiques the AI-generated memo for lacking depth, a conclusion, and overall quality compared to what his students are capable of writing.
  • 🌟 The video concludes with Dr. Moore encouraging students to focus on improving their own writing skills.

Q & A

  • What is the main topic of the video?

    -The main topic of the video is the demonstration and discussion of Turnitin's new AI detection tool and its effectiveness in identifying AI-generated content in academic assignments.

  • Who is the speaker in the video?

    -The speaker in the video is Dr. Moore, a faculty member at the University of Texas at Dallas.

  • How did Dr. Moore simulate a student's experience with AI writing tools?

    -Dr. Moore simulated a student's experience by using ChatGPT to generate a memo comparing three AI writers based on a standard essay assignment prompt he gives to his students.

  • What was the similarity score given by Turnitin for the AI-generated memo?

    -The similarity score given by Turnitin for the AI-generated memo was 45%.

  • What does the 45% similarity score indicate?

    -The 45% similarity score indicates the percentage of the document that matches content already uploaded to Turnitin, and it is not the score for AI-generated content.

  • What message did Turnitin display regarding AI-generated content?

    -Turnitin displayed a message saying 'AI 100' with a caution that the percentage may not indicate academic misconduct and that a review is required.

  • How did Turnitin's AI detection tool perform in the demonstration?

    -Turnitin's AI detection tool correctly flagged the AI-generated essay with an 'AI 100' mark, indicating that it identified the content as entirely AI-written.

  • What implications does the AI detection tool have for faculty?

    -The AI detection tool provides faculty with new strategies to detect and address AI-generated content in assignments, potentially requiring changes to grading rubrics and assignment structures.

  • What is the policy on using AI writing tools at the University of Texas at Dallas?

    -At the University of Texas at Dallas, using AI writing tools like ChatGPT to complete assignments is considered unauthorized and can be treated as an incidence of cheating if reported.

  • What was Dr. Moore's critique of the AI-generated memo?

    -Dr. Moore critiqued the AI-generated memo as being subpar, lacking a conclusion, and not as interesting or well-written as what he expects from his students.

  • What was the overall conclusion of the video?

    -The overall conclusion of the video is that Turnitin's AI detection tool appears to be effective in identifying AI-generated content, and faculty should be aware of its capabilities to maintain academic integrity.

Outlines

00:00

👨‍🏫 Introduction to AI Detection Tool

Dr. Moore introduces himself as a faculty member at the University of Texas at Dallas and explains the purpose of the video: to demonstrate the capabilities of Turnitin's new AI detection tool. He describes his approach by imagining himself as a student in need and uses a standard essay assignment prompt to test the tool. Dr. Moore details the process of logging into Chat GPT, providing a prompt to compare AI writers, and the subsequent generation of a memo including sources. He then discusses uploading the memo to Turnitin and the resulting similarity score, highlighting that the score represents matches to previously uploaded content and not necessarily academic misconduct.

Mindmap

null
null
Context
null
null
null
null
Procedure
null
null
null
null
Findings
null
null
null
Implications for Faculty
null
null
null
Educational Considerations
Dr. Moore's Experiment
null
null
Functionality
null
null
Advantages
null
null
Challenges
Turnitin's AI Detection Tool
null
Definition
null
Consequences
null
null
Preventive Measures
Academic Misconduct and Cheating
null
null
Positive Aspects
null
null
Ethical Concerns
null
null
Future Directions
The Role of AI in Education
Academic Integrity and AI Detection Tools
Alert

Keywords

💡Turnitin

Turnitin is a widely used plagiarism detection software that helps educators identify instances of academic dishonesty by comparing submitted documents to a large database of existing content. In the video, Dr. Moore demonstrates how Turnitin's new AI detection tool can identify essays written by AI writers, such as Chat GPT, by analyzing the similarity score and flagging potential AI-generated content with a cautionary message.

💡AI Detection Tool

The AI Detection Tool is an advanced feature within Turnitin designed to identify and flag content that may have been generated by artificial intelligence. This tool is particularly relevant in the context of the video, as it helps educators discern whether a student's work is original or has been produced with the assistance of AI writing platforms like Chat GPT. The tool provides a percentage score indicating the likelihood of AI authorship, which prompts a manual review to confirm academic integrity.

💡Chat GPT

Chat GPT is an AI-based language model developed by OpenAI, capable of generating human-like text based on given prompts. In the video, Dr. Moore uses Chat GPT to create a sample memo comparing AI writers, which he then submits to Turnitin's AI Detection Tool to test the effectiveness of the tool in identifying AI-generated content. The use of Chat GPT in this scenario highlights the challenges educators face in maintaining academic integrity in the age of advanced AI technologies.

💡Memo

A memo, short for memorandum, is a written communication typically used in a business or academic setting to convey information or make a proposal. In the context of the video, Dr. Moore assigns a memo writing task to simulate a student's assignment and tests the AI Detection Tool's ability to identify AI-generated memos. The memo serves as a practical example of how AI technologies can assist in, or potentially undermine, the educational process.

💡Plagiarism

Plagiarism is the act of using someone else's words, ideas, or work without proper attribution, thereby presenting it as one's own. In the video, the concern about AI-generated content relates to the potential for plagiarism, as students might submit essays or assignments created by AI writers without disclosing the source, which is considered academic misconduct. Turnitin's AI Detection Tool aims to mitigate this issue by identifying such instances.

💡Academic Integrity

Academic integrity refers to the ethical principles and standards that govern the scholarly community, emphasizing honesty, trust, fairness, respect, and responsibility in academic pursuits. The video addresses the importance of maintaining academic integrity by highlighting the role of Turnitin's AI Detection Tool in preventing AI-assisted plagiarism and ensuring that students produce original work, which is a fundamental aspect of the educational process.

💡Rubrics

Rubrics are assessment tools that provide a set of criteria for evaluating the quality of student work. In the video, Dr. Moore suggests that the advent of AI Detection Tools might necessitate a reevaluation of rubrics to account for the changing landscape of academic writing and to ensure that assignments remain challenging and promote original thought, even in the face of AI-generated content.

💡Assignments

Assignments are tasks or projects given by educators to students to assess their understanding of a subject or to develop their skills. In the video, the discussion around AI-generated content and Turnitin's AI Detection Tool prompts a consideration of how assignments might be adapted to maintain academic integrity and encourage original work from students, despite the availability of AI writing tools.

💡Faculty

Faculty refers to the teaching staff or academic professionals at an educational institution. In the video, Dr. Moore, as a faculty member, explores the implications of AI-generated content for faculty, including the need to adapt their strategies for detecting plagiarism and ensuring that their assessments align with the goal of promoting genuine student learning and originality.

💡Cautionary Message

A cautionary message is a warning or alert that prompts further action or consideration. In the context of the video, Turnitin's AI Detection Tool provides a cautionary message when it identifies content as potentially being 100% AI-generated, indicating that the faculty should review the submission to determine if academic misconduct has occurred. This message is a crucial feature that helps educators take appropriate action to maintain academic standards.

💡Cheating

Cheating refers to the act of dishonestly obtaining an advantage, especially in an examination or assessment. In the video, Dr. Moore discusses how the use of AI writers like Chat GPT to complete assignments can be considered cheating, as it undermines the principles of academic integrity and the value of original work. The AI Detection Tool serves as a deterrent and a means of detection to uphold these principles.

Highlights

Dr. Moore, a faculty member at the University of Texas at Dallas, explores Turnitin's new AI detection tool.

The demonstration involves using a standard essay assignment prompt typically given to students.

Instead of writing an essay, the assignment tasks students with writing a memo comparing AI writers.

Dr. Moore utilizes Chat GPT to generate a memo, including sources, for comparison of three AI writers.

The generated memo is uploaded to Turnitin, resulting in a similarity score of 45.

The 45% similarity score reflects matches with previously uploaded content, not flagged as problematic.

Turnitin's new feature flags the memo as 100% AI-written, with a caution message for review.

The sources included in the memo were not flagged by Turnitin's AI detection tool.

The new AI detection tool may change the way faculty approach rubrics and assignments.

Unauthorized use of Chat GPT for assignments is considered cheating at the University of Texas at Dallas.

Dr. Moore emphasizes the importance of original student writing over AI-generated content.

The AI-generated memo lacks quality, interest, and a proper conclusion compared to student writing.

Turnitin's AI detection tool is anticipated to catch instances of cheating that previous versions could not.

The video aims to inform faculty about the capabilities of Turnitin's new AI detection and its implications for academic integrity.

Dr. Moore concludes the video, hoping it was helpful and wishes luck to viewers.