Papers
Topics
Authors
Recent
Search
2000 character limit reached

On the Educational Impact of ChatGPT: Is Artificial Intelligence Ready to Obtain a University Degree?

Published 20 Mar 2023 in cs.CY | (2303.11146v1)

Abstract: In late 2022, OpenAI released a new version of ChatGPT, a sophisticated natural language processing system capable of holding natural conversations while preserving and responding to the context of the discussion. ChatGPT has exceeded expectations in its abilities, leading to extensive considerations of its potential applications and misuse. In this work, we evaluate the influence of ChatGPT on university education, with a primary focus on computer security-oriented specialization. We gather data regarding the effectiveness and usability of this tool for completing exams, programming assignments, and term papers. We evaluate multiple levels of tool misuse, ranging from utilizing it as a consultant to simply copying its outputs. While we demonstrate how easily ChatGPT can be used to cheat, we also discuss the potentially significant benefits to the educational system. For instance, it might be used as an aid (assistant) to discuss problems encountered while solving an assignment or to speed up the learning process. Ultimately, we discuss how computer science higher education should adapt to tools like ChatGPT.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (21)
  1. Michael Bommarito and Daniel Martin Katz. 2022. GPT Takes the Bar Exam. https://doi.org/10.48550/ARXIV.2212.14402
  2. David Clinton. 2022. Pair programming with the CHATGPT AI – does GPT-3.5 understand bash? https://www.freecodecamp.org/news/pair-programming-with-the-chatgpt-ai-how-well-does-gpt-3-5-understand-bash/
  3. Chatting and Cheating. Ensuring academic integrity in the era of ChatGPT. https://doi.org/10.35542/osf.io/mrz8h
  4. Defcon Capture the Flag: defending vulnerable code from intense attack. In Proceedings DARPA Information Survivability Conference and Exposition, Vol. 1. IEEE, NY, USA, 120–129. https://doi.org/10.1109/DISCEX.2003.1194878
  5. Nassim Dehouche. 2021. Plagiarism in the age of massive Generative Pre-trained Transformers (GPT-3). Ethics in Science and Environmental Politics 21 (Jan. 2021), 17–23. https://doi.org/10.3354/esep00195
  6. FaceApp. 2022. Face editor. https://www.faceapp.com/
  7. Can GPT-3 write an academic paper on itself, with minimal human input? https://hal.archives-ouvertes.fr/hal-03701250
  8. GitHub. 2022. GitHub Copilot · Your AI pair programmer. https://github.com/features/copilot
  9. Jaroslaw Kutylowski. 2018. DeepL Translator. https://www.deepl.com/translator
  10. Steve Mollman. 2022. CHATGPT gained 1 million users in under a week. here’s why the AI chatbot is primed to disrupt search as we know it. https://www.yahoo.com/video/chatgpt-gained-1-million-followers-224523258.html
  11. Assessing the Quality of Student-Generated Short Answer Questions Using GPT-3. In Educating for a New Future: Making Sense of Technology-Enhanced Learning Adoption. Springer International Publishing, Cham, 243–257.
  12. OpenAI. 2022a. CHATGPT: Optimizing language models for dialogue. https://openai.com/blog/chatgpt/
  13. OpenAI. 2022b. Dall·E 2. https://openai.com/dall-e-2/
  14. Katie Rees. 2023. Chatgpt used by Cybercriminals to write malware. https://www.makeuseof.com/chatgpt-used-by-cybercriminals-to-write-malware/
  15. Kalhan Rosenblatt. 2023. ChatGPT banned from New York City public schools’ devices and networks. https://www.nbcnews.com/tech/tech-news/new-york-city-public-schools-ban-chatgpt-devices-networks-rcna64446
  16. Teo Susnjak. 2022. ChatGPT: The End of Online Exam Integrity? https://doi.org/10.48550/ARXIV.2212.09292
  17. Pete Syme. 2023. A Princeton student built an app which can detect if ChatGPT wrote an essay to combat AI-based plagiarism. https://www.businessinsider.com/app-detects-if-chatgpt-wrote-essay-ai-plagiarism-2023-1
  18. Anaïs Tack and Chris Piech. 2022. The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialogues. https://doi.org/10.48550/ARXIV.2205.07540
  19. Educational Research and AI-Generated Writing: Confronting the Coming Tsunami. https://doi.org/10.35542/osf.io/4mec3
  20. NL Times. 2023. Dutch Students using ChatGPT to finish homework; Teachers aren’t noticing. https://nltimes.nl/2023/01/16/dutch-students-using-chatgpt-finish-homework-teachers-arent-noticing
  21. Mingyu Zong and Bhaskar Krishnamachari. 2022. Solving Math Word Problems Concerning Systems of Equations with GPT-3. Proceedings of the Thirteenth AAAI Symposium on Educational Advances in Artificial Intelligence. https://anrg.usc.edu/www/wp-content/uploads/2022/12/Solving_Math_Word_Problems_with_GPT3-2022.pdf
Citations (146)

Summary

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.