Papers
Topics
Authors
Recent
Search
2000 character limit reached

"Like a Nesting Doll": Analyzing Recursion Analogies Generated by CS Students using Large Language Models

Published 14 Mar 2024 in cs.HC, cs.AI, and cs.CL | (2403.09409v1)

Abstract: Grasping complex computing concepts often poses a challenge for students who struggle to anchor these new ideas to familiar experiences and understandings. To help with this, a good analogy can bridge the gap between unfamiliar concepts and familiar ones, providing an engaging way to aid understanding. However, creating effective educational analogies is difficult even for experienced instructors. We investigate to what extent LLMs, specifically ChatGPT, can provide access to personally relevant analogies on demand. Focusing on recursion, a challenging threshold concept, we conducted an investigation analyzing the analogies generated by more than 350 first-year computing students. They were provided with a code snippet and tasked to generate their own recursion-based analogies using ChatGPT, optionally including personally relevant topics in their prompts. We observed a great deal of diversity in the analogies produced with student-prescribed topics, in contrast to the otherwise generic analogies, highlighting the value of student creativity when working with LLMs. Not only did students enjoy the activity and report an improved understanding of recursion, but they described more easily remembering analogies that were personally and culturally relevant.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (44)
  1. Briana Bettin and Linda Ott. 2021. Frozen in the Past: When it Comes to Analogy Fears, It’s Time For Us to” Let it Go”. In Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1. 359–365.
  2. Semaphore or Metaphor? Exploring Concurrent Students’ Conceptions of and with Analogy. In Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1. 200–206.
  3. More (Sema— Meta) phors: Additional Perspectives on Analogy Use from Concurrent Programming Students. In Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 1. 166–172.
  4. Threshold concepts in computer science: do they exist and are they useful? ACM Sigcse Bulletin 39, 1 (2007).
  5. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
  6. Virginia Braun and Victoria Clarke. 2021. One size fits all? What counts as quality practice in (reflexive) thematic analysis? Qualitative research in psychology 18, 3 (2021), 328–352.
  7. Examining the value of analogies in introductory computing. In Proceedings of the 2016 ACM Conference on International computing education research. 231–239.
  8. The role of models/and analogies in science education: implications from research. International Journal of Science Education 27, 2 (2005), 183–198.
  9. Fluid transformers and creative analogies: Exploring large language models’ capacity for augmenting cross-domain analogical creativity. In Proceedings of the 15th Conference on Creativity and Cognition. 489–505.
  10. The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conf. 10–19.
  11. Michal Forišek and Monika Steinová. 2012. Metaphors and analogies for teaching algorithms. In Proceedings of the 43rd ACM technical symposium on Computer Science Education. 15–20.
  12. Scratch Encore: The design and pilot of a culturally-relevant intermediate Scratch curriculum. In Proceedings of the 51st ACM technical symposium on computer science education. 794–800.
  13. Nasser Giacaman. 2012. Teaching by example: using analogies and live coding demonstrations to teach parallel computing concepts to undergraduate students. In 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum. IEEE, 1295–1298.
  14. John K Gilbert and Rosária Justi. 2016. Analogies in modelling-based teaching and learning. Modelling-based teaching in science education (2016), 149–169.
  15. Mental Models of Recursion. In Proceedings of the 34th SIGCSE Technical Symposium on Computer Science Education (SIGCSE ’03). Association for Computing Machinery, New York, NY, USA, 346–350.
  16. Colton Harper. 2022. Developing and Evaluating Scaffolding for Student-Generated Analogies in CS1. In Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 2. 656–657.
  17. Investigating Themes of Student-Generated Analogies. In Proceedings of the ACM Conference on Global Computing Education Vol 1 (CompEd 2023). Association for Computing Machinery, 64–70.
  18. Allan G Harrison and David F Treagust. 2006. Teaching and learning with analogies: Friend or foe? Metaphor and analogy in science education (2006).
  19. Ava Heinonen and Arto Hellas. 2020. Exploring the instructional efficiency of representation and engagement in online learning materials. In United Kingdom & Ireland Computing Education Research conference. 38–44.
  20. Exploring the Responses of Large Language Models to Beginner Programmers’ Help Requests. In Proceedings of the 2023 ACM Conference on International Computing Education Research V.1. ACM.
  21. Dave Heywood. 2002. The place of analogies in science education. Cambridge Journal of Education 32, 2 (2002), 233–247.
  22. The Effects of Generative AI on Computing Students’ Help-Seeking Preferences. In Proceedings of the 26th Australasian Computing Education Conference (ACE ’24). Association for Computing Machinery, New York, NY, USA, 39–48. https://doi-org.libproxy.temple.edu/10.1145/3636243.3636248
  23. Anthony Robins Janet Rountree and Nathan Rountree. 2013. Elaborating on threshold concepts. Computer Science Education 23, 3 (2013), 265–289.
  24. Andreas Larsson. 2023. Metaphors and Gestures in Programming Education. In Programming and Computational Thinking in Technology Education. Brill.
  25. Comparing Code Explanations Created by Students and Large Language Models. arXiv preprint arXiv:2304.03938 (2023).
  26. Using large language models to enhance programming error messages. In Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1. 563–569.
  27. Decoding Logic Errors: A Comparative Study on Bug Detection by Students and Large Language Models. arXiv preprint arXiv:2311.16017 (2023).
  28. Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book. In Proc. SIGCSE’23. ACM, 6 pages.
  29. Automatically Generating CS Learning Materials with Large Language Models. arXiv preprint arXiv:2212.05113 (2022).
  30. Generating Diverse Code Explanations Using the GPT-3 Large Language Model. In Proc. of the 2022 ACM Conf. on Int. Computing Education Research - Volume 2. ACM, 37–39.
  31. Culturally relevant computer science pedagogy: From theory to practice. In 2019 research on equity and sustained participation in engineering, computing, and technology (RESPECT). IEEE, 1–4.
  32. Computing with relevance and purpose: A review of culturally relevant education in computing. International Journal of Multicultural Education 21, 1 (2019), 125–155.
  33. Ability to ’explain in Plain English’ Linked to Proficiency in Computer-Based Programming. In Proc. of the Ninth Annual Int. Conf. on Int. Computing Education Research. ACM, 111–118.
  34. The robots are here: Navigating the generative ai revolution in computing education. In Proceedings of the 2023 Working Group Reports on Innovation and Technology in Computer Science Education. 108–159.
  35. Learning and teaching programming: A review and discussion. Computer science education 13, 2 (2003), 137–172.
  36. Yam San Chee. 1993. Applying Gentner’s theory of analogy to the teaching of computer programming. International journal of man-machine studies 38, 3 (1993), 347–368.
  37. Kate Sanders and Robert McCartney. 2016. Threshold concepts in computing: past, present, and future. In Proceedings of the 16th Koli Calling international conference on computing education research. 91–100.
  38. Automatic Generation of Programming Exercises and Code Explanations Using Large Language Models. In Proc. of the 2022 ACM Conf. on Int. Computing Education Research - Volume 1. ACM, 27–43.
  39. Norbert M Seel. 2017. Model-based learning: A synthesis of theory and research. Educational Technology Research and Development 65 (2017), 931–966.
  40. Using Large Language Models to Automatically Identify Programming Concepts in Code Snippets. In Proc. of the 2023 ACM Conf. on Int. Computing Education Research - Volume 2, Vol. 1. ACM, 563–569. https://doi.org/10.1145/3568812.3603482
  41. Writing in-code comments to self-explain in computational science and engineering education. ACM Transactions on Computing Education 17, 4 (2017).
  42. Benefits of self-explanation in introductory programming. In Proc. of the 46th ACM Technical Symposium on Computer Science Education. 284–289.
  43. An Australasian Study of Reading and Comprehension Skills in Novice Programmers, Using the Bloom and SOLO Taxonomies. In Proc. of the 8th Australasian Conf. on Computing Education - Volume 52. Australian Computer Society, Inc., AUS, 243–252.
  44. Generative AI in Computing Education: Perspectives of Students and Instructors. In 2023 IEEE Frontiers in Education Conference (FIE). 1–9. https://doi.org/10.1109/FIE58773.2023.10343467
Citations (4)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

Sign Up for Free