SARA: Smart AI Reading Assistant for Reading Comprehension
Abstract: SARA integrates Eye Tracking and state-of-the-art LLMs in a mixed reality framework to enhance the reading experience by providing personalized assistance in real-time. By tracking eye movements, SARA identifies the text segments that attract the user's attention the most and potentially indicate uncertain areas and comprehension issues. The process involves these key steps: text detection and extraction, gaze tracking and alignment, and assessment of detected reading difficulty. The results are customized solutions presented directly within the user's field of view as virtual overlays on identified difficult text areas. This support enables users to overcome challenges like unfamiliar vocabulary and complex sentences by offering additional context, rephrased solutions, and multilingual help. SARA's innovative approach demonstrates it has the potential to transform the reading experience and improve reading proficiency.
- 2024. Microsoft HoloLens. https://www.microsoft.com/de-de/hololens. Accessed: March 18, 2024.
- Visual Attentional Training Improves Reading Capabilities in Children with Dyslexia: An Eye Tracker Study During a Reading Task. Brain Sciences 10, 8 (2020), 558. https://doi.org/10.3390/brainsci10080558
- Pablo Delgado and Ladislao Salmerón. 2022. Cognitive Effort in Text Processing and Reading Comprehension in Print and on Tablet: An Eye-Tracking Study. Discourse Processes 59, 4 (2022), 237–274. https://doi.org/10.1080/0163853X.2022.2030157 arXiv:https://doi.org/10.1080/0163853X.2022.2030157
- Eye-tracking for human-centered mixed reality: promises and challenges. In Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR), Bernard C. Kress and Christophe Peroz (Eds.), Vol. 11310. International Society for Optics and Photonics, SPIE, 113100T. https://doi.org/10.1117/12.2542699
- ChatGPT for good? On opportunities and challenges of large language models for education. Learning and individual differences 103 (2023), 102274.
- A Situation Awareness Perspective on Intelligent Writing Assistants: Augmenting Human-AI Interaction with Eye Tracking Technology. (2023).
- Integrating Eye-Tracking to Augmented Reality System for Surgical Training. Journal of medical systems 44 (09 2020), 192. https://doi.org/10.1007/s10916-020-01656-w
- Using Eye-Tracking Measures to Predict Reading Comprehension. Reading Research Quarterly 58, 3 (2023), 425–449. https://doi.org/10.1002/rrq.498 arXiv:https://ila.onlinelibrary.wiley.com/doi/pdf/10.1002/rrq.498
- Screening for Dyslexia Using Eye Tracking during Reading. PLOS ONE 11, 12 (12 2016), 1–16. https://doi.org/10.1371/journal.pone.0165508
- D. Sonntag and O. Bodensiek. 2021. EYE-TRACKING-BASED DESIGN OF MIXED REALITY LEARNING ENVIRONMENTS IN STEM. In INTED2021 Proceedings (Online Conference) (15th International Technology, Education and Development Conference). IATED, 9519–9524. https://doi.org/10.21125/inted.2021.1990
- Micheal M Van Wyk. 2024. Is ChatGPT an Opportunity or a Threat? Preventive Strategies Employed by Academics Related to a GenAI-based LLM at a Faculty of Education. Vol. 7 No. 1 (2024). https://doi.org/10.37074/jalt.2024.7.1.15
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.