- The paper explores an AI-based speaking assistant (AISA) using AI-mediated communication to generate speaking references for non-native speakers (NNSs) in real-time multilingual communication, employing a mixed-methods study.
- Findings show AISA facilitated better logical flow and depth in NNS speech qualitatively, but did not improve speaking competence quantitatively and increased workload and anxiety due to multitasking demands.
- Implications highlight the need for precision design to reduce user burden, personalize tools, explore voice input and suggestion streaming, and address potential AI hallucination issues in future development.
AI-Based Speaking Assistant: Facilitating Real-Time Multilingual Communication for Non-Native Speakers
The paper presents an exploration into the implementation of an AI-based speaking assistant (AISA) aimed at enhancing the real-time multilingual communication experience for non-native speakers (NNSs). This assistant utilizes advanced AI-mediated communication (AIMC) methodologies to generate speaking references by integrating inputs from NNSs with contextual information derived from task background and conversation history.
Study Methodology
A mixed-methods study was employed, including a within-subject experiment that engaged teams comprised of two native speakers (NSs) and one NNS. Participants completed collaborative tasks under two conditions: one allowing access to the AISA and one without. The study methodology incorporated rigorous quantitative assessments alongside qualitative interviews, yielding insights into the interaction patterns between NNSs and the tool, and evaluating impacts on speaking performance, anxiety, and workload.
Findings
The paper identifies four distinct input patterns that emerged from NNS interactions with AISA: seeking word translation, rationalizing decisions, stating viewpoints, and using keywords. Notably, the rationalizing decisions pattern posed significant burdens, evidenced by longer input durations and frequent modifications. Although no improvements in speaking competence were revealed through quantitative measures, qualitative data highlighted that AISA facilitated better logical flow and depth in NNSs' speech.
AISA was found to inadvertently increase multitasking demands, thereby heightening NNSs' workload and anxiety. The tool's requirement for simultaneous listening, comprehension, and speaking introduced complexities at odds with the intended support function. Nonetheless, AISA delivered valuable utility in organizing thoughts and enhancing communication coherence, showcasing strengths in aiding speaking logic not captured by traditional metrics.
Implications and Future Directions
The implications of this research extend to both practical applications and theoretical understanding of AIMC. Practically, while showcasing the breadth of AI assistance capabilities, the study underscores the necessity for precision-focused design improvements to reduce user burden and integrate support within the natural conversational dynamics. Theoretically, it invites further inquiries into personalizing AIMC tools to users' linguistic profiles and communication preferences, ensuring tools do not overshadow user autonomy or impede creativity.
To address workload and anxiety, future tools might incorporate voice input capabilities allowing NNSs to express complex ideas in their native languages seamlessly, thereby reducing cognitive load. Additionally, adopting a system of real-time suggestion streaming might alleviate content generation delays, enabling more fluid conversational participation.
Long-term application efforts should consider potential hallucination issues inherent in LLMs, offering transparency in AI outputs through mechanisms like uncertainty visualization or confidence indicators. Such adaptations could sustain user trust and enhance informed decision-making during interactions.
Overall, the study enriches the discourse on AI-mediated real-time communication, offering a foundational exploration into leveraging AIMC tools to enhance multilingual collaboration efficacy without imposing further communicative burdens. Future efforts, informed by this study, can pioneer advancements in AI tools harmoniously integrated into dynamic communication environments, enabling more inclusive participation across diverse linguistic landscapes.