ICON: An Immersive Conversation Sim Utilizing AI in a Web-Based or Virtual Reality Environment
This presentation will outline how the University of New South Wales (UNSW) in Sydney, Australia, has developed ICON, an immersive conversation simulator. ICON combines generative AI, 3D environments, avatars, and highly customized academic scenarios that allow students to practice discipline-specific conversation skills such as patient interactions, difficult parent-teacher interviews, and language learning. The application is available both in web browsers and VR and includes unique features like customizable attachments and avatar states. Attachments can take the form of images and text, and content authors can have them appear at different times in the scenario to provide students with additional context and information. Dynamic avatar states are driven by AI prompts that change during the conversation in response to what users say. These systems allow for fluid conversations in which students must adapt their approach as the scenario unfolds. ICON is designed to support and supplement class role-playing exercises that are common across many academic disciplines. It brings the added benefits of being repeatable, customizable, and accessible outside of class. The platform-like nature of ICON will allow for expanding the immersive and interactive possibilities for students.