Developing (in-House) Virtual Reality and 3D Gaming Apps for STEM Education

The Rhode Island IDeA Network of Biomedical Research Excellence (RI-INBRE) Molecular Informatics Core (MIC) and the University of Rhode Island Information Technology Services Innovative Learning Technologies (ILT) developed virtual and "first-person" 3D gaming applications to teach concepts in biomedical science, including pharmacology, cell culture, nanotechnology, and high-performance liquid chromatography. The apps were developed as full virtual reality (VR) and 3D gaming versions. The VR versions require headsets and controllers. The 3D gaming versions use keyboard, mouse, and a monitor. They do not require VR headsets. Development challenges included creating intuitive user interfaces, text-to-voice functionality, visualization of molecules, and implementing complex science concepts. In-app quizzes are used to assess the user’s understanding of topics, and user feedback was collected for several apps to improve the experience. The apps were positively reviewed by users and are being implemented into the curriculum at URI. The apps will be hosted on the University of Rhode Island’s Amazon Web Server (AWS). Enrolled students will access the apps through the URI Course Management System (CMS) Brightspace. Method SummaryVirtual and 3D gaming apps were developed in Unity to teach topics in biomedical science. In-app 3D models were created to provide a scientifically accurate user experience. Apps were tested on HTC Vive style VR headsets.