Implementação de realidade aumentada e acessibilidade para auxiliar alunos surdos e ouvintes no aprendizado de química orgânica no jogo "Accessible Interactions 500"

Abstract

Accessible Interactions 500 is a new version of the hybrid game Interactions 500. In a master's study, Fernandes used Interactions 500 as study material and realized that, although the game has a translation for 4 languages, it still does not have a translation for Brazilian Sign Language (LIBRAS). Fernandes also proved that deaf students had disadvantages in games without an interpreter compared to games with an interpreter. In addition, several studies show the benefits of using Augmented Reality in deaf students' education, since sign language is a visuospatial language. To address this need, we idealized the game Accessible Interactions 500 using Augmented Reality. This work presents the technical part of the game's development, describing how the game engine Unity and Vuforia Engine were used to manage the Augmented Reality experience, the use of Firebase as a cloud storage mechanism for the LIBRAS interpretation videos, as well as other tools used in the development. We also performed usability tests with a class of deaf students and hearing high school students. According to the results, the user experience was considered positive, with no significant problems. Despite the satisfactory result, we noticed some problems and bugs during the gameplay that can be fixed in next versions.