Avaliação de usabilidade de um chatbot educacional na plataforma do Discord

Abstract

This work explores programming education and the emergence of educational chatbots as tools for more dynamic learning. The COVID-19 pandemic accelerated reliance on the digital environment, highlighting the need to integrate pedagogical tools into communication platforms already used by students. The general objective is to perform an exploratory usability evaluation of the ’Hora de Codar’ chatbot in a controlled environment to identify interface barriers and opportunities for improvement in the technical interaction flow. The methodology adopted a mixed approach, including the definition of practical use scenarios (registration, progress verification, activity query and submission, and ranking), user profile collection, and usability evaluation via the System Usability Scale (SUS). The analysis combined quantitative results from the SUS with an investigation of interaction logs, focusing on identifying barriers in command-line interaction. The conclusions point to a high acceptance of the tool but highlight specific interface challenges, guiding improvement proposals such as confirmation mechanisms and the use of native platform commands