Evolução de uma ferramenta de avaliação textual da usabilidade e experiência dos usuários em sistemas

Abstract

Texts from users showing their opinions have been often used to evaluate Usability and/or User eXperience (UX). This type of evaluation has shown good results due to the possibility to identify problems such as support which in other types of evaluation would be difficult to find. There is a textual evaluation methodology called MALTU that aims to evaluate the Usability and/or UX of a system using a set of Usage Related Posts (PRUs). A PRU is a spontaneous text or comment posted by users referring to the use of a system. MALTU has five steps of evaluation: (1) definition of the evaluation context; (2) extraction of PRUs; (3) classification of PRUs; (4) interpretation of results and (5) reporting of results. Aiming to support the MALTU methodology there is a tool called UUX-Posts that supports steps 2 and 3 extracting and classifying posts automatically. However, that tool does not have a classification accuracy that is as effective as one performed by evaluators being necessary a validation of this classification. This study aimed at the evolution of the UUX-Posts tool with the addition of new functionalities such as: the possibility of evaluators to classify posts in the tool itself; possibility to generate graphs of the results; and an evaluation report. For this, a survey and definition of new requirements for the tool was carried out; system analysis; development of new features; and an evaluation experience using the evolved tool. With the evaluation of the new tool was found that although the post classification functionality still needs improvements; the graphics generation and evaluation reports have become easier to perform.