Tipo de publicación: Conference Paper

Publicado en: Product-Focused Software Process Improvement

Descripción:

This paper proposes the creation of a smart meeting room through the incorporation of a PIR sensor and an AWS IoT button that allows the booking system to reflect a more precise availability of meeting rooms according to the actual occupancy status. The Internet of Things (IoT) devices are controlled using a Wi-Fi module that allows them to connect to the REST web service and to integrate with the open source Meeting Room Booking System (MRBS). In order to evaluate the system a storyboard evaluation was conducted with 47 participants. All participants filled out the User Experience Questionnaires (UEQ), described the product using three words and expressed their opinion through open comments. Finally, 19 participants took part in a real-life simulation of the smart meeting room and evaluated the system using the UEQ questionnaire. Based on the positive acceptance reflected in the evaluations, results show that the proposed system is considered very attractive and useful by the participants.

Tipo de publicación: Conference Paper

Publicado en: 2019 IV Jornadas Costarricenses de Investigación en Computación e Informática (JoCICI)

Descripción:

Standardized questionnaires are well-known, reliable, and inexpensive instruments to evaluate user experience (UX). Although the structure, content, and application procedure of the three most recognized questionnaires (AttrakDiff, UEQ, and meCUE) are known, there is no systematic literature review (SLR) that classifies how these questionnaires have been used in primary studies reported academically. This SLR seeks to answer five research questions (RQs), starting with identifying the uses of each questionnaire over the years and by geographic region (RQ1) and the median number of participants per study (how many participants is considered enough when evaluating UX?) (RQ2). This work also aims to establish whether these questionnaires are combined with other evaluation instruments and with which complementary instruments are they used more frequently (RQ3). In addition, this review intends to determine how the three questionnaires have been applied in the fields of ubiquitous computing and ambient intelligence (RQ4) and also in studies that incorporate nontraditional interfaces, such as haptic, gesture, or speech interfaces, to name a few (RQ5). Methods. A systematic literature review was conducted starting from 946 studies retrieved from four digital databases. The main inclusion criteria being the study describes a primary study reported academically, where the standardized questionnaire is used as a UX evaluation instrument in its original and complete form. In the first phase, 189 studies were discarded by screening the title, abstract, and keyword list. In the second phase, 757 studies were full-text reviewed, and 209 were discarded due to the inclusion/exclusion criteria. The 548 resulting studies were analyzed in detail. Results. AttrakDiff is the questionnaire that counts the most uses since 2006, when the first studies appeared. However, since 2017, UEQ has far surpassed AttrakDiff in uses per year. The contribution of meCUE is still minimal. Europe is the region with the most extended use, followed by Asia. Within Europe, Germany greatly exceeds the rest of countries (RQ1). The median number of participants per study is 20, considering the aggregated data from the three questionnaires. However, this median rises to 30 participants in journal studies while it stays in 20 in conference studies (RQ2). Almost 4 in 10 studies apply the questionnaire as the only evaluation instrument. The remaining studies used between one and five complementary instruments, among which the System Usability Scale (SUS) stands out (RQ3). About 1 in 4 studies analyzed belong to ubiquitous computing and ambient intelligence fields, in which UEQ increases the percentage of uses when compared to its general percentage, particularly in topics such as IoT and wearable interfaces. However, AttrakDiff remains the predominant questionnaire for studies in smart cities and homes and in-vehicle information systems (RQ4). Around 1 in 3 studies include nontraditional interfaces, being virtual reality and gesture interfaces the most numerous. Percentages of UEQ and meCUE uses in these studies are higher than their respective global percentages, particularly in studies using virtual reality and eye tracking interfaces. AttrakDiff maintains its overall percentage in studies with tangible and gesture interfaces and exceeds it in studies with nontraditional visual interfaces, such as displays in windshields or motorcycle helmets (RQ5).

Tipo de publicación: Journal Article

Publicado en: Advances in Human-Computer Interaction

Descripción:

In recent years there has been an increase of voice interfaces, driven by developments in Artificial Intelligence and the expansion of commercial devices that use them, such as smart assistants present on phones or smart speakers. One field that could take advantage of the potential of voice interaction is in the self-administered surveys data collection, such as standardized UX evaluation questionnaires. This work proposes a set of conversational design patterns for standardized UX evaluation questionnaires that use semantic difference scales as a means of collecting quantitative information on user experience, as is the case of AttrakDiff and UEQ (User Experience Questionnaire). The presented design patterns seek to establish a natural conversation created in accordance with the user, the conservation of context between subsequent questions, the minimization of statements and with statement repair mechanisms not completely understood by the user or voice agent, as eliciting explanation of a concept or repetition.

Tipo de publicación: Book Chapter

Publicado en: Lecture Notes in Networks and Systems

Descripción:

Voice interfaces have gained popularity, driven by the proliferation of intelligent assistants and the development of natural language processing. Given their progress, they could be used to implement self-reported instruments such as standardized user experience (UX) evaluation questionnaires, particularly in the response capture mechanism. This novel use of voice interfaces would make sense if the evaluations using the voice mechanism did not differ significantly from the evaluations carried out with the traditional written questionnaire. In addition, given different possible implementations of the voice mechanism, it must be analyzed whether the user experience is affected by the format of the instrument used. This paper compares two implementations of the User Experience Questionnaire in which the capture mechanism is implemented by voice. Results show that in both implementations the evaluations retain their validity, and that the use of conversational patterns improves the user experience and increases the quality of the answers, which present fewer inconsistencies.

Tipo de publicación: Conference Paper

Publicado en: Proceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023)

Descripción:

User experience (UX) evaluation is essential for organizations since it allows them to generate competitive advantage and ensure that the software created is in accordance with the target users. There are several UX evaluation techniques and tools for information systems, among which the most widely used are standardized written questionnaires. However, in recent years, more interactive techniques have begun to take center stage, such as gamified methodologies that seek to include gaming techniques to attract greater interest from evaluators. This research aims to analyze the use of gamified mechanisms in combination with standardized UX evaluation questionnaires, taking advantage of the already demonstrated statistical capabilities of the questionnaires and at the same time providing the novelty of gamification techniques so that the collection of evaluation responses is attractive to participants.

Tipo de publicación: Conference Paper

Publicado en: 2024 IEEE VII Congreso Internacional en Inteligencia Ambiental, Ingeniería de Software y Salud Electrónica y Móvil (AmITIC)

Descripción:

This article aims to fill the gap in accessibility assessment practices through a comprehensive review of over 100 research articles, identifying the most commonly used accessibility assessment methods. The review includes both studies assessing the accessibility of systems and those promoting accessibility or assistive technologies. By reviewing existing research, we seek to provide a clear overview of the predominant methodologies in the field, highlighting current practices and pointing out areas for methodological improvement and innovation. The significance of this study lies in its potential to inform future research and practice, providing a basis for developing more effective and comprehensive assessment frameworks that improve accessibility for users with disabilities.

Tipo de publicación: Conference Paper

Publicado en: 2024 IEEE VII Congreso Internacional en Inteligencia Ambiental, Ingeniería de Software y Salud Electrónica y Móvil (AmITIC)

Descripción:

This paper consolidates the efforts of our research group in designing and developing voice applications for smart speakers and intelligent personal assistants (such as Amazon Alexa, Google Assistant, Siri, and Cortana) over recent years. We present six case studies: a career guidance system, an application for educational fairs, an appointment booking system for a dentist's office, a set of games for seniors, a notification system for smart farming, and the use of smart speakers as mechanisms to evaluate user experience. These case studies encompass various contexts, each requiring unique approaches. Each voice application was individually evaluated using standardized questionnaires and customized surveys. Additionally, we conducted two parallel evaluations to address key questions about human interaction with intelligent personal assistants. These evaluations involved both expert groups and end-users of the voice applications. Finally, we synthesize the knowledge, experiences, and perspectives gathered over these years to present a list of lessons learned, aimed at guiding researchers and developers in enhancing the user experience (UX) of voice applications.

Tipo de publicación: Conference Paper

Publicado en: 2024 IEEE VII Congreso Internacional en Inteligencia Ambiental, Ingeniería de Software y Salud Electrónica y Móvil (AmITIC)