microphones multimodal hci in user interface design

by:Winbridge      2019-09-27
Multimodal human-computer interaction is the intersection of several disciplines including psychology, computer vision, user interface design and artificial intelligence.Computers have been integrated into everyday objects and tasks (commonly referred to as ubiquitous pervasive computing ). Therefore, it becomes important to promote the natural interaction between users and computers, which simulates the face-to-face interaction of human beings.
Multi-modal human-computer interaction is designed to identify how humans interact in order to transform these processes into human-computer interaction.Multimodal man-machine interaction includes multiple modes.Mode is a mode of communication based on the human feeling or the type of computer input device.
There are two types of typical patterns: 1.Human senses: visual, tactile, auditory, olfactory, taste, and cognitive/emotional abilities.Computer input devices: cameras, tactile sensors, microphones, sense of smell (all to simulate the human senses) these patterns can be used together to build various types of UI designs in order to improve usability.
In this article, I will give a brief overview of the features of each model and then discuss the benefits of multimodal user interface design.The above categories exist in order to understand how, particularly related to user interface design, humans and computers use the same functions and therefore can complement each other for a more positive user experience.The human sensory category helps designers understand how humans acquire and process information.
Vision is related to what the user sees on the interface-words, images, etc.Listening has something to do with the audio aspect of the user interface, whether it's music, commands, or conversations between two people.Although in traditional UI design, smells, especially tastes, are not important, they are still important for designers because they affect other senses, the synergy of all senses ultimately affects the user's cognitive and emotional state.
From a design point of view, it is essential to understand the cognitive and emotional state generated by the user using the user interface.This helps to detect and track user execution, motivation, and satisfaction with the task of the design.Computer input devices mimic human senses to help people connect with computer interfaces (instead, to help computers connect with people ).
The camera works like an eye, mimicking the vision, and the tactile sensor is a tactile feedback technique (think about the mouse) that imitates the touch.Microphones and speakers enable users to hear and make sounds.The smell device can stimulate the user's sense of smell;A process called Machine sense of smell (commonly referred to as "electronic nose") used by SMBO instruments uses a series of complex chemical sensors and pattern recognition algorithms that allow computers to simulate sense of smell.
Why is Multimodal Human-computer interaction important for user interface design?Multimodal is a very broadIn terms of scope and complexity of HCI, we only give a very short overview in this article.However, it is important, at least, to have a basic understanding of interface design, because its core is to try to understand how humans function as an integrated system of sensory and cognitive abilities, thus, the user interface designer is allowed to allow the computer to mimic and/or supplement these processes.Understanding the various senses and emotions of human beings allows designers to build user interfaces that take advantage of the senses and emotions that their target groups most depend on or are most affected.
The user interface can then facilitate the user's ability to perform tasks and achieve goals at a more efficient speed, and ultimately lead to more optimized available systems.Stating that best availability is one of the ultimate goals of multimodal man-machine interaction and interface design, it seems to be an escape and may be a bit redundant, however, in terms of user interface design, optimal availability is always the ultimate goal, but it is difficult to achieve if the designer does not have the key methods and paths to achieve this
Custom message