Gesture recognition as an application of NUI

Natural user interface (NUI) is regarded as an important topic in human computer interaction (HCI) which is a field of study that focuses on the way people interact with computers. Basically, the rise of NUI is based on the idea of improving people experiences with interfaces through natural body movement. Gesture recognition is one example. What are the roles of gesture recognition as an application of NUI ?

At its core, gesture recognition approach involved a system that functions to track motion or movement (usually hand gesture and body motion) and interpret them into commands and instruction. The most notable application of NUI involving gesture recognition interface is sport simulation video game. For instance, Nintendo Wii and Playstation Move Motion system which were introduced in 2006 and 2010 respectively. These two examples of gesture recognition interface as application of NUI involve the use of controller-based accelerometers and gyroscopes to detect players actions such as tilting, rotation and acceleration. In addition, in a more intuitive device, cameras are also equipped to the device to recognize specific actions.

One of the most useful application of gesture recognition is in healthcare. The outbreak of Covid-19 had highlighted the importance of technologies that allow healthcare procedures to be done in remote or without being near to patients. Healthcare workers can maintain safety and health by reducing contact with any surface through gesture recognition interface where the devices or displays can be controlled by moving hands as a virtual mouse.

Devices based on gesture recognition show some beneficial roles in certain industry, however, it is believed that the longevity of the developed devices remains a challenge to developer since NUI focuses on intuitive interaction between people and digital world. Therefore, continuous researches need to be carried out on the developed applications to fit the objective of NUI in order to ensure their reliability.

E-SPIN Group in the enterprise ICT solutions supply, consulting, project management, training and maintenance for multinational corporations and government agencies across the region E-SPIN do business. Feel free to contact E-SPIN for your enterprise digital transformation initiative, project requirement and inquiry.