Robot man-machine interaction method taking semantic recognition as main mode and other modes as auxiliary modes

Abstract

The invention provides a robot man-machine interaction method taking the semantic recognition as a main mode and other modes as auxiliary modes. The method is characterized in that the method is implemented through five modules, namely a semantic recognition module, a sensitive skin module, a touch screen module, a somatosensory interaction module and an eye movement tracking module, and the robotman-machine interaction method takes semantic recognition as a main mode and takes other modes as auxiliary modes. Various interaction modes such as semantic recognition, sensitive skin, somatosensory interaction, eye movement tracking and touch screen are fused, advantages and disadvantages are improved, and the problem of robot man-machine interaction is thoroughly solved.

Description

Technical field [0001] The invention relates to a human-computer interaction system and an interaction method based on semantic recognition and supplemented by other methods. Background technique [0002] Traditional robot man-machine communication method: [0003] Traditional man-machine communication methods for robots include keyboard, mouse / touch pad, etc. New man-machine communication methods such as touch screen, semantic recognition, somatosensory, etc. have gradually appeared after 2007 and have quickly been widely used; robots can be used through analysis The user’s voice, gestures, body language and other methods understand human intentions and give corresponding feedback. [0004] Human-computer interaction is a very important branch of artificial intelligence. In the process of enriching and developing human-computer interaction technology, we have gradually realized that any single human-computer communication mode has shortcomings. Therefore, comprehensive multiple com...

AI Technical Summary

Problems solved by technology

[0005] 1. With the advancement of science and technology and the rapid development of artificial intelligence, the keyboard, mouse, touch screen and other methods in the traditional human-computer interaction methods are increasingly unsuitable for the rapidly developing human-computer interaction needs due to their cumbersome operations and slow speed;

[0006] 2. The new technologies emerging after 2007, such as semantic recognition, gestures and other interactive methods, are still susceptible to on-site environmental influences, such as noise, lighting and background, resulting in ambiguity, resulting in low efficiency and affecting user satisfaction; Somatosensory interaction may not be able to accurately capture finer movements due to unreasonable camera angles and program processing effects;

[0007] 3. On the other hand, these sub-traditional technologies will also have an impact on the environment during human-computer communication, and the privacy is poor; for example, the impact of the sound on others when communicating loudly, and the limitations of the use of somatosensory communication in public places sex

[0008] 4. Another disadvantage is that it cannot be used without barriers. People with physical disabilities may not be able to communicate with robots through voice, gestures, and body sensations.

Images