Man-machine interaction method for remote sensing image processing and display on basis of gestures and speech recognition

Abstract

Provided is a man-machine interaction method for remote sensing image processing and display on the basis of gesture recognition and speech recognition. The method comprises the following steps: acquisition of interaction information, user identity authentication, interaction information recognition, interaction process generation and processing, and remote sensing image processing and display. Through Kinect arrays, user faces and vocal print identity information are obtained on the basis of a deep learning method. By means of gesture recognition and speech recognition on a digital earth, aninteraction command is created. According to a remote sensing knowledge graph and the interaction context, interaction process is generated. Additionally, remote sensing image processing service is called for processing so that intelligent man-machine interaction for remote sensing image processing and display is achieved. Multi-modal user identity information is utilized in order to prevent interference of speech and limbs of irrelevant personnel during an interaction process. Intelligentized interaction control of gestures and speech is adopted so that interaction efficiency and display effect of a system are effectively improved. Therefore, user-friendly operation for processing and display of a remote sensing image software system is conveniently performed.

Description

technical field [0001] The invention relates to a human-computer interaction technology for processing and displaying remote sensing images, in particular to a human-computer interaction method for processing and displaying remote sensing images based on speech and gesture recognition. Background technique [0002] With the development of high-resolution earth observation systems, the demand for remote sensing image processing and display applications is increasing rapidly. Existing remote sensing image processing and display methods generally use a character command interface or a graphical user interface, and the user operates through the keyboard and mouse, which is not conducive to the user's on-site processing process demonstration and visual display of execution results. [0003] The development of gesture recognition, speech recognition and other applications based on deep learning and cognitive computing has made human-computer interaction a trend of humanization and...

AI Technical Summary

Problems solved by technology

It can overcome the deficiencies of existing technologies, and use gesture recognition and voice recognition for remote sensing image processing and display systems. It can obtain a more natural interactive experience and ideal display effects when users make speeches, demonstrations and real-time manipulations. Effectively solve the human-computer interaction problems existing in the display control of the existing remote sensing image processing system

Images