A simulated flight cockpit system with mixed reality function and its processing method

Abstract

The invention provides a simulation flight cockpit system having a virtual-real scene integration function. The system comprises an infrared boundary stereo mode identification module, a stereo image digital processing module, a virtual scene generation module, a virtual scene and real scene integration module and a high-definition display module, wherein the infrared boundary stereo mode identification module, the stereo image digital processing module and the virtual scene generation module are respectively connected with the virtual scene and real scene integration module, and the image information of a virtual scene and a real scene is integrated in a same coordinate system and is then displayed through the high-definition display module. The invention further discloses a processing method of the system. Through the system and the method, the image information of the virtual scene and the real scene can be rapidly processed, corrected and integrated, so trainers are enabled to observe operation motions of the trainers themselves in real time, image display timeliness is improved, the image display vividness effect is greatly improved, and the trainers can acquire high comfort levels and better training effects.

Description

technical field [0001] The invention relates to the technical field of flight simulation training facilities, in particular to a simulated flight cockpit system with a mixed reality function and a processing method thereof. Background technique [0002] Virtual reality is a combination of multiple technologies, including real-time three-dimensional computer graphics technology, wide-angle (wide-view) stereoscopic display technology, tracking technology for the observer's head, eyes and hands, and tactile / force feedback, stereo, network transmission, voice, etc. Input and output technology, etc. With the development of virtual reality display technology and pattern recognition technology, the experiencer can import the actual environment vision and hearing of the real world into the digital world through the stereo camera, and use the stereo head-mounted display to generate virtual Realistic digital world. In recent years, virtual reality technology has been widely used in ...

AI Technical Summary

Problems solved by technology

[0005] (1) It is impossible to observe and operate the real environment and virtual digital space in real time and at the same time. The real visual information captured by the camera module needs to be processed by a computer before it is combined with the virtual reality information. Some post-processing work even requires manual participation. , resulting in a certain time delay, the displayed screen and the operation of the trainee have deviation and delay, which affects the training effect;

[0006] (2) The final display effect after processing is not realistic enough. The real visual information captured by the camera module needs to be post-processed by computer and manual. Due to the short processing time and technical problems, the synthetic edge noise of the final image will be serious. Affect the display quality of the image;

[0007] (3) When the trainee obtains the final display effect, due to reasons such as distance and shooting depth of field, although the depth of field of the object can be judged, it cannot be guaranteed to be consistent with the real distance and height sense, which will affect the normal operation of the trainee and even cause Create an unsafe and uncomfortable experience

Images