Unlock instant, AI-driven research and patent intelligence for your innovation.
Interactive three-dimensional real scene and digital image high-speed fusion processing system and processing method
What is Al technical title?
Al technical title is built by PatSnap Al team. It summarizes the technical point description of the patent document.
A digital image and fusion processing technology, applied in the field of virtual reality, can solve the problems of inability to real-time and simultaneous stereoscopic observation, inability to interact with virtual digital vision normally, inconvenient to see, etc.
Active Publication Date: 2018-07-27
SHENZHEN WEIA TECH
View PDF11 Cites 2 Cited by
Summary
Abstract
Description
Claims
Application Information
AI Technical Summary
This helps you quickly interpret patents by identifying the three key elements:
Problems solved by technology
Method used
Benefits of technology
Problems solved by technology
[0005] 1. It is impossible to observe and operate the real environment and virtual digital space in real time and at the same time. The current head-mounted display uses electronic gyroscopes and electronic accelerometers. There will be errors in the position seen by the eyes, and then superimposed on the final image in the virtual space to be output to the LCD screen, and there will be a delay of about 100 milliseconds. Then, due to the mismatch between the two spatial positions, the human visual image will be different Deviation and delay, easy to cause dizziness;
[0006] 2. Being blocked by the head-mounted display, it is inconvenient for people to see the input devices or body movements in the real world. It is necessary to let people's visual nerves concentrate on the screen displayed on the head-mounted display. People bring the feeling of "invisibility", resulting in an unsafe and uncomfortable experience;
[0007] 3. In people's daily usage habits, the functions completed by body movements cannot be normally interacted with virtual digital vision;
[0008] 4. The system is complex, requiring multiple systems such as display, shooting, and processing. The system is complex, costly, and poor in portability
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more
Image
Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
Click on the blue label to locate the original text in one second.
Reading with bidirectional positioning of images and text.
Smart Image
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0048] figure 1 It is a schematic structural diagram of an interactive three-dimensional real scene and digital image high-speed fusion processing system according to an embodiment of the present invention. The processing system includes: an image signal identification module 10 , a head positioning and movement sensing module 20 , a liquid crystal display module 60 , a stereoscopic image encoding module 30 and an application processor 50 .
[0049] The image signal recognition module 10 includes a stereoscopic space recognition unit 11 connected to a stereo camera and a microphone. The stereoscopic space recognition unit 11 recognizes images and sounds of the real environment and uploads them to the stereoscopic image coding module 30 .
[0050] The head positioning and motion sensing module 20 includes an electronic gyroscope and an accelerometer for obtaining the original posture information of the head motion.
[0051] The stereoscopic image coding module 30 is connected ...
Embodiment 2
[0058] A high-speed fusion processing method of interactive 3D real scenes and digital images, Figure 6 shown, including the following steps,
[0059] Initialization of each module of the S100 system;
[0060] S200 computer to establish a three-dimensional digital scene;
[0061] The processing module of the computer extracts the real scene features from the real scene information, maps the real scene features to the features for the virtual scene based on the preset mapping relationship, and constructs the virtual reality scene information based on the features used to construct the virtual scene .
[0062] S300 uses stereo vision image technology to correct the head position, and generates a stereo image of a new perspective in the virtual reality software;
[0063] Figure 7 As shown, the specific correction steps are as follows,
[0064] S301 automatically resets the head positioning module and sets the origin of the space;
[0065] S302 captures the target feature ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
PUM
Login to View More
Abstract
The invention provides an interactive three-dimensional real scene and digital image high-speed fusion processing system, which at least includes an image signal recognition module, a head positioning and motion sensing module, a liquid crystal display module, a stereo image coding module and an application processor; an image signal recognition module It includes a three-dimensional space recognition unit and a hand image recognition unit. The three-dimensional image coding module is connected to the image signal recognition module and the head positioning and motion sensing module. The application processor is connected to the three-dimensional image coding module and the liquid crystal display module to complete the virtual image and The fusion of images displayed by feature points in the same space coordinate system; in addition, a processing method using the system is also disclosed. The system and method can integrate the vision and hearing of the surrounding real environment space in real time in the three-dimensional virtual reality digital environment, can observe one's own body movements in real time, and allow the body movements to complete interactions such as operating models of the digital world.
Description
technical field [0001] The invention belongs to the technology in the field of virtual reality, and in particular relates to an interactive three-dimensional real scene and digital image high-speed fusion processing system and a processing method of the system. Background technique [0002] Virtual reality is a combination of multiple technologies, including real-time three-dimensional computer graphics technology, wide-angle (wide-view) stereoscopic display technology, tracking technology for the observer's head, eyes and hands, and tactile / force feedback, stereo, network transmission, voice, etc. Input and output technology, etc. With the development of virtual reality display technology and pattern recognition technology, the experiencer can import the actual environment vision and hearing of the real world into the digital world through the stereo camera, and use the stereo head-mounted display to generate virtual reality through the visual nerves. Realistic digital wor...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More
Application Information
Patent Timeline
Application Date:The date an application was filed.
Publication Date:The date a patent or application was officially published.
First Publication Date:The earliest publication date of a patent with the same application number.
Issue Date:Publication date of the patent grant document.
PCT Entry Date:The Entry date of PCT National Phase.
Estimated Expiry Date:The statutory expiry date of a patent right according to the Patent Law, and it is the longest term of protection that the patent right can achieve without the termination of the patent right due to other reasons(Term extension factor has been taken into account ).
Invalid Date:Actual expiry date is based on effective date or publication date of legal transaction data of invalid patent.
Login to View More 
Login to View More