Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-eye stereo vision system and method applied to indoor scene virtual reality live broadcast

A multi-eye stereo vision and virtual reality technology, applied in the field of multi-eye stereo vision system for indoor scene virtual reality live broadcast, can solve the problem of shooting target objects, cannot provide 360° all-round shooting, and loses the flexibility of multi-eye vision system and other issues to achieve accurate and fine 3D modeling

Active Publication Date: 2019-07-16
SOUTH CHINA UNIV OF TECH +1
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In summary, although the binocular stereo vision system can measure the depth of field information of the target object, it cannot provide 360° all-round shooting due to the small coverage of the two cameras.
The multi-eye vision system that uses a pair of main-eye cameras and multiple auxiliary-eye cameras also loses the flexibility of the multi-eye vision system because the main-eye camera and the auxiliary-eye cameras are fixed on the same component. The range is limited by the movement of the main eye camera, making it impossible to capture the target object from multiple angles at the same time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-eye stereo vision system and method applied to indoor scene virtual reality live broadcast
  • Multi-eye stereo vision system and method applied to indoor scene virtual reality live broadcast
  • Multi-eye stereo vision system and method applied to indoor scene virtual reality live broadcast

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] In the first embodiment, a trinocular stereo vision system with three independent slide rails applied to indoor scene virtual reality live broadcasting is implemented.

[0047] figure 1 It is the operation flowchart of the first embodiment, and the deployment diagram of the camera is as follows figure 2 As shown, the shaded part in the figure is the common shooting area of ​​the cameras. In this embodiment, three independent slide rails are adopted, and the viewing angle ranges of the three cameras are all above 120°, and they are respectively arranged on the three slide rails.

[0048] When the system starts to run, firstly carry out the calibration of the camera, because in the photographing process in the later period, three cameras will move according to the movement of the target object, therefore, the present invention has adopted the self-calibration method of the camera, guarantees that the camera is moving Calibration can still be completed quickly after cha...

Embodiment 2

[0055] In the second embodiment, a trinocular stereo vision system with two arc-shaped slide rails applied to indoor scene virtual reality live broadcasting is implemented.

[0056] This embodiment adopts two sections of arc-shaped slide rails, and the two slide rails together form a circular track. Three cameras are arranged on the slide rails and can move freely independently.

[0057] The operation process of the system is the same as that in Embodiment 1, and the attached Figure 5 Then it is a schematic diagram of camera distribution in Embodiment 2.

[0058] Similar to Example 1, such as Figure 6 As shown, since the camera has three degrees of freedom, when the target is outside the plane of the slide rail, the camera can also move to the corresponding position, and cooperate with the tracking and shooting of the target at a suitable shooting angle.

[0059] In order to make the technical problems, technical solutions and beneficial effects solved by the present inven...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-view stereoscopic vision system for indoor scene virtual reality live broadcast. The multi-view stereoscopic vision system for indoor scene virtual reality live broadcast includes M indoor guide rails, N independent cameras sliding on the M guide rails, N drive dollies which can drive the cameras to move on the guide rails, a processor and virtual reality output equipment, wherein M>=1, and N>=3; the N independent cameras can be combined two by two to shoot a target object, and can transmit the shot information to the processor; after processing the information, the processor transmits virtual reality video signals to the virtual reality output equipment; and a user can observe the target object through the virtual reality output equipment. As the plurality of cameras can form multi pairs of binocular stereoscopic vision systems two by two, the multi-view stereoscopic vision system and system for indoor scene virtual reality live broadcast can observe and shoot the object to guarantee that the environment information of the object and the surrounding environment of the object can be maximally extracted so as to enable 3D modeling to be more exquisite.

Description

technical field [0001] The invention relates to the field of virtual reality applications, in particular to a multi-eye stereo vision system and method applied to indoor scene virtual reality live broadcasting. Background technique [0002] Nowadays, with the continuous development of virtual reality technology, the camera system based on the principle of binocular vision has played an increasingly important role in the industrial production and real life of human society. Different from the general traditional monocular camera method, binocular vision uses two cameras to shoot the same object, observes an object from two or more points, and obtains images under different perspectives, according to the pixel matching between images The relationship between pixels is calculated by the principle of triangulation to obtain the three-dimensional information of the object. After obtaining the depth of field information of the object, the actual distance between the object and th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/30G06T7/593G06T7/80G06T17/00G06T19/00G06F3/01H04N13/243H04N13/332
CPCG06F3/011G06T17/00G06T19/00G06T2207/10016H04N13/243H04N13/332
Inventor 杨辰光梁聪垣曾超贺波涛
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com