Three-dimensional panoramic video stream generating method and equipment and video conference method and equipment

A panorama video and video streaming technology, applied in the field of video splicing, can solve the problems of large gap between original viewpoints, increase in number, and increase in computational complexity, and achieve the effect of improving efficiency, splicing real-time video images, and reducing complexity.

Active Publication Date: 2012-09-19
HUAWEI DEVICE CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in image stitching, (1) the occlusion and hole problems of reconstructed virtual viewpoints; (2) the large gap between the original viewpoints leads to large parallax, and the number of intermediate virtual viewpoint maps that need to generate continuous viewpoints will increase suddenly. The problem that the amount will increase; (3) the calculation problem of parallax; it has not been well resolved
[0005] Due to the above-mentioned many problems, the telepresence conference system in the prior art cannot provide users with a panoramic, high-resolution, seamless and three-dimensional conference experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional panoramic video stream generating method and equipment and video conference method and equipment
  • Three-dimensional panoramic video stream generating method and equipment and video conference method and equipment
  • Three-dimensional panoramic video stream generating method and equipment and video conference method and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] like figure 2As shown, the method for generating a stereoscopic panoramic video stream in the embodiment of the present invention includes the following steps: obtaining depth information of at least two video images (step S201); obtaining a plurality of depth information from corresponding video images according to the depth information of each video image Hierarchical image data (step S202); video image data are spliced ​​according to the acquired multiple depth-level image data to generate a stereoscopic panoramic video stream (step S203).

[0037] like figure 1 As shown, the depth camera (111B, 112B) acquires the video stream of the venue B and the depth information of each frame image synchronously from two perspectives; obtains depth images of different depth levels according to the depth information of the image, and the depth level changes little Generally, only one image stitching is done for the area; for people and objects with changing motion, frame-by-fra...

Embodiment 2

[0044] like Figure 3A As shown, the device for generating a stereoscopic panoramic video stream in the embodiment of the present invention includes: depth information acquisition means 301 for acquiring depth information of at least two video images; layered image acquisition means 302 for obtaining from The image data of multiple depth levels is obtained from the corresponding video image; the stereoscopic panoramic video stream generation device 303 is used for splicing video image data according to the acquired image data of multiple depth levels to generate a stereoscopic panoramic video stream.

[0045] like figure 1 As shown, the depth camera (111B, 112B) acquires the video stream of the venue B and the depth information of each frame image synchronously from two perspectives; obtains depth images of different depth levels according to the depth information of the image, and the depth level changes little Generally, only one image stitching is done for the area; for pe...

Embodiment 3

[0050] like Figure 5 As shown, the stereoscopic panoramic video conferencing method of the embodiment of the present invention includes: synchronously acquiring video streams of the same venue from at least two viewing angles (step S501); acquiring multiple depths from the corresponding video streams according to the depth information of each video stream Hierarchical image data (step S502); the obtained video streams of different viewing angles are spliced ​​based on depth information to generate a stereoscopic panoramic video stream (step S503); according to the category of the terminal display, the video images of the stereoscopic panoramic video stream are displayed on the terminal display (step S504).

[0051] like Figure 8 As shown, in step S801, video stitching is performed on the initial frame to calculate a complete mosaic image, and the first image and the second image of the initial frame are stitched together; step S802, first detecting the first image of the cu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a three-dimensional panoramic video stream generating method and equipment and a video conference method and equipment. The three-dimensional panoramic video stream generating method comprises the following steps of: acquiring the depth information of at least two video images; acquiring a plurality of image data of a depth level from a corresponding videoimage according to the depth information of each video image; and jointing the video image data according to the image data of the depth level to generate a three-dimensional panoramic video stream. The invention provides a three-dimensional panoramic seamless high-resolution telepresence conference video image for users by utilizing a multi-display mode based on different display equipment.

Description

technical field [0001] The present invention relates to video splicing technology, in particular to video splicing technology in a telepresence conference system, specifically a method and device for generating stereoscopic panoramic video streams, and a video conferencing method and device. Background technique [0002] Existing telepresence technology is a technology that combines high-quality audio, high-definition video images and interactive components, aiming to provide a unique experience as if it were immersive through the network. For example, using advanced video, audio and collaboration technologies in a telepresence conference system can provide users with a real-time face-to-face interactive experience. The telepresence conference system can even provide a picture of the suite in the room, creating a face-to-face meeting experience around a virtual conference table through life-size images, high-definition resolution, and stereo and multi-channel audio. Althoug...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N5/262H04N13/00H04N7/15
Inventor 李凯
Owner HUAWEI DEVICE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products