Three-dimensional panoramic video stream generating method and equipment and video conference method and equipment

A panoramic video and video stream technology, applied in the field of video splicing, can solve the problems of large gaps in original viewpoints, increase in number, and increase in computation, and achieve the effects of improving efficiency, real-time video image splicing, and reducing complexity

Active Publication Date: 2010-07-07
HUAWEI DEVICE CO LTD
View PDF0 Cites 43 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in image stitching, (1) the occlusion and hole problems of reconstructed virtual viewpoints; (2) the large gap between the original viewpoints leads to large parallax, and the number of intermediate virtual viewpoint maps that need to generate continuous viewpoints will increase suddenly. The problem that the amount will increase; (3) the calculation problem of parallax; it has not been well resolved
[0005] Due to the above-mentioned many problems, the telepresence conference system in the prior art cannot provide users with a panoramic, high-resolution, seamless and three-dimensional conference experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional panoramic video stream generating method and equipment and video conference method and equipment
  • Three-dimensional panoramic video stream generating method and equipment and video conference method and equipment
  • Three-dimensional panoramic video stream generating method and equipment and video conference method and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] Such as figure 2 As shown, the method for generating a stereoscopic panoramic video stream in the embodiment of the present invention includes the following steps: obtaining depth information of at least two video images (step S201); obtaining a plurality of depth information from corresponding video images according to the depth information of each video image Hierarchical image data (step S202); video image data are spliced ​​according to the acquired multiple depth-level image data to generate a stereoscopic panoramic video stream (step S203).

[0037] Such as figure 1 As shown, the depth camera (111B, 112B) acquires the video stream of the venue B and the depth information of each frame image synchronously from two perspectives; obtains depth images of different depth levels according to the depth information of the image, and the depth level changes little Generally, only one image stitching is done for the area; for people and objects with changing motion, frame...

Embodiment 2

[0044] Such as Figure 3A As shown, the device for generating a stereoscopic panoramic video stream in the embodiment of the present invention includes: depth information acquisition means 301 for acquiring depth information of at least two video images; layered image acquisition means 302 for obtaining from The image data of multiple depth levels is obtained from the corresponding video image; the stereoscopic panoramic video stream generation device 303 is used for splicing video image data according to the acquired image data of multiple depth levels to generate a stereoscopic panoramic video stream.

[0045] Such as figure 1 As shown, the depth camera (111B, 112B) acquires the video stream of the venue B and the depth information of each frame image synchronously from two perspectives; obtains depth images of different depth levels according to the depth information of the image, and the depth level changes little Generally, only one image stitching is done for the area; ...

Embodiment 3

[0050] Such as Figure 5 As shown, the stereoscopic panoramic video conferencing method of the embodiment of the present invention includes: synchronously acquiring video streams of the same venue from at least two viewing angles (step S501); acquiring multiple depths from the corresponding video streams according to the depth information of each video stream Hierarchical image data (step S502); the obtained video streams of different viewing angles are spliced ​​based on depth information to generate a stereoscopic panoramic video stream (step S503); according to the category of the terminal display, the video images of the stereoscopic panoramic video stream are displayed on the terminal display (step S504).

[0051] Such as Figure 8 As shown, in step S801, video stitching is performed on the initial frame to calculate a complete mosaic image, and the first image and the second image of the initial frame are stitched together; step S802, first detecting the first image of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a three-dimensional panoramic video stream generating method and equipment and a video conference method and equipment. The three-dimensional panoramic video stream generating method comprises the following steps of: acquiring the depth information of at least two video images; acquiring a plurality of image data of a depth level from a corresponding video image according to the depth information of each video image; and jointing the video image data according to the image data of the depth level to generate a three-dimensional panoramic video stream. The invention provides a three-dimensional panoramic seamless high-resolution telepresence conference video image for users by utilizing a multi-display mode based on different display equipment.

Description

technical field [0001] The present invention relates to video splicing technology, in particular to video splicing technology in a telepresence conference system, specifically a method and device for generating stereoscopic panoramic video streams, and a video conferencing method and device. Background technique [0002] Existing telepresence technology is a technology that combines high-quality audio, high-definition video images and interactive components, aiming to provide a unique experience as if it were immersive through the network. For example, using advanced video, audio and collaboration technologies in a telepresence conference system can provide users with a real-time face-to-face interactive experience. The telepresence conference system can even provide a picture of the suite in the room, creating a face-to-face meeting experience around a virtual conference table through life-size images, high-definition resolution, and stereo and multi-channel audio. Althoug...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N5/262H04N13/00H04N7/15
Inventor 李凯
Owner HUAWEI DEVICE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products