Dynamic three-dimensional character reconstruction and live broadcast method based on RGBD camera

A character and dynamic technology, applied in image data processing, instruments, electrical components, etc., can solve problems such as difficult real-time transmission, high bandwidth requirements, and large data volumes, achieving wide application scenarios, low transmission bandwidth requirements, and good effects. Effect

Active Publication Date: 2019-07-26
PLEX VR DIGITAL TECH CO LTD
View PDF11 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the huge amount of reconstructed data and high bandwidth requirements, it is difficult to transmit in real time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic three-dimensional character reconstruction and live broadcast method based on RGBD camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The following describes several preferred embodiments of the present invention with reference to the accompanying drawings, so as to make the technical content clearer and easier to understand. The present invention can be embodied in many different forms of embodiments, and the protection scope of the present invention is not limited to the embodiments mentioned herein.

[0034] In the drawings, components with the same structure are denoted by the same numerals, and components with similar structures or functions are denoted by similar numerals. The size and thickness of each component shown in the drawings are shown arbitrarily, and the present invention does not limit the size and thickness of each component. In order to make the illustration clearer, the thickness of parts is appropriately exaggerated in some places in the drawings.

[0035] In the application of 3D character live broadcast, since the audience only pays attention to the front of the anchor, here a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a dynamic three-dimensional figure reconstruction and live broadcast method based on an RGBD camera, and the method comprises the steps: S1, carrying out the real-time image matting of a collected RGBD image, and carrying out the matting of a figure part of the RGBD image; S2, compressing the RGBD image after image matting, and carrying out real-time stream pushing by adopting a video stream pushing protocol; s3, receiving an image matting result of the RGBD image at a mobile terminal, decompressing the image matting result to generate three-dimensional point clouds, and connecting the point clouds into a plane to obtain a three-dimensional model of the human body; and S4, carrying out binocular rendering on the three-dimensional model at the mobile terminal. An image with a three-dimensional effect and an AR effect can be seen by wearing the three-dimensional display device. The method is relatively small in calculated amount, can be used for reconstruction ata mobile terminal, and is high in reconstruction speed and good in effect. The method is wide in application scene, not only can be applied to real-time three-dimensional character live broadcast, butalso can be applied to multiple fields such as holographic communication and holographic conferences, and a user can watch through AR, VR and holographic equipment.

Description

technical field [0001] The invention relates to the field of real-time three-dimensional reconstruction, in particular to a dynamic three-dimensional character reconstruction and live broadcast method based on an RGBD camera. Background technique [0002] Due to the current rise of the live broadcast industry, the traditional two-dimensional video live broadcast has a single form and poor immersion. It is urgent to intervene in a new live broadcast form to enhance the audience's experience. With the development of augmented reality (AR), virtual reality (VR) and holographic technology, AR, VR and holographic devices provide display terminals for the presentation of 3D data, and the future live broadcast method is very likely to be 3D live broadcast. At present, some new live broadcast forms have gradually emerged. Next, we will briefly introduce and analyze three of them: [0003] 1. Use the technology of green screen cutout to cut out the anchor characters, and then change...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00H04L29/06
CPCG06T19/006H04L65/80G06T2207/30196H04L65/762
Inventor 孙正忠张迎梁
Owner PLEX VR DIGITAL TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap