A VR social system and method based on real-time human body three-dimensional reconstruction

A real-time three-dimensional, three-dimensional reconstruction technology, applied in the field of virtual reality social realization, can solve the problem of unable to generate face point cloud in real time, achieve strong immersion and authenticity, and solve the effect of head-mounted display occlusion

Active Publication Date: 2020-10-09
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the above-mentioned prior art, the purpose of the present invention is to provide a VR social system and method based on real-time human body three-dimensional reconstruction, which solves the problem that the human body three-dimensional reconstruction cannot Real-time generation of facial point clouds and other technical issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A VR social system and method based on real-time human body three-dimensional reconstruction
  • A VR social system and method based on real-time human body three-dimensional reconstruction
  • A VR social system and method based on real-time human body three-dimensional reconstruction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0070] figure 1 The specific implementation process of the present invention is described. Since this system uses a method of real-time three-dimensional human body reconstruction to realize VR social interaction, in order to reduce the burden on the terminal processor, the present invention adopts the method of realizing scene three-dimensional reconstruction and human body three-dimensional reconstruction on the cloud. In addition, in order to complete the establishment of the 3D scene database, obtain the 3D scene point cloud by the terminal, reconstruct the 3D human body model, save the internal parameters of the sensor camera, the position transformation matrix between sensors, and the bone point data of the human body model, set the initial state of all social objects in the 3D scene. position, the system must first be initialized.

[0071] (1) The establishment process of the 3D scene database is as follows: figure 2 , Scene reconstruction refers to data collection t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a VR social system and method based on real-time three-dimensional reconstruction of human body, relates to the technical field of three-dimensional reconstruction technology and virtual reality social realization, and solves the problem caused by the user wearing a head-mounted display that blocks the face in the prior art VR social activities Technical problems such as the inability to generate face point clouds in real time during 3D reconstruction of the human body. The invention not only allows each social object to freely control its position in the virtual scene through human body positioning, but also allows each social object to freely control the angle of view it sees in the head display through poses, and can also use real-time human body three-dimensional Rebuild sees itself and other social objects. The present invention is used in fields such as VR social interaction, meetings, games, and medical research.

Description

technical field [0001] The invention relates to the technical field of virtual reality social interaction, in particular to a VR social system and method based on real-time three-dimensional human body reconstruction. Background technique [0002] In September 2015, at the press conference of AltspaceVR, Altspace announced that it would support the Samsung Gear VR headset. However, it did not live broadcast the speech of founder and CEO Enrique Romo, but the avatar of Romo and a group of reporters. The avatars talk together in a virtual environment, where the avatar's movements are mirrored by those of Romo and the group of reporters. Similarly, in October 2016, at the Oculus Connect3 developer conference, Zuckerberg and his colleagues put on the Oculus Rift helmet and the Oculus Touch handle to make a practical demonstration of VR social interaction in a virtual environment. These VR social technologies are aimed at tracking the position, direction, basic posture, expressi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/55G06T7/33G06T19/20G06Q50/00
CPCG06Q50/01G06T7/33G06T7/55G06T19/20G06T2207/10004G06T2207/10024G06T2207/10028
Inventor 彭雄峰赵丽丽曾辽原陈建文张汝民王文一
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap