Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Panoramic 3D video generation method for virtual reality equipment

A technology of virtual reality and panoramic video, applied in the field of panoramic 3D video generation, can solve the problem of three-dimensional sense of incapable viewers, and achieve the effect of enhancing the sense of experience and increasing the fidelity

Active Publication Date: 2016-09-21
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV +1
View PDF2 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the general VR display content is a panoramic video under one viewpoint. When this content is displayed on a VR device, the left and right eye videos see the same image, so it cannot give the viewer a three-dimensional effect.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Panoramic 3D video generation method for virtual reality equipment
  • Panoramic 3D video generation method for virtual reality equipment
  • Panoramic 3D video generation method for virtual reality equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0009] Such as figure 1 As shown, this embodiment proposes a panoramic 3D video generation method for a virtual reality device, including: using a wide-angle camera and a depth camera to capture a scene to generate a panoramic video and a panoramic depth map video under one viewpoint. The worn virtual reality device such as Oculus can detect the person's head posture in real time through its own sensor, and can call the corresponding function in the development kit to obtain the pitch angle, yaw angle and roll angle of the head coordinate system relative to the ground coordinate system. Cut the image at the corresponding position in the panoramic video frame as the video of the left viewpoint; based on the image of the left viewpoint and the corresponding depth map, the right viewpoint image is generated by extrapolation based on virtual viewpoint synthesis technology, and the two images are spliced ​​into a left and right 3D video. displayed on real devices.

[0010] figure...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a panoramic 3D video generation method for virtual reality equipment, comprising the following steps: shooting a scene video using a wide-angle camera array, and generating a panoramic video through a stitching algorithm; shooting a scene depth map using a depth camera array, and generating a panoramic depth map video through the stitching algorithm; by detecting the head position of a person in real time, cutting an image of a corresponding position in the panoramic video frame as a video of the left view; and generating a right view image through extrapolation based on a virtual view synthesis technology according to the left view image and the corresponding depth map, wherein the two images are stitched into a left-right 3D video which is displayed in virtual reality equipment. By adding the view synthesis technology to a panoramic video displayed by virtual reality equipment, viewers can see the 3D effect of the panoramic video, the scene is more lifelike, and the viewer experience is enhanced.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to a panoramic 3D video generation method for virtual reality equipment. Background technique [0002] Virtual reality technology creates a virtual world that is close to reality through the interaction between entities and three-dimensional real-time vision. It is considered as a new technology that changes people's life style, so it has broad development prospects. In the real world, people have a three-dimensional view of the scene in front of them because of the parallax between the left and right eyes. However, the general VR display content is a panoramic video under one viewpoint. When this content is displayed on a VR device, the left and right eye videos see the same image, so it cannot give the viewer a three-dimensional sense. If it is possible to automatically render the corresponding video of the human eye under another viewpoint based on th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/00H04N13/02H04N13/04G06T3/40
CPCG06T3/4038H04N13/122H04N13/243H04N13/344
Inventor 金欣刘站奇张新戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com