Adversarial network based rapid multi-visual-angle 3D synthesis-display method and device

A multi-view and network technology, applied in the input/output process of data processing, input/output of user/computer interaction, image data processing, etc., can solve problems such as slow speed, complicated process, and reduced model quality, and achieve The effect of simplifying complex processes

Active Publication Date: 2018-04-20
洛阳中科信息产业研究院 +1
View PDF4 Cites 44 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, only the 3D reconstruction model includes various complex processes such as collecting multi-view images, finding matching point correspondence, geometric projection, point cloud fusion, and patch fusion. The whole process is complicated, slow and the effect is not perfect. Reconstruction Sometimes there will be black holes in the model, which will reduce the quality of the model and give people an unreal feeling

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Adversarial network based rapid multi-visual-angle 3D synthesis-display method and device
  • Adversarial network based rapid multi-visual-angle 3D synthesis-display method and device
  • Adversarial network based rapid multi-visual-angle 3D synthesis-display method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The method of the present invention starts from the essence of displaying three-dimensional objects, and no matter how the intermediate process is handled, what the human eye sees finally is a two-dimensional image like a camera. Ordinary 3D reconstruction methods need to reconstruct a high-quality 3D model, and after texture mapping and relighting, project it to a specific 2D map at a certain viewing angle for display.

[0036] However, by observing each sample, it can be found that the object under the perspective of a certain camera actually contains two attributes, one is its essential attribute, reflecting its own three-dimensional structure, color texture, etc., and the other is the viewing angle attribute, reflecting the The change caused by the positional projection of the viewing angle. The essence of an object will not change with the change of the viewing angle, but the viewing angle property will cause the change of the two-dimensional projection. Therefore...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an adversarial network based rapid multi-visual-angle 3D synthesis-display method and device. A depth map and an RGB picture in certain visual angle are processed, a generative adversarial network (GAN) is constructed to obtain continuous multi-visual-angle 2D mapping of an object, and reconstruction of a 3D model is not needed. Only the depth map and RGB picture in certain visual angle are processed, continuous multi-visual-angle 2D mapping of the object can be obtained needless of reconstructing the high-quality 3D model, the visual angle transformed to obtain the 2Dimage in real time, the flow of 3D object display is simplified, and the 3D object can be displayed in real time in multiple visual angles in higher quality.

Description

technical field [0001] The invention relates to fields including game interaction, 3D animation production and synthesis, virtual reality content acquisition, 3D virtual object display, etc., and specifically relates to a method and device for rapidly synthesizing and displaying real objects under different viewing angles based on an adversarial network. Background technique [0002] In the past few years, with the rapid popularization of mobile Internet and smart devices, people have higher requirements for human-computer interaction, and virtual reality (VR) technology has also developed rapidly. Samsung's Gear VR helmet The emergence of VR devices such as Oculus Rift and Oculus Rift has brought people a brand-new interactive experience. People can experience VR games, socialize in VR through VR devices, and even reconstruct a part of the real world, giving people a strong sense of reality. At present, many scientific researchers and technicians are studying 3D reconstruct...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/00G06F3/01
CPCG06F3/011G06T19/00
Inventor 宋强
Owner 洛阳中科信息产业研究院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap