Virtual and real lighting fusion method based on fish-eye lens

A technology of fisheye lens and fusion method, which is applied in 3D image processing, image data processing, instruments, etc., can solve a large number of offline computing problems, and achieve the effect of improving real-time performance, efficiency and accuracy

Active Publication Date: 2015-07-08
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF3 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this type of method can achieve more effective illumination estimation through online calculations, its disadvantage is that it requires a large amount of offline calculations.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual and real lighting fusion method based on fish-eye lens
  • Virtual and real lighting fusion method based on fish-eye lens
  • Virtual and real lighting fusion method based on fish-eye lens

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The present invention will be described in detail below with reference to the accompanying drawings and examples.

[0025] A method for fusion of virtual and real light based on a fisheye lens in the present invention, such as figure 2 shown, including the following steps:

[0026] Step 1, in the real scene, place a fisheye lens camera at the position where the virtual object will be placed in the future; wherein, the hemispherical shooting space of the camera includes all light sources in the real scene; as figure 1 As shown, the center of the fisheye lens is the origin O, passing through the origin O and along the direction of the fisheye lens is the Z axis; the plane XOY passing through the origin and perpendicular to the Z axis is the plane where the image plane of the fisheye lens is located;

[0027] In the present invention, in order to ensure the accuracy of light source estimation in the real scene and reduce the amount of computation, the global world coordi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a virtual and real lighting fusion method based on a fish-eye lens. The method mainly includes the following steps that firstly, a fish-eye lens camera is placed in the position of a virtual object in scene space and the real-time dynamic lighting environment in the scene is photographed through the fish-eye lens camera; then, the light source direction in a real scene is calculated through fish-eye lens images via image processing, the fish-eye lens images are converted into YUV space, and the light source intensity is calculated according to a light source intensity calculation formula; finally, calculated light source information is used, the virtual object is rendered faster by the adoption of a GPU, real-time augmented reality application with real scene lighting is achieved, and rapid and efficient scene lighting acquisition is achieved.

Description

technical field [0001] The invention relates to the technical field of computer image processing and augmented reality, in particular to a method for fusion of virtual and real light based on a fisheye lens. Background technique [0002] Augmented reality technology superimposes and displays computer-generated information such as virtual three-dimensional objects, videos, texts, and pictures into real scenes in real time, and realizes natural human-computer interaction through virtual-real fusion. The industry has broad application prospects. The highly realistic augmented reality effect is mainly reflected in three aspects: consistent geometry, consistent lighting and consistent time. Geometric consistency means that the virtual object generated by the computer should maintain an accurate and stable positional relationship with the real object; lighting consistency means that the virtual object should have a correct lighting matching relationship with the real environment;...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/00G06T15/50
Inventor 刘越刘万奎闫达远常军翁冬冬
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap