Self-adaptive light field imaging calibration method and device and storage medium

A technology of light field imaging and calibration method, applied in the field of image processing, which can solve problems such as difficult calibration of camera array system, waste of camera resources, inability to adaptively collect scene content, etc.

Active Publication Date: 2021-02-19
TSINGHUA UNIV
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This type of camera is often calibrated before use, while the traditional calibration algorithm using a calibration board has a complicated calibration process, and it is difficult to calibrate a complex camera array system; the second is that the fixed camera array system has poor flexibility and cannot be used for scene content. Adaptive acquisition will waste a lot of camera resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Self-adaptive light field imaging calibration method and device and storage medium
  • Self-adaptive light field imaging calibration method and device and storage medium
  • Self-adaptive light field imaging calibration method and device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0032] figure 1 It is a flowchart of an adaptive light field imaging calibration method provided by Embodiment 1 of the present invention. This embodiment is applicable to the case of adaptive light field imaging calibration, and the method can be performed by the adaptive light field imaging in the embodiment of the present invention calibration device, the adaptive light field imaging calibration device can be implemented in software and / or hardware, such as figure 1 As shown, the method specifically includes the following steps:

[0033] S110. Acquire global video data captured by a global camera in each module, where the module includes: one global camera and at least one local camera.

[0034] The number of global cameras and local cameras in each module can be set according to user requirements, which is not limited in this embodiment of the present invention.

[0035] S120. Determine a spatial information distribution map according to the global video data.

[0036] ...

Embodiment 2

[0098] figure 2 It is a schematic structural diagram of an adaptive light field imaging calibration device provided in Embodiment 2 of the present invention. This embodiment can be applied to the situation of adaptive light field imaging calibration, the device can be implemented in software and / or hardware, and the device can be integrated in any device that provides the function of adaptive light field imaging calibration, such as figure 2 As shown, the adaptive light field imaging calibration device specifically includes: an acquisition module 210 , a first determination module 220 , a second determination module 230 and a third determination module 240 .

[0099] Wherein, the obtaining module 210 is used to obtain the global video data captured by the global camera in each module, wherein the modules include: a global camera and at least one local camera;

[0100] The first determination module 220 is configured to determine a spatial information distribution map accord...

Embodiment 3

[0106] image 3 It is a schematic structural diagram of a computer device in Embodiment 3 of the present invention. image 3 A block diagram of an exemplary computer device 12 suitable for implementing embodiments of the invention is shown. image 3 The computer device 12 shown is only an example, and should not impose any limitation on the functions and scope of use of the embodiments of the present invention.

[0107] Such as image 3 As shown, computer device 12 takes the form of a general-purpose computing device. Components of computer device 12 may include, but are not limited to: one or more processors or processing units 16 , system memory 28 , bus 18 connecting various system components including system memory 28 and processing unit 16 .

[0108] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus struc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a self-adaptive light field imaging calibration method and device and a storage medium. The method comprises the steps: acquiring global video data shot by a global camera in each module, wherein the modules comprise one global camera and at least one local camera, determining a spatial information distribution diagram according to the global video data, determining parameter information of each local camera in the module according to the spatial information distribution diagram, calculating a mapping grid between images of the global camera and the local cameras, and calibrating the local cameras to the corresponding global cameras. A new module is designed for realization, and the interiors of all the modules are designed in a graded manner, so that in light fieldcalibration, the interior of each module can be calibrated firstly, and then all the modules are integrally calibrated. Through a two-stage calibration mode, the complexity of light field calibrationis reduced, and the robustness and parallelism are improved.

Description

technical field [0001] Embodiments of the present invention relate to the field of image processing, and in particular, to an adaptive light field imaging calibration method, device, and storage medium. Background technique [0002] With the popularity of high-resolution displays and projectors, as well as the rise of VR and AR, people have higher and higher requirements for image resolution, viewing angle and quality. Due to the limited viewing angle range of a single camera, it is necessary to use multi-camera fusion Advanced technology to obtain high-resolution, wide viewing angle, and images with depth. Among them, the light field camera array, as one of the core technologies, is a research hotspot of related technologies in the world, and has a wide range of applications, including biomedical engineering research, astronomical observation, public safety, aerospace and other aspects. [0003] The traditional camera array uses a fixed camera method, which usually has the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/80H04N5/247
CPCG06T7/80H04N23/90
Inventor 方璐季梦奇袁肖赟戴琼海
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products