Imaging method and imaging system of dynamic optical fields of multichannel space-time coding apertures

Abstract

The invention discloses an imaging method and an imaging system of dynamic optical fields of multichannel space-time coding apertures, which comprise the steps of establishing a five-dimensional dynamic optical field module of space-time coding, introducing exposure time regarded as a time dimension into coding apertures based on a four-dimensional optical filed, and achieving space-time joint coding of a aperture mode and orthogonal space-time coding apertures based on multiplexing; estimating motion fields, eliminating motion blur, and achieving recovery of motion blur images based on exposure time coding; reestablishing multichannel depth super resolution; and achieving decoupling of motion fields and depth fields and recovering full focus images. Through multiplexing, signal to noise ratio of images and influence of shutter noise are reduced, and optical filed imaging quality is improved. Frequency response characteristics of the exposure time decoding and recovery of the motion blur images can improve definition of images after being recovered, and reestablishment of the depth super resolution improves depth resolution and modifies estimation errors of depth images with low resolution.

Description

technical field [0001] The invention relates to light field imaging technology in stereoscopic images, in particular to a dynamic light field imaging method and imaging system with multi-channel space-time coded apertures. Background technique [0002] As the core pillar of the global next-generation digital film and television and digital entertainment industry, stereoscopic video has gradually formed a new industry growth point and new industrial chain based on 3D video / stereoscopic video. 3D reality capture provides 3D content support for 3D model rendering and stereoscopic display, and is an essential front-end and basic link in the entire industry chain. [0003] The light field imaging technology developed in recent years can obtain additional information such as scene geometry that cannot be captured by traditional imaging models. This feature effectively expands the capabilities of imaging applications, and avoids the ill-conditioned inverse problem solving in tradi...

AI Technical Summary

Problems solved by technology

[0015] The purpose of the present invention is to solve the influence of image sensor shutter noise and Bayer output mode existing in the actual light field capture process, as well as the motion blur caused by dynamic scenes, and overcome the low depth resolution and low precision of existing light field imaging. A Dynamic Light Field Imaging Model Based on Multi-Channel Space-Time Coding Aperture

Images