Computational imaging method and imaging system based on nonplanar image sensor

Abstract

The invention discloses a computational imaging method and an imaging system based on a nonplanar image sensor, and the light-receiving surface of the image sensor is arranged by adopting a nonplanar mode. The imaging method includes the following steps: extracting the image information which is acquired by the nonplanarly arranged light-receiving surface in single exposure, and generating an image focused at different depths according to the image information; in combination with the method for estimating depth from focus (DFF) and the method of estimating depth from defocus (DFD), carrying out depth estimation on the image focused at different depths to obtain a depth map; generating a full-focused image on the basis of the image focused at different depths and the depth map, and generating refocused images focused at specific positions and provided with specific depths of field on the basis of the obtained depth map and the full-focused image. The method and the system can use single exposure to effectively acquire the information of the depth of field, and can use a single image to restore and control the depth of field.

Description

technical field [0001] The present invention relates to the field of computational photography, in particular to the field of computational sensing, in particular to a computational imaging method and system for a non-planar image sensor. Background technique [0002] Traditional digital photography is essentially to obtain the projection of the scene in the three-dimensional world on the two-dimensional plane, and the obtained single image cannot accurately restore the depth and structure information of the three-dimensional scene, and cannot bring a sense of depth to the human eye. three-dimensional sense. The traditional camera imaging model needs to make a trade-off between the depth of field and the signal-to-noise ratio. The depth of field is adjusted by the aperture. When the aperture is larger, the depth of field is smaller. If you want to increase the signal-to-noise ratio, you need to take a long exposure, and the long exposure will introduce motion blur in the im...

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a non-planar image sensor computational imaging method and system to solve the problem that traditional imaging cannot effectively collect scene depth information, and to decouple images focused at different depths of the scene in the case of a single exposure Sequence, which can effectively restore the depth of the scene and control the depth of field

Images