A camera time resolution multiplication method and device based on time coding

Abstract

The present invention provides a method for doubling the time resolution of a camera based on time coding, comprising: step S1, for a three-dimensional space-time volume E(x, y, t), decomposing several time points of a single exposure time into t i ∈{t 1 ,t 2 ,...,t N}; Step S2, introducing the exposure coding pattern H(x, y, t at each time point, and directly multiplying the space-time body E(x, y, t to form a coded image I(x, y, t, that is, I( x, y, t)=E(x, y, t)×H(x, y, t); Step S3, add the exposure coded images of all time points within the exposure time to obtain the single sheet recorded by the image sensor The time-coded image is recorded as: step S4. In the above formula, the compressed sensing algorithm is used to reconstruct the image E(x, y, t i ). The method of the invention solves the technical problem that it is difficult to improve the time resolution of the camera in the prior art, and can improve the time resolution of the camera without sacrificing the spatial resolution.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular, to a method and device for multiplying camera time resolution based on time coding. Background technique [0002] With the advancement and development of science and technology, the application of high frame rate cameras is becoming more and more extensive. High-speed cameras can record various instantaneous changes, which play a very important role in observing and analyzing various high-speed mechanical operations, object movement, chemical reactions, and animal behavior analysis. Due to the limitation of camera bandwidth, the pixel information acquired by the camera per unit time is limited, and the improvement of temporal resolution will inevitably lead to the reduction of spatial resolution. Taking the real-time transmission camera as an example, CoaxPress, the fastest commercial interface currently, has a maximum transmission speed of 1.5GB / s. For a camera w...

AI Technical Summary

Problems solved by technology

Due to the limitation of camera bandwidth, the pixel information acquired by the camera per unit time is limited, and the improvement of temporal resolution will inevitably lead to the reduction of spatial resolution.

Taking the real-time transmission camera as an example, CoaxPress, the fastest commercial interface currently, has a maximum transmission speed of 1.5GB / s. For a camera with a resolution of 3 million, the maximum frame rate is 500 frames, and the overall bandwidth of the camera is improved at the hardware level, such as Improving the speed at which the camera reads and writes information or building a camera array will greatly increase hardware cost, power consumption, and system complexity

[0003] In addition, using software algorithms to super-resolution video in the time dimension can improve the frame rate of video to a certain extent, for example in A.Gupta, P.Bhat, M.Dontcheva, O.Deussen, B.Curless, and M. Cohen, "Enhancing and Experiencing Space-Time Resolution with Videos and Stills," in IEEE International Conference on Computational Photography (ICCP), 2009, pp.1–9., through high-resolution low-frame-number images and low-resolution high-frame Digital video synthesis of high-frame-number high-resolution video, but this method will cause irregular motion blur and weakening of the target, and the ability of temporal super-resolution is limited

Images