Cross-scale adaptive mapping light field imaging method

Abstract

The embodiment of the invention discloses a cross-scale adaptive mapping light field imaging method, and the method comprises the steps: obtaining a light field image collected by a light field camera and a gray-scale map collected by an event camera, according to the light field image and the grey-scale map, determining a current area distribution image containing at least one dynamic object and a movement speed corresponding to each dynamic object; determining a motion saliency index according to the light field image, the current area distribution image and the motion speed corresponding to each dynamic object; screening each dynamic object according to the motion saliency index to obtain a target motion object; and determining a target image according to the target moving object. According to the invention, the problem of frequent and mass acquisition and processing of images caused by tiny change when the images of the monitoring area are acquired is solved, dynamic objects which do not need to be concerned or do not expect to be concerned in the images can be effectively filtered, the data processing amount is reduced, the data analysis speed is improved, a target moving object is visually observed through the target image, and subsequent data processing is facilitated.

Description

technical field

[0001] Embodiments of the present invention relate to image processing technologies, and in particular to a light field imaging method for cross-scale adaptive mapping. Background technique

[0002] With the improvement of social informatization, big data collection, analysis, and storage have gradually become the bottleneck restricting its further development. In the field of video surveillance, performance indicators such as camera resolution and frame rate are gradually improving. However, high-definition video sequences put forward higher requirements for storage and subsequent analysis in terms of hardware computing power and efficient algorithms. In many surveillance scenarios, the monitored object or environment is static and stable most of the time, but the high-definition surveillance camera equipment is still shooting continuously, generating a large amount of data to be saved in real time. Although the volume of these data is huge, the amount of e...

Examples

Embodiment 1

[0022] figure 1 It is a flow chart of a cross-scale adaptive mapping light field imaging method provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation of screening target moving objects in images and determining the target image. The light field imaging device adapted to the mapping is performed, and specifically includes the following steps:

[0023] Step S110, acquire the light field image collected by the light field camera and the grayscale image collected by the event camera, and determine the current area distribution image containing at least one dynamic object and the corresponding motion speed of each dynamic object according to the light field image and the grayscale image.

[0024] In this embodiment, the light field camera does not need to select the focal point before taking pictures, and can take pictures first. The camera captures a large amount of light data and selects the focal point. It is more flexible when taking ...

Embodiment 2

[0035] figure 2 It is a flow chart of a cross-scale adaptive mapping light field imaging method provided by Embodiment 2 of the present invention. The technical solution of this embodiment is further refined on the basis of the above-mentioned technical solution, and specifically mainly includes the following steps:

[0036] Step S210, receiving the trigger event sent by the event camera and accumulatively adding 1 to the trigger times of the trigger event.

[0037] In this embodiment, the trigger event can be understood as an event that is generated and sent by the event camera when it detects the movement of an object. The number of triggers can be understood as the number of occurrences of a trigger event.

[0038] Event cameras do not have the array output limitation of conventional image sensors. When each photodiode detects a change in intensity, a trigger event is generated immediately and output to a processing device such as a computer through a USB bus structure. ...

Embodiment 3

[0092] Figure 4A schematic structural diagram of a cross-scale adaptive mapping light field imaging device provided by Embodiment 3 of the present invention, the device includes: an acquisition module 61 , an index determination module 62 , an object screening module 63 and an image determination module 64 .

[0093] Wherein, the obtaining module 61 is configured to obtain the light field image collected by the light field camera and the grayscale image collected by the event camera, and determine the current area distribution image and each dynamic object containing at least one dynamic object according to the light field image and the grayscale image. The motion speed corresponding to the dynamic object; the index determination module 62, used to determine the motion significance index according to the light field image, the current area distribution image and the motion speed corresponding to each of the dynamic objects; the object screening module 63, used to Filter each ...

technical field

[0001] Embodiments of the present invention relate to image processing technologies, and in particular to a light field imaging method for cross-scale adaptive mapping. Background technique

[0002] With the improvement of social informatization, big data collection, analysis, and storage have gradually become the bottleneck restricting its further development. In the field of video surveillance, performance indicators such as camera resolution and frame rate are gradually improving. However, high-definition video sequences put forward higher requirements for storage and subsequent analysis in terms of hardware computing power and efficient algorithms. In many surveillance scenarios, the monitored object or environment is static and stable most of the time, but the high-definition surveillance camera equipment is still shooting continuously, generating a large amount of data to be saved in real time. Although the volume of these data is huge, the amount of e...

Examples

Embodiment 1

[0022] figure 1 It is a flow chart of a cross-scale adaptive mapping light field imaging method provided by Embodiment 1 of the present invention. This embodiment is applicable to the situation of screening target moving objects in images and determining the target image. The light field imaging device adapted to the mapping is performed, and specifically includes the following steps:

[0023] Step S110, acquire the light field image collected by the light field camera and the grayscale image collected by the event camera, and determine the current area distribution image containing at least one dynamic object and the corresponding motion speed of each dynamic object according to the light field image and the grayscale image.

[0024] In this embodiment, the light field camera does not need to select the focal point before taking pictures, and can take pictures first. The camera captures a large amount of light data and selects the focal point. It is more flexible when taking ...

Embodiment 2

[0035] figure 2 It is a flow chart of a cross-scale adaptive mapping light field imaging method provided by Embodiment 2 of the present invention. The technical solution of this embodiment is further refined on the basis of the above-mentioned technical solution, and specifically mainly includes the following steps:

[0036] Step S210, receiving the trigger event sent by the event camera and accumulatively adding 1 to the trigger times of the trigger event.

[0037] In this embodiment, the trigger event can be understood as an event that is generated and sent by the event camera when it detects the movement of an object. The number of triggers can be understood as the number of occurrences of a trigger event.

[0038] Event cameras do not have the array output limitation of conventional image sensors. When each photodiode detects a change in intensity, a trigger event is generated immediately and output to a processing device such as a computer through a USB bus structure. ...

Embodiment 3

[0092] Figure 4A schematic structural diagram of a cross-scale adaptive mapping light field imaging device provided by Embodiment 3 of the present invention, the device includes: an acquisition module 61 , an index determination module 62 , an object screening module 63 and an image determination module 64 .

[0093] Wherein, the obtaining module 61 is configured to obtain the light field image collected by the light field camera and the grayscale image collected by the event camera, and determine the current area distribution image and each dynamic object containing at least one dynamic object according to the light field image and the grayscale image. The motion speed corresponding to the dynamic object; the index determination module 62, used to determine the motion significance index according to the light field image, the current area distribution image and the motion speed corresponding to each of the dynamic objects; the object screening module 63, used to Filter each ...

Images