Image processing device and method thereof

Abstract

The invention discloses an image processing device and a method thereof. The device comprises a first camera, a second camera and an image processing circuit. The first camera shoots a first film in a visible light mode, the second camera shoots a second film in a visual detection mode, and event data is output according to the movement change of a moving object in the second film. The image processing circuit respectively controls the first camera and the second camera to synchronously shoot the target area. When the second camera shoots that the moving object in the target area moves and changes, the second camera outputs event data to the image processing circuit, and the image processing circuit compensates a blurred image in a first film corresponding to the shooting position in the first camera according to the event data to obtain a clear image. And covering the display position where the fuzzy image appears in the first film with the clear image to form a composite film and outputting the composite film. According to the invention, image processing is only carried out on fuzzy images, and the image processing amount is reduced.

Description

Technical Field

[0001] The present invention relates to the field of image processing, and in particular to an image processing device and a method thereof. Background Art

[0002] When existing high-speed cameras need to capture fast-moving objects, they need to increase the shutter and image acquisition speed and reduce the exposure time. This requires increasing the ambient light source at the same time to achieve the high-speed image capture function.

[0003] Therefore, the high-speed cameras currently used generally have the problems of high cost, large size, high power consumption, high ambient light source requirements and high computing requirements. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide an image processing device and method thereof in view of the deficiencies in the prior art.

[0005] An image processing device provided by an embodiment of the present invention includes a first camera, a second camera, and an image processing circuit. The first camera shoots a first video in a visible light manner, and the second camera shoots a second video in a visual detection manner, and outputs event data according to the movement change of a moving object in the second video; the image processing circuit is electrically connected to the first camera and the second camera, respectively, and controls the first camera and the second camera to synchronously shoot a target area; when the second camera shoots a moving object in the target area, the second camera outputs event data to the image processing circuit, and the event data at least includes time data and position data of the moving object in the target area;

[0006] When the image processing circuit receives the event data, the image processing circuit compensates for the blurred image generated by the movement of the moving object in the first video corresponding to the shooting position of the first camera according to the event data to obtain a clear image, and then covers the display position where the blurred image appears in the first video with the clear image, and outputs a composite video;

[0007] The first camera shoots a first video at a first frame rate, and the second camera shoots a second video at a second frame rate, wherein the second frame rate is greater than the first frame rate.

[0008] An image processing method provided by an embodiment of the present invention is applied to any of the above-mentioned image processing devices, wherein an image processing circuit controls a first camera and a second camera to synchronously shoot a target area, and the image processing method comprises the following steps:

[0009] The first camera shoots the first video;

[0010] The second camera shoots a second video and outputs event data according to the movement change of the moving object in the second video; wherein the event data at least includes time data and position data of the movement change of the moving object in the target area;

[0011] The image processing circuit receives the event data and compensates for the blurred image of the moving object in the first video according to the event data to obtain a clear image;

[0012] The image processing circuit overlays the clear image on the display position of the blurred image in the first video and outputs it as a composite video;

[0013] The first camera shoots a first video at a first frame rate, and the second camera shoots a second video at a second frame rate; the second frame rate is greater than the first frame rate.

[0014] The beneficial effect of the present application is that the image processing device and method provided by the embodiments of the present invention can quickly restore a blurred image to a clear image by only performing image processing on the blurred image, which can effectively reduce the image processing amount of the hardware device. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0016] Figure 1 A schematic diagram of an image processing device provided by an embodiment of the present invention;

[0017] Figure 2 A functional block diagram of an image processing circuit provided by an embodiment of the present invention;

[0018] Figure 3 A flowchart of the steps of the image processing method provided by an embodiment of the present invention;

[0019] Figure 4 FIG. 4 is a schematic diagram of film shooting according to an embodiment of the present invention.

[0020] It should be noted that the drawings are not necessarily drawn to scale, but are merely shown in a schematic manner that does not affect the reader's understanding.

[0021] Description of the drawings: 1. Image processing device; 11. First camera; 13. Second camera; 15. Image processing circuit; 20. Background image; 22. Moving object; A1. Target area. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0023] In the present application, the terms "upper", "lower", "left", "right", "front", "back", "top", "bottom", "inner", "outer", "middle", "vertical", "horizontal", "lateral", "longitudinal" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the drawings. These terms are mainly used to better describe the present application and its embodiments, and are not used to limit the indicated devices, elements or components to have a specific orientation, or to be constructed and operated in a specific orientation.

[0024] In addition, some of the above terms may be used to express other meanings in addition to indicating orientation or positional relationship. For example, the term "on" may also be used to express a certain dependency or connection relationship in some cases. For those of ordinary skill in the art, the specific meanings of these terms in this application can be understood according to specific circumstances.

[0025] In addition, the terms "installed", "set", "provided with", "connected", and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral structure; it can be a mechanical connection, or an electrical connection; it can be a direct connection, or an indirect connection through an intermediate medium, or it can be an internal connection between two devices, elements, or components. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0026] In addition, the terms "first", "second", etc. are mainly used to distinguish different devices, elements or components (the specific types and structures may be the same or different), and are not used to indicate or imply the relative importance and quantity of the indicated devices, elements or components. Unless otherwise specified, "plurality" means two or more.

[0027] It should also be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, the singular forms "a", "an" and "the" are intended to include plural forms unless the context clearly indicates otherwise.

[0028] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0029] The embodiment of the present invention provides an image processing device and method thereof. The image processing device described herein uses two cameras to jointly shoot a target area, wherein one camera is a currently commonly used optical camera, and the other camera is a visual sensing camera that can output the moving trajectory change data of the moving object only when the moving object in the target area moves. When a blurred image of a moving object appears in the video shot by the optical camera due to movement, the moving trajectory change data of the moving object can be provided through another visual sensing camera to perform image processing on the blurred image, and the blurred image can be made into a clear image. This process only requires image processing of the area covered by the blurred image, which can effectively reduce the amount of image data that needs to be calculated, and can achieve the technical effects of high-speed photography and deblurring.

[0030] Please refer to Figure 1 and Figure 2 , Figure 1 A schematic diagram of an image processing device is provided for an embodiment of the present invention. Figure 2 The functional block diagram of the image processing circuit is provided for an embodiment of the present invention. The image processing device 1 described herein includes, for example, but is not limited to, a first camera 11, a second camera 13, and an image processing circuit 15. The image processing circuit 15 is electrically connected to the first camera 11 and the second camera 13, respectively, and controls the first camera 11 and the second camera 13 to synchronously shoot a target area A1, and can perform an image clarity processing procedure on the blurred image obtained by the first camera 11 shooting the moving object 22. This image clarity processing procedure is, for example, to shoot the moving object 22 through the second camera 13 to obtain the corresponding moving trajectory change data, and to reconstruct the image based on the moving trajectory change data and the blurred image to obtain the corresponding clear image. The moving trajectory change data described herein is exemplified by information such as the moving direction and vector of the moving object 22. The moving object 22 can be, for example, any object, whether living or inanimate.

[0031] In one embodiment, the first camera 11 shoots a first video in a visible light manner. The first camera 11 is, for example but not limited to, a color camera (RGB camera), and the first camera 11 shoots the first video at a first frame rate.

[0032] In one embodiment, the second camera 12 shoots a second video in a visual sensing manner, and the second camera 13 can output an event data according to the movement change of a moving object 22 in the second video. Further, the second camera 13 is, for example but not limited to, an event-based vision sensor (EVS), and the event data includes the pixel position (x, y), time (t) and polarity (p) of the pixel where the event occurs, wherein the polarity is the increase or decrease in brightness of the pixel before and after the event occurs. The internal structure and operation of the event-based vision sensor (EVS) are known to those skilled in the art, so they are not described in detail here. The second camera 13 shoots the second video at a second frame rate, and the second frame rate is greater than the first frame rate.

[0033] Specifically, since the second camera 13 uses an event-oriented line visual sensor for image sensing, the second camera 13 can be used as an EVS camera. In addition, when the event-oriented line visual sensor outputs event data, it means that the pixel brightness of the event has a change above a preset threshold value. Therefore, when the second camera 13 captures the movement of the moving object 22, it will output corresponding event data.

[0034] Since the first camera 11 and the second camera 13 are synchronously shooting the target area A1, when the first camera 11 captures a moving object 22 moving at high speed in the target area A1, the moving object 22 in the video captured by the first camera 11 is likely to become a blurred image. However, at the same time, the second camera 13 will also generate event data during the high-speed movement of the moving object 22. Here, the image processing circuit 15 can refer to the relevant information such as the moving direction and vector of the moving object 22 provided by the second camera 13 and combine it with the AI ​​image processing technology to generate a clear image from the blurred image of the moving object 22 originally obtained in the video captured by the first camera 11. For example, the image processing circuit 15 can obtain relevant information such as the moving direction and vector of the moving object 22 according to the event data provided by the second camera 12, and then use the event data to perform AI image processing to deblur the blurred image presented in the first video, so that the moving object 22 will present a clear image in the video captured by the first camera 11.

[0035] In one embodiment, when the second camera 13 shoots a moving object 22 in the target area A1 that moves, the second camera 13 outputs event data to the image processing circuit 15. When the image processing circuit 15 receives the event data, the image processing circuit 15 compensates for a blurred image in the first video of the same shooting time and corresponding shooting position in the first camera 11 according to the event data to obtain a clear image, and then overlays the clear image on the display position where the blurred image appears in the first video, and outputs it as a composite video.

[0036] Regarding the specific image processing method of the image processing circuit 15, Figure 2 The architecture is illustrated with an example. Figure 2 The image processing circuit 15 shown includes, for example, but is not limited to, an image quality screening circuit 151, a motion track output circuit 153, a mapping circuit 155, an integration circuit 157 and a background compensation circuit 159, wherein the mapping circuit 155 is electrically connected to the image quality screening circuit 151 and the motion track output circuit 153, and the integration circuit 157 is electrically connected to the mapping circuit 155 and the background compensation circuit 159.

[0037] In one embodiment, the image quality screening circuit 151 is electrically connected to the first camera 11, and the image quality screening circuit 151 can be used to identify and screen the blurred images in the first video that reflect the movement of the moving object 22. For example, since the blurred images have relatively lower image quality (Image Quality; IQ), the images that are lower than the preset image quality can be identified as blurred images.

[0038] In one embodiment, the moving track output circuit 153 is electrically connected to the second camera. The moving track output circuit 153 outputs event data generated by the moving object 22 in the target area A1 due to the moving change according to whether the shooting result of the second camera 13 has a moving change. Specifically, this event data can reflect the moving track change data of the moving object 22 (for example, the moving direction and vector of the moving object 22 and other related information), and can be used as reference data for subsequent reconstruction of blurred images into clear images by AI image processing.

[0039] In one embodiment, the mapping circuit 155 performs an image reconstruction process on the blurred image obtained by the first camera 11 after identification and screening according to the event data output by the moving trajectory output circuit 153. The image reconstruction process described herein is, for example, an image compensation process for the data of each pixel in the blurred image and the data of the associated pixel position in the event data to obtain a clear image. Since the event data includes the pixel position (x, y), time (t) and polarity (p) of the pixel where the event occurs, that is, the moving position, speed and direction of the moving object 22 and other moving trajectory related information can be presented through the event data, the image compensation process described herein can restore each pixel data in the blurred image to the correct position of the moving object 22 during the movement according to the event data. For example, during the image compensation process, the aforementioned operation can be completed through AI image processing technology (such as image integration or distributed image processing), but the present invention is not limited to this. In short, the mapping circuit 155 can reconstruct the blurred images obtained by the first camera 11 and the second camera 13 at the same shooting time and the event data reflecting the moving trajectory of the moving object 22 through image reconstruction, and then map each image pixel position of the blurred image to the correct position.

[0040] In one embodiment, since the blurred image is only a portion of the image area in a complete image area captured by the first camera 11, the mapping circuit 155 only needs to perform image reconstruction processing on the partial image area captured by the first camera 11 (i.e., the image area of ​​the blurred image generated by the movement of the moving object 22), which can effectively improve the image processing speed.

[0041] In one embodiment, the background compensation circuit 159 obtains a background image 20 excluding the moving object 22 through the first camera 11 .

[0042] In one embodiment, the integration circuit 157 performs an image fusion process according to the clear image output by the mapping circuit 155 and the background image 20 output by the background compensation circuit 159 to obtain a composite video. The composite video mentioned here refers to the combination of the clear image on the background image 20, and the position of the clear image positioned on the background image 20 is based on the moving position of the moving object 22 captured by the first camera 11. That is, the image fusion process here covers the clear image at the display position where the blurred image appears in the first video according to the event data, so as to restore the real movement change of the moving object 22 in the target area A1.

[0043] In one embodiment, the frame rate of the background image 20 is, for example, the same as the first frame rate, and the frame rate of the clear image and the frame rate of the synthetic video are, for example, respectively the same as the second frame rate. That is, the synthetic video obtained after the above-mentioned image fusion processing can present the moving object 22 in the target area A1 with more clear image details during the movement process.

[0044] Another embodiment of the present invention further provides an image processing method, which is applied to any of the above-mentioned image processing devices. Figure 3 , Figure 3 A control flow chart of an image processing method is provided for an embodiment of the present invention.

[0045] Figure 3 The flowchart shown is in conjunction with Figure 1 to Figure 2 The structure of FIG. 1 is illustrated by way of example, but is not limited thereto. Figure 3 The process shown includes, for example, the following steps.

[0046] Step S301 , shooting a first video: The first camera 11 shoots a first video of the target area A1 .

[0047] Step S303, identifying the moving object 22 to obtain a blurred image. The first video is image-recognized and screened to identify whether there is a moving object 22 in the first video and a blurred image caused by the moving object 22 (for example, the moving object 22 moves quickly in the target area A1). Specifically, the quality of the first video is evaluated by an image quality screening circuit. The image pixel quality (IQ) of the first video is lower than a preset value and can be identified as a blurred image, but the present invention is not limited thereto. That is, the image processing circuit 15 can obtain the blurred image in the first video through the execution of step S303.

[0048] Step S305, shooting a second video. The second video is shot for the same target area A1 by the second camera 13. Here, the second camera 13 is an EVS camera. The EVS can capture the movement changes of the moving object 22 at high speed, and obtain the event data generated by the movement of the moving object 22. The event data records the pixel position (x, y), time (t) and polarity (p) of the pixel where the event occurs, including the moving direction and vector of the moving object 22. The event data can be used for subsequent processing of the image clarity.

[0049] Step S307 , outputting event data. According to the second video shot by the second camera 13 , if there is a change in the movement of the moving object 22 , one or more event data can be output to the image processing circuit 15 accordingly, and the event data can effectively reflect the change in the movement trajectory of the moving object 22 .

[0050] Step S309, background reconstruction. After step S303 is executed, since the blurred image in the first video has been filtered out, that is, the position of the original blurred image in the first video may produce a blank or missing image, the image processing circuit 15 needs to reconstruct the background of the original blurred image position in the first video, that is, the complete background image excluding the moving object 22 can be obtained in the reconstructed first video.

[0051] Step S311, reconstructing the moving object 22. Based on the blurred image obtained in step S303 and the event data obtained in step S307, the image processing circuit 15 can use the event data to perform an image reconstruction process on the blurred image obtained by the first camera 11 after identification and screening. For example, the image processing circuit 15 can refer to the relevant information such as the moving direction and vector of the moving object 22 and combine it with AI image processing technology. In this way, the blurred image of the moving object 22 obtained in the video shot by the first camera 11 can be generated into a clear image.

[0052] Further, the image reconstruction process performed by the image processing circuit 15 is to perform an image compensation process on the data of each pixel in the blurred image and the data of the associated pixel position in the event data to obtain a clear image. For example, the image processing circuit 15 receives the event data output by the second camera 13, and performs image compensation on the blurred image selected from the first video in step S303 according to the event data to obtain a clear image.

[0053] Specifically, the image compensation process restores each pixel data in the blurred image to the correct position of the moving object 22 during the moving process through the event data, so that the originally blurred image can be turned into a clear image. Therefore, after the processing of step S311, the image processing circuit 15 can process the blurred images obtained by the first camera 11 and the second camera 13 at the same shooting time and the event data reflecting the moving trajectory of the moving object 22, and then perform image reconstruction processing (steps S309 and S311), so that each image pixel position of the blurred image can be smoothly mapped to the correct position to obtain a clear image.

[0054] In step S313, high-speed image fusion and positioning. The image processing circuit 15 performs image fusion processing based on the background image obtained after the background reconstruction in step S309 and the clear image obtained after the moving object reconstruction in step S311 to obtain a synthetic video. It should be noted that the synthetic video here refers to combining this clear image on the background image 20, and the position of this clear image positioned on the background image 20 is based on the moving position of the moving object 22 captured by the first camera 11. Among them, the image fusion processing is to cover the clear image with the display position of the blurred image in the first video according to the event data, so that the real movement change of the moving object 22 in the target area A1 can be restored.

[0055] Step S315, image output. The synthesized video obtained by the image processing circuit 15 after executing step S313 can be used as the image output of the image processing device 1. Specifically, the synthesized video can replace the blurred image in the original first video with a clear image, and the synthesized video can dynamically capture the detailed movement process of the moving object 22 at high speed without distortion through the reconstruction of the moving object 22 executed in the aforementioned step S311.

[0056] In one embodiment, the frame rate of the background image 20 in step S309 is the same as the first frame rate, and the frame rate of the clear image in step S311 and the frame rate of the synthesized video in step S313 are the same as the second frame rate. Therefore, when the synthesized video is obtained after the image fusion process is performed in step S313, the synthesized video can present the moving object 22 in the target area A1 with more clear image details compared to the first video.

[0057] In one embodiment, the image processing device 1 may further perform image compression on the synthesized video, and store the compressed synthesized video in a memory or perform image playback.

[0058] In one embodiment, Figure 3 The flowchart in FIG. 1 is based on the assumption that a moving object 22 moves in the target area A1. At this time, the second camera 13 needs to provide event data generated by the movement of the moving object 22 to perform image processing to make the blurred image in the first video clear. However, when there is no moving object 22 moving in the target area A1, the second camera 13 does not provide any event data at this time, that is, the first camera 11 does not produce a blurred image in the first video at this time, so there is no need to perform image processing to make the first video clear, but the first video can be directly output as a composite video.

[0059] Here, an example is given to illustrate the processing method of the image processing device 1. Please refer to Figure 4 , Figure 4 FIG. 1 is a schematic diagram of film shooting according to an embodiment of the present invention. Figure 4 It can be seen that the first camera 11 and the second camera 13 in the image processing device 1 respectively shoot videos of the same target area at different frame rates, that is, the second video can capture more picture frames than the first video, that is, the second video can capture more image changes than the first video.

[0060] When the moving object 22 moves and changes at high speed in the target area A1 from time TA to time TB, the moving object 22 will present a blurred image in the first video. However, the second camera 13 is an EVS camera, so the second camera 13 can follow the movement of the moving object 22 from time TA to time TB to generate multiple event data, and this event data can be used to reflect the continuous change of the moving trajectory of the moving object 22 from time TA to time TB. Therefore, the image processing device 1 can use this multiple event data as a basis for performing image processing to make the blurred image in the first video clear, and the blurred image in the first video can be copied by the clear image of the moving object 22 after this image processing. Accordingly, the composite video finally obtained by the image processing device 1 can fully and clearly present the high-speed movement of the moving object 22 from time TA to time TB compared to the first video.

[0061] In addition, during other times other than the time TA to the time TB, the object 22 does not move. At this time, the image processing device 1 can directly use the first video shot by the first camera 11 as the composite video.

[0062] In one embodiment, the image processing circuit 15 may be, for example, one or any combination of an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or a system on a chip (SOC), and may cooperate with other related circuit elements and firmware to implement the above functional flow.

[0063] The image processing device and method provided by the present invention can complete the filming of high-speed objects at a lower cost than the existing high-speed cameras, and only the blurred image needs to be processed to quickly restore it to a clear image, which can effectively reduce the image processing amount of the hardware equipment. Furthermore, this filming method of the present case does not require a high light source, so it can be widely used in filming in various low-light environments.

[0064] It should be understood that the above is only an example and does not constitute any limitation on the technical solution of the present invention. In specific applications, technicians in this field can make settings as needed, and the present invention does not limit this.

[0065] It should be noted that the steps described above are merely illustrative and do not limit the scope of protection of the present invention. In practical applications, technicians in this field can select part or all of them according to actual needs to achieve the purpose of the present embodiment, and no limitation is made here.

[0066] The above is only a preferred embodiment of the present application, and does not constitute any formal limitation on the present application. The protection scope of the present application shall be subject to the protection scope of the claims. Although the present application has been disclosed as a preferred embodiment, it is not intended to limit the present application. Any technician familiar with the profession can make some changes or modifications to equivalent embodiments of equivalent changes using the technical content disclosed above without departing from the scope of the technical solution of the present application. However, any simple modification, equivalent changes and modifications made to the above embodiments based on the technical essence of the present application without departing from the content of the technical solution of the present application are within the scope of the technical solution of the present application.

Claims

1. An image processing device, characterized in that: The image processing device comprises: A first camera is used to shoot a first video in a visible light mode; A second camera captures a second video by visual detection and outputs event data according to the movement changes of the moving object in the second video; An image processing circuit is electrically connected to the first camera and the second camera respectively, and controls the first camera and the second camera respectively to synchronously shoot the target area; When the second camera captures the moving object in the target area and the moving object changes, the second camera outputs the event data to the image processing circuit, and the event data at least includes the time data and the position data of the moving object in the target area; When the image processing circuit receives the event data, the image processing circuit compensates for the blurred image of the moving object in the first video corresponding to the shooting position of the first camera due to the movement to obtain a clear image according to the event data, and then covers the display position of the blurred image in the first video to form a composite video and output it; The first camera shoots the first video at a first frame rate, and the second camera shoots the second video at a second frame rate, and the second frame rate is greater than the first frame rate.

2. The image processing device according to claim 1, characterized in that: The second camera is an event-based vision sensor (EVS), and the event data includes the pixel position, time and polarity of the event. The polarity is the increase or decrease in brightness of the pixel before and after the event occurs. The blurred image is a partial image area of ​​the complete image area captured by the first camera.

3. The image processing device according to claim 2, characterized in that: The image processing circuit includes an image quality screening circuit, which is electrically connected to the first camera and is used to screen the blurred image generated by the movement of the moving object reflected in the first video.

4. The image processing device according to claim 3, characterized in that: The image processing circuit further includes a movement track output circuit, which is electrically connected to the second camera and outputs the event data generated by the movement change of the moving object in the target area.

5. The image processing device according to claim 4, characterized in that: The image processing circuit further includes a mapping circuit, which is electrically connected to the image quality screening circuit and the movement trajectory output circuit. The mapping circuit performs image reconstruction processing on the blurred image obtained by the first camera according to the event data. The image reconstruction processing is used to perform image compensation processing on the data of each pixel in the blurred image and the data of the associated pixel position in the event data to obtain the clear image.

6. The image processing device according to claim 5, characterized in that: The image processing circuit further includes a background compensation circuit, and the background compensation circuit obtains a background image excluding the moving object through the first camera.

7. The image processing device according to claim 6, characterized in that: The image processing circuit further includes an integration circuit, the integration circuit is electrically connected to the mapping circuit and the background compensation circuit, the integration circuit performs image fusion processing according to the clear image output by the mapping circuit and the background image output by the background compensation circuit to obtain the synthesized video, the frame rate of the background image is the first frame rate, and the frame rates of the clear image and the synthesized video are both the second frame rate; The image fusion process is to locate the clear image in the background image according to the event data, so as to restore the real movement change of the moving object in the target area.

8. An image processing method, characterized in that: Applied to the image processing device according to any one of claims 1 to 7, the image processing circuit controls the first camera and the second camera to synchronously shoot the target area, and the image processing method comprises the following steps: The first camera shoots a first video; The second camera shoots a second video and outputs event data according to the movement change of the moving object in the second video; wherein the event data at least includes time data and position data of the movement change of the moving object in the target area; The image processing circuit receives the event data, and compensates the blurred image of the moving object in the first video according to the event data to obtain a clear image; The image processing circuit overlays the clear image on the display position of the blurred image in the first video to form a composite video and output it; The first camera shoots the first video at a first frame rate, and the second camera shoots the second video at a second frame rate; the second frame rate is greater than the first frame rate.

9. The image processing method according to claim 8, characterized in that: The second camera is an event-based vision sensor (EVS), and the event data includes the pixel position, time and polarity of the event. The polarity is the increase or decrease in brightness of the pixel before and after the event occurs. The blurred image is a partial image area of ​​the complete image area captured by the first camera.

10. The image processing method according to claim 9, characterized in that: The image processing method further comprises: Screening out blurred images caused by the movement of the moving object in the first video; Performing image reconstruction processing on the blurred image to obtain a clear image; Acquiring a background image excluding the moving object through a first camera; Performing image fusion processing according to the background image and the clear image to obtain a composite image; The image reconstruction process is to perform image compensation processing on each pixel data in the blurred image and the data of the pixel position associated with the event data to obtain the clear image; Among them, the frame rate of the background image is the first frame rate, the frame rate of the clear image and the frame rate of the synthetic image are both the second frame rate, and the image fusion processing is to position the clear image in the background image according to the event data to restore the actual movement changes of the moving object in the target area.

Images