Image acquisition control method, device, equipment and program product

Abstract

The invention relates to the field of image acquisition, in particular to an image acquisition control method and device, equipment and a program product. The method comprises the following steps: detecting a target object in a monitoring image; when the change information of the target object meets a preset exposure parameter value switching requirement, the switched exposure parameter value is determined, and the exposure parameter value comprises light supplementing intensity and an electronic exposure parameter value; transmitting the electronic exposure parameter value to an image sensing module, and determining the response duration of the electronic exposure parameter value of the image sensing module; and determining the delay response time of the light supplementing intensity according to the response duration, and controlling the change of the light supplementing intensity according to the delay response time. According to the method, the change of the light supplementing intensity can be controlled according to the delay response time, so that the switched light supplementing intensity and the electronic exposure parameter can take effect simultaneously, the situation that the image is too bright due to overexposure or too dark due to underexposure caused by sudden change of the light supplementing intensity can be effectively reduced, the loss of image information is reduced, and the image quality is improved. And the picture watching experience can be improved.

Description

Technical Field

[0001] The present application relates to the field of image acquisition, and in particular, to a control method, device, equipment, and program product for image acquisition. Background Art

[0002] In the field of video surveillance, in order to obtain clear images of monitoring targets, after detecting a monitoring target, the exposure of the image of the scene where the monitoring target is located is usually adjusted, including adjusting the fill light intensity of the fill light, etc., so that more detailed information of the monitoring target can be retained in the captured video image. For example, after detecting a face, by increasing the fill light intensity of the fill light, the captured image can be used for more accurate face recognition.

[0003] However, when the fill light switches from a weak light scene to a strong light scene, since the brightness of the picture suddenly increases, multiple frames of overexposure will occur in the picture. During the overexposure period, no effective image information can be obtained, and it is necessary to wait for a certain period of time to obtain the required image, which is likely to lose important image information during the overexposure period and is not conducive to improving the viewing experience of the picture. Summary of the Invention

[0004] In view of this, embodiments of the present application provide a control method, device, equipment, and program product for image acquisition to solve the problem that in the prior art, when performing image acquisition, due to scene switching, multiple frames of overexposure will occur in the picture, important image information is likely to be lost, and it is not conducive to improving the viewing experience of the picture.

[0005] The first aspect of the embodiments of the present application provides a control method for image acquisition, and the method includes:

[0006] Detect a target object in the monitoring image;

[0007] When the change information of the target object in the monitoring image meets the preset exposure parameter value switching requirement, determine the switched exposure parameter value, where the exposure parameter value includes fill light intensity and electronic exposure parameter value;

[0008] Transmit the electronic exposure parameter value to the image sensing module that acquires the monitoring image, and determine the response duration of the electronic exposure parameter value of the image sensing module;

[0009] Determine the delay response time of the fill light intensity according to the response duration, and control the change of the fill light intensity according to the delay response time.

[0010] In combination with the first aspect, in the first possible implementation manner of the first aspect, the target object in the monitoring image includes a first scene without a target object and a second scene with a target object;

[0011] When the change information of the target object in the monitoring image meets the preset requirements for switching exposure parameter values, determining the switched exposure parameter values includes:

[0012] When the change information of the target object in the monitoring image is changed from the first scene to the second scene, determining the second exposure parameter value of the second scene after switching includes increasing the first fill light intensity of the first scene to the second fill light intensity of the second scene, and adaptively adjusting the first electronic exposure parameter value of the first scene to the second electronic exposure parameter value of the second scene.

[0013] Combined with the first possible implementation manner of the first aspect, in the second possible implementation manner of the first aspect, the second electronic exposure parameter value includes a second exposure time;

[0014] Determining the second exposure parameter value of the second scene after switching includes increasing the first fill light intensity of the first scene to the second fill light intensity of the second scene, and adaptively adjusting the first electronic exposure parameter value of the first scene to the second electronic exposure parameter value of the second scene, including:

[0015] Determining that the second fill light intensity of the switched scene with people is the maximum fill light intensity of the fill light device, and determining that the second exposure time in the switched scene with people is a specific exposure time in the predetermined scene mode with target objects.

[0016] Combined with the first possible implementation manner of the first aspect, in the third possible implementation manner of the first aspect, the second electronic exposure parameter value further includes a second gain;

[0017] Adapting the first electronic exposure parameter value of the first scene to the second electronic exposure parameter value of the second scene further includes:

[0018] Reducing the first gain in the first electronic exposure parameter value to the second gain in the second electronic exposure parameter value, so that the second exposure intensity determined by the second gain, the second exposure time, and the second fill light intensity is the same as the first exposure intensity determined by the first gain, the first exposure time, and the first fill light intensity.

[0019] Combined with the first possible implementation manner of the first aspect, in the fourth possible implementation manner of the first aspect, the image sensing module is a CMOS sensor with rolling shutter exposure;

[0020] Transmitting the electronic exposure parameter value to the image sensing module that acquires the monitoring image, and determining the response duration of the electronic exposure parameter value of the image sensing module, includes:

[0021] Transmit the electronic exposure parameter value to the CMOS sensor of the monitoring camera, and determine the response duration of the electronic exposure parameter value of the image sensing module according to the number of frames that the CMOS sensor needs to delay in response to the electronic exposure parameter value and the interval duration between monitoring images.

[0022] Combined with the first aspect, in the fifth possible implementation manner of the first aspect, the target objects in the monitoring image include a first scene without target objects and a second scene with target objects;

[0023] When the change information of the target object in the monitoring image meets the preset exposure parameter value switching requirement, determine the switched exposure parameter value, including:

[0024] When the change information of the target object in the monitoring image is that the second scene changes to the first scene, detect the continuous cumulative duration of the transformed first scene;

[0025] When the continuous cumulative duration is greater than the predetermined duration threshold, determine that the exposure parameter value of the switched first scene includes reducing the second fill light intensity to the first fill light intensity and increasing the second electronic exposure parameter value to the first electronic exposure parameter value.

[0026] Combined with the fifth possible implementation manner of the first aspect, in the sixth possible implementation manner of the first aspect, increasing the second electronic exposure parameter value to the first electronic exposure parameter value includes:

[0027] Increase the second exposure time in the second electronic exposure parameter value to the third exposure time;

[0028] And / or, increase the second gain in the second electronic exposure parameter value to the third gain.

[0029] The second aspect of the embodiments of the present application provides a control device for image acquisition, and the device includes:

[0030] A target object detection unit, configured to detect target objects in a monitoring image;

[0031] A switching parameter determination unit, configured to determine a switched exposure parameter value when the change information of the target object in the monitoring image meets the preset exposure parameter value switching requirement, where the exposure parameter value includes a fill light intensity and an electronic exposure parameter value;

[0032] A response duration determination unit, configured to transmit the electronic exposure parameter value to an image sensing module that acquires the monitoring image, and determine the response duration of the electronic exposure parameter value of the image sensing module;

[0033] The fill light control unit is configured to determine the delay response time of the fill light intensity according to the response duration, and control the change of the fill light intensity according to the delay response time.

[0034] In a third aspect of the embodiments of the present application, there is provided a control device for image acquisition, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the control device for image acquisition implements the method according to any one of the first aspects.

[0035] In a fourth aspect of the embodiments of the present application, there is provided a computer program product which, when running on a computer, causes the computer to execute the method according to the first aspect or its various implementation manners.

[0036] In a fifth aspect of the embodiments of the present application, there is provided a computer-readable storage medium storing a computer program, and when the computer program is executed by a processor, the steps of the method according to any one of the first aspects are implemented.

[0037] In a sixth aspect of the embodiments of the present application, there is provided a chip for implementing the methods according to the various implementation manners in the first aspect. Specifically, the above chip includes: a processor for calling and running a computer program from a memory, so that a device installed with the above chip executes the method according to the first aspect or its various implementation manners.

[0038] The beneficial effects of the embodiments of the present application compared with the prior art are as follows: In the embodiments of the present application, by detecting the target object in the monitoring image, it is determined whether the change information of the target object in the monitoring image meets the requirements for switching the exposure parameter values. When the requirements for switching the exposure parameter values are met, the fill light intensity and the electronic exposure parameter value in the switched exposure parameter values are determined, the electronic exposure parameter value is transmitted to the image sensing module for collecting the monitoring image, and the response duration of the image sensing module in response to the electronic exposure parameter value is determined, that is, the duration from sending the electronic exposure parameter value to the effective time of the electronic exposure parameter value. The delay response time of the fill light intensity is determined according to the response duration, and the change of the fill light intensity is controlled according to the delay response time, so that the switched fill light intensity and the electronic exposure parameter can take effect simultaneously, thereby effectively reducing overexposure caused by sudden changes in the fill light intensity, making the image too bright or underexposure, making the image too dark, which is beneficial to reducing the loss of image information and improving the viewing experience of the picture. Description of the Drawings

[0039] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the accompanying drawings required for use in the embodiments or the description of the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0040] Figure 1 It is a schematic diagram of an implementation scenario of a method for controlling image acquisition provided by an embodiment of the present application;

[0041] Figure 2 It is a schematic diagram of an implementation process of a method for controlling image acquisition provided by an embodiment of the present application;

[0042] Figure 3 It is a schematic diagram of an implementation process of a method for controlling image acquisition provided by an embodiment of the present application;

[0043] Figure 4 It is a schematic diagram of an implementation process for switching from an unmanned scenario mode to a manned scenario mode provided by an embodiment of the present application;

[0044] Figure 5 It is a schematic diagram of an implementation process for switching from a manned scenario mode to an unmanned scenario mode provided by an embodiment of the present application;

[0045] Figure 6 It is a schematic diagram of a control device for image acquisition provided by an embodiment of the present application;

[0046] Figure 7 It is a schematic diagram of a control device for image acquisition provided by an embodiment of the present application. Detailed implementation manners

[0047] In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. However, those skilled in the art should clearly understand that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from interfering with the description of the present application.

[0048] To illustrate the technical solutions described in the present application, the following will be described through specific embodiments.

[0049] In the field of video surveillance, when the light in the surveillance scene is weak (such as at night), in order to obtain a clear image of the monitoring target, after detecting the monitoring target, the image of the scene where the monitoring target is located is usually adjusted for exposure, including adjusting the supplementary light intensity of the supplementary light, etc., so that the captured video image can obtain a higher exposure intensity, improving the clarity of the video image, and thus facilitating the retention of more detailed information of the monitoring target. For example, after detecting a face, by increasing the supplementary light intensity of the supplementary light, the captured image can be used for more accurate face recognition.

[0050] After detecting that the monitoring target has left, the supplementary light can be turned off, so that the captured video image can meet the requirements of monitoring target detection while reducing the energy consumption of the supplementary light.

[0051] However, when the supplementary light switches from a weak light scene to a strong light scene, due to the sudden increase in the brightness of the picture, multiple frames of overexposure will occur in the picture. During the overexposure period, no effective image information can be obtained, and it is necessary to wait for a certain period of time to obtain the required image. It is easy to lose important image information during the overexposure period, and when the supplementary light is turned off, the exposure intensity is likely to be too low and the image becomes too dark, which is not conducive to improving the viewing experience of the picture.

[0052] To solve the above problems, an embodiment of the present application proposes a control method for image acquisition. Figure 1 FIG. is a schematic diagram of an implementation scenario of a control method for image acquisition provided by an embodiment of the present application. The implementation scenario includes a control device 1 for image acquisition that acquires monitoring images. The control device for image acquisition includes a supplementary light 11, an image sensing module 12, and a controller 13. Among them, the image sensing module 12 can be used to acquire monitoring images according to preset exposure parameters, and the controller 13 can be used to perform target object detection on the monitoring images. The target object can include pedestrians, vehicles, or other specific targets, such as Figure 1 When the target object is a pedestrian, it is determined whether the monitoring image includes the target object. When the change information of the target object in the monitoring image meets the exposure parameter value switching requirement, the switched exposure parameter value is determined, the electronic exposure parameter value is transmitted to the image sensing module 12, and the response duration of the image sensing module in response to the electronic exposure parameter value is determined. According to this response duration, the delayed response time of the supplementary light 11 is controlled, and according to this delayed response time, the supplementary light 11 is controlled to perform supplementary light, so that the effective time of the supplementary light 11 is consistent with the effective time of the electronic exposure parameter value, reducing the overexposure or underexposure of the picture caused when the supplementary light intensity increases while the electronic exposure parameter value has not taken effect, and thus effectively improving the viewing experience of the picture.

[0053] Figure 2The figure is a schematic flowchart of an implementation process of a method for controlling image acquisition provided by an embodiment of the present application. The execution subject of this method can be a control device for image acquisition. The method is described in detail as follows:

[0054] In S201, detect a target object in the monitored image.

[0055] An embodiment of the present application can monitor a monitored scene through a control device for image acquisition, including a control device for image acquisition such as a camera, to obtain a monitored image of the monitored scene.

[0056] The camera can be a security camera or a traffic camera, etc. When the camera is a security camera, the detected target objects can include human figures, faces, or specific events, etc. When the camera is a traffic camera, the detected target objects can include vehicles and pedestrians, etc.

[0057] In S202, when the change information of the target object in the monitored image meets the switching requirement of the preset exposure parameter value, determine the switched exposure parameter value.

[0058] Among them, the target object in the monitored image includes a first scene with a target object and a second scene without a target object. The change information of the target object includes changing from the first scene to the second scene and changing from the second scene to the first scene.

[0059] The exposure parameter value can include the exposure parameter value of the first clarity image and the exposure parameter value of the second clarity image. Among them, compared with the second clarity, the first clarity has higher image quality, richer image details, and less noise. For example, the first clarity corresponds to a high-definition image, and the second clarity corresponds to a normal image. It is not limited to the exposure parameter values of two clarities, and can also include the exposure parameter values of more than two clarities to adapt to image acquisition in scenarios including target objects, where there are different types of target objects, and scenarios without target objects. The corresponding relationship between different types of target objects and exposure parameter values can be set to facilitate obtaining clear images of different types of target objects. For example, for a target object with a faster movement speed, a smaller exposure time can be set, and for a target object with a slower movement speed, a larger exposure time can be set.

[0060] Among them, the exposure parameter value of the first clarity image is the first exposure parameter value, and the exposure parameter value of the second clarity image is the second exposure parameter value. The first exposure parameter value can have a greater fill light intensity, a smaller exposure time, or a smaller exposure gain relative to the second exposure parameter value. For example, the first exposure parameter value includes a first fill light intensity, a first exposure time, and a first exposure gain, and the second exposure parameter value includes a second fill light intensity, a second exposure time, and a second exposure gain. The first fill light intensity can be greater than the second fill light intensity, the first exposure time can be less than the second exposure time, and the first exposure gain can be less than the second exposure gain. It should be noted that the first exposure time and the second exposure time are automatically calculated by the automatic exposure algorithm according to the ambient brightness, and the magnitudes of the first exposure time and the second exposure time are not determined and need to be determined by the automatic exposure algorithm in combination with the specific scenario.

[0061] Therefore, when the switching method is to switch the first exposure parameter value to the second exposure parameter value, the fill light intensity of the fill light will be reduced from the first fill light intensity to the second fill light intensity, the exposure time will be increased from the first exposure time to the second exposure time, and the exposure gain will be increased from the first exposure gain to the second exposure gain.

[0062] When the switching method is to switch the second exposure parameter value to the first exposure parameter value, the fill light intensity of the fill light will be increased from the first fill light intensity to the second fill light intensity, the exposure time will be reduced from the first exposure time to the second exposure time, and the exposure gain will be reduced from the first exposure gain to the second exposure gain.

[0063] In order to reduce the impact on the image quality when switching the exposure parameter values, the first exposure intensity determined by the first exposure parameter value can be adapted to the second exposure intensity determined by the second exposure parameter value. For example, the first exposure intensity can be equal to the second exposure intensity, or the deviation between the two is less than a predetermined deviation threshold. For example, the ratio of the deviation between the first exposure intensity and the second exposure intensity to the first exposure intensity is less than a predetermined ratio threshold.

[0064] The switching requirements of the exposure parameter values can include a first switching requirement for switching from the second exposure parameter value of the second clarity image to the first exposure parameter value of the first clarity image, and a second switching requirement for switching from the first exposure parameter value of the first clarity image to the second exposure parameter value of the second clarity image.

[0065] Among them, the first switching requirement can include that when a target object is detected in the monitored image, the first switching requirement is satisfied, so as to quickly respond to the acquisition of high-quality images of the target object and improve the detection accuracy of the target object.

[0066] The second switching requirement may include that when it is detected that there is no target object in the monitored image and the continuous cumulative time of the absence of the target object is greater than a predetermined duration threshold, the second switching condition is satisfied. By setting a certain buffer time, it is possible to reduce the switching frequency of the exposure parameter values and improve the image stability in the case where the target object repeatedly appears in the scene.

[0067] Among them, the exposure parameter values include the fill light intensity and the electronic exposure parameter values.

[0068] The adjustment of the fill light intensity can be achieved by controlling the working power of the fill light. The fill light intensity may include the maximum fill light intensity of the fill light. At the maximum fill light intensity, the image clarity of the collected target object can be improved, but it consumes a large amount of power. Therefore, when no target object to be monitored is detected in the monitored scene, the fill light intensity can be reduced or the fill light can be turned off.

[0069] The electronic exposure parameter values may include the exposure time and the exposure gain. Among them, the exposure time is the time length during which the photosensitive element of the camera receives light. The size of the exposure time directly affects the brightness and motion blur degree of the image. The longer the exposure time, the more light the photosensitive element receives and the brighter the image; the shorter the exposure time, the darker the image.

[0070] In addition, the longer the exposure time, the higher the blur degree of the moving object. Therefore, in order to obtain a clearer monitored image, when the monitored image includes a fast-moving target object, the exposure time can be adjusted according to the speed of the monitored object.

[0071] The exposure gain is the magnification factor for amplifying the optical signal received by the image sensing module, that is, the photosensitive element. By amplifying the signal, the brightness of the image is increased, but at the same time, the noise is also amplified. The higher the gain value, the higher the image brightness. However, too high a gain value will cause an increase in image noise and affect the image quality. Therefore, in a scene where no target object is detected, if the light is dim, the gain can be appropriately increased to improve the image brightness.

[0072] In a possible implementation, if the target object is a human face or a pedestrian, it can be determined that the second fill light intensity in the human presence scene mode after switching is the maximum intensity of the fill light device, that is, the fill light. The exposure time in the human presence scene mode can be a preset exposure time. The preset exposure time can be adjusted according to the moving speed of the human figure. When the moving speed is faster, the exposure time can be set to a shorter duration, and when the moving speed is slower, the exposure time can be set to a longer duration.

[0073] After determining the fill light intensity and exposure time, the first exposure gain in the first exposure parameter value and the second exposure gain in the second exposure parameter value can be determined according to the principle of smooth transition between the first exposure intensity and the second exposure intensity, so that the change in the exposure intensity of the image after the scene is switched is small, enabling the collected surveillance images to be switched seamlessly. Although the fill light has a large change in fill light intensity, there will be no obvious flicker in the picture.

[0074] In S203, the electronic exposure parameter value is transmitted to the image sensing module that collects the surveillance image, and the response duration of the electronic exposure parameter value of the image sensing module is determined.

[0075] After determining that the current scene meets the switching condition and determining the exposure parameter value after switching, the electronic exposure parameter value in the exposure parameter value, including the exposure time and exposure gain, can be transmitted to the image sensing module in the control device for image acquisition, such as a CMOS sensor, etc.

[0076] When the image sensing module, such as a CMOS sensor, performs image acquisition by means of rolling shutter exposure, due to the inherent delay of frame - to - frame adaptive adjustment and the delay from the start of exposure to data acquisition, the currently set electronic exposure parameter value needs to be delayed by 2 frames to take effect. For example, if the current is the Nth frame, after modifying the exposure time and exposure gain at the Nth frame, it will take effect until the (N + 2)th frame.

[0077] Therefore, the response duration of the electronic exposure parameter value can be determined with the start time of the transmission of the electronic exposure parameter value to the image sensing module as the starting point time and the effective time of the electronic exposure parameter value as the ending point time. That is to say, after the electronic exposure parameter value is transmitted to the image sensing module, it takes the response duration for the electronic exposure parameter value to take effect.

[0078] After determining the number of frames to wait for the electronic exposure parameter value to take effect, combined with the interval duration between two adjacent surveillance images, the response duration can be determined.

[0079] In S204, the delay response time of the fill light intensity is determined according to the response duration, and the change of the fill light intensity is controlled according to the delay response time.

[0080] In order to make the effective time of the electronic exposure parameter value match the effective time of the fill light intensity, so that the exposure intensity of the captured surveillance image can be smoothly transitioned, the delay response time of the fill light intensity can be determined according to this response time. For example, if the response duration is 100 ms, while transmitting the electronic exposure parameter to the image sensing module, the delay response time of the fill light device can be set to 100 ms. After 100 ms, the switched fill light intensity takes effect, and the electronic exposure parameter value takes effect, so that the switched exposure intensity can be smoothly transitioned to the switched exposure intensity in the shortest possible time, thus significantly reducing the defects of overexposed or underexposed images and improving the image viewing experience.

[0081] Figure 3 The following is a schematic application flow diagram of a method for controlling image acquisition provided by an embodiment of the present application:

[0082] In S301, enter the night vision mode.

[0083] Since the fill light device is usually not required to fill light in the daytime mode, therefore, the method for controlling image acquisition in the embodiment of the present application is particularly applicable to scenarios with weak ambient light, so as to dynamically adjust the fill light intensity of the fill light device according to the detection result of the target object.

[0084] In S302, detect whether the intelligent dynamic fill light function is enabled.

[0085] Among them, the intelligent dynamic fill light function may include the method for smoothly adjusting the exposure intensity by using the fill light and exposure control methods adopted in the method for controlling image acquisition shown above Figure 2 This method can not only effectively meet the clarity requirements of images in different scenarios, but also reduce the duration of overexposure or underexposure of images.

[0086] In S303, if the intelligent dynamic fill light function is not enabled, enter the ordinary intelligent fill light mode.

[0087] Ordinary intelligent fill light can adjust the fill light intensity of the fill light device and the electronic exposure parameter value at the same time. In this mode, when switching from the unmanned scene mode to the manned scene mode, the fill light intensity of the fill light device is adjusted to the maximum value. At this time, the new electronic exposure parameter value does not take effect, and the electronic exposure parameter value of the unmanned scene mode that still takes effect will generate a large amount of exposure, overlapping with the fill light intensity of the maximum value, and the surveillance image will be severely overexposed. When switching from the manned scene mode to the unmanned scene mode, the picture will become very dark, and the switching is not smooth enough, affecting the viewing experience of the surveillance image.

[0088] In S304, after the intelligent dynamic fill light function is enabled, detect whether there is a human figure in the surveillance image.

[0089] After enabling the intelligent dynamic fill light function, the delay response time of the fill light intensity can be determined according to the effective time of the switched electronic exposure parameter value, and the switched fill light intensity becomes effective when the delay response time is reached, thereby reducing the overshoot time of the exposure intensity, reducing the duration of overexposure or underexposure, and improving the viewing quality of the picture.

[0090] In S305, if the current is the unmanned scene mode and a human figure is detected in the monitored image, determine the electronic exposure parameter value and fill light intensity in the manned scene mode, and transmit the electronic exposure parameter to the image sensing module.

[0091] When the system is in the unmanned scene mode, that is, when image acquisition is performed using the exposure parameter value of the unmanned scene mode, if a human figure is present in the monitored image, the exposure parameter values to be used when switching to the manned scene mode can be determined, including the fill light intensity and the electronic exposure parameter value, and the determined electronic exposure parameter value in the manned scene mode is transmitted to the image acquisition module, such as transmitted to the CMOS sensor.

[0092] In S306, determine the delay response time of the fill light intensity according to the response duration of the electronic exposure parameter.

[0093] According to the system characteristics, determine the effective time of the electronic exposure parameter value in the image acquisition module, thereby obtaining the response duration of the electronic exposure parameter value. Determine the delay response time of the fill light intensity in the manned scene mode according to this response duration.

[0094] In S307, when the delay response time is reached, enter the manned scene mode.

[0095] When the delay response time is reached, the electronic exposure parameter value and the fill light intensity become effective at the same time. At this time, the determined exposure intensity is basically the same as the exposure intensity before switching, but the switching action duration is short, which can effectively reduce the duration of overexposure or underexposure in the monitored image.

[0096] In S308, if the current is the manned scene mode, obtain and determine whether the cumulative duration of no human figure in the monitored image is greater than a predetermined duration threshold.

[0097] When the current is the manned scene mode, that is, the exposure parameter value of the system is the exposure parameter value of the manned scene mode. In order to reduce the system from repeatedly switching the exposure parameter value due to the frequent appearance of human figures, the cumulative duration of no human figure can be detected. If the cumulative duration is greater than the predetermined duration threshold, S309 can be executed. If it is less than or equal to the predetermined duration threshold, it remains in the manned scene mode.

[0098] In S309, determine the electronic exposure parameter value and fill light intensity in the unmanned scene mode, and transmit the electronic exposure parameter to the image sensing module.

[0099] In S310, the delay response time of the fill light intensity is determined according to the response duration of the electronic exposure parameters.

[0100] In S311, when the delay response time is reached, enter the unmanned scene mode.

[0101] S309 - S311 is basically the same as S305 - S307.

[0102] This method makes differential settings by determining the switching conditions between the manned scene mode and the unmanned scene mode, enabling the system to respond in a timely and effective manner to the acquisition of high-quality images when people appear, and reducing the number of adjustments to the exposure parameter values in scenes where people frequently appear, which is beneficial to improving the stability of the picture quality.

[0103] Figure 4 The following is a schematic diagram of a control method for switching from the unmanned scene mode to the manned scene mode provided by an embodiment of the present application:

[0104] In S401, it is determined that the current is the unmanned scene mode.

[0105] For example, in the unmanned scene mode, the current exposure parameter values can be: the exposure time is 60 ms, the exposure gain is 20 times, and the fill light intensity is 30% of the maximum fill light intensity. For example, 30% of the maximum fill light intensity is 60 W / m 2 .

[0106] In S402, a human figure is detected in the monitored image, and the exposure parameter values in the manned scene mode are calculated.

[0107] The exposure parameter values in the manned scene mode can be calculated according to parameters such as the moving speed of the human figure. For example, the determined exposure parameter values in the manned scene mode can be: the exposure time is 30 ms, the exposure gain is 10 times, and the fill light intensity is 100% of the maximum fill light intensity, for example, 200 W / m 2 , in addition, the response duration of the electronic exposure parameter values can also be determined. This response duration is associated with the actual exposure time of the current scene mode and is usually a predetermined multiple of the actual exposure time of the current scene mode. For example, the delay effective duration of the fill light intensity can be determined to be 80 ms.

[0108] In S403, the electronic exposure parameter values are transmitted to the CMOS sensor.

[0109] While the electronic exposure parameter values are being transmitted to the CMOS sensor, the delay effective duration of the fill light intensity starts to be timed. Before the timing is completed, the exposure parameter values are still the exposure parameter values of the unmanned scene mode determined in S401.

[0110] In S404, when the delay takes effect, the fill light intensity and the electronic exposure parameter values in the presence of people scene mode take effect.

[0111] At this time, the fill light intensity is adjusted to 100%. At this time, the adaptive exposure time and exposure gain in the CMOS sensor take effect simultaneously. Although the fill light intensity becomes 3 - 4 times stronger, the exposure time and exposure gain take effect at this time, so there is no sudden change in brightness in the picture.

[0112] In S405, switch to the presence of people scene mode.

[0113] Since the adjusted exposure intensity is almost the same as the exposure amount required in the presence of people scene mode, and the adjusted fill light intensity is the same as the fill light intensity in the presence of people scene mode, the picture hardly needs to be adjusted in brightness at this time. And during the process of adjusting the exposure parameter values, since the exposure intensities before and after the adjustment are basically the same, the picture will not have obvious overexposure or underexposure, and the take - effect time is the same, which can effectively improve the quality of surveillance images.

[0114] Figure 5 The following is a schematic diagram of a control method for switching from the presence of people scene mode to the absence of people scene mode provided by an embodiment of the present application:

[0115] In S501, it is determined that the current is the presence of people scene mode.

[0116] For example, in the presence of people scene mode, the current exposure parameter values can be: the exposure time is 30 ms, the exposure gain is 10 times, and the fill light intensity is 100% of the maximum fill light intensity, for example, 200 W / m 2 .

[0117] In S502, it is detected that the continuous cumulative time when there is no portrait in the surveillance image is greater than a predetermined duration threshold, and the exposure parameter values in the absence of people scene mode are determined.

[0118] For example, the exposure parameter values determined in the absence of people scene mode can be: the exposure time is 60 ms, the exposure gain is 20 times, and the fill light intensity is 30% of the maximum fill light intensity, for example, 60 W / m 2 , in addition, the response duration of the electronic exposure parameter values can also be determined, that is, the delay take - effect duration of the fill light intensity is 40 ms.

[0119] In S503, the electronic exposure parameter values are transmitted to the CMOS sensor.

[0120] While the electronic exposure parameter values are transmitted to the CMOS sensor, the delay take - effect duration of the fill light intensity starts timing. Before the timing is completed, the exposure parameter values are still the exposure parameter values of the absence of people scene mode determined in S501.

[0121] In S504, when the delay takes effect, the fill light intensity and the electronic exposure parameter values in the unmanned scene mode take effect.

[0122] At this time, the fill light intensity is adjusted to 10. At this time, the adaptive exposure time and exposure gain in the CMOS sensor take effect exactly synchronously. Although the fill light intensity becomes 10 times smaller, the exposure time and exposure gain take effect, so there is no sudden change in brightness in the picture.

[0123] In S505, switch to the unmanned scene mode.

[0124] Since the adjusted exposure intensity is almost the same as the exposure amount required in the unmanned scene mode, and the adjusted fill light intensity is the same as the fill light intensity in the unmanned scene mode, the picture hardly needs to be adjusted in brightness at this time. And in the process of adjusting the exposure parameter values, since the exposure intensities before and after the adjustment are basically the same, there will be no obvious overexposure or underexposure in the picture, and the effective time is the same, which can effectively improve the quality of the monitoring image.

[0125] It should be understood that the magnitudes of the sequence numbers of the steps in the above embodiments do not mean the order of execution. The order of execution of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0126] Figure 6 The figure is a schematic diagram of a control device for image acquisition provided by an embodiment of the present application. The device includes:

[0127] A target object detection unit 601 for detecting a target object in a monitoring image;

[0128] A switching parameter determination unit 602 for determining the switched exposure parameter values when the change information of the target object in the monitoring image meets the preset switching requirements of the exposure parameter values. The exposure parameter values include fill light intensity and electronic exposure parameter values;

[0129] A response duration determination unit 603 for transmitting the electronic exposure parameter values to an image sensing module that acquires the monitoring image, and determining the response duration of the electronic exposure parameter values of the image sensing module;

[0130] A fill light control unit 604 for determining the delay response time of the fill light intensity according to the response duration, and controlling the change of the fill light intensity according to the delay response time.

[0131] Figure 6 The shown control device for image acquisition corresponds to Figure 2 the shown control method for image acquisition.

[0132] Figure 7It is a schematic diagram of a control device for image acquisition provided by an embodiment of the present application. As Figure 7 shown, the control device 7 for image acquisition in this embodiment includes: a processor 70, a memory 71, and a computer program 72 stored in the memory 71 and executable on the processor 70, such as a control program for image acquisition. When the processor 70 executes the computer program 72, the steps in the above-mentioned embodiments of various control methods for image acquisition are implemented. Alternatively, when the processor 70 executes the computer program 72, the functions of each module / unit in the above-mentioned device embodiments are implemented.

[0133] Exemplarily, the computer program 72 can be divided into one or more modules / units. The one or more modules / units are stored in the memory 71 and executed by the processor 70 to complete the present application. The one or more modules / units can be a series of computer program instruction segments capable of performing specific functions, and these instruction segments are used to describe the execution process of the computer program 72 in the control device 7 for image acquisition.

[0134] The control device 7 for image acquisition can be a computing device such as a desktop computer, a notebook, a palm computer, and a cloud server. The control device for image acquisition may include, but is not limited to, a processor 70 and a memory 71. Those skilled in the art can understand that Figure 7 it is merely an example of a control device 7 for image acquisition and does not constitute a limitation on the control device 7 for image acquisition. It may include more or fewer components than shown in the figure, or combine certain components, or different components. For example, the control device for image acquisition may further include input / output devices, network access devices, a bus, etc.

[0135] The so-called processor 70 may be a central processing unit (CPU), or may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0136] The memory 71 may be an internal storage unit of the control device 7 for image acquisition, such as a hard disk or memory of the control device 7 for image acquisition. The memory 71 may also be an external storage device of the control device 7 for image acquisition, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a Flash Card, etc. equipped on the control device 7 for image acquisition. Further, the memory 71 may also include both an internal storage unit and an external storage device of the control device 7 for image acquisition. The memory 71 is used to store the computer program and other programs and data required by the control device for image acquisition. The memory 71 may also be used to temporarily store the data that has been output or will be output.

[0137] Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the above-mentioned division of each functional unit and module is used as an example. In practical applications, the above functions can be assigned to different functional units and modules according to needs, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit. In addition, the specific names of each functional unit and module are only for the convenience of mutual distinction and do not limit the protection scope of this application. The specific working process of the units and modules in the above system can refer to the corresponding process in the foregoing method embodiment and will not be elaborated here.

[0138] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For the parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0139] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or by a combination of computer software and electronic hardware. Whether these functions are executed in hardware or software depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0140] In the embodiments provided in the present application, it should be understood that the disclosed device / terminal device and method can be implemented in other ways. For example, the device / terminal device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in electrical, mechanical or other forms.

[0141] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0142] In addition, each functional unit in the various embodiments of the present application can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

[0143] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, to implement all or part of the processes in the above method embodiments of the present application, it can also be completed by hardware related to computer program instructions. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of the above method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file or some intermediate form. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the content included in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.

[0144] In addition, an embodiment of the present application further provides a computer program product, which, when running on a computer, causes the computer to execute the methods in the above-mentioned implementation manners.

[0145] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A control method for image acquisition, characterized in that: The method comprises: Detect target objects in surveillance images; When the change information of the target object in the monitoring image meets the preset exposure parameter value switching requirement, determining the exposure parameter value after switching, wherein the exposure parameter value includes the fill light intensity and the electronic exposure parameter value; Transmitting the electronic exposure parameter value to an image sensor module that collects the monitoring image, and determining a response time of the electronic exposure parameter value of the image sensor module; A delayed response time of the fill light intensity is determined according to the response duration, and a change of the fill light intensity is controlled according to the delayed response time.

2. The method according to claim 1, characterized in that The target object in the monitoring image includes a first scene without the target object and a second scene with the target object; When the change information of the target object in the monitoring image meets the preset exposure parameter value switching requirement, determining the exposure parameter value after switching includes: When the change information of the target object in the monitoring image is a transformation from a first scene to a second scene, determining the second exposure parameter value of the second scene after switching includes increasing the first fill light intensity of the first scene to the second fill light intensity of the second scene, and adaptively adjusting the first electronic exposure parameter value of the first scene to the second electronic exposure parameter value of the second scene.

3. The method according to claim 2, characterized in that The second electronic exposure parameter value includes a second exposure time; Determining the second exposure parameter value of the second scene after switching includes increasing the first fill light intensity of the first scene to the second fill light intensity of the second scene, and adaptively adjusting the first electronic exposure parameter value of the first scene to the second electronic exposure parameter value of the second scene, including: The second fill light intensity of the switched scene mode with people is determined to be the maximum fill light intensity of the fill light device, and the second exposure time of the switched scene mode with people is determined to be the specific exposure time of the predetermined scene mode with target object.

4. The method according to claim 3, characterized in that The second electronic exposure parameter value also includes a second gain; Adaptively adjusting the first electronic exposure parameter value of the first scene to the second electronic exposure parameter value of the second scene, further comprising: The first gain in the first electronic exposure parameter value is reduced to the second gain in the second electronic exposure parameter value, so that the second exposure intensity determined by the second gain, the second exposure time and the second fill light intensity is the same as the first exposure intensity determined by the first gain, the first exposure time and the first fill light intensity.

5. The method according to claim 2, characterized in that: The image sensing module is a CMOS sensor exposed by rolling shutter; The electronic exposure parameter value is transmitted to an image sensor module that collects the monitoring image, and the response time of the electronic exposure parameter value of the image sensor module is determined, including: The electronic exposure parameter value is transmitted to the CMOS sensor of the monitoring camera, and the response time of the electronic exposure parameter value of the image sensor module is determined according to the number of frames required to delay the CMOS sensor in responding to the electronic exposure parameter value and the interval between monitoring images.

6. The method according to claim 1, characterized in that The target object in the monitoring image includes a first scene without the target object and a second scene with the target object; When the change information of the target object in the monitoring image meets the preset exposure parameter value switching requirement, determining the exposure parameter value after switching includes: When the change information of the target object in the monitoring image is that the second scene is changed to the first scene, detecting the continuous cumulative duration of the changed first scene; When the continuous accumulated time is greater than a predetermined time threshold, determining the exposure parameter value of the first scene after switching includes reducing the second fill light intensity to the first fill light intensity, and increasing the second electronic exposure parameter value to the first electronic exposure parameter value.

7. The method according to claim 6, characterized in that Adding the second electronic exposure parameter value to the first electronic exposure parameter value includes: Increasing the second exposure time in the second electronic exposure parameter value to a third exposure time; And / or, the second gain in the second electronic exposure parameter value is increased to a third gain.

8. A control device for image acquisition, characterized in that: The device comprises: A target object detection unit, used to detect a target object in a surveillance image; A switching parameter determination unit, configured to determine a switched exposure parameter value when the change information of the target object in the monitoring image meets the preset exposure parameter value switching requirement, wherein the exposure parameter value includes a fill light intensity and an electronic exposure parameter value; a response time determination unit, used to transmit the electronic exposure parameter value to the image sensor module for collecting the monitoring image, and determine the response time of the electronic exposure parameter value of the image sensor module; A fill light control unit is used to determine a delayed response time of the fill light intensity according to the response duration, and control a change of the fill light intensity according to the delayed response time.

9. A control device for image acquisition, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the image acquisition control device implements the method according to any one of claims 1 to 7.

10. A computer program product comprising computer program instructions, characterized in that When the computer program is executed, the method according to any one of claims 1 to 7 is performed.

Images