Image parameter processing method, device and equipment of photographing device and storage medium
By using image parameter processing methods that estimate and synchronously configure exposure or gain, the image quality problem caused by the flickering of alarm lights in warning cameras was solved, achieving image stability and improved clarity during flickering.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-02
- Publication Date
- 2026-03-27
AI Technical Summary
The flashing of alarm lights on surveillance cameras causes sudden changes in image brightness and noise, affecting image quality.
By estimating the instantaneous brightness of the captured image after the shooting equipment adjusts to the target operating mode, estimating the exposure amount or gain when the exposure is stable, and simultaneously configuring the corresponding image parameters when the target operating mode is detected, the sudden changes in image brightness and noise caused by the flashing of the alarm light are reduced.
Adjust image parameters promptly during the flashing of the warning light to improve image capture quality, ensure rapid stabilization of image quality, and reduce sudden changes in brightness and noise.
Smart Images

Figure CN116233617B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of image parameter processing technology for shooting devices, and in particular to an image parameter processing method, apparatus, device and storage medium for shooting devices. Background Technology
[0002] With the rapid development of the security industry, new types of cameras are constantly emerging, among which surveillance cameras are quite popular. Surveillance cameras typically use red-blue or white LEDs as alarm lights. However, when the alarm light flashes, the color or brightness of the image changes rapidly and significantly within a short period, greatly affecting the image, such as causing color distortion, sudden changes in brightness, and noise. Therefore, reducing the sudden changes in brightness and noise caused by alarm light flashing and improving image quality has become particularly important. Summary of the Invention
[0003] This invention provides an image parameter processing method, apparatus, device, and storage medium for a shooting device, so that the image quality can be quickly stabilized after the alarm light flashes.
[0004] In a first aspect, embodiments of the present invention provide an image parameter processing method for an imaging device, the method comprising:
[0005] Estimate the instantaneous brightness of the captured image after adjusting the shooting device to the target operating mode; wherein the target operating mode includes the shooting device's alarm light being turned on and / or off.
[0006] Based on the instantaneous brightness of the captured image, estimate the exposure amount or gain when the shooting device is adjusted to the target operating mode to achieve stable exposure;
[0007] When the camera is detected to be operating in the target mode, the image parameters corresponding to the estimated exposure or gain at the exposure stabilization time are simultaneously configured to capture the image.
[0008] Secondly, embodiments of the present invention also provide an image parameter processing apparatus for an imaging device, the apparatus comprising:
[0009] The first estimation module is used to estimate the brightness of the target image after the shooting device is adjusted to the target operating mode; wherein the target operating mode includes the alarm light of the shooting device being turned on and / or turned off.
[0010] The second estimation module is used to estimate the exposure amount or gain when the shooting device is adjusted to the target operating mode to achieve stable exposure based on the brightness of the target shooting image.
[0011] The image parameter configuration module is used to synchronously configure the image parameters corresponding to the estimated exposure or gain when the shooting device is detected to be operating in the target operating mode, so as to take an image.
[0012] Thirdly, this invention also provides an electronic device, comprising:
[0013] One or more processors;
[0014] Storage device for storing one or more programs;
[0015] The one or more programs are executed by the one or more processors, causing the one or more processors to implement the image parameter processing method of the shooting device as provided in any embodiment of the present invention.
[0016] Fourthly, embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the image parameter processing method of the shooting device provided in any embodiment of the present invention.
[0017] This invention provides an image parameter processing method for a shooting device. The method estimates the target image brightness after adjusting the shooting device to a target operating mode. Based on the target image brightness, it further estimates the exposure or gain required to achieve stable exposure after adjusting the shooting device to the target operating mode. Simultaneously, when the shooting device is detected operating in the target mode, the method synchronously configures and uses the image parameters corresponding to the estimated stable exposure or gain for image capture. This solution can estimate the stable exposure or gain value after the alarm light is on or off. This allows for timely adjustment of image parameters when the flashing of the alarm light causes rapid and significant changes in image color or brightness within a short period, improving image quality and ensuring rapid stabilization of image quality after alarm light changes. This reduces sudden changes in image brightness and noise caused by alarm light flashing.
[0018] The above description of the invention is merely an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention and to implement it in accordance with the contents of the specification, and in order to make the above and other objects, features and advantages of the present invention more apparent and understandable, specific embodiments of the present invention are described below. Attached Figure Description
[0019] Other features, objects, and advantages of the invention will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings. The drawings are for illustrative purposes only and are not intended to limit the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:
[0020] Figure 1 This is a flowchart of an image parameter processing method for a shooting device provided in an embodiment of the present invention;
[0021] Figure 2 This is a flowchart of another image parameter processing method for a shooting device provided in an embodiment of the present invention;
[0022] Figure 3 This is a structural block diagram of an image parameter processing device provided in an embodiment of the present invention;
[0023] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation
[0024] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, the accompanying drawings show only the parts relevant to the present invention, and not all of the structures.
[0025] Before discussing the exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the operations (or steps) as sequential processes, many of these operations can be performed in parallel, concurrently, or simultaneously. Furthermore, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but it may also have additional steps not included in the figures. The process may correspond to a method, function, procedure, subroutine, subroutine, etc.
[0026] To better understand the technical solution of this application, this section analyzes in detail the relevant content of image capture by controlling a fill light, in order to better identify the shortcomings of controlling a fill light for shooting. The intelligent fill light system of the image capturing device includes: a lens, an image sensor, a DSP, a metering module, and a fill light device. The lens captures an image of the target object and transmits it to the DSP via the image sensor. The DSP analyzes and processes the input image data and transmits the analysis results to the metering module. The metering module is also connected to the fill light device, which provides fill light. However, during fill light operation, the brightness changes of the fill light cause continuous changes in the image captured by the lens, potentially resulting in a blurry image and severely affecting the image capture quality.
[0027] The material handling method, apparatus, system, control server, and storage medium provided in the embodiments of the present invention will be described in detail below through various embodiments and optional technical solutions of each embodiment.
[0028] Figure 1 This is a flowchart illustrating an image parameter processing method for a shooting device provided in an embodiment of the present invention. This embodiment of the invention is applicable to situations where image quality is improved despite sudden changes in brightness and noise caused by flashing alarm lights. The method can be executed by an image parameter processing device of the shooting device, which can be implemented in software and / or hardware and can be integrated into any image shooting device with network communication capabilities. The image shooting device in this embodiment includes, but is not limited to, various types of electronic security devices and electronic police devices. Figure 1 As shown, the image parameter processing method of the shooting device provided in this embodiment includes the following steps:
[0029] S110, Estimate the brightness of the target image after adjusting the shooting device to the target operating mode; wherein the target operating mode includes the shooting device's alarm light being turned on and / or off.
[0030] In this embodiment, the capturing device can capture images at night by flashing lights. For example, in devices such as surveillance cameras, the capturing device can use an alarm light to flash. The alarm light reuses the supplementary light built into the capturing device, which includes white light or warm light.
[0031] When the shooting device is in the target operating mode, the alarm light will flash and / or turn off. When the alarm light is on, it causes a momentary overexposure of the captured image. The automatic exposure program detects the overexposure and quickly reduces the exposure or gain, but due to the delay, the shooting device still uses the parameters from the high exposure. When the alarm light flashes from on to off, the automatic exposure program detects that the image is too dark and quickly increases the exposure or gain, but the camera still uses the image parameters before the exposure adjustment, such as low exposure and low gain. Due to the camera's delay, the image captured in the target operating mode is blurry and has significant noise. Therefore, the solution in this embodiment needs to estimate the instantaneous brightness of the captured image after adjusting the shooting device to the target operating mode, so as to estimate the exposure or gain needed to achieve stable exposure after adjusting the shooting device to the target operating mode based on the instantaneous brightness of the captured image.
[0032] S120: Based on the instantaneous brightness of the captured image, estimate the exposure amount or gain when the shooting device is adjusted to the target operating mode to achieve stable exposure.
[0033] Specifically, after estimating the instantaneous brightness of the captured image, the exposure amount or gain required to achieve stable exposure after adjusting the shooting device to the target operating mode can be estimated based on the estimated instantaneous brightness. The target operating mode includes whether the shooting device's alarm light is flashing on or off. Exposure is the process by which the image sensor senses light. There are three factors that affect exposure:
[0034] 1) Aperture: The aperture controls the size of the path through which light enters. The larger the aperture, the greater the luminous flux per unit time; the smaller the aperture, the smaller the luminous flux per unit time.
[0035] 2) Shutter speed: Shooting equipment can use either an electronic shutter or a traditional mechanical shutter. Shutter speed and aperture size are complementary; shutter speed allows more light to enter.
[0036] 3) Gain: The gain in the shooting device can be the amplification gain of the analog signal after double sampling.
[0037] Since amplifying the image signal also amplifies the noise signal, the amplifier gain is usually set to minimum. Exposure and gain directly control the data read from the sensor and can be adjusted preferentially, primarily by adjusting the exposure time. Increasing the exposure time, without overexposure, can increase the signal-to-noise ratio and make the image clearer. The image quality varies with different gains; lower gain results in less noise, while higher gain results in more noise. In this embodiment, a suitable exposure or gain in the target operating mode allows the camera to achieve exposure stability and improve image clarity. Therefore, this embodiment requires estimating the exposure or gain needed to achieve exposure stability after adjusting the camera to the target operating mode.
[0038] S130. When the camera is detected to be operating in the target operating mode, the image parameters corresponding to the estimated exposure or gain when the exposure is stable are simultaneously configured to capture the image.
[0039] Image parameters can be determined based on exposure; that is, if the exposure is uncertain, image parameters cannot be updated or adjusted. After estimating the exposure or gain required for stable exposure after the shooting device adjusts to the target operating mode, the corresponding image parameters can be calculated in advance based on the estimated exposure. Exposure can be determined by shutter speed and gain. In low ambient light, the shutter speed may be slow, and even with a fill light, the shutter speed will not change. Therefore, by determining the gain, the exposure can be determined, and thus the image parameters.
[0040] When the camera is operating in the target mode, the image parameters corresponding to the exposure level are synchronously configured for the camera. This allows for timely adjustment of image parameters when the flashing of the alarm light causes rapid and noticeable changes in image color or brightness within a short period, improving image quality and ensuring rapid stabilization of image quality after the alarm light changes. Simultaneously, the alarm light can be used normally for exposure, avoiding sudden changes in image brightness and noise caused by slowing down or not adjusting the exposure at all, ensuring image quality during alarm flashing and enabling normal image information acquisition during alarm periods. Furthermore, there is no need to deliberately adjust the alarm light flashing frequency according to the exposure, minimizing issues such as passive exposure and low accuracy, and maximizing the warning effect of the alarm light.
[0041] According to the image parameter processing method for a shooting device provided in this embodiment of the invention, the instantaneous brightness of the captured image after the shooting device is adjusted to a target operating mode is estimated; wherein the target operating mode includes the alarm light of the shooting device being turned on and / or off; based on the instantaneous brightness of the captured image, the exposure amount or gain at which exposure stability is achieved after the shooting device is adjusted to the target operating mode is estimated; when the shooting device is detected to be operating in the target operating mode, the image parameters corresponding to the estimated exposure amount or gain at the time of exposure stability are simultaneously configured and used for image capture. This solution can reduce the sudden changes in image brightness and noise caused by alarm light flickering. When the flashing of the alarm light causes rapid and significant changes in image attributes (brightness, color, noise, and encoding, etc.) within a short period of time, the image parameters can be adjusted in a timely manner, thereby improving the image capture quality.
[0042] Based on the above embodiments, optionally, estimating the exposure amount or gain when the shooting device is adjusted to the target operating mode to achieve stable exposure, based on the instantaneous brightness of the captured image, may include steps A1-A2:
[0043] Step A1: Determine the initial image brightness and initial gain before the shooting device is adjusted to the target operating mode, and the ideal image brightness when the exposure is stable after the shooting device is adjusted to the target operating mode.
[0044] The target operating mode includes the flashing of the camera's alarm lights and / or their de-flashing. Before the alarm lights are flashed on and / or off, the brightness and gain of the current captured image are acquired as the initial captured image brightness and initial gain. In practical applications, by analyzing the image brightness after multiple flashing cycles of the alarm lights, the ideal captured image brightness for stable exposure after the camera is adjusted to the target operating mode can be obtained.
[0045] Step A2: Based on the supplementary light intensity of the alarm light, the instantaneous brightness of the captured image, the initial brightness of the captured image, the initial gain, and the ideal brightness of the captured image, estimate the gain or exposure amount when the shooting device is adjusted to the target operating mode to achieve stable exposure using the principle of equal exposure.
[0046] In this context, the image achieves an ideal brightness at each exposure level or gain, which is the ideal brightness for the captured image. Equal exposure means that when the aperture is increased or decreased by a certain number of stops, the exposure obtained for each combination of aperture and shutter speed is the same, provided the shutter speed is increased or decreased accordingly by the same number of stops. Furthermore, based on the above steps, given the alarm light intensity, instantaneous image brightness, initial image brightness, initial gain, and ideal image brightness, the equal exposure principle is used to estimate the gain or exposure required to achieve stable exposure after adjusting the shooting equipment to the target operating mode.
[0047] By determining the initial image brightness and initial gain before the shooting equipment is adjusted to the target operating mode, and the ideal image brightness when the exposure stabilizes after the shooting equipment is adjusted to the target operating mode, the gain or exposure amount when the exposure stabilizes after adjusting the shooting equipment to the target operating mode is estimated using the principle of equal exposure. This can improve the accuracy of estimating the exposure amount and / or gain when the exposure stabilizes, thereby improving the quality of the captured image.
[0048] Figure 2 This is a flowchart of another image parameter processing method for a shooting device provided in an embodiment of the present invention. The embodiments of the present invention further refine the steps in the foregoing embodiments based on the above embodiments. The embodiments of the present invention can be combined with various optional solutions in one or more of the above embodiments. For example... Figure 2 As shown, the image parameter processing method of the shooting device provided in this embodiment includes the following steps:
[0049] S210. After determining that the shooting device is adjusted to the target operating mode and before the exposure is adjusted, the estimated brightness information of the pre-divided screen blocks in the shooting screen of the shooting device.
[0050] Specifically, after adjusting the shooting equipment to the target operating mode, the brightness of the fill light varies across different parts of the image. Therefore, the captured image is divided into equal blocks. The block whose brightness remains unchanged before and after the fill light is turned on is selected as the baseline block. Specifically, the entire captured image can be divided into a×b blocks.
[0051] Based on the above embodiments, optionally, after adjusting the shooting device to the target operating mode, the estimated brightness information of the pre-divided screen blocks in the shooting screen of the shooting device may include steps B1-B3:
[0052] Step B1: Determine the fill light angle and / or fill light distance when filling light on the pre-divided image blocks in the shooting scene after the alarm light of the shooting device is turned on and flashing.
[0053] Specifically, in this embodiment, the shooting device, such as the alarm light, can be a built-in supplementary light, such as a white light or a warm light. A white light has different brightness distributions for different blocks of the captured image at different angles. For example, assuming the image brightness is uniform, without obvious overly bright or dark blocks interfering, based on the energy distribution of the supplementary light, it can be inferred that the brightness of blocks at a large angle from the camera and close to the top of the scene will be almost unaffected by the supplementary light; that is, the brightness of these blocks remains unchanged before and after the supplementary light is turned on. Furthermore, the blocks whose brightness remains unchanged before and after the supplementary light is turned on are used as reference blocks.
[0054] In this embodiment of the solution, optionally, in the energy distribution after the alarm light is turned on and flashing, the energy generated at the center of the alarm light is greater than the energy generated at the edge of the alarm light; and, in the energy distribution after the alarm light is turned on and flashing, the energy at the location farther away from the alarm light is lower.
[0055] The energy is strongest at the center of the captured image, decreasing with distance from the center; that is, the energy decreases from the center to the edge. Different fill light angles and / or different fill light distances result in different energy levels in different parts of the image. Therefore, it is necessary to determine the fill light angles and / or fill light distances for the pre-divided parts of the captured image after the alarm light of the shooting device is activated and flashing.
[0056] By utilizing different distances from the warning light to determine the different energy distributions in different image blocks, we can focus on the energy of each image block and better determine the fill light angle and / or fill light distance for the pre-divided image blocks in the captured image.
[0057] Step B2: Based on the fill light distance and fill light angle after the alarm light is turned on and flashing, determine the estimated brightness contribution value of the pre-divided image blocks after the alarm light is turned on and flashing and before exposure adjustment.
[0058] Because different fill light angles and / or different fill light distances result in varying fill light intensity, leading to different brightness levels in different parts of the image, the contribution of the white light switch to the average brightness of each image block is different. This brightness contribution can be the amount of change in brightness between the captured image and the original image after the fill light is turned on and / or flashed. For example, the brightness of the image after the fill light is turned on is the original image brightness plus the contribution.
[0059] The values are added together, resulting in a positive contribution. The image brightness after the fill light is turned off is the original image brightness minus the contribution, resulting in a negative contribution. The contribution can be determined by the fill light angle and / or fill light distance.
[0060] In this embodiment, optionally, the estimated brightness contribution value is inversely proportional to the supplementary lighting distance, and the estimated brightness contribution value is directly proportional to the energy corresponding to the supplementary lighting angle.
[0061] Specifically, the block closest to the fill light point has the largest estimated brightness contribution, while the farther away from the fill light point, the smaller the estimated brightness contribution. The smaller the fill light angle, the closer the block is to the fill light point, and the larger its estimated brightness value; the larger the fill light angle, the smaller the estimated brightness value of the block.
[0062] By utilizing the different lighting angles and distances of each segment, the estimated brightness value of each segment can be calculated. This allows us to focus on the impact of each segment on the overall image brightness and improve the accuracy of the estimated brightness information for pre-divided image segments in the captured image.
[0063] For example, assuming the center of the fill light, i.e., the point of strongest energy at a zero-degree angle, can increase the image brightness by L. U And the maximum angle of the fill light is θ M The maximum illumination distance is D. M Then at an angle of θ C And the distance from camera D C The contribution of this location to the image brightness is
[0064]
[0065] Where κ is the weight of the energy of the fill light of the shooting device, the fill light angle and the fill light distance attenuation, and κ∈[0,1].
[0066] For example, assuming the shooting device is a camera with a 2-megapixel resolution lens, a horizontal length of W = 1920 × P, and a vertical height of W = 1080 × P, where P is the sensor pixel size, then the fill light angle for the image at the a-th column and b-th row is:
[0067]
[0068] Assuming the image is symmetrically divided into left and right sections from the center of the camera, the fill light distance is:
[0069]
[0070] The contribution of the supplementary light to the average brightness of the block is:
[0071]
[0072] Based on the formulas in the steps above, calculate the average brightness of the blocks to the left, right, and below the reference block. This is the current block's brightness plus the brightness contributed by the fill lights on the left, right, or bottom blocks. By analogy, the brightness of all blocks from the center to the corners of the image can be calculated.
[0073] In practical applications, in bright environments, the contribution of turning the fill light on and off to the image brightness is relatively small. However, in darker environments, the contribution of turning the fill light on and off to the image brightness is relatively large. Therefore, the contribution value L of the fill light to the image brightness is... U Updates are needed based on ambient brightness. For example, using a calibration method, the shooting device is set to manual exposure under different ambient illuminance levels. The average brightness of the image is collected when the fill light is on and off, as well as the average brightness of the area matching the fill light's energy field, to calculate the contribution of the fill light's on / off state to the image brightness. Alternatively, it can be theoretically calculated based on the relationship with ambient illuminance, as shown in the following formula:
[0074]
[0075] Among them, L BAVG L represents the average brightness of the brightest block. BAVG It could be the brightest spot, or several spots that are close to the brightest spot. L DAVG L represents the average brightness of the darkest area. DAVG It can be the darkest block, L DAVG It could also be one of the patches closest to the darkest. Gain THR Gain is the gain threshold that significantly affects the brightness of the image from the fill light. CUR L is the current gain value. CUR This represents the average brightness of the current scene. When the ambient brightness is good, the gain is low, and the brightness difference between dark and bright areas is not significant, resulting in a relatively small calculated contribution value from the fill light. When the ambient brightness is low, the gain increases, and the average brightness difference between bright and dark areas becomes more pronounced, leading to a larger calculated contribution value from the fill light. Step B3: Based on the estimated brightness contribution value and the baseline brightness information of the pre-divided scene blocks in the captured image, determine the estimated brightness information for the pre-divided scene blocks in the captured image.
[0076] The reference brightness information of the pre-divided screen blocks in the captured image is determined based on the brightness of the pre-divided screen blocks in the captured image before the shooting device is adjusted to the target operating mode, or the brightness of the pre-divided screen blocks at preset positions in the captured image after the shooting device is adjusted to the target operating mode.
[0077] The baseline brightness information can be determined by the brightness of pre-divided image blocks in the captured image before the shooting device is adjusted to the target operating mode. Specifically, before the fill light is turned on, the average brightness of each pre-divided image block is obtained. Then, after the fill light is turned on, the average brightness of each pre-divided image block can be obtained by adding the current average brightness of the current pre-divided image block to its brightness contribution value. The estimated brightness information of the pre-divided image blocks obtained in this way is recorded as the first brightness. Alternatively, the brightness of pre-divided image blocks at preset positions in the captured image can be determined after the shooting device is adjusted to the target operating mode. The preset position is a position less affected by the fill light, such as the corner position farthest from the fill light. Specifically, after estimating the brightness contribution value of each block, the estimated brightness information of the pre-divided image blocks in the captured image can be determined based on the estimated brightness contribution value and the baseline brightness information of the pre-divided image blocks in the captured image. After obtaining the baseline brightness, the average brightness of the pre-divided image blocks on the left, right, and bottom sides is calculated sequentially based on the supplementary lighting angle and distance. This is the current baseline brightness plus the estimated brightness contribution value from the left, right, or bottom block. Similarly, the brightness of all pre-divided image blocks from the corner (the image block furthest from the center) to the center of the image can be calculated. The estimated brightness information of the pre-divided image blocks obtained in this way is recorded as the second brightness.
[0078] Similarly, when the fill light is off, when calculating the first brightness, select the brightness block near the center of the image and several blocks around it, remove the brightness of the brightest and darkest blocks, and calculate the average brightness. Use this brightness as the reference brightness to calculate the brightness of the blocks above, below, left and right, that is, the reference brightness minus the brightness contributed by the fill light of the corresponding block, and finally calculate the average brightness of the entire image.
[0079] S220: The estimated brightness information of each pre-divided block of the captured image is weighted by brightness to obtain the instantaneous brightness of the captured image after the shooting device is adjusted to the target operating mode and before the exposure is adjusted.
[0080] After obtaining the estimated brightness information of each pre-divided image block in the captured image, they are weighted. Let the weights of the image blocks be W respectively. 11 W 12 ,…W 1b ,…,W ab The weights can be determined based on user needs or the requirements of the current environment. Following the steps described above, the average brightness of the captured image and the average brightness of each block of the captured image are first obtained. The brightness value for each block is L. 11 ,L 12 ,…L 1b ,…,L ab When performing brightness statistics, the weights of each block of the captured image are W respectively.11 W 12 ,…W 1b ,…,W ab Then, the instantaneous brightness of the captured image after the shooting device is adjusted to the target operating mode and before exposure adjustment is obtained is the weighted average of the brightness of each block:
[0081]
[0082] Furthermore, the instantaneous brightness of the captured image is obtained after the shooting device is adjusted to the target operating mode and before exposure adjustment.
[0083] In practical applications, the installation environment of the shooting equipment is often complex, with many trees, streetlights, and other municipal facilities nearby. In such cases, the brightness around the shooting equipment may not be meaningful, so some areas can be excluded when calculating the overall brightness. This can be achieved by comparing the first brightness and the second brightness and setting a threshold. If the difference between the first brightness and the second brightness exceeds the threshold, the larger value is used for subsequent calculations. If the difference between the first brightness and the second brightness is within the threshold range, the average of the first brightness and the second brightness is used for subsequent calculations. S230: When the shooting equipment is detected to be operating in the target operating mode, the image parameters corresponding to the estimated exposure or gain at stable exposure are simultaneously configured for image capture.
[0084] For example, based on the steps above, the average brightness of the image before the fill light is turned on is known to be L. B Shutter speed is S B The gain is G B The ideal image brightness is L. A Shutter speed is S A The intensity of the fill light is E, E max This represents the maximum value of the fill light intensity, and the estimated average brightness of the image after the fill light is turned on is L. S By applying the principle of equal exposure, the gain value G after exposure adjustment can be calculated. A :
[0085]
[0086] At the same time, a gain of G can be obtained. A The image parameters are configured simultaneously when the fill light is turned on.
[0087] Furthermore, when the camera is detected to be operating in the target mode, image parameters corresponding to the estimated exposure amount or gain at stable exposure are simultaneously configured and used for image capture. In this embodiment, the estimated brightness information of pre-divided image blocks in the captured image is determined after the camera is adjusted to the target mode and before exposure adjustment; the estimated brightness information of each pre-divided image block in the captured image is weighted by brightness to obtain the instantaneous captured image brightness after the camera is adjusted to the target mode and before exposure adjustment; when the camera is detected to be operating in the target mode, image parameters corresponding to the estimated exposure amount or gain at stable exposure are simultaneously configured and used for image capture.
[0088] Optionally, there may be some error between the estimated brightness and the predicted gain value calculated from the estimated brightness and the actual effective value. Therefore, after configuring the predicted image parameters while the fill light is flashing, the parameters need to be updated again based on the actual effective gain value to ensure that the parameters are more accurate.
[0089] According to the image parameter processing method for the shooting device provided in this embodiment of the invention, this solution can estimate the stable exposure or gain value after the alarm light is on and off in advance. This allows for timely adjustment of image parameters when the flashing of the alarm light causes rapid and significant changes in the color or brightness of the image within a short period, improving image quality and ensuring rapid stabilization of image quality after alarm light changes. This reduces sudden changes in image brightness and noise caused by alarm light flashing. Simultaneously, it fully considers the brightness interference experienced by various positions in the captured image during the flashing of the alarm light, accurately estimating the brightness contribution of each corresponding image block, and thus estimating the average brightness of the captured image as accurately as possible. This improves the accuracy of subsequent exposure and gain calculations that ensure stable exposure for the shooting device.
[0090] Figure 3 This is a structural block diagram of an image parameter processing device for a shooting device provided in an embodiment of the present invention. This embodiment of the present invention is applicable to situations where image quality is improved despite sudden changes in brightness and noise caused by flashing alarm lights. The device can be implemented in software and / or hardware and can be integrated into any image shooting device with network communication capabilities. The image shooting device in this embodiment includes, but is not limited to, various types of electronic security devices and electronic police devices. Figure 3 As shown, the image parameter processing device of the shooting equipment provided in this embodiment includes: a first estimation module 310, a second estimation module 320, and an image parameter configuration module 330. Wherein:
[0091] The first estimation module 310 is used to estimate the instantaneous brightness of the captured image after the shooting device is adjusted to the target operating mode; wherein the target operating mode includes the alarm light of the shooting device being turned on and / or turned off.
[0092] The second estimation module 320 is used to estimate the exposure amount or gain when the shooting device is adjusted to the target operating mode to achieve stable exposure based on the brightness of the instantaneous captured image.
[0093] The image parameter configuration module 330 is used to synchronously configure the image parameters corresponding to the estimated exposure or gain when the shooting device is detected to be operating in the target operating mode, so as to perform image shooting.
[0094] Based on the above embodiments, optionally, the first estimation module 310 includes:
[0095] The brightness information estimation unit is used to determine the estimated brightness information of the pre-divided screen blocks in the shooting image of the shooting device after the shooting device is adjusted to the target operating mode and before the exposure is adjusted.
[0096] The instantaneous image brightness acquisition unit is used to perform brightness weighting on the estimated brightness information of each pre-divided image block in the captured image to obtain the instantaneous image brightness after the shooting device is adjusted to the target operating mode and before exposure adjustment.
[0097] Based on the above embodiments, optionally, the brightness information estimation unit includes:
[0098] The first determining subunit is used to determine the supplementary lighting angle and / or supplementary lighting distance of the pre-divided screen blocks in the captured image after the alarm light of the shooting device is turned on and flashes.
[0099] The second determining subunit is used to determine the estimated brightness contribution value of the pre-divided screen blocks after the alarm light turns on and flashes, based on the supplementary lighting distance and supplementary lighting angle after the alarm light turns on and flashes.
[0100] The third determining subunit is used to determine the estimated brightness information of the pre-divided image blocks in the captured image based on the estimated brightness contribution value and the reference brightness information of the pre-divided image blocks in the captured image.
[0101] The reference brightness information of the pre-divided screen blocks in the captured image is determined based on the brightness of the pre-divided screen blocks in the captured image before the shooting device is adjusted to the target operating mode, or the brightness of the pre-divided screen blocks at preset positions in the captured image after the shooting device is adjusted to the target operating mode.
[0102] Based on the above embodiments, optionally, the first determining subunit includes:
[0103] In the energy distribution after the warning light is turned on and flashing, the energy generated at the center of the warning light is greater than the energy generated at the edge of the warning light; and, in the energy distribution after the warning light is turned on and flashing, the energy at the location farther away from the warning light is lower.
[0104] Based on the above embodiments, optionally, the third determining subunit includes:
[0105] The estimated brightness contribution is inversely proportional to the supplementary lighting distance, and the estimated brightness contribution is directly proportional to the energy corresponding to the supplementary lighting angle.
[0106] Based on the above embodiments, optionally, the second estimation module 320 includes:
[0107] Determine the initial image brightness and initial gain before the shooting equipment is adjusted to the target operating mode, and the ideal image brightness when the exposure is stable after the shooting equipment is adjusted to the target operating mode;
[0108] Based on the supplementary light intensity of the alarm light, the instantaneous brightness of the captured image, the initial brightness of the captured image, the initial gain, and the ideal brightness of the captured image, the gain or exposure amount when the shooting equipment is adjusted to the target operating mode to achieve stable exposure is estimated by using the principle of equal exposure.
[0109] Optionally, based on the above embodiments, the device further includes:
[0110] The alarm light is a supplementary light built into the shooting device, and the supplementary light includes a white light or a warm light.
[0111] The image parameter processing device of the shooting device provided in the embodiments of the present invention can execute the image parameter processing method of the shooting device provided in any of the embodiments of the present invention, and has the corresponding functions and beneficial effects of executing the image parameter processing method of the shooting device. For details, please refer to the relevant operations of the image parameter processing method of the shooting device in the foregoing embodiments.
[0112] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. For example... Figure 4 The structure shown in this embodiment of the invention includes an electronic device comprising one or more processors 410 and a storage device 420; the processors 410 in this electronic device may be one or more. Figure 4 Taking a processor 410 as an example; storage device 420 is used to store one or more programs; the one or more programs are executed by the one or more processors 410, so that the one or more processors 410 implement the image parameter processing method of the shooting device as described in any one embodiment of the present invention.
[0113] The electronic device may also include an input device 430 and an output device 440.
[0114] The processor 410, storage device 420, input device 430, and output device 540 in this electronic device can be connected via a bus or other means. Figure 4 Taking the example of a connection between China and Israel via a bus.
[0115] The storage device 420 in this electronic device serves as a computer-readable storage medium, capable of storing one or more programs. These programs can be software programs, computer-executable programs, or modules, such as the program instructions / modules corresponding to the image parameter processing method of the imaging device provided in this embodiment of the invention. The processor 410 executes various functional applications and data processing of the electronic device by running the software programs, instructions, and modules stored in the storage device 420, thereby implementing the image parameter processing method of the imaging device in the above method embodiment.
[0116] Storage device 420 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the electronic device. Furthermore, storage device 420 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, storage device 420 may further include memory remotely located relative to processor 410, which can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
[0117] Input device 430 can be used to receive input digital or character information, and to generate key signal inputs related to user settings and function control of the electronic device. Output device 440 may include display devices such as a display screen.
[0118] Furthermore, when one or more programs included in the aforementioned electronic device are executed by one or more processors 410, the programs perform the following operations:
[0119] Estimate the instantaneous brightness of the captured image after adjusting the shooting device to the target operating mode; wherein the target operating mode includes the shooting device's alarm light being turned on and / or off.
[0120] Based on the instantaneous brightness of the captured image, estimate the exposure amount or gain when the shooting device is adjusted to the target operating mode to achieve stable exposure;
[0121] When the camera is detected to be operating in the target mode, the image parameters corresponding to the estimated exposure or gain at the exposure stabilization time are simultaneously configured to capture the image.
[0122] Of course, those skilled in the art will understand that when one or more programs included in the above-mentioned electronic device are executed by one or more processors 410, the programs can also perform related operations in the image parameter processing method of the shooting device provided in any embodiment of the present invention.
[0123] This invention provides a computer-readable medium storing a computer program that, when executed by a processor, performs an image parameter processing method for an imaging device, the method comprising:
[0124] Estimate the instantaneous brightness of the captured image after adjusting the shooting device to the target operating mode; wherein the target operating mode includes the shooting device's alarm light being turned on and / or off.
[0125] Based on the instantaneous brightness of the captured image, estimate the exposure amount or gain when the shooting device is adjusted to the target operating mode to achieve stable exposure;
[0126] When the camera is detected to be operating in the target mode, the image parameters corresponding to the estimated exposure or gain at the exposure stabilization time are simultaneously configured to capture the image.
[0127] Optionally, when executed by a processor, the program can also be used to execute the image parameter processing method of the shooting device provided in any embodiment of the present invention.
[0128] The computer storage medium of this invention can be any combination of one or more computer-readable media. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, a portable CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination thereof. A computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
[0129] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit programs for use by or in connection with an instruction execution system, apparatus, or device.
[0130] Program code contained on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, radio frequency (RF), etc., or any suitable combination thereof.
[0131] Computer program code for performing the operations of this invention can be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, and C++, as well as conventional procedural programming languages such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0132] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.
[0133] Note that the above description is merely a preferred embodiment of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions can be made without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of the present invention, the scope of which is determined by the scope of the appended claims.
Claims
1. An image parameter processing method for a shooting device, characterized in that, The method includes: The instantaneous brightness of the captured image is estimated when the shooting device is adjusted to the target operating mode; wherein the target operating mode includes the alarm light of the shooting device being turned on and / or off; the instantaneous brightness of the captured image is determined based on the estimated brightness information of each pre-divided image block in the captured image, and the estimated brightness information is determined based on the fill light angle and fill light distance of each pre-divided image block; Based on the instantaneous brightness of the captured image, estimate the exposure or gain required to adjust the shooting device to the target operating mode to achieve stable exposure. When the camera is detected to be operating in the target mode, the image parameters corresponding to the estimated exposure or gain at the exposure stabilization time are simultaneously configured to capture the image.
2. The method according to claim 1, characterized in that, The estimated instantaneous brightness of the captured image when the shooting equipment is adjusted to the target operating mode includes: The estimated brightness information of the pre-divided image blocks in the image captured by the shooting device after the shooting device is adjusted to the target operating mode and before the exposure is adjusted; The estimated brightness information of each pre-divided block of the captured image is weighted to obtain the instantaneous brightness of the captured image after the shooting device is adjusted to the target operating mode and before exposure adjustment.
3. The method according to claim 2, characterized in that, After determining that the shooting equipment is adjusted to the target operating mode and before exposure adjustment is performed, the estimated brightness information of the pre-divided image blocks in the shooting equipment's image includes: After confirming that the alarm light of the shooting equipment is turned on and flashing, adjust the fill light angle and / or fill light distance for the pre-divided image blocks in the shooting image; Based on the illumination distance and illumination angle after the alarm light is turned on and flashing, determine the estimated brightness contribution value of the pre-divided image blocks after the alarm light is turned on and flashing and before exposure adjustment. Based on the estimated brightness contribution value and the reference brightness information of the pre-divided image blocks in the captured image, the estimated brightness information of the pre-divided image blocks in the captured image is determined. The reference brightness information of the pre-divided screen blocks in the captured image is determined based on the brightness of the pre-divided screen blocks in the captured image before the shooting device is adjusted to the target operating mode, or the brightness of the pre-divided screen blocks at preset positions in the captured image after the shooting device is adjusted to the target operating mode.
4. The method according to claim 3, characterized in that, In the energy distribution after the warning light is turned on and flashing, the energy generated at the center of the warning light is greater than the energy generated at the edge of the warning light; and, in the energy distribution after the warning light is turned on and flashing, the energy at the location farther away from the warning light is lower.
5. The method according to claim 3, characterized in that, The estimated brightness contribution is inversely proportional to the supplementary lighting distance, and the estimated brightness contribution is directly proportional to the energy corresponding to the supplementary lighting angle.
6. The method according to claim 1, characterized in that, Based on the instantaneous brightness of the captured image, estimate the exposure amount or gain required to achieve stable exposure after adjusting the shooting device to the target operating mode, including: Determine the initial image brightness and initial gain before the shooting equipment is adjusted to the target operating mode, and the ideal image brightness when the exposure is stable after the shooting equipment is adjusted to the target operating mode; Based on the supplementary light intensity of the alarm light, the instantaneous brightness of the captured image, the initial brightness of the captured image, the initial gain, and the ideal brightness of the captured image, the gain or exposure amount when the shooting equipment is adjusted to the target operating mode to achieve stable exposure is estimated by using the principle of equal exposure.
7. The method according to claim 1, characterized in that, The alarm light is a supplementary light built into the shooting device, and the supplementary light includes a white light or a warm light.
8. An image parameter processing device for a shooting apparatus, characterized in that, The device includes: The first estimation module is used to estimate the instantaneous brightness of the captured image when the shooting device is adjusted to the target operating mode; wherein the target operating mode includes the alarm light of the shooting device being turned on and / or off; the instantaneous brightness of the captured image is determined based on the estimated brightness information of each pre-divided image block in the captured image, and the estimated brightness information is determined based on the supplementary lighting angle and supplementary lighting distance of each pre-divided image block; The second estimation module is used to estimate the exposure amount or gain when the shooting device is adjusted to the target operating mode to achieve stable exposure based on the brightness of the instantaneous captured image. The image parameter configuration module is used to synchronously configure the image parameters corresponding to the estimated exposure or gain when the shooting device is detected to be operating in the target operating mode, so as to take an image.
9. A shooting device, characterized in that, include: One or more processors; Storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the image parameter processing method of the imaging device according to any one of claims 1-7.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the program implements the image parameter processing method of any of the shooting devices described in claims 1-7.
Citation Information
Patent Citations
Image processing method and electronic equipment
CN111083386A