Automatic exposure adjustment method and device, electronic equipment and storage medium

By calculating the camera rotation ratio and brightness information of the overlapping area, the problem of image brightness changes during the camera rotation is solved, and a smooth transition of image brightness and image quality are achieved.

CN118945476APending Publication Date: 2024-11-12JINAN YUSHI INTELLIGENT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202310534048.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-09
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

The image brightness changes drastically during the rotation of the camera, affecting the image quality. The prior art solves the problem by reducing the rotation speed of the camera, but it is impossible to optimize the image effect during the high-speed rotation.

Method used

By acquiring the current frame image of the camera, calculating the rotation ratio to determine the overlapping area between the image frames, adjusting the exposure parameters based on the brightness information of the overlapping area, and achieving a smooth transition of image brightness.

Benefits of technology

Without reducing the camera rotation speed, the image brightness is optimized and the image quality during the camera rotation is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945476A_ABST
    Figure CN118945476A_ABST
Patent Text Reader

Abstract

The invention provides an automatic exposure adjustment method and device, electronic equipment and a storage medium, and relates to the technical field of image imaging, and the method comprises the steps: obtaining a current frame image collected by a camera in the rotation process of the camera; determining the rotation ratio of each rotation direction according to the camera parameters of the camera and the rotation speed in each rotation direction; based on the rotation ratio of each rotation direction, determining an overlapping region of the current frame image and a frame image after the current frame image in the current frame image; and determining brightness information of the current frame image based on the overlapping region, and adjusting exposure parameters of the camera based on the brightness information to obtain target exposure parameters of the next frame image acquired by the camera. According to the technical scheme provided by the invention, stable transition of image brightness in a camera rotation process can be realized, and the quality of images acquired by the camera is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of image imaging technology, and in particular to an automatic exposure adjustment method, device, electronic equipment and storage medium. Background Art

[0002] Rotatable cameras, such as pan / tilt cameras, can collect monitoring images from multiple angles by rotating the camera, expanding the camera's monitoring viewing angle. They have been widely used in monitoring scenarios such as buildings, transportation, mines, and factories.

[0003] When the camera is rotating, the scene in the collected surveillance image will change, especially when the camera is rotating rapidly, the scene will change dramatically, resulting in a drastic change in the image brightness, affecting the image quality. In the related art, during the zooming period during the camera rotation, the rotation speed of the camera is reduced to prevent the scene change of the image from being too large, thereby reducing the impact on the image effect. However, this method is at the expense of reducing the rotation speed of the camera, and it is impossible to optimize the image effect during high-speed rotation, and the performance of the camera's rapid rotation is lost. Summary of the invention

[0004] The present invention provides an automatic exposure adjustment method, device, electronic device and storage medium, which are used to solve the problem of drastic changes in image brightness caused by the rotation of a camera in the prior art. Without reducing the rotation speed of the camera, a smooth transition of the image brightness during the rotation of the camera can be achieved.

[0005] The present invention provides an automatic exposure adjustment method, comprising:

[0006] During the rotation of the camera, a current frame image captured by the camera is obtained;

[0007] Determine the rotation ratio of each rotation direction according to the camera parameters of the camera and the rotation speed in each rotation direction; the rotation ratio is used to represent the ratio of the disappearance area of ​​the image picture caused by the rotation of the camera in the rotation direction in the time interval of adjacent image frames to the whole frame image;

[0008] Based on the rotation ratio of each of the rotation directions, determining an overlapping area between the current frame image and a frame image subsequent to the current frame image in the current frame image;

[0009] The brightness information of the current frame image is determined based on the overlapping area, and the exposure parameter of the camera is adjusted based on the brightness information to obtain the target exposure parameter of the camera for capturing the next frame image.

[0010] According to an automatic exposure adjustment method provided by the present invention, the determining of an overlapping area between the current frame image and a subsequent frame image of the current frame image in the current frame image based on the rotation ratio of each rotation direction includes:

[0011] For each of the rotation directions, the disappearance region of the current frame image is determined based on the rotation ratio corresponding to the rotation direction; the disappearance region is the screen region where the subsequent frame image disappears relative to the current frame image;

[0012] Merging the disappearing areas in each of the rotation directions to obtain a target disappearing area;

[0013] The other regions in the current frame image except the target disappearing region are determined as the overlapping region between the current frame image and the subsequent frame image in the current frame image.

[0014] According to an automatic exposure adjustment method provided by the present invention, in a non-target tracking scenario, determining the brightness information of the current frame image based on the overlapping area includes:

[0015] The overlapping area is divided based on the rotation ratio of each rotation direction to obtain a first motion area and a first intermediate area; wherein the first motion area is a new screen area of ​​the current frame image relative to a previous frame image of the current frame image; and the first intermediate area is a remaining area in the overlapping area except the first motion area;

[0016] Obtaining a first weight of the first motion area and a second weight of the first middle area; wherein the first weight is greater than the second weight;

[0017] The brightness information of the current frame image is determined based on the brightness information of the first motion area, the first weight, the brightness information of the first middle area, and the second weight.

[0018] According to an automatic exposure adjustment method provided by the present invention, in a target tracking scenario, determining the brightness information of the current frame image based on the overlapping area includes:

[0019] Determine a target tracking area occupied by the target tracking object in the overlapping area;

[0020] The overlapping area is divided based on the rotation ratio of each rotation direction to obtain a second motion area and a second intermediate area; wherein the second motion area is an area in the picture area that newly appears in the current frame image relative to the previous frame image of the current frame image, which does not overlap with the target tracking area; and the second intermediate area is the remaining area in the overlapping area except the second motion area and the target tracking area;

[0021] Acquire a third weight of the target tracking area, a fourth weight of the second motion area, and a fifth weight of the second middle area; wherein the third weight is greater than the fourth weight, and the fourth weight is greater than the fifth weight;

[0022] The brightness information of the current frame image is determined based on the brightness information of the target tracking area, the third weight, the brightness information of the second motion area, the fourth weight, the brightness information of the second middle area and the fifth weight.

[0023] An automatic exposure adjustment method according to the present invention also includes:

[0024] Determining a brightness change amplitude of the current frame image relative to a previous frame image of the current frame image;

[0025] When the brightness variation amplitude is greater than a set threshold, the adjustment strategy for adjusting the exposure parameter of the camera based on the brightness information is adjusted by at least one of the following: reducing the adjustment speed of adjusting the exposure parameter, expanding the brightness tolerance range when adjusting the exposure parameter, and increasing the weight of the motion area;

[0026] After the adjustment is performed, for the current frame image captured by the camera, adjusting the exposure parameters of the camera based on the brightness information includes:

[0027] Based on the brightness information, the exposure parameters of the camera are adjusted using the adjusted adjustment strategy.

[0028] According to an automatic exposure adjustment method provided by the present invention, after performing the adjustment, the method further includes:

[0029] When it is detected that the brightness change amplitudes of the current frame image for a preset number of consecutive frames are all less than or equal to the set threshold, the adjustment strategy for adjusting the exposure parameter based on the brightness information is restored to the strategy before adjustment.

[0030] According to an automatic exposure adjustment method provided by the present invention, after adjusting the exposure parameter of the camera based on the brightness information to obtain the target exposure parameter of the camera capturing the next frame of image, the method further includes:

[0031] Determining target image signal processing parameters corresponding to the next frame of image based on the target exposure parameters and the overlapping area;

[0032] Image signal processing is performed on the next frame of image according to the target image signal processing parameter.

[0033] The present invention also provides an automatic exposure adjustment device, comprising:

[0034] An image acquisition module, used to acquire a current frame image captured by the camera during the camera rotation;

[0035] A first determination module is used to determine the rotation ratio of each rotation direction according to the camera parameters of the camera and the rotation speed in each rotation direction; the rotation ratio is used to represent the ratio of the disappearance area of ​​the image screen caused by the rotation of the camera in the rotation direction in the time interval of adjacent image frames to the whole frame image;

[0036] A second determination module is used to determine an overlapping area between the current frame image and a subsequent frame image of the current frame image in the current frame image based on the rotation ratio of each rotation direction;

[0037] An adjustment module is used to determine the brightness information of the current frame image based on the overlapping area, and adjust the exposure parameters of the camera based on the brightness information to obtain the target exposure parameters of the camera for capturing the next frame image.

[0038] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, any one of the automatic exposure adjustment methods described above is implemented.

[0039] The present invention also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the automatic exposure adjustment method as described above is implemented.

[0040] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the automatic exposure adjustment method as described above is implemented.

[0041] The automatic exposure adjustment method, device, electronic device and storage medium provided by the present invention determine the rotation ratio of each rotation direction through the camera parameters and the rotation speed in each rotation direction during the rotation of the camera. The rotation ratio can represent the ratio of the disappearance area of ​​the image screen caused by the rotation of the camera in the rotation direction in the time interval of adjacent image frames to the whole frame image. In this way, based on the rotation ratio, the overlapping area of ​​the current frame image and the next frame image can be determined, and the overlapping area is the area reproduced in the next frame image; then the brightness information of the current frame image is determined based on the overlapping area and the exposure parameters of the camera are adjusted based on the brightness information to obtain the target exposure parameters of the next frame image collected by the camera. The target exposure parameters are determined according to the image information of the overlap between the current frame image and the next frame image, so that they can be better applied to the next frame image, so as to achieve the effect of smooth transition of image brightness, thereby improving the quality of the image collected during the rotation of the camera. Moreover, in this process, the acquisition of each frame image will not be affected by the rotation speed of the camera. In this way, the smooth transition of image brightness during the rotation of the camera can be achieved without reducing the rotation speed of the camera. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0043] Figure 1 This is one of the flow charts of the automatic exposure adjustment method provided by an embodiment of the present invention;

[0044] Figure 2 is a schematic diagram of the principle of determining the overlapping area of ​​the current frame image based on the horizontal rotation ratio in an embodiment of the present invention;

[0045] Figure 3 is a schematic diagram of the principle of determining the overlapping area of ​​the current frame image based on the rotation ratio in the horizontal direction and the vertical direction in an embodiment of the present invention;

[0046] Figure 4 This is one of the schematic diagrams of the image change process during the rotation of the camera in the embodiment of the present invention;

[0047] Figure 5 This is the second schematic diagram of the image change process during the camera rotation process in the embodiment of the present invention;

[0048] Figure 6is a schematic diagram of the principle of dividing the current frame image into regions based on the rotation ratios in the horizontal direction and the vertical direction in an embodiment of the present invention;

[0049] Figure 7 is a schematic diagram of a region division result of a current frame image in a target tracking scenario in an embodiment of the present invention;

[0050] Figure 8 This is a second flow chart of the automatic exposure adjustment method provided by an embodiment of the present invention;

[0051] Fig. 9 is a schematic structural diagram of an automatic exposure adjustment device provided by an embodiment of the present invention;

[0052] Fig.10 It is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0054] It should be noted that the serial numbers assigned to the objects described in the present invention, such as "first", "second", etc., are only used to distinguish the objects described and do not have any order or technical meaning.

[0055] Automatic exposure (AE) is the process of automatically adjusting the exposure of the camera according to the intensity of light. That is, when the light in the external environment changes, the camera's shutter, gain and other exposure parameters are automatically adjusted to keep the image brightness within the target brightness range. Specifically, during the AE algorithm calculation process, after obtaining the brightness of the current frame image, the brightness is compared with the target brightness, and the exposure parameters required for the next frame image are determined based on the comparison result, so that the brightness of the next frame image is closer to the target brightness.

[0056] With the advancement of technology, the rotation speed of rotating cameras (such as PTZ cameras) has been greatly improved, and the automatic tracking function has emerged, which can continuously track the target. However, when the camera rotates quickly, the monitoring scene will change dramatically, resulting in drastic changes in image brightness and poor clarity, affecting image quality.

[0057] After an in-depth analysis of the root cause of the dramatic changes in image brightness during the rapid rotation of the camera, it is known that it is mainly related to the adjustment principle of the AE algorithm. Specifically, the adjustment principle of the AE algorithm is to use the image information of the current frame image to calculate the shutter, gain and other exposure parameters that need to be effective for the next frame image, and adjust the exposure parameters to make the brightness of the next frame image closer to the target brightness, and continuously adjust and optimize. However, during the rotation of the camera, the picture range of the current frame image and the next frame image are not the same, which makes the AE adjustment process inaccurate, resulting in obvious fluctuations in the image brightness. At the same time, the Image Signal Processing (ISP) parameters are linked according to the gain in the AE adjustment process. Inaccurate AE calculation will also lead to inaccurate effective ISP parameters, which in turn leads to poor image effects.

[0058] Based on this, an embodiment of the present invention provides an automatic exposure adjustment method, which can determine the rotation ratio of each rotation direction according to the camera parameters and the rotation speed in each rotation direction of the camera, determine the overlapping area of ​​the current frame image and the next frame image in the current frame image captured by the camera based on the rotation ratio of each rotation direction, and then determine the brightness information of the current frame image based on the overlapping area, and adjust the exposure parameters of the camera based on the brightness information to obtain the target exposure parameters of the next frame image captured by the camera. By using the image information of the intersection of the current frame image and the next frame image to perform AE adjustment, the exposure parameters determined in this way are more suitable for the next frame image, achieving a relatively smooth brightness transition effect, thereby optimizing the image effect during the camera rotation process and ensuring the quality of the captured image.

[0059] Combine the following Figure 1-Figure 8 The automatic exposure adjustment method of the present invention is described. The automatic exposure adjustment method can be applied to an electronic device, which may include a camera or a terminal device or a server connected to the camera for communication. The terminal device may include a mobile phone, a computer, a vehicle-mounted device, a tablet computer, a wearable device, etc. The server may include an independent server, a cluster server or a cloud server, etc. The automatic exposure adjustment method can also be applied to an automatic exposure adjustment device set in an electronic device, which can be implemented by software, hardware or a combination of the two.

[0060] Figure 1 One of the flow charts of the automatic exposure adjustment method provided by an embodiment of the present invention is exemplarily shown, referring to Figure 1 As shown, the automatic exposure adjustment method may include the following steps 110 to 150.

[0061] Step 110: While the camera is rotating, obtain the current frame image captured by the camera.

[0062] The camera can collect images within its monitoring range during the rotation process, and the camera or other electronic devices connected to the camera for communication can obtain the current frame image collected by the camera.

[0063] Step 120: Determine the rotation ratio in each rotation direction according to the camera parameters of the camera and the rotation speed in each rotation direction.

[0064] The rotation ratio is used to characterize the ratio of the disappearance area of ​​the image caused by the rotation of the camera in the rotation direction to the entire frame image within the time interval of adjacent image frames. The camera (such as a pan / tilt camera) can rotate in the horizontal direction and the vertical direction, and each rotation direction has its corresponding rotation speed. The camera parameters may include the horizontal field of view angle α, the vertical field of view angle β and the frame rate fps.

[0065] For the horizontal direction, the rotation ratio P1 in the horizontal direction can be determined according to the rotation speed ω1 of the camera in the horizontal direction, the horizontal field angle α and the frame rate fps. Specifically, the rotation ratio P1 in the horizontal direction can be determined by the following formula (1):

[0066]

[0067] For the vertical direction, the rotation ratio P2 in the vertical direction can be determined according to the rotation speed ω2 of the camera in the vertical direction, the vertical field angle β and the frame rate fps. Specifically, the rotation ratio P2 in the vertical direction can be determined by the following formula (2):

[0068]

[0069] Step 130: Determine an overlapping area between the current frame image and a frame image subsequent to the current frame image in the current frame image based on the rotation ratio of each rotation direction.

[0070] The camera can be moved horizontally, vertically, or both horizontally and vertically.

[0071] If the camera rotates in one direction, such as the horizontal direction, the disappearing area of ​​the next frame image relative to the current frame image can be determined according to the horizontal rotation ratio P1 to obtain the disappearing area of ​​the current frame image, and the other areas of the current frame image except the disappearing area are the overlapping areas with the next frame image. For example, Figure 2 The schematic diagram exemplarily shows the principle of determining the overlapping area of ​​the current frame image based on the horizontal rotation ratio, referring to Figure 2As shown, the shadow area on the left side that occupies P1 of the current frame image can be determined as the disappearing area of ​​the current frame image along the horizontal direction. The picture in this area disappears in the next frame image. The blank area in the current frame image except the shadow area is the overlapping area where the current frame image overlaps with the next frame image. Exemplarily, the dividing point O can be found from the horizontal side AB in the current frame image, so that the ratio of the length of AO to the side AB is P1, and then the current frame image is vertically divided along the dividing point O, and the disappearing area shown in the shadow area can be determined.

[0072] When the camera rotates in the vertical direction, the overlapping area of ​​the current frame image when rotating in the vertical direction can be determined by the same method as that in the horizontal direction.

[0073] For the case where the camera rotates in various rotation directions at the same time, such as rotating in the horizontal and vertical directions at the same time, the disappearing areas determined in each rotation direction can be merged, and then the remaining area in the current frame image except the merged disappearing area can be determined as the overlapping area of ​​the current frame image.

[0074] Specifically, determining the overlapping area between the current frame image and the next frame image of the current frame image based on the rotation ratio of each rotation direction may include: for each rotation direction, determining the disappearance area of ​​the current frame image based on the rotation ratio corresponding to the rotation direction; merging the disappearance areas of each rotation direction to obtain the target disappearance area; determining other areas of the current frame image except the target disappearance area as the overlapping area between the current frame image and the next frame image in the current frame image. The disappearance area is the screen area where the next frame image disappears relative to the current frame image.

[0075] For example, Figure 3 The schematic diagram exemplarily shows the principle of determining the overlapping area of ​​the current frame image based on the rotation ratio of the horizontal direction and the vertical direction, referring to Figure 3 As shown, image 31 is the current frame image, and image 32 is the next frame image; the area formed by the combination of area C1 and area C2 is the disappearance area caused by the camera rotating in the horizontal direction, which can be determined based on the rotation ratio in the horizontal direction; the area formed by the combination of area C2 and area C3 is the disappearance area caused by the camera rotating in the vertical direction, which can be determined based on the rotation ratio in the vertical direction; these two disappearance areas are merged to obtain the target disappearance area, that is, the area formed by the combination of area C1, area C2 and area C3. The remaining area in the current frame image 31 except area C1, area C2 and area C3 is the overlapping area of ​​the current frame image 31.

[0076] Step 140: Determine brightness information of the current frame image based on the overlapping area.

[0077] After the overlapping area of ​​the current frame image is determined, the overlapping area can be used as a source of brightness statistical information, and the brightness information of the current frame image can be calculated based on the image information of the overlapping area.

[0078] Step 150: adjusting the exposure parameters of the camera based on the brightness information to obtain the target exposure parameters of a frame of image captured by the camera.

[0079] After obtaining the brightness information of the current frame image, the brightness information can be compared with the target brightness, and the exposure parameters of the camera can be adjusted according to the comparison result to obtain the target exposure parameters required when the camera captures the next frame image, thus realizing an AE adjustment. The camera can perform such an AE adjustment every time it captures a frame image, so that the next frame image is closer to the target brightness, and the image effect and quality of the camera rotation process are continuously optimized.

[0080] The automatic exposure adjustment method provided by the present invention determines the rotation ratio of each rotation direction through the camera parameters and the rotation speed in each rotation direction during the rotation of the camera. The rotation ratio can represent the ratio of the disappearance area of ​​the image screen caused by the rotation of the camera in the rotation direction in the time interval of adjacent image frames to the whole frame image. In this way, based on the rotation ratio, the overlapping area of ​​the current frame image and the next frame image can be determined, and the overlapping area is the area reproduced in the next frame image; then the brightness information of the current frame image is determined based on the overlapping area and the exposure parameters of the camera are adjusted based on the brightness information to obtain the target exposure parameters of the next frame image collected by the camera. The target exposure parameters are determined according to the image information of the overlap between the current frame image and the next frame image, so that they can be better applied to the next frame image, so as to achieve the effect of smooth transition of image brightness, thereby improving the quality of the image collected during the rotation of the camera. Moreover, in this process, the acquisition of each frame image will not be affected by the rotation speed of the camera. In this way, the smooth transition of image brightness during the rotation of the camera can be achieved without reducing the rotation speed of the camera.

[0081] based on Figure 1 In the automatic exposure adjustment method of the corresponding embodiment, the rotation of the camera not only causes the disappearance of the image area, but also causes a new image area. That is, as the camera rotates, a new image area will appear in the current frame image relative to its previous frame image. In the embodiment of the present invention, the newly appeared image area can be defined as a motion area. Based on this, in an exemplary embodiment, the motion area of ​​the current frame image can be determined based on the rotation ratio of each rotation direction, and the overlapping area of ​​the current frame image can be further divided. The following is a description of the two application scenarios of non-target tracking scenario and target tracking scenario.

[0082] In a non-target tracking scenario, determining the brightness information of the current frame image based on the overlapping area may include: dividing the overlapping area based on the rotation ratio of each rotation direction to obtain a first motion area and a first intermediate area; obtaining a first weight of the first motion area and a second weight of the first intermediate area; determining the brightness information of the current frame image based on the brightness information of the first motion area, the first weight, the brightness information of the first intermediate area, and the second weight; wherein the first motion area is a newly appearing picture area of ​​the current frame image relative to the previous frame image of the current frame image, and the first intermediate area is the remaining area in the overlapping area except the first motion area; wherein the first weight is greater than the second weight.

[0083] Exemplarily, after weighting the brightness information of the first motion area with a first weight and weighting the brightness information of the first middle area with a second weight, the brightness of the overlapping area, such as the average brightness, is calculated based on the weighted brightness information of the first motion area and the weighted brightness information of the first middle area, and the brightness of the overlapping area is used as the brightness information of the current frame image.

[0084] Exemplarily, dividing the overlapping area based on the rotation ratio of each rotation direction to obtain the first motion area and the first intermediate area may include: for each rotation direction, determining the motion area of ​​the rotation direction in the current frame image according to the rotation ratio of the rotation direction; merging the motion areas of each motion direction to obtain the first motion area of ​​the current frame image; and determining the remaining area in the overlapping area except the first motion area as the first intermediate area of ​​the current frame image. It is understandable that the camera can rotate in only one rotation direction. In this case, the first motion area is the motion area in the rotation direction, and the first intermediate area is the remaining area in the overlapping area except the motion area in the rotation direction.

[0085] Specifically, for each rotation direction, if the rotation ratio of the rotation direction is less than 0.5, the area of ​​the motion region in the rotation direction is equal to the area of ​​the disappearance region in the rotation direction, and the motion region can be divided from the opposite end of the disappearance region in the rotation direction. For each rotation direction, if the rotation ratio of the rotation direction is greater than or equal to 0.5 and less than 1, there is no intermediate region in the rotation direction of the current frame image, and the region in the current frame image other than the disappearance region in the rotation direction is determined as the motion region in the rotation direction.

[0086] For example, Figure 4 One of the schematic diagrams of the image change process during the camera rotation process is exemplified, which takes the case where the camera rotates in one rotation direction and the rotation ratio of the rotation direction is less than 0.5 as an example. Figure 4As shown, for each frame image, area S1 represents the disappearing area in the frame image, that is, the image area that will disappear in the next frame image as the camera rotates; area S2 represents the middle area in the frame image; area S3 represents the moving area in the frame image, that is, the image area that appears newly relative to the previous frame image as the camera rotates. Specifically, in this case, for the rotation direction, the disappearing area S1, the middle area S2 and the moving area S3 of a frame image can be determined by the following formula (3):

[0087]

[0088] Wherein, P represents the rotation ratio of the rotation direction. When the rotation direction is horizontal, P is the above-mentioned P1, and when the rotation direction is vertical, P is the above-mentioned P2; S represents the entire frame image.

[0089] Figure 5 The second schematic diagram of the image change process during the camera rotation process is exemplified, which takes the case where the camera rotates in one rotation direction and the rotation ratio of the rotation direction is greater than or equal to 0.5 and less than 1 as an example. Figure 5 As shown, for each frame image, area S1 represents the disappearing area in the frame image, that is, the image area that will disappear in the next frame image as the camera rotates; area S3 represents the moving area in the frame image, that is, the image area that appears newly relative to the previous frame image as the camera rotates. Specifically, in this case, for the rotation direction, the disappearing area S1, the middle area S2 and the moving area S3 of a frame image can be determined by the following formula (4):

[0090]

[0091] Wherein, P represents the rotation ratio of the rotation direction. When the rotation direction is horizontal, P is the above-mentioned P1, and when the rotation direction is vertical, P is the above-mentioned P2; S represents the entire frame image. It can be understood that in this case, for each frame image, there is no middle area S2.

[0092] based on Figure 4 and Figure 5 Based on the principle of , when the camera rotates in both the horizontal and vertical directions, for each rotation direction, the region division result of the current frame image in the rotation direction can be determined according to the rotation ratio of the rotation direction according to the above formula (3) or (4), and then the region division results of the two rotation directions are merged to obtain the final region division result of the current frame image. For example, Figure 6 The schematic diagram exemplarily shows the principle of dividing the current frame image into regions based on the rotation ratio in the horizontal direction and the vertical direction, referring to Figure 6As shown, for the current frame image, the above formula (3) and formula (4) can be combined to divide the regions in the respective directions based on the horizontal rotation ratio and the vertical rotation ratio, respectively, to obtain the disappearing regions (diagonal shadow regions), middle regions (unshadowed regions) and motion regions (grid shadow regions) corresponding to the two rotation directions, and then merge the divided regions of the same type in the order of priority of "disappearing regions>motion regions>middle regions". That is, first merge the disappearing regions of the two motion directions to obtain the target disappearing regions, corresponding to Figure 6 Then, in the area other than the target disappearing area in the current frame image, the motion areas of the two motion directions are merged to obtain the merged first motion area, corresponding to Figure 6 The grid shadow area of ​​the merged image in the merged image is the final first intermediate area. In this way, the image area division result of the synthetic motion direction formed by the camera rotating in both the horizontal and vertical directions can be obtained.

[0093] In a target tracking scenario, determining the brightness information of the current frame image based on the overlapping area may include: determining the target tracking area occupied by the target tracking object in the overlapping area; dividing the overlapping area based on the rotation ratio of each rotation direction to obtain the second motion area and the second intermediate area; obtaining the third weight of the target tracking area, the fourth weight of the second motion area and the fifth weight of the second intermediate area; determining the brightness information of the current frame image based on the brightness information of the target tracking area, the third weight, the brightness information of the second motion area, the fourth weight, the brightness information of the second intermediate area and the fifth weight. Among them, the second motion area is an area in the picture area that newly appears in the current frame image relative to the previous frame image of the current frame image, which does not overlap with the target tracking area; the second intermediate area is the remaining area in the overlapping area except the second motion area and the target tracking area; the third weight is greater than the fourth weight, and the fourth weight is greater than the fifth weight.

[0094] In this way, by setting the third weight of the target tracking area to the maximum, the image effect during the camera rotation process can be more conducive to identifying the target tracking object.

[0095] Exemplarily, the target tracking object may include a person, a face, or other moving objects, etc. The target tracking area occupied by the target tracking object may be determined based on target detection.

[0096] Exemplarily, the brightness information of the target tracking area can be weighted using the third weight, the brightness information of the second motion area can be weighted using the fourth weight, and the brightness information of the second intermediate area can be weighted using the fifth weight. Then, the brightness of the overlapping area, such as the average brightness, is calculated based on the weighted brightness information of the target tracking area, the weighted brightness information of the second motion area, and the weighted brightness information of the second intermediate area, and the brightness of the overlapping area is used as the brightness information of the current frame image.

[0097] Exemplarily, the above formula (3) and formula (4) can be combined, based on the rotation ratio of each rotation direction, first use the same method as the non-target tracking scene to determine the disappearing area, middle area and moving area of ​​the current frame image in the synthetic rotation direction, and then, according to the area occupied by the target tracking area in the current frame image, the area occupied by the target tracking area in the disappearing area, middle area and moving area is removed from the area occupied by the target tracking area in the disappearing area, middle area and moving area, so as to obtain the final disappearing area, second moving area and second middle area of ​​the current frame image.

[0098] For example, Figure 7 The schematic diagram of the region division result of the current frame image in the target tracking scene is shown as an example, taking the camera rotating in the horizontal direction as an example, referring to Figure 7 As shown, the disappearing area (diagonal line shadow area), the second motion area (grid shadow area), the second middle area (unshaded area) and the target tracking area S0 of the current frame image can be spliced ​​to form the current frame image.

[0099] Based on the automatic exposure adjustment method of the above-mentioned embodiments, in an exemplary embodiment, the ambient brightness can be detected during the continuous AE adjustment process. When the ambient brightness changes dramatically, the AE adjustment strategy is optimized to reduce the impact of the drastic change in ambient brightness on the image quality.

[0100] Specifically, the automatic exposure adjustment method may further include: determining the brightness change amplitude of the current frame image relative to the previous frame image of the current frame image; when the brightness change amplitude is greater than a set threshold, adjusting the adjustment strategy for adjusting the exposure parameters of the camera based on the brightness information by at least one of the following: reducing the adjustment speed of adjusting the exposure parameters, expanding the brightness tolerance range when adjusting the exposure parameters, and increasing the weight of the motion area. Correspondingly, after adjusting the adjustment strategy, for the current frame image captured by the camera, adjusting the exposure parameters of the camera based on the brightness information may include: adjusting the exposure parameters of the camera based on the brightness information using the adjusted adjustment strategy.

[0101] Optionally, after making the adjustment, the automatic exposure adjustment method may further include: when it is detected that the brightness change amplitude of the current frame image for a preset number of consecutive frames is less than or equal to a set threshold, restoring the adjustment strategy for adjusting the exposure parameters based on the brightness information to the strategy before the adjustment.

[0102] The brightness tolerance interval refers to the range of the difference between the brightness of the image collected during the AE adjustment process and the target brightness. If the difference between the brightness of the current frame image and the target brightness is within the brightness tolerance interval, there is no need to recalculate the AE.

[0103] Exemplarily, the brightness change amplitude of the current frame image relative to the previous frame image of the current frame image can be determined according to the following formula (5):

[0104]

[0105] Among them, PE represents the brightness change amplitude of the image during the camera rotation; Luma represents the brightness of the current frame image; Luma pre Indicates the brightness of the previous frame of the current frame.

[0106] In an embodiment of the present invention, the adjustment strategy for adjusting the exposure parameters of the camera based on brightness information can be adjusted according to different working states of the camera. For example, before the camera rotates, the adjustment strategy may include: taking the whole frame image as the source of brightness statistical information, and adjusting the AE exposure parameters. During the rotation of the camera, AE adjustment strategy 1 is effective; if in the process of continuously performing AE adjustment according to AE adjustment strategy 1, it is detected that the brightness change amplitude of the current frame image relative to its previous frame image is greater than the set threshold, indicating that the ambient brightness changes drastically, then AE adjustment strategy 1 is adjusted to obtain the adjusted AE adjustment strategy 2; AE adjustment is performed using AE adjustment strategy 2 until the brightness change amplitude of the current frame image for a preset number of consecutive frames is less than or equal to the set threshold, indicating that the AE adjustment amplitude has returned to normal, and at this time, the AE adjustment is restored to AE adjustment strategy 1.

[0107] Among them, AE adjustment strategy 1 at least includes: taking the overlapping area of ​​the current frame image as the source of brightness statistical information, and calculating the brightness information of the current frame image in combination with the weights of each area divided by the overlapping area; the AE adjustment speed is V1; and the brightness tolerance interval is tolerance interval 1. When it is detected that the ambient brightness changes drastically, for example, AE adjustment strategy 1 is adjusted as follows: the AE adjustment speed is reduced from V1 to V2, the brightness tolerance interval is expanded from tolerance interval 1 to tolerance interval 2, and the weight of the motion area is increased from λ1 to λ2. Then the AE adjustment strategy 2 obtained after adjustment may include: taking the overlapping area of ​​the current frame image as the source of brightness statistical information, and calculating the brightness information of the current frame image in combination with the weights of each area divided by the overlapping area; the AE adjustment speed is V2; and the brightness tolerance interval is tolerance interval 2. Among them, the weights of each area in AE adjustment strategy 2 are adjusted weights, which may be different from AE adjustment strategy 1.

[0108] Based on the automatic exposure adjustment method of the above-mentioned embodiments, in an exemplary embodiment, after adjusting the exposure parameters of the camera based on the brightness information to obtain the target exposure parameters of the next frame of image captured by the camera, the automatic exposure adjustment method also includes: determining the target image signal processing parameters corresponding to the next frame of image based on the target exposure parameters and the overlapping area; and performing image signal processing on the next frame of image according to the target image signal processing parameters.

[0109] The image signal processing (ISP) parameters are linked according to the gain in the AE adjustment process. Moreover, the disappearing area of ​​the current frame image does not appear in the next frame image. Therefore, the overlapping area can be used as the statistical information source for ISP processing of the current frame image, and ISP processing can be performed. This can optimize the next frame image to a certain extent.

[0110] Image signal processing (ISP) mainly includes a series of image processing algorithms such as automatic white balance, automatic exposure, automatic focus, color filter array (CFA) interpolation, vignetting compensation, bad pixel detection, denoising, sharpening, image scaling and gamma correction. ISP processing can improve the effect and quality of images.

[0111] Based on the automatic exposure adjustment methods of the above embodiments, the automatic exposure adjustment methods provided by the embodiments of the present invention are further illustrated below using non-target tracking scenarios and target tracking scenarios.

[0112] Figure 8 The second flow chart of the automatic exposure adjustment method provided by the embodiment of the present invention is exemplified, which takes the horizontal rotation of the camera in a non-target tracking scene as an example, referring to Figure 8 As shown, the automatic exposure adjustment method may include the following steps 801 to 810.

[0113] Step 801: Before the camera rotates, the entire frame image is used as the source of statistical information, and AE adjustment and ISP image parameter adjustment are performed on each frame image.

[0114] Step 802: While the camera is rotating horizontally, a current frame image captured by the camera is obtained.

[0115] Step 803: Determine the horizontal rotation ratio according to the camera parameters and the horizontal rotation speed of the camera.

[0116] Step 804: Determine whether the rotation ratio is less than 0.5.

[0117] If it is less than, execute step 805; otherwise, execute step 809.

[0118] Step 805: Divide the current frame image into a disappearing area S1, a middle area S2 and a moving area S3 based on the rotation ratio, and obtain a first weight and a second weight.

[0119] The first weight and the second weight are configurable, and the first weight is greater than the second weight.

[0120] Step 806: Determine the brightness information of the current frame image based on the brightness information of the middle area S2, the brightness information of the motion area S3, the first weight and the second weight.

[0121] Step 807: adjusting the exposure parameters of the camera based on the brightness information of the current frame image to obtain the target exposure parameters of the next frame image captured by the camera.

[0122] Step 808: Based on the target exposure parameters, the target image signal processing parameters corresponding to the next frame of image are determined with the middle area S2 and the motion area S3 as statistical information sources. Then, step 813 is executed.

[0123] Step 809: Divide the current frame image into a disappearing area S1 and a moving area S3 based on the rotation ratio, and obtain a second weight.

[0124] Step 810: Determine the brightness information of the current frame image based on the brightness information of the motion area S3 and the second weight.

[0125] Step 811: adjusting the exposure parameters of the camera based on the brightness information of the current frame image to obtain the target exposure parameters of the next frame image captured by the camera.

[0126] Step 812: Based on the target exposure parameters and taking the motion area S3 as the statistical information source, determine the target image signal processing parameters corresponding to the next frame of image.

[0127] Specifically, when the rotation ratio is less than 0.5, the above formula (3) can be used to determine the disappearing area S1, the middle area S2 and the moving area S3 of the current frame image. Then, the AE adjustment strategy 1 is implemented, the weight of the disappearing area S1 is set to 0, the brightness information of the moving area S3 is weighted by the first weight, and the brightness information of the middle area S2 is weighted by the second weight, and the brightness information of the current frame image is calculated based on the weighted brightness information of each area. Among them, the middle area S2 and the moving area S3 are the overlapping areas of the current frame image.

[0128] When the rotation ratio is greater than or equal to 0.5 and less than 1, there is no intermediate area, and the above formula (4) can be used to determine the disappearing area S1 and the moving area S3 of the current frame image, and then the AE adjustment strategy 1 is implemented, the weight of the disappearing area S1 is set to 0, and the brightness information of the moving area S3 is weighted by the first weight, and the brightness information of the current frame image is calculated according to the weighted brightness information of the moving area S3. Among them, the moving area S3 is the overlapping area of ​​the current frame image.

[0129] After obtaining the brightness information of the current frame image, the exposure parameters of the camera can be adjusted based on the brightness information of the current frame image to obtain the target exposure parameters of the next frame image captured by the camera. Based on the target exposure parameters, the ISP parameters can be adjusted in a linked manner with the overlapping area as the statistical information source.

[0130] In this way, as the camera rotates, AE adjustment and ISP parameter adjustment can be continuously performed.

[0131] Step 813: Determine the brightness change amplitude PE of the current frame image relative to the previous frame image.

[0132] Step 814: Determine whether the brightness variation amplitude PE is greater than a set threshold.

[0133] During the rotation of the camera, while the AE adjustment is being performed continuously, the brightness change amplitude PE of the current frame image relative to its previous frame image can be continuously calculated by the above formula (5), and then the brightness change amplitude PE is compared with the set threshold. If PE is greater than the set threshold, it is considered that the ambient brightness changes dramatically, and the AE adjustment strategy needs to be adjusted to reduce the impact of the dramatic change in ambient brightness. At this time, step 815 can be executed; otherwise, AE adjustment is continued according to the current AE adjustment strategy.

[0134] Step 815: Adjust the AE regulation strategy.

[0135] When the brightness variation amplitude PE is greater than the set threshold, the current AE adjustment strategy 1 can be adjusted, for example, at least one of the following adjustments is made: reducing the adjustment speed, expanding the brightness tolerance range, and increasing the second weight of the motion area S3, so as to obtain the adjusted AE adjustment strategy 2.

[0136] Step 816: Use the adjusted AE adjustment strategy to adjust the exposure parameters of the camera.

[0137] After the adjustment, AE adjustment is performed on each frame of image captured by the camera according to AE adjustment strategy 2, and step 817 is executed at the same time.

[0138] Step 817: Determine whether the brightness variation amplitudes PE of N consecutive image frames are all less than or equal to a set threshold.

[0139] If it is detected that the brightness variation range PE of N consecutive frames of images is less than or equal to the set threshold, it means that the AE adjustment range is normal, and step 818 is executed; otherwise, step 816 is continued. Wherein, N is a natural number, indicating a preset number.

[0140] Step 818: Restore the AE adjustment strategy to the state before adjustment.

[0141] After the AE adjustment range is normal, the AE adjustment strategy is restored from AE adjustment strategy 2 to AE adjustment strategy 1, and AE adjustment is continued with AE adjustment strategy 1.

[0142] After that, the camera continues to rotate and performs AE adjustment in the same process as the rotation process until the camera stops rotating, and then the adjustment strategy before the camera rotates is restored, that is, step 801 is executed, the AE adjustment strategy is restored to the adjustment speed and brightness tolerance range before the camera rotates, and the whole frame image is used as the source of statistical information, and AE adjustment and ISP image parameter adjustment are performed on each frame image.

[0143] The automatic exposure adjustment method provided by the embodiment of the present invention, on the one hand, during the rotation of the camera, for each frame of the image collected, the frame of the image can be divided into regions along the rotation direction according to the frame rate, rotation direction, field of view in the rotation direction and rotation speed of the camera, and the AE adjustment and ISP parameter adjustment are performed using the statistical information of the overlapping region where the frame of the image overlaps with the next frame of the image, so that the exposure parameters and ISP parameters determined based on the statistical information of the overlapping region of the current frame of the image are more suitable for the next frame of the image, so as to achieve the effect of smooth transition of the image brightness, solve the problem of poor image clarity and large brightness change during the rotation of the camera, especially during high-speed rotation, make the brightness adjustment more stable, and improve the image effect and image quality during the rotation of the camera. On the other hand, during the rotation of the camera, during the AE adjustment process, the AE adjustment strategy can be optimized according to the brightness change amplitude of the image, so that the image brightness during the rotation of the camera can be more smoothly transitioned, and the image effect during the rotation of the camera is further optimized. Furthermore, during the rotation of the camera, the overlapping region of the current frame of the image is used as the source of statistical information to run the ISP algorithm, so that the image effect obtained is more suitable for the overlapping region, so that the effect of the next frame of the image is further optimized.

[0144] Figure 8 The method of the corresponding embodiment is described by taking the horizontal rotation of the camera in a non-target tracking scenario as an example. For the vertical rotation of the camera in a non-target tracking scenario, reference can be made to the horizontal rotation, which will not be repeated here.

[0145] For target tracking scenarios, when the target object moves, the camera will also rotate accordingly to track the target object. Since the speed and direction of the target object that the camera needs to track are uncertain, the rotation direction and speed of the camera are not fixed. In this case, the rotation speed and direction of the camera can be recorded in real time.

[0146] When the camera rotates in a target tracking scenario, the AE adjustment and ISP parameter adjustment process are similar to the adjustment process in a non-target tracking scenario, and the adjustment process in a non-target tracking scenario can be referred to. The difference is that in the target tracking scenario, the rotation ratio of each rotation direction is determined based on the rotation speed obtained in real time. When the current frame image is divided into regions based on the rotation ratio, the target tracking region S0 is added, and the target tracking region S0 is given a weight greater than the motion region, ensuring that the result of AE adjustment is more suitable for the target tracking region that needs to be tracked, preventing the target tracking object from being lost due to brightness fluctuations. In the target tracking scenario, when adjusting the AE adjustment strategy, the weight of the target tracking region S0 can remain unchanged and always remain greater than the weight of the motion region.

[0147] When the target tracking object stops moving, the camera can be rotated until the center point of the target tracking area coincides with the center point of the current frame image and then stop rotating.

[0148] The automatic exposure adjustment method provided by the embodiment of the present invention can not only achieve the beneficial effects in non-target tracking scenarios, but also reduce the probability of the target tracking object being lost and improve the accuracy of target tracking.

[0149] The automatic exposure adjustment device provided by the present invention is described below. The automatic exposure adjustment device described below and the automatic exposure adjustment method described above can be referred to each other.

[0150] Fig. 9 The schematic diagram of the structure of the automatic exposure adjustment device provided by the embodiment of the present invention is exemplarily shown. Fig. 9 As shown, the automatic exposure adjustment device 900 may include: an image acquisition module 910, which is used to acquire the current frame image captured by the camera during the rotation of the camera; a first determination module 920, which is used to determine the rotation ratio of each rotation direction according to the camera parameters of the camera and the rotation speed in each rotation direction, and the rotation ratio is used to characterize the ratio of the disappearance area of ​​the image screen caused by the rotation of the camera in the rotation direction within the time interval of adjacent image frames to the entire frame image; a second determination module 930, which is used to determine the overlapping area of ​​the current frame image and the next frame image of the current frame image in the current frame image based on the rotation ratio of each rotation direction; an adjustment module 940, which is used to determine the brightness information of the current frame image based on the overlapping area, and adjust the exposure parameters of the camera based on the brightness information to obtain the target exposure parameters of the next frame image captured by the camera.

[0151] In an exemplary embodiment, the second determination module 930 may include: a first determination unit, for determining the disappearance area of ​​the current frame image based on the rotation ratio corresponding to each rotation direction; a merging unit, for merging the disappearance areas of each rotation direction to obtain a target disappearance area; and a second determination unit, for determining other areas in the current frame image except the target disappearance area as the overlapping area of ​​the current frame image and the next frame image in the current frame image. The disappearance area is the screen area where the next frame image disappears relative to the current frame image.

[0152] In an exemplary embodiment, the adjustment module 940 may include: a first division unit, used to divide the overlapping area based on the rotation ratio of each rotation direction in a non-target tracking scenario to obtain a first motion area and a first intermediate area; a first acquisition unit, used to obtain a first weight of the first motion area and a second weight of the first intermediate area, wherein the first weight is greater than the second weight; a third determination unit, used to determine the brightness information of the current frame image based on the brightness information of the first motion area, the first weight, the brightness information of the first intermediate area, and the second weight. The first motion area is a newly appeared picture area of ​​the current frame image relative to the previous frame image of the current frame image, and the first intermediate area is the remaining area in the overlapping area except the first motion area;

[0153] In an exemplary embodiment, the adjustment module 940 may include: a fourth determination unit, for determining the target tracking area occupied by the target tracking object in the overlapping area in the target tracking scene; a second division unit, for dividing the overlapping area based on the rotation ratio of each rotation direction to obtain the second motion area and the second intermediate area; a second acquisition unit, for acquiring the third weight of the target tracking area, the fourth weight of the second motion area, and the fifth weight of the second intermediate area, wherein the third weight is greater than the fourth weight, and the fourth weight is greater than the fifth weight; a fifth determination unit, for determining the brightness information of the current frame image based on the brightness information of the target tracking area, the third weight, the brightness information of the second motion area, the fourth weight, the brightness information of the second intermediate area, and the fifth weight. The second motion area is an area in the picture area that newly appears in the current frame image relative to the previous frame image of the current frame image, which does not overlap with the target tracking area, and the second intermediate area is the remaining area in the overlapping area except the second motion area and the target tracking area.

[0154] In an exemplary embodiment, the adjustment module 940 also includes: a sixth determination unit, which is used to determine the brightness change amplitude of the current frame image relative to the previous frame image of the current frame image; an adjustment unit, which is used to adjust the adjustment strategy for adjusting the exposure parameters of the camera based on the brightness information when the brightness change amplitude is greater than a set threshold, by at least one of the following adjustments: reducing the adjustment speed of adjusting the exposure parameters, expanding the brightness tolerance range when adjusting the exposure parameters, and increasing the weight of the motion area; after the adjustment, for the current frame image captured by the camera, based on the brightness information, the adjusted adjustment strategy is used to adjust the exposure parameters of the camera.

[0155] In an exemplary embodiment, the adjustment unit is also used to restore the adjustment strategy of adjusting the exposure parameters based on brightness information to the strategy before adjustment after adjusting the adjustment strategy, when it is detected that the brightness change amplitude of the current frame image for a preset number of consecutive frames is less than or equal to a set threshold.

[0156] In an exemplary embodiment, the automatic exposure adjustment device 900 also includes a processing module, which is used to: determine the target image signal processing parameters corresponding to the next frame image based on the target exposure parameters and the overlapping area; and perform image signal processing on the next frame image according to the target image signal processing parameters.

[0157] Fig.10 An example of a structural diagram of an electronic device is shown in FIG. Fig.10 As shown, the electronic device may include: a processor 1010, a communication interface 1020, a memory 1030, and a communication bus 1040, wherein the processor 1010, the communication interface 1020, and the memory 1030 may communicate with each other through the communication bus 1040. The processor 1010 may call the logic instructions in the memory 1030 to execute the automatic exposure adjustment method provided by any of the above method embodiments.

[0158] Exemplarily, the electronic device may include a camera or a terminal device connected to the camera for communication. The camera may be a rotatable camera, such as a pan / tilt camera; and the terminal device may be a mobile phone, a computer, a server, or other devices.

[0159] In addition, the logic instructions in the above-mentioned memory 1030 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk.

[0160] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the automatic exposure adjustment method provided by any of the above method embodiments.

[0161] On the other hand, the present invention further provides a computer-readable storage medium having a computer program stored thereon, which is implemented when the computer program is executed by a processor to execute the automatic exposure adjustment method provided by any of the above method embodiments.

[0162] Exemplarily, the computer-readable storage medium includes a non-transitory computer-readable storage medium.

[0163] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0164] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0165] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An automatic exposure adjustment method, characterized in that: include: During the rotation of the camera, a current frame image captured by the camera is obtained; Determine the rotation ratio of each rotation direction according to the camera parameters of the camera and the rotation speed in each rotation direction; the rotation ratio is used to represent the ratio of the disappearance area of ​​the image picture caused by the rotation of the camera in the rotation direction in the time interval of adjacent image frames to the whole frame image; Based on the rotation ratio of each of the rotation directions, determining an overlapping area between the current frame image and a frame image subsequent to the current frame image in the current frame image; The brightness information of the current frame image is determined based on the overlapping area, and the exposure parameter of the camera is adjusted based on the brightness information to obtain the target exposure parameter of the camera for capturing the next frame image.

2. The automatic exposure adjustment method according to claim 1, characterized in that: The determining, based on the rotation ratio of each of the rotation directions, an overlapping area between the current frame image and a frame image subsequent to the current frame image in the current frame image comprises: For each of the rotation directions, the disappearance region of the current frame image is determined based on the rotation ratio corresponding to the rotation direction; the disappearance region is the screen region where the subsequent frame image disappears relative to the current frame image; Merging the disappearing areas in each of the rotation directions to obtain a target disappearing area; The other regions in the current frame image except the target disappearing region are determined as the overlapping region between the current frame image and the subsequent frame image in the current frame image.

3. The automatic exposure adjustment method according to claim 1, characterized in that: In a non-target tracking scenario, determining the brightness information of the current frame image based on the overlapping area includes: The overlapping area is divided based on the rotation ratio of each rotation direction to obtain a first motion area and a first intermediate area; wherein the first motion area is a new screen area of ​​the current frame image relative to a previous frame image of the current frame image; and the first intermediate area is a remaining area in the overlapping area except the first motion area; Obtaining a first weight of the first motion area and a second weight of the first middle area; wherein the first weight is greater than the second weight; The brightness information of the current frame image is determined based on the brightness information of the first motion area, the first weight, the brightness information of the first middle area, and the second weight.

4. The automatic exposure adjustment method according to claim 1, characterized in that: In a target tracking scenario, determining the brightness information of the current frame image based on the overlapping area includes: Determine a target tracking area occupied by the target tracking object in the overlapping area; The overlapping area is divided based on the rotation ratio of each rotation direction to obtain a second motion area and a second intermediate area; wherein the second motion area is an area in the picture area that newly appears in the current frame image relative to the previous frame image of the current frame image, which does not overlap with the target tracking area; and the second intermediate area is the remaining area in the overlapping area except the second motion area and the target tracking area; Acquire a third weight of the target tracking area, a fourth weight of the second motion area, and a fifth weight of the second middle area; wherein the third weight is greater than the fourth weight, and the fourth weight is greater than the fifth weight; The brightness information of the current frame image is determined based on the brightness information of the target tracking area, the third weight, the brightness information of the second motion area, the fourth weight, the brightness information of the second middle area and the fifth weight.

5. The automatic exposure adjustment method according to claim 3 or 4, characterized in that: Also includes: Determining a brightness change amplitude of the current frame image relative to a previous frame image of the current frame image; When the brightness variation amplitude is greater than a set threshold, the adjustment strategy for adjusting the exposure parameter of the camera based on the brightness information is adjusted by at least one of the following: reducing the adjustment speed of adjusting the exposure parameter, expanding the brightness tolerance range when adjusting the exposure parameter, and increasing the weight of the motion area; After the adjustment is performed, for the current frame image captured by the camera, adjusting the exposure parameters of the camera based on the brightness information includes: Based on the brightness information, the exposure parameters of the camera are adjusted using the adjusted adjustment strategy.

6. The automatic exposure adjustment method according to claim 5, characterized in that: After performing the adjustment, the method further includes: When it is detected that the brightness change amplitudes of the current frame image for a preset number of consecutive frames are all less than or equal to the set threshold, the adjustment strategy for adjusting the exposure parameter based on the brightness information is restored to the strategy before adjustment.

7. The automatic exposure adjustment method according to any one of claims 1 to 4, characterized in that: After adjusting the exposure parameter of the camera based on the brightness information to obtain the target exposure parameter for the camera to capture the next frame of image, the method further includes: Determining target image signal processing parameters corresponding to the next frame of image based on the target exposure parameters and the overlapping area; Image signal processing is performed on the next frame of image according to the target image signal processing parameter.

8. An automatic exposure adjustment device, characterized in that: include: An image acquisition module, used to acquire a current frame image captured by the camera during the camera rotation; A first determination module is used to determine the rotation ratio of each rotation direction according to the camera parameters of the camera and the rotation speed in each rotation direction; the rotation ratio is used to represent the ratio of the disappearance area of ​​the image screen caused by the rotation of the camera in the rotation direction in the time interval of adjacent image frames to the whole frame image; A second determination module is used to determine an overlapping area between the current frame image and a subsequent frame image of the current frame image in the current frame image based on the rotation ratio of each rotation direction; An adjustment module is used to determine the brightness information of the current frame image based on the overlapping area, and adjust the exposure parameters of the camera based on the brightness information to obtain the target exposure parameters of the camera for capturing the next frame image.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the automatic exposure adjustment method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the automatic exposure adjustment method according to any one of claims 1 to 7 is implemented.