Processing method and device of camera equipment, equipment and medium

Abstract

The embodiment of the invention provides a processing method and device of camera equipment, equipment and a medium, and the method specifically comprises the steps: controlling a real-time frame rate value of the camera equipment within a first frame rate value range under the condition that a moving object in a camera equipment environment is not detected; the upper limit value of the first frame rate value range does not exceed the first frame rate threshold value, so that the light incoming amount of the camera equipment is increased; under the condition that the moving object in the environment of the camera equipment is detected, controlling the real-time frame rate value of the camera equipment within a second frame rate value range so as to reduce smear of the image; when the brightness represented by the real-time ambient brightness index value is darker than the brightness represented by the real-time turn-on threshold value, turning on a light supplementing device; and under the condition that the brightness represented by the real-time environment brightness index value is higher than the brightness represented by the real-time lamp turn-off threshold value, turning off the light supplementing device. According to the embodiment of the invention, the starting time of the light supplementing device can be effectively reduced, and the power consumption of the camera equipment can be reduced.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular, to a processing method, apparatus, device and medium for a camera device. Background Art

[0002] With the development of computer technology, video equipment has been widely used in many technical fields such as education, commerce, medical treatment, and public utilities. The adaptive mechanism of video equipment refers to a working mechanism in which the video equipment can automatically adjust the shooting mode according to different lighting conditions to provide clear and reliable images both during the day and at night. The shooting modes specifically include: day mode and night mode.

[0003] At present, photosensitive elements are usually used to sense whether the environment of the camera equipment is in a daytime environment or a night environment. If it is in a night environment, the shooting mode of the camera equipment is switched to a night mode and the fill light device is turned on, so that the output image of the camera equipment has a good and clear picture.

[0004] However, since the fill light device is an integral part of the camera device, if the fill light device is turned on for a long time in night mode, the power consumption of the camera device will be significantly increased. For camera devices that need to work continuously for a long time, this may lead to a decrease in battery life or increase dependence on external power supplies, increasing energy costs and maintenance difficulties. Summary of the invention

[0005] The embodiment of the present application provides a processing method for a camera device, which can effectively reduce the activation time of a fill light device and reduce the power consumption of the camera device.

[0006] Correspondingly, the embodiments of the present application also provide a processing device for a camera device, an electronic device and a machine-readable medium to ensure the implementation and application of the above method.

[0007] In order to solve the above problems, an embodiment of the present application discloses a processing method for a camera device, the method comprising: Detecting moving objects in the camera environment; When no moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a first frame rate value range; wherein the upper limit value of the first frame rate value range does not exceed the first frame rate threshold value, so as to increase the amount of light entering the camera device; or When a moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a second frame rate value range; wherein the lower limit value of the second frame rate value range is greater than or equal to the second frame rate threshold value, and the second frequency threshold value is greater than or equal to the first frequency threshold value, so as to reduce image smear; According to the relationship between the real-time frame rate value and the real-time light-on threshold, the real-time light-on threshold corresponding to the real-time frame rate value is determined; wherein, when the brightness represented by the real-time environment brightness index value is darker than the brightness represented by the real-time light-on threshold, the fill light device is turned on; when the brightness represented by the real-time environment brightness index value is brighter than the brightness represented by the real-time light-off threshold, the fill light device is turned off; the real-time light-off threshold is determined according to the real-time frame rate value.

[0008] The embodiment of the present application further discloses a processing device for a camera device, the device comprising: A motion detection module, used to detect moving objects in the camera environment; A first frame rate control module is used to control the real-time frame rate value of the camera device within a first frame rate value range when no moving object is detected in the environment of the camera device; wherein an upper limit value of the first frame rate value range does not exceed a first frame rate threshold value, so as to increase the amount of light entering the camera device; or A second frame rate control module is used to control the real-time frame rate value of the camera device within a second frame rate value range when a moving object is detected in the environment of the camera device; wherein the lower limit value of the second frame rate value range is greater than or equal to the second frame rate threshold value, and the second frequency threshold value is greater than or equal to the first frequency threshold value, so as to reduce image smear; A threshold determination module is used to determine the real-time light-on threshold corresponding to the real-time frame rate value according to the established relationship between the real-time frame rate value and the real-time light-on threshold; wherein, when the brightness represented by the real-time environment brightness index value is darker than the brightness represented by the real-time light-on threshold, the fill light device is turned on; when the brightness represented by the real-time environment brightness index value is brighter than the brightness represented by the real-time light-off threshold, the fill light device is turned off; the real-time light-off threshold is determined according to the real-time frame rate value.

[0009] Optionally, the apparatus further comprises: a third frame rate control module, configured to control the frame rate value of the camera device within the first frame rate value range when the moving object in the camera device environment disappears.

[0010] Optionally, the device further comprises: A lower limit value determination module, used to determine a lower limit value of the first frame rate value range according to an upper limit value of the exposure time; The upper limit of exposure time is a value set by a user, or the upper limit of exposure time is a statistical value of historical exposure time values ​​used by the camera device under time periods and without turning on the light.

[0011] Optionally, the device further comprises: A time determination module, used to determine the sunset time and sunrise time of the time zone where the camera device is located; An interval division module is used to divide the time interval between sunset time and sunrise time to obtain multiple time periods; The statistical module is used to collect statistics on the historical exposure time values ​​used by the camera equipment under time periods and without turning on the lights, so as to obtain the upper limit value of the exposure time corresponding to the time period.

[0012] Optionally, the lower limit value determination module is specifically used to determine the lower limit value of the first frame rate value range according to a mapping relationship between exposure time and frame rate, and an upper limit value of exposure time.

[0013] Optionally, the device further comprises: A target level determination module is used to determine the target brightness level of the fill light device according to the real-time environment brightness index value or the real-time time period information; The start module is used to start the fill light device according to the target brightness level.

[0014] Optionally, the target gear position determination module includes: The initial gear determination module is used to determine the initial brightness gear of the fill light device according to the real-time ambient brightness index value and the ambient brightness index values ​​and brightness gears corresponding to the N acquisition points respectively; N is a positive integer; The target brightness level determination module is used to determine the target brightness level of the fill light device according to the initial brightness level, the upper limit value and the lower limit value of the fill light device.

[0015] Optionally, the target gear position determination module includes: A search module, used to search in the mapping relationship between the time period information and the brightness level according to the real-time time period information, so as to obtain the target brightness level of the fill light device; Among them, according to the time period information, the real-time frame rate value of the camera equipment is controlled within the second frame rate value range, the fill light device is turned on, and the brightness level corresponding to the fill light device when the ambient brightness value is the first preset brightness value is recorded, thereby recording the mapping relationship between the time period information and the brightness level.

[0016] Optionally, the threshold determination module includes: A threshold adjustment module, used for multiplying a preset light-on threshold corresponding to a preset frame rate value by a ratio of the preset frame rate value to a real-time frame rate value to obtain a real-time light-on threshold; The preset light-on threshold is determined according to the ambient brightness index value obtained by the camera device when the preset frame rate value and the ambient brightness value are the first preset brightness value.

[0017] The embodiment of the present application further discloses an electronic device, including: a processor; and a memory, on which executable code is stored. When the executable code is executed, the processor executes the method described in the embodiment of the present application.

[0018] The embodiment of the present application further discloses a machine-readable medium on which executable code is stored. When the executable code is executed, a processor executes the method described in the embodiment of the present application.

[0019] The embodiments of the present application include the following advantages: In the technical solution of the embodiment of the present application, when no moving object is detected, the real-time frame rate value of the camera device is controlled within a first frame rate value range, and the upper limit value of the first frame rate value range does not exceed the first frame rate threshold. Since the exposure time can be increased accordingly when the frame rate is reduced, a lower frame rate means a longer exposure time. A longer exposure time allows the lens of the camera device to receive more light, thereby increasing the amount of light entering. Based on this, when no moving object is detected, the embodiment of the present application can reduce the degree of dependence on the fill light device, reduce the activation time of the fill light device, and reduce the power consumption consumed by the work, thereby effectively reducing the overall power consumption of the camera device.

[0020] Furthermore, in the case where a moving object is detected, the embodiment of the present application increases the frame rate to a second frame rate value range. Since a higher frame rate means an increase in the number of images captured per unit time, when the moving object moves in the image screen, a larger number of images can more accurately capture the position and state of the moving object at different times, and the time interval between two adjacent frames of images is shortened, so that the position change of the moving object in two adjacent frames of images is reduced. In this way, when these images are played continuously, since the recording of the moving object is more intensive and accurate, the embodiment of the present application can reduce the image smear phenomenon caused by the faster movement speed.

[0021] Furthermore, in the embodiment of the present application, after the moving object disappears, there is no need to deal with the ghosting problem that may be caused by the moving object. Therefore, in this case, the camera device is restored to a low frame rate state, which can significantly reduce the power consumption of the camera device.

[0022] In addition, the embodiment of the present application determines the real-time light-on threshold and the real-time light-off threshold according to the real-time frame rate value, and can realize intelligent fill light control. Specifically, when the ambient brightness is darker than the real-time light-on threshold, the fill light device is turned on, and a clear image can still be obtained in a low-light environment. When the ambient brightness is brighter than the brightness corresponding to the real-time light-off threshold, the fill light device is turned off, which can avoid unnecessary fill light, thereby reducing the power consumption of the fill light device, and further reducing the overall power consumption of the camera device. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a flowchart of a processing method of a camera device according to an embodiment of the present application; Figure 2 It is a schematic diagram of the steps of a processing method of a camera device according to an embodiment of the present application; Figure 3 It is a schematic diagram of the steps of a processing method of a camera device according to an embodiment of the present application; Figure 4 is a schematic diagram of the structure of a processing device of a camera device according to an embodiment of the present application; Figure 5 It is a schematic diagram of the structure of a device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0024] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0025] The processing method of the camera device in the embodiment of the present application is used to improve the quality of the output image of the camera device while reducing the power consumption of the camera device.

[0026] In practical applications, the camera device may include: a battery-powered low-power camera device. Of course, the camera device may also include: a power-powered camera device, or a POE (Power Over Ethernet)-powered camera device, etc. It can be understood that the embodiments of the present application do not limit the specific camera device.

[0027] In order to improve the quality of the output image of the camera equipment, photosensitive elements are generally used to sense whether the environment of the camera equipment is in a daytime environment or a night environment. If it is in a night environment, the shooting mode of the camera equipment is switched to night mode and the fill light device is turned on, so that the output image of the camera equipment has a good and clear picture.

[0028] However, since the fill light device is an integral part of the camera device, if the fill light device is turned on for a long time in night mode, the power consumption of the camera device will be significantly increased. For camera devices that need to work continuously for a long time, this may lead to a decrease in battery life or increase dependence on external power supplies, increasing energy costs and maintenance difficulties.

[0029] In view of the technical problem of high power consumption of camera devices in the related art, an embodiment of the present application provides a processing method for camera devices, which specifically includes the following steps: When no moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a first frame rate value range; wherein the upper limit value of the first frame rate value range does not exceed the first frame rate threshold value, so as to increase the amount of light entering the camera device; When a moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a second frame rate value range; wherein the lower limit value of the second frame rate value range is greater than or equal to the second frame rate threshold value, and the second frequency threshold value is greater than or equal to the first frequency threshold value, so as to reduce image smear; According to the relationship between the real-time frame rate value and the real-time light-on threshold, the real-time light-on threshold corresponding to the real-time frame rate value is determined; wherein, when the brightness represented by the real-time environment brightness index value is darker than the brightness represented by the real-time light-on threshold, the fill light device is turned on; when the brightness represented by the real-time environment brightness index value is brighter than the brightness represented by the real-time light-off threshold, the fill light device is turned off; the real-time light-off threshold is determined according to the real-time frame rate value.

[0030] When the moving object in the camera environment disappears, the frame rate value of the camera is controlled within a first frame rate value range; wherein, when the moving object in the camera environment is detected, timing is started to obtain a timing result.

[0031] In the embodiment of the present application, the frame rate refers to the number of images taken by the camera device per second, usually expressed as FPS (Frames Per Second). For example, a camera frame rate of 30 FPS means that the camera device takes 30 photos per second. The exposure time refers to the length of time the lens of the camera device is open, that is, the time the camera device collects light from the subject. The shorter the exposure time, the shorter the movement trajectory of the subject in the photo, and vice versa.

[0032] There is a close connection between frame rate and exposure time. During the shooting process, the frame rate determines the number of images that the camera device can capture per second, while the exposure time controls the exposure effect of each image. When you want to increase the frame rate, the exposure time needs to be shortened accordingly, otherwise it will cause image blur, dimming and other effects.

[0033] In the embodiment of the present application, the real-time environment brightness index value specifically includes: a first real-time environment brightness index value, or a second real-time environment brightness index value; the larger the first real-time environment brightness index value, the brighter the brightness represented by it; the larger the second real-time environment brightness index value, the darker the brightness represented by it; The light-on threshold includes: a first light-on threshold or a second light-on threshold; the larger the first light-on threshold, the brighter the brightness represented by it; the larger the second light-on threshold, the darker the brightness represented by it; The light-off threshold includes: a first light-off threshold or a second light-off threshold; the larger the first light-off threshold, the brighter the brightness represented by it; the larger the second light-off threshold, the darker the brightness represented by it; The brightness represented by the real-time environment brightness index value is darker than the brightness represented by the real-time light-on threshold, including: the first real-time environment brightness index value is less than or equal to the first light-on threshold, or the second real-time environment brightness index value is greater than or equal to the second light-on threshold.

[0034] The brightness represented by the real-time environment brightness index value is brighter than the brightness represented by the real-time light-off threshold, including: the first real-time environment brightness index value is greater than or equal to the first light-off threshold, or the second real-time environment brightness index value is less than or equal to the second light-off threshold.

[0035] In the case where no moving object is detected, the embodiment of the present application controls the real-time frame rate value of the camera device within a first frame rate value range, and the upper limit value of the first frame rate value range does not exceed the first frame rate threshold. Since the exposure time can be increased accordingly when the frame rate is reduced, a lower frame rate means a longer exposure time. A longer exposure time allows the lens of the camera device to receive more light, thereby increasing the amount of light entering. Based on this, in the case where no moving object is detected, the embodiment of the present application can reduce the degree of dependence on the fill light device and reduce the power consumption of the fill light device, thereby effectively reducing the overall power consumption of the camera device.

[0036] Furthermore, in the case where a moving object is detected, the embodiment of the present application increases the frame rate to a second frame rate value range. Since a higher frame rate means an increase in the number of images captured per unit time, when the moving object moves in the image screen, a larger number of images can more accurately capture the position and state of the moving object at different times, and the time interval between two adjacent frames of images is shortened, so that the position change of the moving object in two adjacent frames of images is reduced. In this way, when these images are played continuously, since the recording of the moving object is more intensive and accurate, the embodiment of the present application can reduce the image smear phenomenon caused by the faster movement speed.

[0037] Furthermore, in the embodiment of the present application, after the moving object disappears, there is no need to deal with the ghosting problem that may be caused by the moving object. Therefore, in this case, the camera device is restored to a low frame rate state, which can significantly reduce the power consumption of the camera device.

[0038] In addition, the embodiment of the present application determines the real-time light-on threshold and the real-time light-off threshold according to the real-time frame rate value, and can realize intelligent fill light control. Specifically, when the ambient brightness is darker than the real-time light-on threshold, the fill light device is turned on, and a clear image can still be obtained in a low-light environment. When the ambient brightness is brighter than the brightness corresponding to the real-time light-off threshold, the fill light device is turned off, which can avoid unnecessary fill light, thereby reducing the power consumption of the fill light device, and further reducing the overall power consumption of the camera device.

[0039] Method Example 1 refer to Figure 1 , shows a schematic flow chart of a processing method of a camera device according to an embodiment of the present application, the method specifically comprises the following steps: Step 101, detecting a moving object in a camera environment; Step 102: When no moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a first frame rate value range; wherein the upper limit value of the first frame rate value range does not exceed the first frame rate threshold value, so as to increase the amount of light entering the camera device; Step 103: When a moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a second frame rate value range; wherein the lower limit value of the second frame rate value range is greater than or equal to the second frame rate threshold value, and the second frequency threshold value is greater than or equal to the first frequency threshold value, so as to reduce image smear; Step 104: determining the real-time light-on threshold value corresponding to the real-time frame rate value according to the relationship between the real-time frame rate value and the real-time light-on threshold value; wherein, when the brightness represented by the real-time environment brightness index value is darker than the brightness represented by the real-time light-on threshold value, turning on the fill light device; when the brightness represented by the real-time environment brightness index value is brighter than the brightness represented by the real-time light-off threshold value, turning off the fill light device; the real-time light-off threshold value is determined according to the real-time frame rate value; In another embodiment of the present application, the above method may further include: step 105, when the moving object in the camera environment disappears, controlling the frame rate value of the camera device within a first frame rate value range; wherein, when a moving object is detected in the camera environment, starting timing to obtain a timing result.

[0040] Figure 1 The method embodiment shown can improve the quality of the output image of the camera device while reducing the power consumption of the camera device.

[0041] In step 101, a moving object generally refers to an object or organism whose position changes relative to the background in the environment monitored by the camera device. The moving object may include but is not limited to: a person, an animal, a vehicle or an object.

[0042] Detecting moving objects in the camera environment can quickly identify dynamic changes in the camera environment, focus on moving objects, avoid meaningless monitoring of static scenes, and thus improve overall monitoring efficiency. For example, in the security field, potential security threats such as intruders or abnormally moving objects can be discovered in a timely manner.

[0043] The embodiments of the present application do not limit the specific detection method for detecting the moving object in the camera environment. For example, the detection method may include: frame difference method, optical flow method, or PIR (Passive Infrared) method.

[0044] Among them, the PIR detector can be a component of the camera equipment, which specifically includes: optical system, infrared sensor and alarm controller, etc. The PIR detector passively receives and detects infrared radiation from the environment. Once infrared radiation comes in, it is focused by the optical system to make the infrared sensor generate a sudden change electrical signal, thereby sounding an alarm.

[0045] In a specific implementation, the moving object in the camera environment can be detected according to a first preset time period. The first preset time period can be determined by a person skilled in the art according to actual application requirements. For example, the first preset time period can be 10 seconds, etc. In this way, one first preset time period can generate a detection result.

[0046] In step 102, the real-time frame rate value may refer to the frame rate value at the current moment. Specifically, the real-time frame rate value refers to the number of image frames captured per second by the camera device at the current moment.

[0047] When no moving object is detected, the real-time frame rate value of the camera device is controlled within the first frame rate value range, which means that the camera device collects images at a specific lower frame rate.

[0048] The first frame rate value range may correspond to an upper limit value and a lower limit value. The upper limit value and the lower limit value of the first frame rate value range may be the same or different. When the upper limit value and the lower limit value of the first frame rate value range are the same, the first frame rate value range may include one first frequency value. When the upper limit value and the lower limit value of the first frame rate value range are different, the first frame rate value range may include multiple first frequency values.

[0049] In the case where the first frame rate value range includes multiple first frequency values, the camera device can use one of the multiple first frequency values ​​according to the automatic exposure algorithm. The automatic exposure algorithm will automatically adjust the parameters of the camera device according to factors such as the current ambient lighting conditions and the brightness distribution of the shooting scene to obtain the best shooting effect. In this case, when there are multiple first frequency values ​​to choose from, the automatic exposure algorithm will comprehensively consider the current shooting requirements and environmental factors, and select the most suitable frame rate value from these different first frequency values ​​for image capture.

[0050] In one implementation, the embodiment of the present application may support the configuration of a first frame rate value range. Among them, the user may configure the first frame rate value range according to actual application requirements. Alternatively, those skilled in the art may configure the first frame rate value range based on experience or experimental data. An example of the first frame rate value range may be [1,5], indicating that the upper limit value of the first frame rate value range is 5 and the lower limit value of the first frame rate value range is 1.

[0051] In another implementation, the embodiment of the present application can determine the lower limit of the first frame rate value range based on the upper limit value of the exposure time; wherein the upper limit value of the exposure time can be a value set by the user, or the upper limit value of the exposure time can be a statistical value of the historical exposure time values ​​used by the camera device in a time period and without turning on the light.

[0052] The upper limit of exposure time refers to the maximum exposure time allowed by the camera device under specific conditions.

[0053] If the upper limit of the exposure time is a value set by the user, the user can specify a maximum exposure time according to his or her needs and expectations of the shooting effect. For example, the user may consider factors such as the lighting conditions in a specific scene and the speed of the subject's movement, and set a suitable upper limit of the exposure time to ensure that the captured image is neither too bright nor has motion blur due to a long exposure time. Examples of upper limits of exposure time may include: 1 second, 500 milliseconds, 200 milliseconds, etc.

[0054] If the upper limit of exposure time is a statistical value of historical exposure time values ​​used by the camera device in a specific period of time and without turning on the light, then this upper limit of exposure time is based on the actual use of the camera device in the past. For example, it can be the average, maximum, or other statistical value of the exposure time used by the device in a specific period of time and without turning on the fill light device over a period of time. Such statistical values ​​can reflect the typical exposure time requirements of the device in a specific scenario, thereby providing a reference for determining parameters such as the frame rate value range.

[0055] Accordingly, the process of determining the upper limit of the exposure time corresponding to the time period specifically includes: Step A1, determining the sunset time and sunrise time of the time zone where the camera device is located; Step A2, dividing the time interval between sunset time and sunrise time to obtain multiple time periods; Step A3: collect statistics on historical exposure time values ​​used by the camera device in each time period and without turning on the light, so as to obtain an upper limit value of the exposure time corresponding to the time period.

[0056] For step A1, during the day, the light is usually sufficient, and as the sun sets, the light gradually weakens. The time interval corresponding to the sunset time of the previous day to the sunrise time of the next day can be the use time range of the upper limit value of the exposure time.

[0057] In practical applications, the GPS (Global Positioning System) module of the camera device can be used to determine the time zone where the camera device is located. Furthermore, the sunset time and sunrise time of the time zone where the camera device is located can be obtained. For example, the camera device can send the time zone where the camera device is located to the application client, and receive the sunset time and sunrise time returned by the application client.

[0058] For step A2, the time interval between sunset and sunrise is divided to achieve fine division of time periods. The lighting conditions in each time period may have certain similarities, but there may be large differences between different time periods. Such division enables the camera equipment to adopt different exposure time upper limits for different time periods, thereby improving the shooting effect and equipment performance.

[0059] In one example, since the brightness change of the first time interval corresponding to within 2 hours after sunset is relatively large, and the brightness change of the second time interval corresponding to 1 hour before sunrise is relatively large, a shorter first time interval can be used for the first time interval and the second time interval. For the third time interval between 2 hours after sunset and 1 hour before sunrise, a longer second time interval can be used.

[0060] It should be noted that the start time of a time period can be used to represent the time period. Assuming that the sunset time is T1, the time interval after sunset includes the time periods: time period T1, time period T1+20 minutes, time period T1+30 minutes, time period T1+40 minutes, time period T1+50 minutes, time period T1+60 minutes, time period T1+80 minutes, time period T1+100 minutes, time period T1+120 minutes, time period T1+150 minutes, time period T+180 minutes. Assuming that the sunrise time is T2, the time interval before sunrise includes the time periods: time period T1-60 minutes, time period T1-50 minutes, time period T1-40 minutes, time period T1-30 minutes, time period T1-20 minutes, time period T1-10 minutes, time period T1.

[0061] The first time interval may be an interval between adjacent time periods in the first time interval or the second time interval. Those skilled in the art may determine the first time interval according to actual application requirements. In the above example, the first time interval may be 10 minutes or 20 minutes, etc. It is understood that the embodiments of the present application do not limit the specific first time interval.

[0062] Similarly, the second time interval may be an interval between adjacent time periods in the third time interval. Those skilled in the art may determine the second time interval according to actual application requirements. For example, the second time interval may be 30 minutes or 40 minutes.

[0063] Referring to Table 1, an example of a time period information table of an embodiment of the present application is shown, wherein the time period information table specifically includes fields such as time period information, ambient brightness value, exposure time upper limit value, and brightness level.

[0064] The time period information may represent a specific time period.

[0065] The ambient brightness value may be the light intensity of the environment in which the camera device is located during the time period corresponding to the time period information. The ambient brightness value may be obtained through a light sensor of the camera device or other measuring devices such as a brightness meter to evaluate the brightness of the current environment. The unit of the ambient brightness value may be lux (lumen per square meter).

[0066] The upper limit of the exposure time is used to represent the maximum exposure time allowed by the camera device in the time period corresponding to the time period information.

[0067] The brightness gear is used to characterize the brightness level of the fill light device in the time period corresponding to the time period information. Different gears correspond to different fill light intensities. The numbers "1, 2, 3" can be used to represent different brightness gears. Generally speaking, in the time period corresponding to the time period information, the brightness gear corresponding to the fill light device can make the ambient brightness value reach the first preset brightness value. The first preset brightness value can be determined by a person skilled in the art according to actual application requirements. For example, the first preset brightness value can be 0.1lux.

[0068] Table 1

[0069] Taking time period T1 as an example, the historical exposure time value may be the exposure time value actually used by the camera device under the time period and without turning on the light. The embodiment of the present application may collect multiple historical exposure time values ​​under the time period and without turning on the light, and then perform statistics on the multiple historical exposure time values ​​to obtain the exposure time upper limit value corresponding to the time period. The exposure time upper limit value may be the average value, maximum value, mode, etc. of multiple historical exposure time values.

[0070] It should be noted that the embodiment of the present application can collect multiple historical exposure time values ​​on one or more natural days. For example, in a month, every evening period T1, the device will record the exposure time at that time, thereby accumulating multiple historical exposure time values, and then obtaining the exposure time upper limit value corresponding to the period.

[0071] The embodiment of the present application can determine the lower limit of the first frame rate value range according to the mapping relationship between exposure time and frame rate and the upper limit of exposure time. At the same time, when there is a pre-configured frame rate lower limit in the system, it is also necessary to comprehensively consider and determine the lower limit of the first frame rate value range.

[0072] Generally, the mapping formula between exposure time and frame rate is: exp = 1000 / fps, where exp represents exposure time, fps represents frame rate, and the unit of exp can be milliseconds.

[0073] When determining the lower limit of the first frame rate value range, there are the following two situations: Case 1: There is no configured lower frame rate limit.

[0074] The upper limit value of the exposure time can be directly substituted into the above mapping relationship formula. Assuming the upper limit value of the exposure time is exp_max, the lower limit value of the first frame rate value range fps_lower1 = 1000 / exp_max.

[0075] Case 2: There is a configured lower frame rate limit.

[0076] When there is a pre-configured frame rate lower limit value (set as fps_config) in the system, it is first converted into the corresponding exposure time value according to the mapping relationship formula, that is, exp_config = 1000 / fps_config. This exposure time value exp_config will be used as the target value to determine the lower limit value. If there is also an exposure time upper limit value exp_max1 at this time, the minimum value between exp_max1 and exp_config is taken as the final exposure time value used to calculate the lower limit value, set to exp_final (exp_final = min (exp_max1, exp_config)). Then, based on this exp_final, the lower limit value of the first frame rate value range fps_lower2 = 1000 / exp_final is calculated.

[0077] The upper limit of the first frame rate value range can be obtained according to the configuration of the user or a person skilled in the art. The first frame rate value range can be determined by combining the lower limit obtained under the above different situations and the upper limit obtained by configuration.

[0078] In summary, in the embodiment of the present application, when no moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a first frame rate value range; wherein the upper limit value of the first frame rate value range does not exceed the first frame rate threshold to increase the amount of light entering the camera device.

[0079] Among them, the first frame rate threshold can be determined based on a test. For example, an image can be captured by a camera in a night environment, and the amount of light entering at different frame rates can be analyzed for the captured image, thereby obtaining a first frame rate threshold at which the image quality meets the requirements. The image quality meeting the requirements can specifically be: the clarity of the image meets the requirements, etc. It can be understood that those skilled in the art can determine the requirements corresponding to the image quality according to the actual application requirements, and the embodiments of the present application do not limit the specific requirements.

[0080] In step 103, when a moving object is detected, the frame rate is increased to a second frame rate value range, which can reduce the image ghosting phenomenon caused by the fast moving speed.

[0081] The lower limit value of the second frame rate value range is greater than or equal to the second frame rate threshold, and the second frequency threshold is greater than or equal to the first frequency threshold. The embodiment of the present application can determine the second frequency threshold based on testing. For example, an image can be captured by a shooting device in a night environment, and the image smearing conditions at different frame rates can be analyzed for the captured image, thereby obtaining a second frequency threshold that characterizes the critical condition of image smearing.

[0082] For example, according to the degree of ghosting at different frame rates, the image can be divided into several levels such as no ghosting, slight ghosting, obvious ghosting, etc., so as to realize image analysis at different frame rates.

[0083] During the analysis, a critical frame rate at which image smear changes from an acceptable range to an unacceptable range is found, and the frequency value corresponding to the critical frame rate can be used as a candidate value for the second frequency threshold.

[0084] The candidate value of the second frequency threshold can also be adjusted in combination with the needs of the actual application scenario. For example, if the image quality requirement is high in a specific application, the second frequency threshold can be appropriately increased so that no obvious ghosting phenomenon occurs in most cases. In an example, the second frequency threshold can be a value such as 15. Of course, the embodiment of the present application does not limit the specific second frequency threshold.

[0085] The embodiment of the present application can determine the upper limit of the second frame rate value range based on factors such as image ghosting, clarity, and color reproduction.

[0086] For example, if the ghosting phenomenon is well controlled above a certain frame rate and further increasing the frame rate will not bring about a significant improvement in image quality, then this frame rate can be used as a reference for the upper limit of the second frame rate value range.

[0087] For another example, by observing the image clarity and details at different frame rates, the upper limit of the second frame rate value range is determined, so that the image can maintain good clarity and details while meeting the ghosting requirement.

[0088] For another example, considering that a high frame rate may also affect color reproduction, some shooting devices may have color deviation or distortion at a high frame rate. In this way, the color reproduction at different frame rates is evaluated so that the color of the image can still be accurately restored at the upper limit of the second frame rate value range.

[0089] The second frame rate value range may correspond to an upper limit value and a lower limit value. The upper limit value and the lower limit value of the second frame rate value range may be the same or different. When the upper limit value and the lower limit value of the second frame rate value range are the same, the second frame rate value range may include one second frequency value. When the upper limit value and the lower limit value of the second frame rate value range are different, the second frame rate value range may include multiple second frequency values.

[0090] In the case where the second frame rate value range includes multiple second frequency values, the camera device can use one of the multiple second frequency values ​​according to the automatic exposure algorithm. The automatic exposure algorithm will automatically adjust the parameters of the camera device according to factors such as the current ambient lighting conditions and the brightness distribution of the shooting scene to obtain the best shooting effect. In this case, when there are multiple second frequency values ​​to choose from, the automatic exposure algorithm will comprehensively consider the current shooting requirements and environmental factors, and select the most suitable frame rate value from these different second frequency values ​​for image capture.

[0091] In step 104, the real-time light-on threshold value may be used as a basis for turning on the fill light device. Specifically, when the brightness represented by the real-time environment brightness index value is darker than the brightness represented by the real-time light-on threshold value, the fill light device is turned on.

[0092] The real-time light-on threshold may be a light-on threshold corresponding to a real-time frame rate value, and different real-time frame rate values ​​may correspond to different real-time light-on thresholds.

[0093] The embodiment of the present application can determine the real-time light-on threshold corresponding to the real-time frame rate value according to the second time period. Alternatively, the embodiment of the present application can determine the real-time light-on threshold corresponding to the real-time frame rate value when the real-time frame rate value is updated. Therefore, the embodiment of the present application can execute step 104 according to the trigger condition of step 104. The trigger condition of step 104 specifically includes: the second time period arrives, or the real-time frame rate value is updated. When the above trigger conditions are met, the real-time light-on threshold is adjusted in time, so that it can be accurately judged whether it is necessary to turn on the fill light at different real-time frame rates, so that the camera equipment can obtain appropriate lighting in various situations.

[0094] Correspondingly, the process of determining the real-time light-on threshold corresponding to the real-time frame rate value may specifically include: multiplying the preset light-on threshold corresponding to the preset frame rate value by the ratio of the preset frame rate value to the real-time frame rate value to obtain the real-time light-on threshold; wherein, the preset light-on threshold is determined based on the ambient brightness index value obtained when the camera device is at the preset frame rate value and the ambient brightness value is the first preset brightness value.

[0095] The preset frame rate value may be any frame rate within the working range of the camera device. For example, the preset frame rate value may be any frame rate within the first frame rate value range. For another example, the preset frame rate value may be any frame rate within the second frame rate value range.

[0096] The embodiment of the present application can determine the preset light-on threshold luma for the preset frame rate value default_fps. Subsequently, the real-time light-on threshold light_luma can be updated according to the update of the real-time frame rate value. The update formula of the real-time light-on threshold can be: light_luma= luma*default_fps / real_fps, where real_fps represents the real-time frame rate value. The update formula of the real-time light-on threshold can be: a specific example of the relationship between the established real-time frame rate value and the real-time light-on threshold.

[0097] The first preset brightness value may be a relatively dark brightness value selected according to actual application scenarios and experience, but the fill light device does not need to be turned on. For example, the first preset brightness value may be 0.1 lux.

[0098] Under the condition of the preset frame rate value and the first preset brightness value, the camera device is operated and the current environment brightness index value is obtained. This index value may be the light intensity or other parameters that can reflect the environment brightness measured by the photosensitive sensor of the camera device. The environment brightness index value measured by the photosensitive sensor may be an example of the first real-time environment brightness index value.

[0099] For example, the ambient brightness index value may be an EV value (Exposure Value). The EV value is a value that reflects the exposure of the camera device, which comprehensively considers the effects of factors such as aperture size, shutter speed, and sensitivity on the exposure. In a specific shooting scene, the EV value can intuitively reflect the brightness of the environment, and the EV value may be an example of the second real-time ambient brightness index value. A higher EV value indicates a brighter environment, and a lower EV value indicates a darker environment.

[0100] According to the obtained ambient brightness index value, the process of determining the preset light-on threshold value may include: multiplying the obtained ambient brightness index value by a preset coefficient to obtain the preset light-on threshold value. The preset coefficient may be a real number close to 1, for example, the preset coefficient may be a value such as 10 / 9.

[0101] In the embodiment of the present application, when a moving object is detected, the frame rate is increased to a second frame rate value range, which can reduce the image ghosting phenomenon caused by a fast moving speed.

[0102] However, the increase in frame rate will cause the exposure time of each frame to be shortened accordingly, thereby reducing the amount of light entering. In an environment with low light input, the image may become dim, details may not be clear, and even problems such as increased noise may occur. In the embodiment of the present application, when the brightness represented by the real-time ambient brightness index value is darker than the brightness represented by the real-time lighting threshold, turning on the fill light device can effectively increase the ambient brightness and compensate for the loss of light input due to the increase in frame rate, so that the quality of the captured image can still meet the requirements.

[0103] In the embodiment of the present application, when the ambient brightness is brighter than the brightness corresponding to the real-time light-off threshold, the fill light device will also be turned off. This can avoid unnecessary fill light, thereby reducing the power consumption of the fill light device, and further reducing the overall power consumption of the camera equipment.

[0104] The real-time light-off threshold may be a light-off threshold corresponding to a real-time frame rate value, and different real-time frame rate values ​​may correspond to different real-time light-off thresholds.

[0105] The embodiment of the present application can determine the real-time light-off threshold corresponding to the real-time frame rate value according to the second time period. Alternatively, the embodiment of the present application can determine the real-time light-off threshold corresponding to the real-time frame rate value when the real-time frame rate value is updated. Therefore, the triggering conditions for determining the real-time light-off threshold corresponding to the real-time frame rate value specifically include: the second time period arrives, or the real-time frame rate value is updated. When the above triggering conditions are met, the real-time light-off threshold is adjusted in time, so that it can be accurately determined whether the fill light needs to be turned off at different real-time frame rates.

[0106] Accordingly, the process of determining the real-time light-off threshold corresponding to the real-time frame rate value may specifically include: multiplying the preset light-off threshold corresponding to the preset frame rate value by the ratio of the preset frame rate value to the real-time frame rate value to obtain the real-time light-off threshold; wherein, the preset light-off threshold is determined according to the ambient brightness index value obtained when the camera device has the preset frame rate value and the ambient brightness value is the second preset brightness value. The second preset brightness value may be determined according to the needs of the product, which reflects the brightness limit at which the environment is considered to be bright enough and the fill light device does not need to work in a specific application scenario. An example of the second preset brightness value may be 0.2lux, etc.

[0107] Since the process of determining the preset light-off threshold is similar to the process of determining the preset light-on threshold, and the process of determining the real-time light-off threshold is similar to the process of determining the real-time light-on threshold, they are not described here in detail and can be referred to each other.

[0108] It should be noted that in the embodiment of the present application, the real-time environment brightness index value and the environment brightness index value corresponding to the light-on threshold are values ​​obtained by the same technical means. Therefore, the brightness trends reflected by the real-time environment brightness index value and the real-time light-on threshold in numerical terms are consistent. Specifically, if the larger the real-time environment brightness index value means the brighter the brightness, then the larger the value of the real-time light-on threshold means the brighter the brightness; similarly, if the larger the real-time environment brightness index value means the darker the brightness, then the larger the value of the real-time light-on threshold means the darker the brightness. Similarly, the brightness trends reflected by the real-time environment brightness index value and the real-time light-on threshold in numerical terms are also consistent.

[0109] It should also be noted that the embodiment of the present application will only turn on the fill light device when the first setting condition is met, thereby greatly reducing the turn-on time of the fill light device. The first setting condition here is specifically: a moving object is detected, and the brightness represented by the real-time ambient brightness index value is darker than the brightness represented by the real-time light-on threshold.

[0110] In addition, after the fill light device is turned on, the embodiment of the present application will turn off the fill light device once the second setting condition is met, thereby further reducing the turn-on time of the fill light device. The second setting condition is specifically: a moving object is detected, and the brightness represented by the real-time ambient brightness index value is brighter than the brightness represented by the real-time light-off threshold.

[0111] After turning on the fill light device, the ambient brightness can be improved. As the ambient brightness increases, the second setting condition can be met. The above processing enables the opening time of the fill light device to be effectively controlled and kept within a shorter time range. A shorter opening time can not only reduce energy consumption and reduce the operating cost of the camera equipment, but also extend the service life of the fill light device.

[0112] When the fill light device needs to be turned on, the embodiment of the present application can provide the following technical solutions for turning on the fill light device: Technical solution 1, In technical solution 1, the fill light device can be turned on according to a preset brightness level. The preset brightness level can be a brightness level configured by the user or by a person skilled in the art.

[0113] Technical solution 2, Technical solution 2 can first determine the target brightness level of the fill light device according to the real-time time period information; and then turn on the fill light device according to the target brightness level.

[0114] Technical solution 2 determines the brightness level according to different real-time time period information in the night environment, so that the fill light device can provide different brightness compensation in different time periods.

[0115] The process of determining the target brightness level of the fill light device according to the real-time time period information may specifically include: searching in a mapping relationship between the time period information and the brightness level according to the real-time time period information to obtain the target brightness level of the fill light device; Among them, according to the time period information, the real-time frame rate value of the camera equipment is controlled within the second frame rate value range, the fill light device is turned on, and the brightness level corresponding to the fill light device when the ambient brightness value is the first preset brightness value is recorded, thereby recording the mapping relationship between the time period information and the brightness level.

[0116] Table 1 shows an example of the mapping relationship between time period information and brightness level. During the search process, the real-time time period information can be matched with the time period information in Table 1, and the brightness level that is successfully matched is used as the target brightness level. For example, the real-time time period information is T1:19, and it can be determined that it matches the first data record corresponding to time period T1 in Table 1.

[0117] For example, in the first time period within 2 hours after sunset, there is still afterglow in the sky, and the environment gradually darkens but is not completely dark. At this time, the fill light device can be turned on at a lower brightness level to assist shooting or monitoring without destroying the unique atmosphere, making the picture transition naturally.

[0118] For example, in the third time interval from 2 hours after sunset to 1 hour before sunrise, the darkness of the environment keeps changing, and the brightness level of the fill light device can be dynamically adjusted according to the progress of time. In the early stage, the brightness level can be kept at a moderate level, and as time approaches 1 hour before sunrise, the brightness can be gradually increased to adapt to the deepening darkness.

[0119] Alternatively, in the second time interval corresponding to 1 hour before sunrise, the earth is still shrouded in darkness. At this time, the fill light device should be adjusted to a higher brightness level to ensure that the target object can be clearly captured in security monitoring or special scene shooting, and to improve the clarity and recognizability of the image.

[0120] In short, by finely dividing the different time periods at night and using real-time time period information to determine the brightness level, the fill light device can perform at its best at all stages of the night and provide stable and reliable lighting support for various nighttime activities and needs.

[0121] Technical solution 3, Technical solution 3 can first determine the target brightness level of the fill light device according to the real-time ambient brightness index value; and then turn on the fill light device according to the target brightness level.

[0122] The embodiment of the present application determines the target brightness level according to the real-time ambient brightness index value, so that the fill light device can provide more accurate brightness compensation under different lighting conditions. For example, in a darker environment, selecting a higher brightness level can significantly improve the brightness and clarity of the image and make the details richer; while in a relatively bright environment, selecting a lower brightness level can avoid overexposure of the image caused by excessive fill light, ensuring the naturalness and color reproduction of the image.

[0123] Accordingly, the process of determining the target brightness level of the fill light device according to the real-time ambient brightness index value specifically includes: Step B1, determining the initial brightness level of the fill light device according to the real-time ambient brightness index value, and the ambient brightness index values ​​and brightness levels corresponding to N acquisition points, wherein N is a positive integer; Step B2: determining a target brightness level of the fill light device according to the initial brightness level, the upper limit value and the lower limit value of the fill light device.

[0124] Formula (1) shows the process of determining the initial brightness level of the fill light device.

[0125] (1) in, I Indicates the real-time ambient brightness index value. I 1 ....I N They are N The ambient brightness index values ​​corresponding to the collection points are: P i Indicates the brightness level corresponding to the i-th acquisition point, and level indicates the initial brightness level.

[0126] The embodiment of the present application can perform N acquisitions at different times in the night environment, one acquisition corresponds to one acquisition point, and records the ambient brightness index value and brightness level of each acquisition point. The brightness level of a acquisition point can be the historical brightness level actually used by the camera device.

[0127] Formula (1) predicts the reasonable brightness level corresponding to the current real-time brightness by analyzing the relationship between the ambient brightness and the brightness level in the historical data of the collection points and combining it with the current real-time ambient brightness. The principle is to accurately predict the initial brightness level corresponding to the real-time ambient brightness index value based on the trend analysis of historical data and the adaptive adjustment of the real-time ambient brightness.

[0128] Formula (1) first calculates the change in brightness level between each pair of adjacent acquisition points ( ) and the change in the ambient brightness index value ( ), which reflects the trend of the brightness level changing with the ambient brightness in the adjacent ambient brightness interval. Then, these ratios of all adjacent acquisition points are summed to obtain the trend of the overall brightness level changing with the ambient brightness. Next, this trend is multiplied by the current real-time ambient brightness index value I, so that the change trend based on historical data can be adjusted according to the current actual ambient brightness. Finally, it is divided by the total number of acquisition points N for averaging to obtain a more stable and representative result, thereby predicting the initial brightness level corresponding to the real-time ambient brightness index value. i can be a positive integer.

[0129] Formula (2) shows the process of determining the target brightness level of the fill light device.

[0130] (2) in, It is the lower limit of the light on value obtained from the chip manual of the fill light device. is the upper limit of the light on value obtained from the chip manual of the fill light device, and M is the number of gears supported by the fill light device. The value can be 50000, etc. An example of may be 2500 or other values. The gears are mapped to M brightness gears in the embodiment of the present application. Examples of M may be 10000, etc. Indicates the target brightness level.

[0131] Since the fill light device has the characteristics of being lit at high level and off at low level, it is easy to have unstable problems such as stroboscopic under this characteristic, especially when it is in low brightness. The embodiment of the present application comprehensively considers many factors such as the lower limit of turning on the light, the upper limit of automatic turning on the light, and the gear position in the chip manual of the fill light device, and then determines the target brightness gear position. In this way, the fill light device can be in a relatively stable working state when it is started at low brightness, effectively avoiding the situation where the electronic components respond unstably due to too low or too high brightness, thereby greatly improving the working stability of the fill light device.

[0132] In step 105, when the moving object in the camera environment disappears, the frame rate value of the camera is controlled within a first frame rate value range; wherein, when the moving object in the camera environment is detected, timing is started to obtain a timing result.

[0133] When the moving objects originally existing in the environment captured by the camera device disappear, it means that if there were originally moving people, animals or other objects in the image, these objects no longer appear in the image. At this time, controlling the frame rate value of the camera device within the first frame rate value range can reduce the dependence on the fill light device and reduce the power consumption of the fill light device.

[0134] In practical applications, step 101 may detect moving objects in the camera environment according to a first preset time period, and trigger step 102, step 103, or step 105 according to the detection result. For example, when the j-th detection result is that there is no moving object, if the (j-1)-th detection result is that there is no moving object, step 102 may be triggered. For another example, when the j-th detection result is that there is no moving object, if the (j-1)-th detection result is that there is a moving object, step 105 may be triggered. For another example, when the j-th detection result is that there is a moving object, step 103 may be triggered. Wherein, j may be a positive integer.

[0135] In summary, the processing method of the camera device of the embodiment of the present application, when no moving object is detected, controls the real-time frame rate value of the camera device within a first frame rate value range, and the upper limit value of the first frame rate value range does not exceed the first frame rate threshold. Since the exposure time can be increased accordingly when the frame rate is reduced, a lower frame rate means a longer exposure time. And a longer exposure time can allow the lens of the camera device to receive more light, thereby increasing the amount of light entering. Based on this, when no moving object is detected, the embodiment of the present application can reduce the degree of dependence on the fill light device, reduce the power consumption of the fill light device, and thus effectively reduce the overall power consumption of the camera device.

[0136] Furthermore, in the case where a moving object is detected, the embodiment of the present application increases the frame rate to a second frame rate value range. Since a higher frame rate means an increase in the number of images captured per unit time, when the moving object moves in the image screen, a larger number of images can more accurately capture the position and state of the moving object at different times, and the time interval between two adjacent frames of images is shortened, so that the position change of the moving object in two adjacent frames of images is reduced. In this way, when these images are played continuously, since the recording of the moving object is more intensive and accurate, the embodiment of the present application can reduce the image smear phenomenon caused by the faster movement speed.

[0137] Furthermore, in the embodiment of the present application, after the moving object disappears, there is no need to deal with the ghosting problem that may be caused by the moving object. Therefore, in this case, the camera device is restored to a low frame rate state, which can significantly reduce the power consumption of the camera device.

[0138] In addition, the embodiment of the present application determines the real-time light-on threshold and the real-time light-off threshold according to the real-time frame rate value, and can realize intelligent fill light control. Specifically, when the ambient brightness is darker than the real-time light-on threshold, the fill light device is turned on, and a clear image can still be obtained in a low-light environment. When the ambient brightness is brighter than the brightness corresponding to the real-time light-off threshold, the fill light device is turned off, which can avoid unnecessary fill light, thereby reducing the power consumption of the fill light device, and further reducing the overall power consumption of the camera device.

[0139] Method Example 2 In the embodiment of the present application, the working mode of the camera device may include: a user configuration mode or an adaptive mode.

[0140] Wherein, in the user configuration mode, the exposure time upper limit value can be a value set by the user. The user or a person skilled in the art can configure the upper limit value of the first frame rate value range. In this way, the first frame rate value range can be determined according to the exposure time upper limit value and the upper limit value of the first frame rate value range. The user or a person skilled in the art can configure the second frame rate value range.

[0141] In the user configuration mode, if the fill light device needs to be turned on, the target brightness level of the fill light device can be determined according to the real-time ambient brightness index value.

[0142] Reference Figure 2 , shows a schematic flow chart of the steps of a processing method of a camera device according to an embodiment of the present application, the method corresponds to the processing of the user configuration mode, and specifically includes the following steps: Step 201: Determine a first frame rate value range and a second frame rate value range according to configuration information; wherein the configuration information may include: an upper limit value of exposure time, an upper limit value of the first frame rate value range, an upper limit value and a lower limit value of the second frame rate value range, etc.; Step 202: Detect moving objects in the camera environment; The test results may be in the following three situations: Case 1: When the j-th detection result is that there is no moving object, if the (j-1)-th detection result is that there is no moving object, step 203 may be triggered.

[0143] Case 2: when the j-th detection result is that there is no moving object, if the (j-1)-th detection result is that there is a moving object, step 206 may be triggered.

[0144] Case 3: When the j-th detection result indicates that a moving object exists, step 204 may be triggered.

[0145] Step 203: When no moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a first frame rate value range; wherein the upper limit value of the first frame rate value range does not exceed the first frame rate threshold value, so as to increase the amount of light entering the camera device; Step 204: When a moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a second frame rate value range; wherein the lower limit value of the second frame rate value range is greater than or equal to the second frame rate threshold value, and the second frequency threshold value is greater than or equal to the first frequency threshold value, so as to reduce image smear; Step 205: determining the real-time light-on threshold value corresponding to the real-time frame rate value according to the relationship between the real-time frame rate value and the real-time light-on threshold value; wherein, when the brightness represented by the real-time environment brightness index value is darker than the brightness represented by the real-time light-on threshold value, turning on the fill light device; when the brightness represented by the real-time environment brightness index value is brighter than the brightness represented by the real-time light-off threshold value, turning off the fill light device; the real-time light-off threshold value is determined according to the real-time frame rate value; The embodiment of the present application can execute step 205 according to the triggering condition of step 205. The triggering condition of step 205 specifically includes: the second time period arrives, or the real-time frame rate value is updated.

[0146] Step 206: When the moving object in the camera environment disappears, the frame rate value of the camera is controlled within a first frame rate value range; wherein, when the moving object in the camera environment is detected, timing is started to obtain a timing result.

[0147] In the user configuration mode, if the fill light device needs to be turned on, the target brightness level can be determined according to the aforementioned technical solution 1, and the fill light device can be turned on according to the target brightness level.

[0148] In the adaptive mode, the camera device can automatically determine the upper limit of the exposure time based on the historical exposure time values ​​used by the camera device under the time period and without turning on the light, thereby recording the mapping relationship between the time period information and the upper limit of the exposure time. The camera device can also control the real-time frame rate value of the camera device within the second frame rate value range based on the time period information, turn on the fill light device, and record the corresponding brightness level of the fill light device when the ambient brightness value is the first preset brightness value, thereby recording the mapping relationship between the time period information and the brightness level.

[0149] Further, in the adaptive mode, the first frame rate value range may be determined according to the upper limit value of the exposure time and the upper limit value of the first frame rate value range. The user or a person skilled in the art may configure the second frame rate value range.

[0150] Reference Figure 3, shows a schematic flow chart of the steps of a processing method of a camera device according to an embodiment of the present application, the method corresponds to the processing of the adaptive mode, and specifically includes the following steps: Step 301: determine the upper limit of exposure time according to the historical exposure time values ​​used by the camera device under the time period and the condition of not turning on the light, thereby recording the mapping relationship between the time period information and the upper limit of exposure time; Step 302: Determine a first frame rate value range corresponding to the time period information and a second frame rate value range corresponding to the time period information according to the upper limit value of the exposure time; The first frame rate value range corresponding to one time period information may include one or more first frame rate values. The second frame rate value range corresponding to each time period information may be determined, that is, different time period information corresponds to different second frame rate value ranges. Alternatively, all time period information may share one second frame rate value range.

[0151] Step 303: for the time period information, control the real-time frame rate value of the camera device within the second frame rate value range, turn on the fill light device, and record the brightness level of the fill light device when the ambient brightness value is the first preset brightness value, thereby recording the mapping relationship between the time period information and the brightness level; Step 304: Detect moving objects in the camera environment; The test results may be in the following three situations: Case 1: When the j-th detection result is that there is no moving object, if the (j-1)-th detection result is that there is no moving object, step 305 may be triggered.

[0152] Case 2: when the j-th detection result is that there is no moving object, if the (j-1)-th detection result is that there is a moving object, step 310 may be triggered.

[0153] Case 3: When the j-th detection result indicates that a moving object exists, step 306 may be triggered.

[0154] Step 305: When no moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a first frame rate value range; wherein the upper limit value of the first frame rate value range does not exceed the first frame rate threshold value, so as to increase the amount of light entering the camera device; Step 306: When a moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a second frame rate value range; wherein the lower limit value of the second frame rate value range is greater than or equal to the second frame rate threshold value, and the second frequency threshold value is greater than or equal to the first frequency threshold value, so as to reduce image smear; Step 307: Determine the real-time light-on threshold corresponding to the real-time frame rate value according to the relationship between the real-time frame rate value and the real-time light-on threshold value; Step 308: When the brightness represented by the real-time ambient brightness index value is darker than the brightness represented by the real-time light-on threshold value, the fill light device is turned on according to the mapping relationship between the time period information and the brightness level; Step 309: when the brightness represented by the real-time environment brightness index value is brighter than the brightness represented by the real-time light-off threshold, turn off the fill light device; the real-time light-off threshold is determined according to the real-time frame rate value; Step 310: When the moving object in the camera environment disappears, the frame rate value of the camera is controlled within a first frame rate value range; wherein, when the moving object in the camera environment is detected, timing is started to obtain a timing result.

[0155] In the adaptive mode, when the number of acquisition points N is small, the target brightness level can be determined using technical solution 2, and the fill light device can be turned on according to the target brightness level.

[0156] As time accumulates and the number of acquisition points N increases, the target brightness level can be determined using technical solution 3, and the fill light device can be turned on according to the target brightness level.

[0157] In summary, the adaptive mode of the embodiment of the present application will automatically determine the most appropriate exposure time upper limit and brightness level when the light is not on, and then determine the first frame rate value range and the second frame rate value range. The customer configuration mode determines the first frame rate value range according to the exposure time upper limit set by the user.

[0158] Whether it is the exposure time upper limit set by the user or the exposure time upper limit determined automatically, the light-on time can be reduced based on the increase in the amount of light coming in. Actual tests show that in an open environment, if the first frame rate value is within the range of 2fps, the camera device can achieve full-color night vision all night without turning on the light.

[0159] Take a battery-powered camera installed on the roadside and powered by solar energy as an example. If you want to achieve full color day and night, you can use this solution. This can reduce light pollution at night, achieve full color at night, and achieve low power consumption. It can meet actual needs only by solar power supply.

[0160] In summary, the technical solution of the embodiment of the present application, in the absence of anyone, increases the amount of light entering the lens of the camera device by reducing the frame rate and adopting a long exposure mechanism, thereby delaying the time to turn on the lights and achieving full color at night. When someone appears, quickly switch to a high frame rate to reduce ghosting, and, according to the target brightness level of the fill light device, perform short-time fill light to reduce the fill light turn-on time, thereby reducing the power consumption of the camera device. Therefore, full color can be achieved at night even when powered by solar panels outdoors. If the adaptive mode cannot meet user needs, for example, in some scenes with relatively calm environments (such as forests and fish ponds), customers can configure a lower frame rate by themselves, so that the camera device can achieve full color without turning on the lights all night.

[0161] It should be noted that, for the method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the described order of actions, because according to the embodiments of the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

[0162] Based on the above embodiment, this embodiment further provides a processing device for a camera device, referring to Figure 4 As shown in the structural diagram, the device specifically includes: a motion detection module 401, a first frame rate control module 402, a second frame rate control module 403, a threshold determination module 404 and a third frame rate control module 405.

[0163] Wherein, the motion detection module 401 is used to detect the moving object in the camera environment; A first frame rate control module 402 is used to control the real-time frame rate value of the camera device within a first frame rate value range when no moving object is detected in the environment of the camera device; wherein the upper limit value of the first frame rate value range does not exceed the first frame rate threshold value, so as to increase the amount of light entering the camera device; A second frame rate control module 403 is used to control the real-time frame rate value of the camera device within a second frame rate value range when a moving object is detected in the environment of the camera device; wherein the lower limit value of the second frame rate value range is greater than or equal to the second frame rate threshold value, and the second frequency threshold value is greater than or equal to the first frequency threshold value, so as to reduce image smear; The threshold determination module 404 is used to determine the real-time light-on threshold corresponding to the real-time frame rate value according to the relationship between the real-time frame rate value and the real-time light-on threshold; wherein, when the brightness represented by the real-time environment brightness index value is darker than the brightness represented by the real-time light-on threshold, the fill light device is turned on; when the brightness represented by the real-time environment brightness index value is brighter than the brightness represented by the real-time light-off threshold, the fill light device is turned off; the real-time light-off threshold is determined according to the real-time frame rate value; In another embodiment, the above device may further include: The third frame rate control module is used to control the frame rate value of the camera device within the first frame rate value range when the moving object in the camera device environment disappears; wherein, when the moving object in the camera device environment is detected, timing is started to obtain a timing result.

[0164] Optionally, the device further comprises: A lower limit value determination module, used to determine a lower limit value of the first frame rate value range according to an upper limit value of the exposure time; The upper limit of exposure time is a value set by a user, or the upper limit of exposure time is a statistical value of historical exposure time values ​​used by the camera device under time periods and without turning on the light.

[0165] Optionally, the device further comprises: A time determination module, used to determine the sunset time and sunrise time of the time zone where the camera device is located; An interval division module is used to divide the time interval between sunset time and sunrise time to obtain multiple time periods; The statistical module is used to collect statistics on the historical exposure time values ​​used by the camera equipment under time periods and without turning on the lights, so as to obtain the upper limit value of the exposure time corresponding to the time period.

[0166] Optionally, the lower limit value determination module is specifically used to determine the lower limit value of the first frame rate value range according to a mapping relationship between exposure time and frame rate, and an upper limit value of exposure time.

[0167] Optionally, the device further comprises: A target level determination module is used to determine the target brightness level of the fill light device according to the real-time environment brightness index value or the real-time time period information; The start module is used to start the fill light device according to the target brightness level.

[0168] Optionally, the target gear position determination module includes: The initial gear determination module is used to determine the initial brightness gear of the fill light device according to the real-time ambient brightness index value and the ambient brightness index values ​​and brightness gears corresponding to the N acquisition points respectively; N is a positive integer; The target brightness level determination module is used to determine the target brightness level of the fill light device according to the initial brightness level, the upper limit value and the lower limit value of the fill light device.

[0169] Optionally, the target gear position determination module includes: A search module, used to search in the mapping relationship between the time period information and the brightness level according to the real-time time period information, so as to obtain the target brightness level of the fill light device; Among them, according to the time period information, the real-time frame rate value of the camera equipment is controlled within the second frame rate value range, the fill light device is turned on, and the brightness level corresponding to the fill light device when the ambient brightness value is the first preset brightness value is recorded, thereby recording the mapping relationship between the time period information and the brightness level.

[0170] Optionally, the threshold determination module includes: The threshold adjustment module is used to multiply the preset light-on threshold corresponding to the preset frame rate value by the ratio of the preset frame rate value to the real-time frame rate value to obtain the real-time light-on threshold; wherein the preset frame rate value can be, for example, a frame rate value within the working range of the camera device.

[0171] The preset light-on threshold is determined according to the ambient brightness index value obtained by the camera device when the preset frame rate value and the ambient brightness value are the first preset brightness value.

[0172] The embodiment of the present application further provides a non-volatile readable storage medium, in which one or more modules (programs) are stored. When the one or more modules are applied to a device, the device can execute instructions (instructions) of each method step in the embodiment of the present application.

[0173] The present application embodiment provides one or more machine-readable media, on which instructions are stored, and when executed by one or more processors, an electronic device executes one or more of the methods described in the above embodiments. In the present application embodiment, the electronic device includes various types of devices such as terminal devices, servers (clusters), etc.

[0174] The embodiments of the present disclosure may be implemented as a device that uses any appropriate hardware, firmware, software, or any combination thereof to perform a desired configuration, and the device may include: electronic devices such as terminal devices and servers (clusters). Figure 5 An exemplary apparatus 1100 that can be used to implement various embodiments described in this application is schematically shown.

[0175] For one embodiment, Figure 5An exemplary apparatus 1100 is shown having one or more processors 1102, a control module (chip set) 1104 coupled to at least one of the processor(s) 1102, a memory 1106 coupled to the control module 1104, a non-volatile memory / storage device 1108 coupled to the control module 1104, one or more input / output devices 1110 coupled to the control module 1104, and a network interface 1112 coupled to the control module 1104.

[0176] The processor 1102 may include one or more single-core or multi-core processors, and the processor 1102 may include any combination of general-purpose processors or special-purpose processors (such as graphics processors, application processors, baseband processors, etc.). In some embodiments, the device 1100 can be used as a terminal device, server (cluster), etc. described in the embodiments of the present application.

[0177] In some embodiments, the apparatus 1100 may include one or more computer-readable media (e.g., memory 1106 or non-volatile memory / storage device 1108) having instructions 1114 and one or more processors 1102 combined with the one or more computer-readable media and configured to execute the instructions 1114 to implement a module to perform the actions described in the present disclosure.

[0178] For one embodiment, the control module 1104 may include any suitable interface controller to provide any suitable interface to at least one of the processor(s) 1102 and / or any suitable device or component in communication with the control module 1104 .

[0179] The control module 1104 may include a memory controller module to provide an interface to the memory 1106. The memory controller module may be a hardware module, a software module, and / or a firmware module.

[0180] The memory 1106 may be used, for example, to load and store data and / or instructions 1114 for the device 1100. For one embodiment, the memory 1106 may include any suitable volatile memory, such as a suitable DRAM (Dynamic Random Access Memory). In some embodiments, the memory 1106 may include a double data rate type four synchronous dynamic random access memory.

[0181] For one embodiment, the control module 1104 may include one or more input / output controllers to provide an interface to the non-volatile memory / storage device 1108 and the input / output device(s) 1110 .

[0182] For example, non-volatile memory / storage 1108 may be used to store data and / or instructions 1114. Non-volatile memory / storage 1108 may include any suitable non-volatile memory (e.g., flash memory) and / or may include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives, one or more optical disk drives, and / or one or more digital versatile optical disk drives).

[0183] The non-volatile memory / storage device 1108 may include storage resources that are physically part of the device on which the apparatus 1100 is installed, or it may be accessible to the device without being part of the device. For example, the non-volatile memory / storage device 1108 may be accessed via (one or more) input / output devices 1110 over a network.

[0184] The input / output device(s) 1110 may provide an interface for the apparatus 1100 to communicate with any other appropriate device, and the input / output device 1110 may include a communication component, an audio component, a sensor component, etc. The network interface 1112 may provide an interface for the apparatus 1100 to communicate through one or more networks, and the apparatus 1100 may wirelessly communicate with one or more components of a wireless network according to any of one or more wireless network standards and / or protocols, for example, accessing a wireless network based on a communication standard, such as WiFi (Wireless Fidelity), 2G (2nd Generation Wireless Telephone Technology), 3G (3rd Generation Wireless Telephone Technology), 4G (4th Generation Wireless Telephone Technology), 5G (5th Generation Wireless Telephone Technology), etc., or a combination thereof for wireless communication.

[0185] For one embodiment, at least one of the processor(s) 1102 may be packaged together with the logic of one or more controllers (e.g., a memory controller module) of the control module 1104. For one embodiment, at least one of the processor(s) 1102 may be packaged together with the logic of one or more controllers of the control module 1104 to form a system-in-package. For one embodiment, at least one of the processor(s) 1102 may be integrated on the same die with the logic of one or more controllers of the control module 1104. For one embodiment, at least one of the processor(s) 1102 may be integrated on the same die with the logic of one or more controllers of the control module 1104 to form a system-on-chip.

[0186] In various embodiments, the device 1100 may be, but is not limited to, a terminal device such as a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a touch screen device, a netbook, etc.). In various embodiments, the device 1100 may have more or fewer components and / or a different architecture. For example, in some embodiments, the device 1100 includes one or more cameras, a keyboard, a liquid crystal display screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, a dedicated integrated circuit, and a speaker.

[0187] Among them, the main control chip can be used as a processor or control module in the detection device, sensor data, location information, etc. are stored in a memory or non-volatile memory / storage device, the sensor group can be used as an input / output device, and the communication interface may include a network interface.

[0188] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0189] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0190] The present application embodiment is described with reference to the flowchart and / or block diagram of the method, terminal device (system) and computer program product according to the embodiment of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, and the combination of the process and / or box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device produce a device for implementing the function specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.

[0191] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0192] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce computer-implemented processing, so that the instructions executed on the computer or other programmable terminal device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0193] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0194] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0195] The above is a detailed introduction to a processing method and device for a camera device, an electronic device and a machine-readable medium provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application sets. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A processing method of a camera device, characterized in that: The method comprises: Detecting moving objects in the camera environment; When no moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a first frame rate value range; wherein the upper limit value of the first frame rate value range does not exceed the first frame rate threshold value, so as to increase the amount of light entering the camera device; or When a moving object is detected in the environment of the camera device, the real-time frame rate value of the camera device is controlled within a second frame rate value range; wherein the lower limit value of the second frame rate value range is greater than or equal to the second frame rate threshold value, and the second frequency threshold value is greater than or equal to the first frequency threshold value, so as to reduce image smear; According to the relationship between the real-time frame rate value and the real-time light-on threshold, the real-time light-on threshold corresponding to the real-time frame rate value is determined; wherein, when the brightness represented by the real-time ambient brightness index value is darker than the brightness represented by the real-time light-on threshold, the fill light device is turned on; when the brightness represented by the real-time ambient brightness index value is brighter than the brightness represented by the real-time light-off threshold, the fill light device is turned off.

2. The method according to claim 1, characterized in that The method further comprises: Determine a lower limit value of the first frame rate value range according to the upper limit value of the exposure time; The upper limit of exposure time is a value set by a user, or the upper limit of exposure time is a statistical value of historical exposure time values ​​used by the camera device under time periods and without turning on the light.

3. The method according to claim 2, characterized in that The method further comprises: Determine the sunset and sunrise times for the time zone where the camera is located; Divide the time interval between sunset time and sunrise time to obtain multiple time periods; Statistics are collected on historical exposure time values ​​used by the camera equipment in different time periods and without turning on the light, so as to obtain the upper limit of the exposure time corresponding to the time period.

4. The method according to claim 2, characterized in that: The step of determining the lower limit of the first frame rate value range according to the upper limit of the exposure time includes: The lower limit value of the first frame rate value range is determined according to the mapping relationship between the exposure time and the frame rate, and the upper limit value of the exposure time.

5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Determine the target brightness level of the fill light device according to the real-time ambient brightness index value or the real-time time period information; According to the target brightness level, the fill light device is turned on.

6. The method according to claim 5, characterized in that The step of determining the target brightness level of the fill light device according to the real-time environment brightness index value or the real-time time period information includes: According to the real-time time period information, searching is performed in the mapping relationship between the time period information and the brightness level to obtain the target brightness level of the fill light device; Among them, according to the time period information, the real-time frame rate value of the camera equipment is controlled within the second frame rate value range, the fill light device is turned on, and the brightness level corresponding to the fill light device when the ambient brightness value is the first preset brightness value is recorded, thereby recording the mapping relationship between the time period information and the brightness level.

7. The method according to claim 5, characterized in that The step of determining the target brightness level of the fill light device according to the real-time environment brightness index value or the real-time time period information includes: Determine the initial brightness level of the fill light device according to the real-time ambient brightness index value, and the ambient brightness index values ​​and brightness levels corresponding to the N acquisition points; N is a positive integer; A target brightness level of the fill light device is determined according to the initial brightness level, the upper limit value of the fill light device, and the lower limit value of the fill light device.

8. The method according to any one of claims 1 to 4, characterized in that: The determining of the real-time light-on threshold corresponding to the real-time frame rate value includes: The preset light-on threshold corresponding to the preset frame rate value is multiplied by the ratio of the preset frame rate value to the real-time frame rate value to obtain the real-time light-on threshold; The preset light-on threshold is determined according to the ambient brightness index value obtained by the camera device when the preset frame rate value and the ambient brightness value are the first preset brightness value.

9. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: When the moving object in the environment of the camera device disappears, the frame rate value of the camera device is controlled within a first frame rate value range.

10. A processing device for a camera device, characterized in that: The device comprises: A motion detection module, used to detect moving objects in the camera environment; A first frame rate control module is used to control the real-time frame rate value of the camera device within a first frame rate value range when no moving object is detected in the environment of the camera device; wherein an upper limit value of the first frame rate value range does not exceed a first frame rate threshold value, so as to increase the amount of light entering the camera device; or A second frame rate control module is used to control the real-time frame rate value of the camera device within a second frame rate value range when a moving object is detected in the environment of the camera device; wherein the lower limit value of the second frame rate value range is greater than or equal to the second frame rate threshold value, and the second frequency threshold value is greater than or equal to the first frequency threshold value, so as to reduce image smear; The threshold determination module is used to determine the real-time light-on threshold corresponding to the real-time frame rate value according to the relationship between the real-time frame rate value and the real-time light-on threshold; wherein, when the brightness represented by the real-time environment brightness index value is darker than the brightness represented by the real-time light-on threshold, the fill light device is turned on; when the brightness represented by the real-time environment brightness index value is brighter than the brightness represented by the real-time light-off threshold, the fill light device is turned off.

11. An electronic device, characterized in that: include: processor; and A memory having executable codes stored thereon, which, when executed, causes the processor to execute the method according to any one of claims 1 to 9.

12. A machine-readable medium having executable codes stored thereon, which, when executed, causes a processor to execute the method according to any one of claims 1 to 9.

Images