Low-power-consumption awakening method and image acquisition equipment

Abstract

The invention provides a low-power-consumption awakening method and image acquisition equipment, and the method comprises the steps: obtaining a first proportion value of a static pixel point in a first image according to a detection result of an image signal processor, a second proportion value of a moving pixel point in the first image and a third proportion value of other pixel points in the first image are obtained; according to the first proportion value, the second proportion value and the third proportion value, whether a moving object exists in the shooting range of the image acquisition equipment or not is judged; if the moving object exists in the shooting range, sending a first control signal to the image acquisition related device, so that the image acquisition related device is switched from a first state to a second state; the power consumption in the second state is greater than the power consumption in the first state. The overall power consumption of the image acquisition equipment can be reduced, the endurance time of the battery is prolonged, and the service time of the image acquisition equipment is further prolonged.

Description

Technical Field

[0001] The present application relates to the field of data processing, and in particular to a low-power wake-up method and image acquisition device. Background Art

[0002] Power consumption is a very important parameter to measure the equipment. Higher power consumption means more battery consumption and higher usage cost.

[0003] With the increasing application of electronic devices, low power consumption design has attracted more and more attention. Summary of the invention

[0004] The present application provides a low-power wake-up method and an image acquisition device, which can reduce the overall power consumption of the image acquisition device, extend the battery life, and thus increase the use time of the image acquisition device.

[0005] In a first aspect, the present application provides a low-power wake-up method, which is applied to an image acquisition device, wherein the image acquisition device includes a plurality of image acquisition related devices, wherein the plurality of image acquisition related devices include an image signal processor, and the method includes the steps of:

[0006] Acquire a first ratio value of stationary pixels in the first image, a second ratio value of moving pixels in the first image, and a third ratio value of other pixels in the first image according to the detection result of the image signal processor;

[0007] According to the first ratio value, the second ratio value and the third ratio value, determining whether there is a moving object within the shooting range of the image acquisition device;

[0008] If the moving object exists within the shooting range, a first control signal is sent to the image acquisition related device to switch the image acquisition related device from a first state to a second state; the power consumption in the second state is greater than the power consumption in the first state.

[0009] In some embodiments, obtaining a first ratio value of stationary pixels in the first image, a second ratio value of moving pixels in the first image, and a third ratio value of other pixels in the first image according to the detection result of the image signal processor comprises the steps of:

[0010] According to the detection result, a first number of the stationary pixels, a second number of the moving pixels, and a third number of the other pixels in the first image are counted.

[0011] The first ratio value to the third ratio value are obtained according to the first number, the second number, the third number, and the total number of pixels of the first image.

[0012] In some embodiments, after the moving object exists in the shooting range, before the first control signal is sent to the image acquisition related device, the steps include:

[0013] Acquire a plurality of frames of second images, where acquisition time of the plurality of frames of second images is continuous, and acquisition time of the second images is earlier than acquisition time of the first image;

[0014] When it is determined that the moving object exists within the shooting range according to the second image, and when it is determined that the moving object exists within the shooting range according to the first image, the first control signal is generated.

[0015] In some embodiments, it further comprises:

[0016] A second control signal is generated when it is determined according to the plurality of frames of second images that the moving object does not exist within the shooting range, and when it is determined according to the first image that the moving object does not exist within the shooting range.

[0017] In some implementations, judging whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value, and the third ratio value comprises the steps of:

[0018] If the first ratio value, the second ratio value and the third ratio value meet any one of the following preset conditions, it is determined that the moving object exists within the shooting range;

[0019] The preset conditions include that the first ratio value is less than a first set value, the second ratio value is greater than a second set value, and the third ratio value is greater than a third set value.

[0020] In some embodiments, it further comprises:

[0021] If the moving object does not exist in the shooting range, a second control signal is sent to the multiple image acquisition related devices to switch the multiple image acquisition related devices from the second state to the first state.

[0022] In some implementations, judging whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value, and the third ratio value comprises the steps of:

[0023] A first result is obtained by calculating the first proportion value and the first weight corresponding thereto, a second result is obtained by calculating the second proportion value and the second weight corresponding thereto, and a third result is obtained by calculating the third proportion value and the third weight corresponding thereto, wherein the sum of the first weight, the second weight and the third weight is equal to 1;

[0024] Compare the first result with the result sum value; the result sum value is equal to the sum value of the second result and the third result;

[0025] If the comparison result is that the result sum is less than or equal to the first result, it is determined that the moving object exists within the shooting range;

[0026] If the comparison result is that the result sum value is greater than the first result, it is determined that the moving object does not exist in the shooting range.

[0027] In some embodiments, the plurality of image acquisition related devices further include any one or more of an application processor unit, an image acquisition sensor, and a video input interface.

[0028] In a second aspect, the present application further provides an image acquisition device, the image acquisition device comprising a control unit and a plurality of image acquisition related devices, the plurality of image acquisition related devices comprising an image signal processor;

[0029] The control unit is used to obtain a first ratio value of stationary pixels in the first image, a second ratio value of moving pixels in the first image, and a third ratio value of other pixels in the first image according to the detection result of the image signal processor;

[0030] The control unit is used to determine whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value and the third ratio value;

[0031] The control unit is used to send a first control signal to the image acquisition related device if the moving object exists in the shooting range, so that the image acquisition related device switches from a first state to a second state; the power consumption in the second state is greater than the power consumption in the first state.

[0032] In some embodiments, the control unit comprises:

[0033] a calculation module, configured to obtain a first result according to the first proportion value and a first weight corresponding thereto, obtain a second result according to the second proportion value and a second weight corresponding thereto, and obtain a third result according to the third proportion value and a third weight corresponding thereto, wherein a sum of the first weight, the second weight and the third weight is equal to 1;

[0034] A processing module is used to compare the first result with a result sum value, where the result sum value is equal to the sum value of the second result and the third result; if the comparison result is that the result sum value is less than or equal to the first result, it is determined that the moving object exists within the shooting range; if the comparison result is that the result sum value is greater than the first result, it is determined that the moving object does not exist within the shooting range.

[0035] The low-power wake-up method and image acquisition device provided by the present application obtain the first ratio value of the static pixel in the first image, the second ratio value of the moving pixel in the first image, and the third ratio value of other pixels in the first image according to the detection result of the image signal processor; judge whether there is a moving object in the shooting range of the image acquisition device according to the first ratio value, the second ratio value and the third ratio value; if the moving object exists in the shooting range, send a first control signal to the image acquisition related device to switch the image acquisition related device from the first state to the second state; the power consumption in the second state is greater than the power consumption in the first state. The present application can reduce the overall power consumption of the image acquisition device, extend the battery life, and thus increase the use time of the image acquisition device. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0037] Figure 1 This is a flow chart of a low-power wake-up method provided in an embodiment of the present application.

[0038] Figure 2 It is a flow chart of a low-power wake-up method provided in an embodiment of the present application for determining whether there is a moving object. DETAILED DESCRIPTION

[0039] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0040] In the description of the embodiments of the present application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0041] In order to enable any person skilled in the art to implement and use the present application, the following description is provided. In the following description, details are listed for the purpose of explanation. It should be understood that those of ordinary skill in the art can recognize that the present application can also be implemented without using these specific details. In other examples, the known process will not be elaborated in detail to avoid unnecessary details that make the description of the present application embodiment obscure. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest range of principles and features disclosed in accordance with the embodiments of the present application.

[0042] Battery-based image acquisition devices are widely used in smart phones, digital cameras, vehicles, security monitoring, medical imaging and other fields. Image acquisition devices can include cameras, SOC (System on Chip), SOC can be integrated with MCU (Microcontroller Unit), multiple image acquisition related devices can be ISP (Image Signal Processor), image acquisition sensor and ACPU (Application Central Processing Unit), etc. Low power consumption of battery-based image acquisition devices has become the mainstream demand. Some image acquisition devices use PIR (Passive Infrared Sensor) to detect infrared radiation to sense the movement of human or animal to wake up the image acquisition device. However, this method requires a specific infrared heat source (such as human or animal), and due to the characteristics of infrared heat detection technology, false detection and false triggering of wake-up often occur. The high false wake-up rate will cause the whole machine to be repeatedly started, resulting in an increase in overall power consumption, reducing the battery life, and the additional setting of PIR will increase the overall power consumption. Some image acquisition devices use AI (Artificial Intelligence) models to wake up the image acquisition devices by identifying moving objects. However, this method requires AI computing power and specific AI model training, and AI computing power will also increase overall power consumption.

[0043] The following describes the low-power wake-up method and image acquisition device of the present application in conjunction with the accompanying drawings to solve the above-mentioned problems.

[0044] Reference Figure 1 As shown, Figure 1 is a flowchart of a low-power wake-up method provided in an embodiment of the present application. Figure 1 The flowcharts shown in the figures or other figures show a logical order, but in some cases, the steps shown or described may be performed in a different order than that shown in the figure. The low-power wake-up method provided in the embodiment of the present application is applied to an image acquisition device, wherein the image acquisition device includes a plurality of image acquisition related devices, and the plurality of image acquisition related devices include an image signal processor, such as Figure 1 As shown, the low-power wake-up method includes the following steps:

[0045] S100, acquiring a first ratio value of stationary pixels in a first image, a second ratio value of moving pixels in the first image, and a third ratio value of other pixels in the first image according to a detection result of the image signal processor;

[0046] S200, judging whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value and the third ratio value;

[0047] S300. If the moving object exists within the shooting range, a first control signal is sent to the image acquisition related device to switch the image acquisition related device from a first state to a second state; the power consumption in the second state is greater than the power consumption in the first state.

[0048] Specifically, the sum of the first ratio value, the second ratio value and the third ratio value is equal to 1. The image acquisition device includes multiple chips, the multiple chips include a control unit and multiple image acquisition related devices, the control unit may be an MCU, the multiple image acquisition related devices may be an ISP, an image acquisition sensor (such as a visible light sensor and an infrared camera, etc.), a VII (Video Input Interface, video input interface) and an ACPU, etc. The control unit and the multiple image acquisition related devices work together so that the image acquisition device can efficiently process image data, provide high-quality image output, and support multiple multimedia applications. The control unit operates in a normal power area in a low power consumption mode. The working state of the image acquisition device may be a low power consumption mode, i.e., a first state, and a normal working mode, i.e., a second state. The first state includes a sleep state (sleep) and a low frame rate state (the low frame rate can be configured), and the second state includes an active state and a high frame rate state. If the image acquisition device in the low power consumption mode is in a low frame rate state or a non-full service state, wherein the ACPU is in a sleep state (sleep) or a low power consumption state or a low frame rate state, the image acquisition sensor and the ISP are in a low frame rate state, and the MCU is in a low frequency state or a low power state. The registers configured corresponding to ISP will not be deleted during hot reset, and the last configured values ​​will be retained. Both ACPU and MCU can access the register space of ISP.

[0049] The first image is an image frame captured by the image acquisition device in real time. The first image includes a large number of pixels. The ISP can detect and identify the types of all pixels in the first image to determine the type corresponding to each pixel and obtain the corresponding detection result, wherein the pixel type includes static pixels, motion pixels, and semi-motion pixels that are neither static pixels nor motion pixels (i.e., other pixels in the present application). The control unit can calculate the first ratio value of the static pixels in the first image, the second ratio value of the motion pixels in the first image, and the third ratio value of other pixels in the first image according to the detection result. Then, the control unit determines whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value, and the third ratio value. An object whose position changes over time in space within the shooting range of the image acquisition device is a moving object, which is manifested in that the same feature point of the same object has different position coordinates in continuous images. If there is a moving object within the shooting range of the image acquisition device, the control unit can send a first control signal to at least one of the multiple image acquisition related devices, and the image acquisition related device that receives the first control signal will be awakened and switched from the first state to the second state. Among them, the power consumption of the image acquisition related device in the first state is much lower than the power consumption of the second state.

[0050] This application controls the image acquisition related devices to switch from the first state with low power consumption to the second state with high power consumption only when it is determined that there is a moving object within the shooting range, so as to avoid the image acquisition related devices being in the second state all the time, which can reduce the overall power consumption of the image acquisition device, extend the battery life, and thus increase the use time of the image acquisition device. In addition, since the detection results of the ISP built into the image acquisition device are used to judge the type of pixel points, there is no need to add an additional PIR or AI model for type judgment, which can not only reduce hardware costs, but also reduce the power consumption caused by adding a PIR or AI model, indirectly saving the overall device power consumption of the image acquisition device and extending the battery life.

[0051] In some embodiments, S100, obtaining a first ratio value of a stationary pixel in a first image, a second ratio value of a moving pixel in the first image, and a third ratio value of other pixels in the first image according to a detection result of the image signal processor includes the steps of:

[0052] S110, counting a first number of the stationary pixels, a second number of the moving pixels, and a third number of the other pixels in the first image according to the detection result;

[0053] S120. Obtain the first ratio value to the third ratio value according to the first number, the second number, the third number, and the total number of pixels of the first image.

[0054] Specifically, the ISP includes a 3DNR (Digital Noise Reduction) module. The 3DNR module can use motion estimation technology to analyze the motion of each pixel in any one or a first image of a video sequence. By calculating the relative motion offset of each pixel between adjacent frames, the motion vector of each pixel is obtained, so as to determine whether the pixel is in a moving state, a stationary state or other states. Specifically, the relative motion offset of each pixel in two adjacent frames of a video sequence is calculated by motion estimation technology to obtain the motion vector of each pixel, and the corresponding motion level is obtained according to the motion vector (the motion level usually refers to the size of the motion vector, that is, the motion distance of the pixel in the horizontal direction). According to the size of the corresponding motion level of each pixel, all pixels in the first image are weighted by spatial domain filtering and temporal domain filtering. Pixels with higher motion levels will be assigned higher weights, while pixels with lower motion levels will be assigned lower weights. According to the set motion threshold, the pixels are classified into moving pixels, stationary pixels and other pixels. These classifications are based on the motion level of the pixels in the first image. For example, if a pixel shows obvious movement in continuous video frames (multiple second images and first images, the acquisition time of the second image is earlier than the acquisition time of the first image, and the acquisition time of the multiple second images and the first image is continuous), it is determined to be a moving pixel; if its movement level is low but there is still a certain movement, it is determined to be other pixels; if the pixel hardly moves, it is determined to be a stationary pixel. That is, if the movement level of a pixel exceeds the first set threshold, the pixel is determined to be a moving pixel; if the movement level of a pixel is lower than the second set threshold, it is determined to be a stationary pixel; if the movement level of the pixel is less than the first set threshold and greater than the second set threshold, the pixel is determined to be other pixels.

[0055] The detection result output by the ISP includes the type of each pixel in the first image. The control unit can calculate the proportion of the three types of pixels in the entire image according to the detection result, that is, count the first number of static pixels, the second number of moving pixels, and the third number of other pixels according to the detection result. Then, the control unit calculates the proportion of the three types of pixels in the entire image, that is, divides the first number by the total number of all pixels in the first image to obtain the first proportion value. Similarly, the control unit divides the second number by the total number of all pixels in the first image to obtain the second proportion value, and the control unit divides the third number by the total number of all pixels in the first image to obtain the third proportion value.

[0056] In some embodiments, after the moving object exists in the shooting range, before the first control signal is sent to the image acquisition related device, the steps include:

[0057] Acquire a plurality of frames of second images, where acquisition time of the plurality of frames of second images is continuous, and acquisition time of the second images is earlier than acquisition time of the first image;

[0058] generating the first control signal when it is determined that the moving object exists within the shooting range according to the second image and when it is determined that the moving object exists within the shooting range according to the first image;

[0059] A second control signal is generated when it is determined according to the plurality of frames of second images that the moving object does not exist within the shooting range, and when it is determined according to the first image that the moving object does not exist within the shooting range.

[0060] Specifically, before the control unit determines that there is a moving object within the shooting range according to the first image and sends the first control signal to the image acquisition related device, it can also shoot and obtain multiple frames of second images, and refer to the above embodiment to determine whether there is a moving object within the shooting range for the first image according to the multiple frames of second images. If it is determined that there is a moving object within the shooting range according to the second image, the control unit can generate a first control signal and send it to the image acquisition related device. On the contrary, if all the second images in the multiple frames of second images determine that there is no moving object within the shooting range, a second control signal is generated, and the next frame of the first image is switched to repeat the process of S100 to S300 of the above embodiment. Of course, if it is determined that there is a moving object within the shooting range according to the second image, and it is determined that there is the moving object within the shooting range according to the first image, the control unit can generate a first control signal and send it to the image acquisition related device, where n is a positive integer, and n≥2, and the next frame of the first image is switched to repeat the process of S100 to S300 of the above embodiment.

[0061] The present application uses multiple frames of continuous second images and first images to jointly identify moving objects within the shooting range, which can reduce the probability of false triggering and waking up high-power image acquisition related components, extend the battery life, and thus increase the usage time of the image acquisition device.

[0062] In some embodiments, S200, judging whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value and the third ratio value comprises the steps of:

[0063] S210: If the first ratio value, the second ratio value and the third ratio value satisfy any one of the following preset conditions, it is determined that the moving object exists within the shooting range;

[0064] The preset conditions include that the first ratio value is less than a first set value, the second ratio value is greater than a second set value, and the third ratio value is greater than a third set value.

[0065] Specifically, the first setting value, the second setting value and the third setting value may be configured, the first ratio value may be compared with the first setting value, the second ratio value may be compared with the second setting value, and the third ratio value may be compared with the third setting value. The first setting value may be equal to the second setting value, the first setting value may also be greater than the second setting value, and the third setting value may be greater than the first setting value. For example, assuming that the first setting value is 60%, that is, when the first ratio value is <60%, it can be determined that there is a moving object within the shooting range, otherwise, if the first ratio value is ≥60%, it can be determined that there is no moving object within the shooting range. Of course, assuming that the second setting value is 50, that is, when the second ratio value is ≥50%, it can be determined that there is a moving object within the shooting range, otherwise, if the second ratio value is <60%, it can be determined that there is no moving object within the shooting range. For example, assuming that the first ratio value is <60%, the second ratio value is ≥50%, and the third ratio value is ≥65%, it can be determined that there is a moving object within the shooting range.

[0066] In some embodiments, reference Figure 2 As shown, Figure 2 FIG. 1 is a flow chart of a low-power wake-up method provided in an embodiment of the present application for determining whether there is a moving object. Figure 2 As shown, the S200, judging whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value and the third ratio value, includes the steps of:

[0067] S220: Calculate a first result according to the first proportion value and its corresponding first weight, calculate a second result according to the second proportion value and its corresponding second weight, and calculate a third result according to the third proportion value and its corresponding third weight, wherein the sum of the first weight, the second weight and the third weight is equal to 1;

[0068] S230, comparing the first result with the result sum value; the result sum value is equal to the sum value of the second result and the third result;

[0069] S240: If the comparison result is that the result sum is less than or equal to the first result, it is determined that the moving object exists within the shooting range;

[0070] S250: If the comparison result is that the result sum is greater than the first result, determine that the moving object does not exist in the shooting range.

[0071] Specifically, the three ratio values ​​are respectively configured with corresponding weights, that is, the first ratio value corresponds to the first weight W1, the second ratio value corresponds to the second weight W2, and the third ratio value corresponds to the third weight W3, and the sum of the first weight W1, the second weight W2 and the third weight W3 is equal to 1, that is, W1+W2+W3=1. The first ratio value is calculated with the corresponding first weight W1 to obtain the first result M1, the second ratio value is calculated with the corresponding second weight W2 to obtain the second result M2, and the third ratio value is calculated with the corresponding third weight W3 to obtain the third result M3. The control unit adds the second result M2 and the third result M3 to obtain the result sum M2+M3, and then compares the result sum M2+M3 with the first result M1. If M2+M3≥M1, it is determined that there is a moving object in the shooting range and it is considered to enter the second state (which can be confirmed by multiple frames of images). The MCU in the SOC can send a first control signal to switch the image acquisition related components from the first state to the second state, and the image acquisition device enters a normal working state (for example, normal frame rate, normal full service). On the contrary, if M2+M3<M1, it is determined that there is no moving object within the shooting range, and it is considered to enter the sleep state (which can be confirmed by multiple frames of images). The MCU in the SOC can send a second control signal to switch the image acquisition related components from the second state to the first state, and the image acquisition device enters a low power consumption mode, that is, the image acquisition device is in a low frame rate state or a non-full service state.

[0072] For example, if there is a moving object within the shooting range, the MCU in the SOC can send a first control signal to the ACPU to wake up the ACPU in the sleep state and switch it to the running state, and send a first control signal to the image acquisition sensor (such as a visible light sensor and an infrared camera, etc.), ISP and VII to switch the image acquisition sensor, ISP and VII in the low frame rate state to the high frame rate state. Conversely, if there is no moving object within the shooting range, the MCU in the SOC can send a second control signal to the ACPU to switch the ACPU in the running state to the sleep state, and send a second control signal to the image acquisition sensor (such as a visible light sensor and an infrared camera, etc.), ISP and VII to switch the image acquisition sensor, ISP and VII in the high frame rate state to the low frame rate state.

[0073] In some embodiments, it also includes:

[0074] If the moving object does not exist in the shooting range, a second control signal is sent to the multiple image acquisition related devices to switch the multiple image acquisition related devices from the second state to the first state.

[0075] Specifically, if there is no moving object within the shooting range of the image acquisition device, the control unit can send a second control signal to at least one of the multiple image acquisition related devices, and the image acquisition related device that receives the second control signal will be controlled to switch from the second state to the first state. The power consumption of the image acquisition related device in the first state is much lower than that in the second state.

[0076] The present application controls the image acquisition related devices to switch from the first state with low power consumption to the second state with high power consumption for capturing and storing only when it is determined that there is a moving object within the shooting range, so that the image acquisition related devices with high power consumption are in the first state with low power consumption for a long time, saving energy consumption and extending the standby time. The image acquisition related devices are controlled to switch from the second state with high power consumption to the first state with low power consumption only when it is determined that there is no moving object within the shooting range. By switching the control back and forth in this way, it is possible to wake up the captured image in time while avoiding the image acquisition related devices from being in the second state all the time, which can reduce the overall power consumption of the image acquisition device, extend the battery life, and thus increase the use time of the image acquisition device. The low-power wake-up method of the present application can be implemented through chip logic, or through software logic + chip statistical counting.

[0077] In some embodiments, the plurality of image acquisition related devices further include any one or more of an application processor unit, an image acquisition sensor, and a video input interface.

[0078] Specifically, the image acquisition sensor is an image acquisition related device that can realize the photoelectric conversion function, and is widely used in imaging equipment, for example, it can be used in imaging equipment such as cameras, webcams, and security monitors. The image acquisition sensor provided in the embodiment of the present application can be applied to various camera modules, for example, it can be applied to imaging equipment such as cameras, webcams, and security monitors. The image acquisition sensor can be a CCD image acquisition sensor composed of a charge coupled device (CCD), and the image acquisition sensor can also be a CMOS image acquisition sensor composed of a complementary metal oxide semiconductor (CMOS). The control unit can send a first control signal or a second control signal to any one or more of a plurality of image acquisition related devices, and selectively control the state switching of the image acquisition related devices to meet the needs of different scenarios.

[0079] The present application also provides an image acquisition device, the image acquisition device comprising a control unit and a plurality of image acquisition related devices, the plurality of image acquisition related devices comprising an image signal processor;

[0080] The control unit is used to obtain a first ratio value of stationary pixels in the first image, a second ratio value of moving pixels in the first image, and a third ratio value of other pixels in the first image according to the detection result of the image signal processor;

[0081] The control unit is used to determine whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value and the third ratio value;

[0082] The control unit is used to send a first control signal to the image acquisition related device if the moving object exists in the shooting range, so that the image acquisition related device switches from a first state to a second state; the power consumption in the second state is greater than the power consumption in the first state.

[0083] Specifically, the image acquisition device includes multiple chips, and the multiple chips include a control unit and multiple image acquisition related devices. The control unit can be an MCU, and the multiple image acquisition related devices can be an ISP, an image acquisition sensor (such as a visible light sensor and an infrared camera, etc.), a VII (Video Input Interface, video input interface) and an ACPU, etc. The control unit and the multiple image acquisition related devices work together to enable the image acquisition device to efficiently process image data, provide high-quality image output, and support a variety of multimedia applications. The control unit operates in a normal power area in a low power consumption mode. The working state of the image acquisition device can be a low power consumption mode, i.e., a first state, and a normal working mode, i.e., a second state. The first state includes a sleep state (sleep) and a low frame rate state (the low frame rate can be configured), and the second state includes an active state and a high frame rate state. If the image acquisition device in the low power consumption mode is in a low frame rate state or a non-full service state, wherein the ACPU is in a sleep state (sleep) or a low power consumption state or a low frame rate state, the image acquisition sensor and the ISP are in a low frame rate state, and the MCU is in a low frequency state or a low power state. The registers configured by ISP will not be deleted during hot reset, and the last configured values ​​will be retained. Both ACPU and MCU can access the register space of ISP. The sum of the first ratio value, the second ratio value and the third ratio value is equal to 1.

[0084] The first image is an image frame captured by the image acquisition device in real time. The first image includes a large number of pixels. The ISP can detect and identify the types of all pixels in the first image to determine the type corresponding to each pixel and obtain the corresponding detection result, wherein the pixel type includes static pixels, motion pixels, and semi-motion pixels that are neither static pixels nor motion pixels (i.e., other pixels in the present application). The control unit can calculate the first ratio value of the static pixels in the first image, the second ratio value of the motion pixels in the first image, and the third ratio value of other pixels in the first image according to the detection result. Then, the control unit determines whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value, and the third ratio value. An object whose position changes over time in space within the shooting range of the image acquisition device is a moving object, which is manifested in that the same feature point of the same object has different position coordinates in continuous images. If there is a moving object within the shooting range of the image acquisition device, the control unit can send a first control signal to at least one of the multiple image acquisition related devices, and the image acquisition related device that receives the first control signal will be awakened and switched from the first state to the second state. Among them, the power consumption of the image acquisition related device in the first state is much lower than the power consumption of the second state.

[0085] This application controls the image acquisition related devices to switch from the first state with low power consumption to the second state with high power consumption only when it is determined that there is a moving object within the shooting range, so as to avoid the image acquisition related devices being in the second state all the time, which can reduce the overall power consumption of the image acquisition device, extend the battery life, and thus increase the use time of the image acquisition device. In addition, since the detection results of the ISP built into the image acquisition device are used to judge the type of pixel points, there is no need to add an additional PIR or AI model for type judgment, which can not only reduce hardware costs, but also reduce the power consumption caused by adding a PIR or AI model, indirectly saving the overall device power consumption of the image acquisition device and extending the battery life.

[0086] In some embodiments, the control unit comprises:

[0087] a calculation module, configured to obtain a first result according to the first proportion value and a first weight corresponding thereto, obtain a second result according to the second proportion value and a second weight corresponding thereto, and obtain a third result according to the third proportion value and a third weight corresponding thereto, wherein a sum of the first weight, the second weight and the third weight is equal to 1;

[0088] A processing module is used to compare the first result with a result sum value, where the result sum value is equal to the sum value of the second result and the third result; if the comparison result is that the result sum value is less than or equal to the first result, it is determined that the moving object exists within the shooting range; if the comparison result is that the result sum value is greater than the first result, it is determined that the moving object does not exist within the shooting range.

[0089] Specifically, the three ratio values ​​are respectively configured with corresponding weights, that is, the first ratio value corresponds to the first weight W1, the second ratio value corresponds to the second weight W2, and the third ratio value corresponds to the third weight W3, and the sum of the first weight W1, the second weight W2 and the third weight W3 is equal to 1, that is, W1+W2+W3=1. The first ratio value is calculated with the corresponding first weight W1 to obtain the first result M1, the second ratio value is calculated with the corresponding second weight W2 to obtain the second result M2, and the third ratio value is calculated with the corresponding third weight W3 to obtain the third result M3. The control unit adds the second result M2 and the third result M3 to obtain the result sum M2+M3, and then compares the result sum M2+M3 with the first result M1. If M2+M3≥M1, it is determined that there is a moving object in the shooting range and it is considered to enter the second state (which can be confirmed by multiple frames of images). The MCU in the SOC can send a first control signal to switch the image acquisition related components from the first state to the second state, and the image acquisition device enters a normal working state (for example, normal frame rate, normal full service). On the contrary, if M2+M3<M1, it is determined that there is no moving object within the shooting range, and it is considered to enter the sleep state (which can be confirmed by multiple frames of images). The MCU in the SOC can send a second control signal to switch the image acquisition related components from the second state to the first state, and the image acquisition device enters a low power consumption mode, that is, the image acquisition device is in a low frame rate state or a non-full service state.

[0090] For example, if there is a moving object within the shooting range, the MCU in the SOC can send a first control signal to the ACPU to wake up the ACPU in the sleep state and switch it to the running state, and send a first control signal to the image acquisition sensor (such as a visible light sensor and an infrared camera, etc.), ISP and VII to switch the image acquisition sensor, ISP and VII in the low frame rate state to the high frame rate state. Conversely, if there is no moving object within the shooting range, the MCU in the SOC can send a second control signal to the ACPU to switch the ACPU in the running state to the sleep state, and send a second control signal to the image acquisition sensor (such as a visible light sensor and an infrared camera, etc.), ISP and VII to switch the image acquisition sensor, ISP and VII in the high frame rate state to the low frame rate state.

[0091] In specific implementation, the above units or modules can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The above units or modules can refer to the low-power wake-up method in the previous method embodiment, which will not be repeated here.

[0092] Those skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by controlling related hardware through instructions, and the instructions can be stored in a computer-readable storage medium, and loaded and executed by a processor to implement the above method embodiments. The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.

[0093] In the above embodiments, the description of each embodiment has its own emphasis. For the part not described in detail in a certain embodiment, reference can be made to the relevant description of other embodiments. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process and beneficial effects of the data acquisition system and its corresponding units described above can refer to the description of the low-power wake-up method in the above embodiment, and will not be repeated here.

[0094] The above is a detailed introduction to a low-power wake-up method and system provided in an embodiment of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A low-power wake-up method, characterized in that: Applied to an image acquisition device, the image acquisition device includes a plurality of image acquisition related devices, the plurality of image acquisition related devices include an image signal processor, and the method includes the steps of: Acquire a first ratio value of stationary pixels in the first image, a second ratio value of moving pixels in the first image, and a third ratio value of other pixels in the first image according to the detection result of the image signal processor; According to the first ratio value, the second ratio value and the third ratio value, determining whether there is a moving object within the shooting range of the image acquisition device; If the moving object exists within the shooting range, sending a first control signal to the image acquisition related device to switch the image acquisition related device from the first state to the second state; The power consumption in the second state is greater than the power consumption in the first state.

2. The low-power wake-up method according to claim 1, characterized in that: The step of acquiring a first ratio value of stationary pixels in the first image, a second ratio value of moving pixels in the first image, and a third ratio value of other pixels in the first image according to the detection result of the image signal processor comprises the following steps: Counting a first number of the stationary pixels, a second number of the moving pixels, and a third number of the other pixels in the first image according to the detection result; The first ratio value to the third ratio value are obtained according to the first number, the second number, the third number, and the total number of pixels of the first image.

3. The low-power wake-up method according to claim 1, characterized in that: If the moving object exists in the shooting range, before sending the first control signal to the image acquisition related device, the steps include: Acquire a plurality of frames of second images, where acquisition time of the plurality of frames of second images is continuous, and acquisition time of the second images is earlier than acquisition time of the first image; When it is determined that the moving object exists within the shooting range according to the second image, and when it is determined that the moving object exists within the shooting range according to the first image, the first control signal is generated.

4. The low-power wake-up method according to claim 3, characterized in that: Also includes: A second control signal is generated when it is determined according to the plurality of frames of second images that the moving object does not exist within the shooting range, and when it is determined according to the first image that the moving object does not exist within the shooting range.

5. The low-power wake-up method according to claim 1, characterized in that: The step of judging whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value and the third ratio value comprises the following steps: If the first ratio value, the second ratio value and the third ratio value meet any one of the following preset conditions, it is determined that the moving object exists within the shooting range; The preset conditions include that the first ratio value is less than a first set value, the second ratio value is greater than a second set value, and the third ratio value is greater than a third set value.

6. The low-power wake-up method according to claim 1, characterized in that: Also includes: If the moving object does not exist in the shooting range, a second control signal is sent to the multiple image acquisition related devices to switch the multiple image acquisition related devices from the second state to the first state.

7. The low-power wake-up method according to claim 1, characterized in that: The step of judging whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value and the third ratio value comprises the following steps: A first result is obtained by calculating the first proportion value and the first weight corresponding thereto, a second result is obtained by calculating the second proportion value and the second weight corresponding thereto, and a third result is obtained by calculating the third proportion value and the third weight corresponding thereto, wherein the sum of the first weight, the second weight and the third weight is equal to 1; Compare the first result with the result sum value; the result sum value is equal to the sum value of the second result and the third result; If the comparison result is that the result sum value is less than or equal to the first result, it is determined that the moving object exists within the shooting range; If the comparison result is that the result sum value is greater than the first result, it is determined that the moving object does not exist in the shooting range.

8. The low-power wake-up method according to any one of claims 1 to 7, characterized in that: The multiple image acquisition related devices also include any one or more of an application processor unit, an image acquisition sensor, and a video input interface.

9. An image acquisition device, characterized in that: The image acquisition device comprises a control unit and a plurality of image acquisition related devices, wherein the plurality of image acquisition related devices comprises an image signal processor; The control unit is used to obtain a first ratio value of stationary pixels in the first image, a second ratio value of moving pixels in the first image, and a third ratio value of other pixels in the first image according to the detection result of the image signal processor; The control unit is used to determine whether there is a moving object within the shooting range of the image acquisition device according to the first ratio value, the second ratio value and the third ratio value; The control unit is configured to send a first control signal to the image acquisition related device if the moving object exists within the shooting range, so that the image acquisition related device switches from the first state to the second state; The power consumption in the second state is greater than the power consumption in the first state.

10. The image acquisition device according to claim 9, characterized in that: The control unit comprises: a calculation module, configured to obtain a first result according to the first proportion value and a first weight corresponding thereto, obtain a second result according to the second proportion value and a second weight corresponding thereto, and obtain a third result according to the third proportion value and a third weight corresponding thereto, wherein a sum of the first weight, the second weight and the third weight is equal to 1; A processing module is used to compare the first result with a result sum value, where the result sum value is equal to the sum value of the second result and the third result; if the comparison result is that the result sum value is less than or equal to the first result, it is determined that the moving object exists within the shooting range; if the comparison result is that the result sum value is greater than the first result, it is determined that the moving object does not exist within the shooting range.

Images