An image processing chip and method

Abstract

The application discloses an image processing chip, comprising an image sensor module and a central processor module, wherein the image sensor module comprises a photoelectric signal conversion module, a storage module and a wake-up module; the photoelectric signal conversion module comprises a plurality of photoelectric signal conversion units; the storage module comprises a plurality of storage units for storing preset reference values; the wake-up module is used for acquiring the preset reference values from the storage module, comparing each preset reference value with an electric signal transmitted by a corresponding photoelectric signal conversion unit, and transmitting a wake-up signal to the central processor module when the electric signal is greater than the preset reference value, so as to wake up the central processor module to enter a working state. The application provides an image processing chip and method, and can save electric energy when an electronic photographing device works.

Description

Technical Field

[0001] The present application relates to the technical field of electronic camera equipment and system-on-chip chips, and in particular to an image processing chip and method. Background Art

[0002] Electronic cameras have been widely used in applications involving capturing the trajectory of moving objects. While their imaging capabilities are close to those of the human eye, they are still inferior to the human eye. This is because higher-quality images captured by an electronic camera mean a higher pixel density per unit size required by the device's image processing chip. The greater the number of frames captured by the electronic camera, the more images the device's image processing chip must process per unit time. Therefore, capturing a moving object often requires the device's chip to utilize significant computing and storage resources. In the prior art, the image processing chip of an electronic camera includes a power generation module, a clock signal generation module, an analog signal detection module, an analog signal processing module, a hardware acceleration module, a storage module, and an interface module. Therefore, when the image processing chip utilizes computing and storage resources, the device's power consumption rapidly decreases. Furthermore, the image processing chip also requires extended periods of image processing, resulting in significant energy consumption. Summary of the Invention

[0003] In response to the above technical problems, the present application provides an image processing chip and method, which can save power when an electronic shooting device is working.

[0004] An embodiment of the present application provides an image processing chip, including an image sensor module and a central processing unit module, wherein the image sensor module includes a photoelectric signal conversion module, a storage module, and a wake-up module;

[0005] The photoelectric signal conversion module includes a plurality of photoelectric signal conversion units, each of which is used to convert an optical signal into a corresponding electrical signal when acquiring an image and then transmit the electrical signal to the wake-up module;

[0006] The storage module includes a plurality of storage units for storing preset reference values, each storage unit corresponding to one or more photoelectric signal conversion units;

[0007] The wake-up module is used to:

[0008] Acquire a preset reference value corresponding to each photoelectric signal conversion unit from the storage module;

[0009] comparing each preset reference value with the electrical signal transmitted by the corresponding photoelectric signal conversion unit;

[0010] When the electrical signal transmitted by one or more photoelectric signal conversion units is greater than the corresponding preset reference value, a wake-up signal is transmitted to the central processing unit module to wake up the central processing unit module and put it into working state.

[0011] Optionally, each of the photoelectric signal conversion units is used to transmit a corresponding electrical signal to the wake-up module when a preset condition is met, and the electrical signal is an assignment;

[0012] The storage module includes a first memory, and the first memory is used to store a preset threshold;

[0013] The wake-up module includes a first comparator; the first comparator is used to add the assignment values ​​transmitted by each photoelectric signal conversion unit to obtain a total assignment value, and compare the preset threshold value obtained from the first memory with the total assignment value;

[0014] If the total assignment value is greater than the preset threshold, the wake-up module transmits a wake-up signal to the central processing unit module.

[0015] Optionally, each of the photoelectric signal conversion units includes a second comparator, a photodiode for transmitting an input voltage to the second comparator, and a second memory for storing a preset voltage value corresponding to the photodiode;

[0016] The photoelectric signal conversion unit transmits a corresponding electrical signal to the wake-up module when a preset condition is met. The electrical signal is an assignment, including:

[0017] Acquire a preset voltage value from a second memory of the photoelectric signal conversion unit;

[0018] comparing the acquired preset voltage value with the input voltage transmitted by the photodiode in the photoelectric signal conversion unit in the second comparator of the photoelectric signal conversion unit;

[0019] If the input voltage is greater than the preset voltage value, the photoelectric signal conversion unit outputs a corresponding assignment value to the wake-up module.

[0020] Optionally, each of the photoelectric signal conversion units includes a second comparator, a photodiode for transmitting an input voltage to the second comparator, and a voltage generator corresponding to the photodiode;

[0021] The photoelectric signal conversion unit transmits a corresponding electrical signal to the wake-up module when a preset condition is met. The electrical signal is an assignment, including:

[0022] The voltage generator of the photoelectric signal conversion unit generates a preset reference voltage;

[0023] comparing the preset reference voltage with an input voltage transmitted by a photodiode in the photoelectric signal conversion unit in a second comparator of the photoelectric signal conversion unit;

[0024] If the input voltage is greater than the preset reference voltage, the photoelectric signal conversion unit outputs a corresponding assignment value to the wake-up module.

[0025] Optionally, each of the photoelectric signal conversion units includes a photodiode and a digital integrator;

[0026] The photoelectric signal conversion unit transmits a corresponding electrical signal to the wake-up module when a preset condition is met. The electrical signal is an assignment, including:

[0027] The photodiode of the photoelectric signal conversion unit transmits an input voltage to the digital integrator of the photoelectric signal conversion unit;

[0028] The digital integrator of the photoelectric signal conversion unit integrates the input voltage to obtain a digital signal as an assignment.

[0029] Optionally, the central processing unit module is used to:

[0030] When entering the working state, controlling the image sensor module to shoot a video, and periodically obtaining a comparison result between a preset reference value and an electrical signal from the wake-up module;

[0031] If the comparison result shows that the electrical signal is greater than the preset reference value, maintaining the image sensor module to perform video shooting;

[0032] If the comparison result is that the electrical signal is less than or equal to the preset reference value, the image sensor module is controlled to stop video shooting.

[0033] An embodiment of the present application provides an image processing method for an image processing chip, wherein the image processing chip includes an image sensor module and a central processing unit module, the image sensor module includes a photoelectric signal conversion module, a storage module, and a wake-up module, the photoelectric signal conversion module includes multiple photoelectric signal conversion units, and the image processing method includes the following steps:

[0034] Each of the photoelectric signal conversion units converts the optical signal into a corresponding electrical signal when acquiring an image and transmits the electrical signal to the wake-up module;

[0035] The storage module transmits the preset reference value corresponding to each photoelectric signal conversion unit to the wake-up module, wherein the storage module includes a plurality of storage units for storing the preset reference values, and each storage unit corresponds to one or more photoelectric signal conversion units;

[0036] The wake-up module compares each preset reference value with the electrical signal transmitted by the corresponding photoelectric signal conversion unit, and transmits a wake-up signal to the central processing unit module when the electrical signal transmitted by one or more photoelectric signal conversion units is greater than the corresponding preset reference value to wake up the central processing unit module and enter a working state.

[0037] Optionally, the storage module includes a first memory for storing a preset threshold, and the wake-up module includes a first comparator;

[0038] The wake-up module compares each preset reference value with the electrical signal transmitted by the corresponding photoelectric signal conversion unit, and transmits a wake-up signal to the central processing unit module when the electrical signal transmitted by one or more photoelectric signal conversion units is greater than the corresponding preset reference value, including:

[0039] The first comparator adds the assignments transmitted by each photoelectric signal conversion unit to obtain a total assignment, wherein each of the photoelectric signal conversion units transmits a corresponding electrical signal to the wake-up module when a preset condition is met, and the electrical signal is the assignment;

[0040] comparing the preset threshold value obtained from the first memory with the total assignment value;

[0041] If the total assignment value is greater than the preset threshold, the wake-up module transmits a wake-up signal to the central processing unit module.

[0042] Optionally, each of the photoelectric signal conversion units includes a second comparator, a photodiode for transmitting an input voltage to the second comparator, and a second memory for storing a preset voltage value corresponding to the photodiode;

[0043] The photoelectric signal conversion unit transmits a corresponding electrical signal to the wake-up module when a preset condition is met. The electrical signal is an assignment, including:

[0044] Acquire a preset voltage value from a second memory of the photoelectric signal conversion unit;

[0045] comparing the acquired preset voltage value with the input voltage transmitted by the photodiode in the photoelectric signal conversion unit in the second comparator of the photoelectric signal conversion unit;

[0046] If the input voltage is greater than the preset voltage value, the photoelectric signal conversion unit outputs a corresponding assignment value to the wake-up module.

[0047] Optionally, the image processing method further includes:

[0048] When the central processing unit module enters the working state, the central processing unit module controls the image sensor module to shoot a video, and periodically obtains a comparison result between a preset reference value and an electrical signal from the wake-up module;

[0049] If the comparison result shows that the electrical signal is greater than the preset reference value, maintaining the image sensor module to perform video shooting;

[0050] If the comparison result is that the electrical signal is less than or equal to the preset reference value, the image sensor module is controlled to stop video shooting.

[0051] Compared with the prior art, the embodiments of the present application have the following beneficial effects:

[0052] An embodiment of the present application provides an image processing chip and method, wherein the image processing chip includes an image sensor module and a central processing unit module, the image sensor module includes a photoelectric signal conversion module, a storage module and a wake-up module; the photoelectric signal conversion module includes a plurality of photoelectric signal conversion units, each of the photoelectric signal conversion units is used to convert an optical signal into a corresponding electrical signal when acquiring an image and then transmit the electrical signal to the wake-up module; the storage module includes a plurality of storage units for storing preset reference values, each storage unit corresponding to one or more photoelectric signal conversion units; the wake-up module is used to: obtain a preset reference value corresponding to each photoelectric signal conversion unit from the storage module; compare each preset reference value with the electrical signal transmitted by the corresponding photoelectric signal conversion unit; when the electrical signal transmitted by one or more photoelectric signal conversion units is greater than the corresponding preset reference value, transmit a wake-up signal to the central processing unit module to wake up the central processing unit module and enter a working state. It can be seen that when the electrical signal transmitted by the photoelectric signal conversion unit is greater than the preset reference value stored in the storage module, the wake-up module wakes up the central processing unit module, and there is no need for the central processing unit module to calculate the comparison result between the electrical signal transmitted by each photoelectric signal conversion unit and the preset reference value stored in the storage module every time a picture is taken, thereby avoiding the central processing unit module from calling a large amount of computing resources and storage resources, and reducing the operating time of the central processing unit module, thereby reducing the energy consumption of the electronic shooting device. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] Figure 1 is a schematic structural diagram of an image processing chip provided in an embodiment of the present application;

[0054] Figure 2 is a first structural diagram of the image sensor module provided in an embodiment of the present application;

[0055] Figure 3 is a second structural diagram of the image sensor module provided in an embodiment of the present application;

[0056] Figure 4 This is a first structural diagram of the photoelectric signal conversion unit provided in an embodiment of the present application;

[0057] Figure 5 is a second structural diagram of the photoelectric signal conversion unit provided in an embodiment of the present application;

[0058] Figure 6 3 is a schematic diagram of the third structure of the photoelectric signal conversion unit provided in an embodiment of the present application;

[0059] Figure 7 This is a schematic diagram of the first flow chart of the image processing method provided in an embodiment of the present application;

[0060] Figure 8 2 is a schematic diagram of a second flow chart of the image processing method provided in an embodiment of the present application;

[0061] Among them, 1000, image sensor module; 2000, central processing unit module; 1100, photoelectric signal conversion module; 1200, storage module; 1300, wake-up module; 1400, power supply module; 1110, photoelectric signal conversion unit; 1210, first memory; 1310, first comparator; 1320, analog-to-digital converter; 1101, photodiode; 1111, second comparator; 1112, second memory; 1113, voltage generator; 1114, digital integrator. DETAILED DESCRIPTION

[0062] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0063] See also Figure 1 , Figure 1 It is a structural diagram of the image processing chip provided in an embodiment of the present application.

[0064] The present application provides an image processing chip, which includes an image sensor module 1000 and a central processing unit module 2000. The image sensor module 1000 includes a photoelectric signal conversion module 1100, a storage module 1200, a wake-up module 1300, and a power supply module 1400.

[0065] The photoelectric signal conversion module 1100 is used to generate an electrical signal when acquiring an image, and transmit the electrical signal to the wake-up module 1300 .

[0066] The storage module 1200 is used to store a preset reference value.

[0067] The wake-up module 1300 is used to obtain the electrical signal and a preset reference value from the storage module 1200, and compare the electrical signal with the preset reference value; if the electrical signal is greater than the preset reference value, a wake-up signal is transmitted to the central processing unit module 2000 to wake up the central processing unit module 2000 and enter a working state.

[0068] The power supply module 1400 is used to generate a reference current and a reference voltage, and provide power to the photoelectric conversion module 1100 , the storage module 1200 , and the wake-up module 1300 .

[0069] It can be understood that the image sensor module 1000 of the image processing chip is used to capture images, and its main function is to convert light and shadow image information (light signal) into electronic image information (electrical signal of current or voltage); while the central processing unit module 2000 performs image processing (such as thresholding, stitching, etc.) on the electronic image information to form a complete and visible image.

[0070] In this embodiment, the photoelectric signal conversion module 1100 of the image sensor module 1000 is the main component that senses ambient light and converts it into an electrical signal. The working process of the photoelectric signal conversion module 1100 is as follows: after receiving a shooting command, the image sensor module 1000 receives a light signal (such as the ambient light of the scene) through a light receiver such as a lens, and the light signal is converted into an electrical signal by the photoelectric signal conversion module 1100. The converted electrical signal can be a current or a voltage. In the wake-up module 1300, the current or voltage converted from the light signal can be compared with a preset reference value in the storage module 1200. For example, the wake-up module 1300 can determine whether the voltage converted from the light signal reaches a preset reference value. If not, the wake-up module 1300 will not generate a wake-up signal. Otherwise, a wake-up signal is generated and sent to the central processing unit module 2000 to wake up the central processing unit module 2000 and enter the working state.

[0071] In existing image processing chips, the image sensor module converts light and shadow image information into electronic image information and transmits it directly to the central processing unit (CPU). The CPU module then compares this electronic image information with a preset threshold value. Based on the comparison results, the CPU module makes different modification instructions to complete the thresholding process. However, each shot requires the CPU module to calculate the comparison result of the electronic image information (electrical signal) with the preset threshold value. Therefore, each calculation consumes a lot of CPU resources and is time-consuming, resulting in high energy consumption of existing image processing chips.

[0072] The image processing chip provided in the embodiment of the present application includes an image sensor module 1000 and a central processing unit module 2000. The image sensor module 1000 includes a photoelectric signal conversion module 1100, a storage module 1200, a wake-up module 1300, and a power supply module 1400; the photoelectric signal conversion module 1100 is used to generate an electrical signal and transmit the electrical signal to the wake-up module 1300 when acquiring an image; the storage module 1200 is used to store a preset reference value and transmit the preset reference value to the wake-up module 1300; the wake-up module 1300 is used to acquire the electrical signal and the preset reference value, and compare the preset reference value with the electrical signal; the power supply module 1400 is used to generate a reference current and a reference voltage to provide power to the photoelectric conversion module 1100, the storage module 1200, and the wake-up module 1300; if the electrical signal is greater than the preset reference value, a wake-up signal is transmitted to the central processing unit module 2000 to wake up the central processing unit module 2000 and enter a working state. It can be seen that when the electrical signal of the photoelectric signal conversion module 1100 is greater than the preset reference value of the storage module 1200, the wake-up module 1300 wakes up the central processing unit module 2000, and there is no need for the central processing unit module 2000 to calculate the comparison result between the electrical signal of the photoelectric signal conversion module 1100 and the preset reference value of the storage module 1200 every time a picture is taken, thereby avoiding the central processing unit module 2000 from calling a large amount of computing resources and storage resources, and reducing the operating time of the central processing unit module 2000, thereby reducing the energy consumption of the electronic shooting device.

[0073] See also Figure 2 , Figure 2 This is a first structural diagram of the image sensor module provided in an embodiment of the present application.

[0074] In one embodiment, the image processing chip includes an image sensor module 1000 and a central processing unit module 2000. The image sensor module 1000 includes a photoelectric signal conversion module 1100, a storage module 1200, a wake-up module 1300, and a power supply module 1400. Figure 1 The same as in , no more repeating.

[0075] In this embodiment, the photoelectric signal conversion module 1100 includes a plurality of photoelectric signal conversion units 1110 , each of which is used to convert a light signal into a corresponding electrical signal when acquiring an image and then transmit the electrical signal to the wake-up module 1300 ;

[0076] The storage module 1200 includes a plurality of storage units for storing preset reference values, each storage unit corresponding to one or more photoelectric signal conversion units 1110;

[0077] The wake-up module 1300 is used to obtain a preset reference value corresponding to each photoelectric signal conversion unit 1110 from the storage module 1200, and compare each preset reference value with the electrical signal transmitted by the corresponding photoelectric signal conversion unit 1110; when the electrical signal transmitted by one or more photoelectric signal conversion units 1110 is greater than the corresponding preset reference value, a wake-up signal is transmitted to the central processing unit module 2000 to wake up the central processing unit module 2000 and enter the working state.

[0078] Optionally, the photoelectric signal conversion unit 1110 includes one or more photodiodes 1101 , each of which is used to transmit a corresponding input voltage to the wake-up module 1300 , and each storage unit corresponds to one or more photodiodes 1101 .

[0079] Optionally, the first memory 1210 includes multiple storage units, each of which is an independent storage hardware. Each time the preset voltage value stored in the first memory 1210 is replaced, the storage unit in the first memory 1210 is directly switched according to user needs, and the replacement can be completed without re-importing the preset voltage value into the first memory 1210. Furthermore, each storage unit includes multiple storage areas for storing multiple preset voltage values. This embodiment thus allows for flexible replacement of the preset voltage value stored in the first memory and increases the storage space of the first memory.

[0080] The wake-up module 1300 obtains the preset reference value corresponding to each photoelectric signal conversion unit 1110 from the storage module 1200, and compares each preset reference value with the electrical signal transmitted by the corresponding photoelectric signal conversion unit 1110. The specific method is as follows:

[0081] The preset voltage value corresponding to each photodiode 1101 is obtained from the plurality of storage units.

[0082] Each preset voltage value is compared with the input voltage transmitted by the corresponding photodiode 1101, wherein the preset voltage value obtained from the first memory 1210 is a preset reference value, and the input voltage transmitted by each photodiode 1101 to the wake-up module 1300 is an electrical signal.

[0083] In this embodiment, the image sensor module 1000 is a CMOS image sensor module 1000 powered by a pulse-width modulated power supply. The CMOS image sensor module 1000 includes a microlens, a color filter, a circuit layer, a photodiode 1101, and a non-volatile memory, which is a first memory 1210. The wake-up module 1300 includes a first comparator 1310, which is a voltage comparator. The photodiode 1101 is connected to the first comparator 1310 via the circuit layer, and the non-volatile memory is connected to the first comparator 1310. After the CMOS image sensor module 1000 is powered, electrical energy is transmitted through the circuit layer to the photodiode 1101, thereby driving the photodiode 1101 to convert the light signal obtained by capturing the external environment, thereby generating an input voltage. This input voltage is transmitted to the first comparator 1310. The first comparator 1310 obtains the preset voltage value corresponding to each photodiode 1101 from the non-volatile memory. The non-volatile memory is divided into a plurality of storage areas, and the voltage value of each storage area corresponds to one or more photodiodes 1101. The first comparator 1310 compares the input voltage with a preset voltage value.

[0084] It will be appreciated that the photoelectric signal conversion module 1100 of this embodiment includes one or more photodiodes 1101, which facilitates receiving as many optical signals as possible and converting the optical signals into electrical signals in parallel via the one or more photodiodes 1101, thereby improving image acquisition efficiency. Since multiple photodiodes 1101 require multiple different preset reference values, this embodiment divides the first memory 1210 into multiple storage areas to store these different preset reference values, thereby reducing the amount of memory required.

[0085] The existing CMOS image sensor module 1000 generally includes an image sensor module 1000 array (of size M×N), an analog readout processing circuit, and a digital control module. Such a high-resolution CMOS image sensor module 1000 requires the first comparator 1310 to have a high computing capability.

[0086] See also Figure 3 , Figure 3 This is a second structural diagram of the image sensor module provided in an embodiment of the present application.

[0087] In one embodiment, the image processing chip includes an image sensor module 1000 and a central processing unit module 2000. The image sensor module 1000 includes a photoelectric signal conversion module 1100, a storage module 1200, a wake-up module 1300, and a power supply module; wherein the image sensor module 1000, the photoelectric signal conversion module 1100, the storage module 1200, the wake-up module 1300, and the power supply module 1400 and Figure 2 The same as in , no more repeating.

[0088] In this embodiment, each photoelectric signal conversion unit 1110 is used to transmit a corresponding electrical signal to the wake-up module 1300 when a preset condition is met, and the electrical signal is an assignment;

[0089] The storage module 1200 includes a first memory 1210, which is used to store a preset threshold value. The wake-up module 1300 includes a first comparator 1310. The first comparator 1310 is used to add the assignment values ​​transmitted by each photoelectric signal conversion unit 1110 to obtain a total assignment value, and compare the preset threshold value obtained from the first memory 1210 with the total assignment value.

[0090] If the total assigned value is greater than the preset threshold, the awakening module 1300 transmits a wake-up signal to the central processing unit module 2000 .

[0091] Optionally, the wake-up module 1300 includes a first comparator 1310 and an analog-to-digital converter 1320; the first comparator 1310 is used to send an analog signal to the analog-to-digital converter 1320 when it is determined that the electrical signal is greater than a preset reference value; the analog-to-digital converter 1320 is used to obtain the analog signal, and convert the analog signal into a digital signal and transmit it to the central processing unit module 2000 to wake up the central processing unit module 2000 and put it into working state.

[0092] In this embodiment, after converting the optical signal into an electrical signal, the photoelectric signal conversion unit 1110 sends a corresponding assignment to the wake-up module 1300 when a preset condition is met. That is, the assignment sent is a specific numerical value, which can be 1, 2, 3, or other numerical values. It should be understood that the assignments sent by each photoelectric conversion unit can be the same or different. It should be understood that when the condition is not met, the photoelectric signal conversion unit 1110 does not send the assignment to the wake-up module 1300. After all the photoelectric conversion units that meet the preset conditions send assignments, the wake-up module 1300 adds these assignments to obtain a total assignment, and then compares the preset threshold obtained from the first memory 1210 with the total assignment; in one embodiment, the wake-up module 1300 adds the assignments into a total assignment through an adder; in another embodiment, the first comparator 1310 in the wake-up module 1300 (if the assignment is a voltage value and the preset threshold is also a voltage value, then the first comparator 1310 is a voltage comparator) adds these assignments to obtain a total assignment, and then compares the preset threshold obtained from the first memory 1210 with the total assignment.

[0093] It can be understood that from this embodiment, the first memory 1210 of this embodiment only needs to store the preset threshold value, which greatly reduces the storage space requirement for the first memory 1210. Moreover, the wake-up module 1300 of this embodiment only needs to perform an addition operation on multiple assignments to obtain a total assignment value, and then compare the total assignment value with the preset threshold value, which relatively simplifies the calculation steps of the wake-up module 1300, reduces the calculation amount of the wake-up module 1300, and is conducive to improving the processing speed and reducing the processing time.

[0094] See also Figure 4 , Figure 4 This is a first structural schematic diagram of the photoelectric signal conversion unit provided in an embodiment of the present application.

[0095] In one embodiment, each of the photoelectric signal conversion units 1110 includes a second comparator 1111 , a photodiode 1101 for transmitting an input voltage to the second comparator 1111 , and a second memory 1112 for storing a preset voltage value corresponding to the photodiode 1101 .

[0096] When the preset conditions are met, the photoelectric signal conversion unit 1110 transmits the corresponding assignment to the wake-up module 1300, including:

[0097] The preset voltage value is obtained from the second memory 1112 of the optical-electrical signal conversion unit 1110 .

[0098] The acquired preset voltage value is compared with the input voltage transmitted by the photodiode 1101 in the photoelectric signal conversion unit 1110 in the second comparator 1111 of the photoelectric signal conversion unit 1110 .

[0099] If the input voltage is greater than the preset voltage value, the photoelectric signal conversion unit 1110 outputs a corresponding assignment value to the wake-up module 1300 .

[0100] In this embodiment, the second memory 1112 is a non-volatile memory, and the second memory 1112 only stores a preset voltage value corresponding to the photodiode 1101. The second memory 1112 is connected to the second comparator 1111, and each photodiode 1101 is connected to the second comparator 1111. The second comparator 1111 is connected to the wake-up module 1300. In one embodiment, the second comparator 1111 is connected to the first comparator 1310 of the wake-up module 1300. Taking one of the photoelectric signal conversion units 1110 as an example, in the same photoelectric signal conversion unit 1110, the second comparator 1111 is a voltage comparator. The second comparator 1111 obtains the preset voltage value from the second memory 1112 and compares it with the input voltage transmitted by the photodiode 1101. If the input voltage transmitted by the photodiode 1101 is greater than the preset voltage value, the photoelectric signal conversion unit 1110 meets the preset conditions and transmits an assignment to the wake-up module 1300; if the input voltage transmitted by the photodiode 1101 is less than or equal to the preset voltage value, the photoelectric signal conversion unit 1110 does not meet the preset conditions.

[0101] It is understood that each photoelectric signal conversion unit 1110 of this embodiment includes a photodiode 1101, and a corresponding second memory 1112 and a second comparator 1111 are configured for the photodiode 1101. The second memory 1112 only needs to store a preset voltage value of the corresponding photodiode 1101, which reduces the requirement for storage space; the second comparator 1111 only needs to compare an input voltage with the preset voltage value of the second memory 1112 for each operation. Compared with image sensor modules with simple pixel arrays and low pixel density requirements, the following can be used: Figure 2 The first structural diagram of the image sensor module is shown in FIG. Figure 3The image sensor module shown in the second structural diagram of the image sensor module has a more complex pixel array and a higher pixel density. Although an image sensor module with a more complex pixel array and a higher pixel density increases the computational load of the wake-up module, resulting in a decrease in the computational speed of the wake-up module, this embodiment, by having the second comparator 1111 in each photoelectric signal conversion unit 1110 compare the preset voltage value obtained from the second memory 1112 with the input voltage transmitted by the photodiode 1101 in the photoelectric signal conversion unit 1110, shares the computational load of the first comparator 1310 in the wake-up module 1300 in calculating and outputting the comparison result, thereby reducing the workload of the wake-up module 1300 and enabling the wake-up module 1300 to maintain a high computational speed.

[0102] Specifically, taking an MxN array CMOS image sensor module as an example, in the first embodiment, when the array of the CMOS image sensor module is 24x24, the first comparator 1310 compares the input voltage transmitted by each photodiode 1101 with the preset voltage value corresponding to each photodiode 1101, and the first comparator 1310 can still maintain a high operating speed. However, when the array of the CMOS image sensor module is 240x240, the number of photodiodes 1101 increases significantly. Comparing the input voltage transmitted by each photodiode 1101 with the preset voltage value corresponding to each photodiode 1101 by the first comparator 1310 will increase the workload of the first comparator 1310, resulting in a decrease in its operating speed. In order to solve the problem that the first comparator 1310 reduces the operation speed due to excessive workload, the second embodiment configures a second memory 1112 and a second comparator 1111 corresponding to each photodiode 1101, and each second comparator 1111 compares the input voltage transmitted by a photodiode 1101 with the preset voltage value stored in the second memory 1112 corresponding to the photodiode 1101, and then each second comparator 1111 sends an assignment value of 0 or 1 to the first comparator 1310 (if the input voltage is greater than the preset voltage value, the assignment value is 1, otherwise the assignment value is 0). In this way, the first comparator 1310 only needs to add the assignment 0 or assignment 1 sent by each second comparator 1111, and then compare it with the total assignment stored in the first memory to obtain the comparison result, without having to compare the input voltage transmitted by each photodiode 1101 with the preset voltage value one by one, thereby reducing the workload of the first comparator 1310 and enabling the first comparator 1310 to maintain a high operating speed; at the same time, since each second comparator 1111 is operated in parallel, the operating speed of obtaining the comparison result can be improved as a whole.

[0103] See also Figure 5 , Figure 511 is a second structural diagram of the photoelectric signal conversion unit 1110 provided in an embodiment of the present application.

[0104] In one embodiment, each of the optical-to-electrical signal conversion units 1110 includes a second comparator 1111 , a photodiode 1101 for transmitting an input voltage to the second comparator 1111 , and a voltage generator 1113 corresponding to the photodiode 1101 .

[0105] The photoelectric signal conversion unit 1110 transmits a corresponding electrical signal to the wake-up module 1300 when a preset condition is met. The electrical signal is an assignment, including:

[0106] The voltage generator 1113 of the optical-to-electrical signal conversion unit 1110 generates a preset reference voltage.

[0107] The preset reference voltage is compared with the input voltage transmitted by the photodiode 1101 in the photoelectric signal conversion unit 1110 in the second comparator 1111 of the photoelectric signal conversion unit 1110 .

[0108] If the input voltage is greater than the preset reference voltage, the optical-electrical signal conversion unit 1110 outputs a corresponding assignment value to the wake-up module 1300 .

[0109] Understandably, compared to Figure 4 In the photoelectric signal conversion unit 1110, the second memory 1112 can only store a predetermined preset voltage value and cannot flexibly change the preset voltage value. Therefore, when the preset voltage value is to be adjusted, the preset voltage value originally stored in the second memory 1112 can only be deleted and a new preset voltage value can be stored, which is a relatively cumbersome operation. The advantage of the photoelectric signal conversion unit 1110 of this embodiment, which eliminates the second memory 1112 and adopts the voltage generator 1113, is that the desired preset reference voltage can be generated by the voltage generator 1113 at any time, thereby affecting the comparison result between the preset reference voltage and the input voltage transmitted by the photodiode 1101 in the photoelectric signal conversion unit 1110. As a result, this embodiment can more flexibly control the comparison result obtained by the second comparator 1111.

[0110] See also Figure 6 , Figure 6 This is a third structural diagram of the optoelectronic signal conversion unit 1110 provided in an embodiment of the present application.

[0111] In one embodiment, each of the optical-to-electrical signal conversion units 1110 includes a photodiode 1101 and a digital integrator 1114 .

[0112] The photoelectric signal conversion unit 1110 transmits a corresponding electrical signal to the wake-up module 1300 when a preset condition is met. The electrical signal is an assignment, including:

[0113] The photodiode 1101 of the optical-to-electrical signal conversion unit 1110 transmits an input voltage to the digital integrator 1114 of the optical-to-electrical signal conversion unit 1110 .

[0114] The digital integrator 1114 of the optical-to-electrical signal conversion unit 1110 integrates the input voltage to obtain a digital signal as an assignment value.

[0115] In this embodiment, the specific method in which the digital integrator 1114 of the photoelectric signal conversion unit 1110 integrates the input voltage to obtain a digital signal as an assignment is: the digital integrator 1114 sets an integration working period, receives the input voltage and clock signal transmitted by the photodiode 1101 of the photoelectric signal conversion unit 1110 within a period of time, and uses the rising edge of the pulse of the clock signal to quantize the number of pulses of the input voltage transmitted by the photodiode 1101 of the photoelectric signal conversion unit 1110 within a period of time into a digital signal, and outputs the digital signal, wherein the clock signal is a high-frequency signal.

[0116] It is understandable that, considering that the image sensor module 1000 operates for a long period of time, the photoelectric conversion unit continuously converts the optical signal into an electrical signal over a period of time. That is, the photodiode 1101 in the photoelectric conversion unit will output a voltage pulse signal within a period during the process of converting the optical signal into an electrical signal. For example, during a one-minute shooting time, the photoelectric conversion process lasts for 60 seconds. During this 60-second period, the photodiode 1101 of a photoelectric signal conversion unit 1110 only outputs a +5V voltage pulse lasting 3 seconds, a +5V voltage pulse lasting 1 second, and a +5V voltage pulse lasting 3.5 seconds. Thus, with this 60-second period as one cycle, the photodiode 1101 of the photoelectric signal conversion unit 1110 actually outputs a voltage pulse signal with an amplitude of +5V. Therefore, the digital integrator 1114 of this embodiment integrates this voltage pulse signal using a high-frequency clock signal. For example, if the clock signal is 1 / 0.5s, the voltage pulse signal with a period of 60 seconds is integrated to 6+2+7=15, so the output value of the photoelectric signal conversion unit 1110 is equal to 15. Figure 4 or Figure 5 The photoelectric signal conversion unit 1110 in this embodiment reduces the second comparator 1111 and can also output the assignment value. Therefore, the structure of the photoelectric signal conversion unit 1110 in this embodiment is simpler and easier to miniaturize.

[0117] In one embodiment, the first memory 1210 and the second memory 1112 are both non-volatile memories and are integrated into the circuit layer of the image sensor module 1000. This helps save space occupied by electronic devices and facilitates miniaturization of image processing chips.

[0118] In one embodiment, the image sensor module 1000 is preferably a back-illuminated image sensor module 1000 .

[0119] The back-illuminated image sensor module 1000 can receive more light, thereby improving sensitivity and signal-to-noise ratio, improving imaging quality, and making the input voltage generated by the photodiode 1101 more accurate.

[0120] In one embodiment, the central processing unit module 2000 is configured to:

[0121] When entering the working state, the image sensor module 1000 is controlled to perform video shooting, and the comparison result between the preset reference value and the electrical signal is periodically obtained from the wake-up module 1300; if the comparison result is that the electrical signal is greater than the preset reference value, the image sensor module 1000 is maintained to perform video shooting; if the comparison result is that the electrical signal is less than or equal to the preset reference value, the image sensor module 1000 is controlled to stop video shooting.

[0122] In this embodiment, in order to prevent the image sensor module 1000 from continuing to shoot even when the moving object has left the shooting range and each frame during the shooting period needs to be processed by the central processing unit module 2000, the central processing unit module 2000 of this embodiment sets a time threshold, for example, thirty seconds as a cycle. After thirty seconds of shooting, the comparison result between the preset reference value and the electrical signal is obtained from the wake-up module 1300. If the comparison result is that the electrical signal is greater than the preset reference value, the image sensor module 1000 is maintained for video shooting; if the comparison result is that the electrical signal is less than or equal to the preset reference value, the image sensor module 1000 is controlled to stop video shooting, thereby avoiding large power consumption during video shooting.

[0123] In one embodiment, the image sensor module 1000 further includes:

[0124] The switch control module is used to control the power switch of the photoelectric signal conversion module 1100 to be in an on state within a preset time period.

[0125] In this embodiment, to prevent power loss caused by continuous operation of the image sensor module 1000, a timer is provided via a switch control module. In one embodiment, the switch control module, which is based on a single-chip microprocessor and works in conjunction with a switching element, controls the power supply to the photoelectric signal conversion module 1100. For example, by controlling the power switch of the photoelectric signal conversion module 1100, the image sensor module 1000 can capture images every 10 seconds or every 20 seconds, depending on the user's set time. This avoids power loss caused by continuous operation of the image sensor module 1000, thus saving power.

[0126] Optionally, the switch control module is further configured to:

[0127] When the image sensor module 1000 is shooting a video, the control of the power switch of the photoelectric signal conversion module 1100 is stopped.

[0128] It is understandable that after the CPU module 2000 controls the image sensor module 1000 to start video shooting, the switch control module of this embodiment stops controlling the power switch of the photoelectric signal conversion module 1100 to avoid repeated switching.

[0129] See also Figure 7 , Figure 7 This is a first flow chart of the image processing method provided in an embodiment of the present application.

[0130] An embodiment of the present application provides an image processing method for an image processing chip, wherein the image processing chip includes an image sensor module 1000 and a central processing unit module 2000. The image sensor module 1000 includes a photoelectric signal conversion module 1100, a storage module 1200, and a wake-up module 1300. The photoelectric signal conversion module 1100 includes multiple photoelectric signal conversion units 1110. The image processing method includes the following steps:

[0131] S100 , each photoelectric signal conversion unit 1110 converts an optical signal into a corresponding electrical signal when acquiring an image, and then transmits the electrical signal to the wake-up module 1300 .

[0132] S200, the storage module 1200 transmits the preset reference value corresponding to each photoelectric signal conversion unit 1110 to the wake-up module 1300, wherein the storage module 1200 includes multiple storage units for storing preset reference values, and each storage unit corresponds to one or more photoelectric signal conversion units 1110.

[0133] S300, the wake-up module 1300 compares each preset reference value with the electrical signal transmitted by the corresponding photoelectric signal conversion unit 1110, and when the electrical signal transmitted by one or more photoelectric signal conversion units 1110 is greater than the corresponding preset reference value, transmits a wake-up signal to the central processing unit module 2000 to wake up the central processing unit module 2000 and enter the working state.

[0134] See also Figure 8 , Figure 8 This is a first flow chart of the image processing method provided in an embodiment of the present application.

[0135] Optionally, the storage module 1200 includes a first memory 1210 for storing a preset threshold, and the wake-up module 1300 includes a first comparator 1310 .

[0136] S300: The wake-up module 1300 compares each preset reference value with the electrical signal transmitted by the corresponding photoelectric signal conversion unit 1110, and transmits a wake-up signal to the central processing unit 2000 when the electrical signal transmitted by one or more photoelectric signal conversion units 1110 is greater than the corresponding preset reference value, including:

[0137] S310, the first comparator 1310 adds the assignments transmitted by each photoelectric signal conversion unit 1110 to obtain a total assignment, wherein each photoelectric signal conversion unit 1110 transmits a corresponding electrical signal to the wake-up module 1300 when a preset condition is met, and the electrical signal is the assignment.

[0138] S320: Compare the preset threshold obtained from the first memory 1210 with the total assignment value.

[0139] S330 : If the total assigned value is greater than the preset threshold, the awakening module 1300 transmits a wake-up signal to the central processing unit module 2000 .

[0140] Optionally, each of the photoelectric signal conversion units 1110 includes a second comparator 1111, a photodiode 1101 for transmitting an input voltage to the second comparator 1111, and a second memory 1112 for storing a preset voltage value corresponding to the photodiode 1101;

[0141] The photoelectric signal conversion unit 1110 transmits a corresponding electrical signal to the wake-up module 1300 when a preset condition is met. The electrical signal is an assignment, including:

[0142] The preset voltage value is obtained from the second memory 1112 of the optical-electrical signal conversion unit 1110 .

[0143] The acquired preset voltage value is compared with the input voltage transmitted by the photodiode 1101 in the photoelectric signal conversion unit 1110 in the second comparator 1111 of the photoelectric signal conversion unit 1110 .

[0144] If the input voltage is greater than the preset voltage value, the photoelectric signal conversion unit 1110 outputs a corresponding assignment value to the wake-up module 1300 .

[0145] Optionally, each of the photoelectric signal conversion units 1110 includes a second comparator 1111 , a photodiode 1101 for transmitting an input voltage to the second comparator 1111 , and a voltage generator 1113 corresponding to the photodiode 1101 .

[0146] The photoelectric signal conversion unit 1110 transmits a corresponding electrical signal to the wake-up module 1300 when a preset condition is met. The electrical signal is an assignment, including:

[0147] The voltage generator 1113 of the optical-to-electrical signal conversion unit 1110 generates a preset reference voltage.

[0148] The preset reference voltage is compared with the input voltage transmitted by the photodiode 1101 in the photoelectric signal conversion unit 1110 in the second comparator 1111 of the photoelectric signal conversion unit 1110 .

[0149] If the input voltage is greater than the preset reference voltage, the optical-electrical signal conversion unit 1110 outputs a corresponding assignment value to the wake-up module 1300 .

[0150] Optionally, each of the optical-to-electrical signal conversion units 1110 includes a photodiode 1101 and a digital integrator 1114 .

[0151] The photoelectric signal conversion unit 1110 transmits a corresponding electrical signal to the wake-up module 1300 when a preset condition is met. The electrical signal is an assignment, including:

[0152] The photodiode 1101 of the optical-to-electrical signal conversion unit 1110 transmits an input voltage to the digital integrator 1114 of the optical-to-electrical signal conversion unit 1110 .

[0153] The digital integrator 1114 of the optical-to-electrical signal conversion unit 1110 integrates the input voltage to obtain a digital signal as an assignment value.

[0154] Optionally, in one embodiment, the wake-up module 1300 includes a first comparator 1310 and an analog-to-digital converter 1320 .

[0155] If the electrical signal is greater than the preset reference value, transmitting a wake-up signal to the central processing unit module 2000 through the wake-up module 1300 includes:

[0156] When the first comparator 1310 determines that the electrical signal is greater than the preset reference value, the first comparator 1310 sends an analog signal to the analog-to-digital converter 1320 .

[0157] The analog signal is acquired by the analog-to-digital converter 1320 , and the analog signal is converted into a digital signal and then transmitted to the central processing unit module 2000 to wake up the central processing unit module 2000 and enter a working state.

[0158] Optionally, in one embodiment, the image processing method further includes the following steps:

[0159] When the CPU module 2000 enters the working state, the CPU module 2000 controls the image sensor module 1000 to shoot a video, and periodically obtains the comparison result between the preset reference value and the electrical signal from the wake-up module 1300.

[0160] If the comparison result shows that the electrical signal is greater than the preset reference value, the image sensor module 1000 is maintained to perform video shooting.

[0161] If the comparison result is that the electrical signal is less than or equal to the preset reference value, the image sensor module 1000 is controlled to stop video shooting.

[0162] Optionally, in one embodiment, the image sensor module 1000 further includes a switch control module, and the image processing method includes:

[0163] The switch control module controls the power switch of the photoelectric signal conversion module 1100 to be in an on state within a preset time period.

[0164] Optionally, in one embodiment, the image processing method further includes the following steps:

[0165] When the image sensor module 1000 is shooting a video, the switch control module stops controlling the power switch of the photoelectric signal conversion module 1100 .

[0166] It should be understood that various parts of the present application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0167] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing module, or each unit may exist physically separately, or two or more units may be integrated into a single module. The aforementioned integrated modules may be implemented in the form of hardware or in the form of software functional modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium. The storage medium may be a read-only memory, a magnetic disk, or an optical disk, etc.

[0168] The above is a preferred embodiment of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications are also considered to be within the scope of protection of the present application.

Claims

1. An image processing chip, characterized in that: It includes an image sensor module and a central processing unit module, wherein the image sensor module includes a photoelectric signal conversion module, a storage module and a wake-up module; The photoelectric signal conversion module includes a plurality of photoelectric signal conversion units, each of which is used to convert an optical signal into a corresponding electrical signal when acquiring an image and then transmit the electrical signal to the wake-up module; The storage module is a non-volatile memory and includes multiple storage units for storing preset reference values. Each storage unit includes multiple storage areas. Each storage unit is an independent storage hardware. Each storage unit corresponds to multiple photoelectric signal conversion units and includes multiple storage areas for storing multiple preset reference values. The multiple photoelectric signal conversion units require multiple different preset reference values. The multiple storage areas store multiple different preset reference values. The preset reference values ​​can be replaced by switching the storage units in the storage module. The wake-up module is used to: Acquire a preset reference value corresponding to each photoelectric signal conversion unit from the storage module; comparing each preset reference value with the electrical signal transmitted by the corresponding photoelectric signal conversion unit; When the electrical signals transmitted by the plurality of optical-electrical signal conversion units are greater than corresponding preset reference values, a wake-up signal is transmitted to the central processing unit module to wake up the central processing unit module and put it into a working state.

2. The image processing chip according to claim 1, wherein: The central processing unit module is used for: When entering the working state, controlling the image sensor module to shoot a video, and periodically obtaining a comparison result between a preset reference value and an electrical signal from the wake-up module; If the comparison result shows that the electrical signal is greater than the preset reference value, maintaining the image sensor module to perform video shooting; If the comparison result is that the electrical signal is less than or equal to the preset reference value, the image sensor module is controlled to stop video shooting.

3. An image processing method, characterized in that: For an image processing chip, wherein the image processing chip includes an image sensor module and a central processing unit module, the image sensor module includes a photoelectric signal conversion module, a storage module, and a wake-up module, the photoelectric signal conversion module includes a plurality of photoelectric signal conversion units, and the image processing method includes the following steps: Each of the photoelectric signal conversion units converts the optical signal into a corresponding electrical signal when acquiring an image and transmits the electrical signal to the wake-up module; The storage module transmits the preset reference value corresponding to each photoelectric signal conversion unit to the wake-up module, wherein the storage module is a non-volatile memory and includes multiple storage units for storing preset reference values, each storage unit includes multiple storage areas, each storage unit is an independent storage hardware, each storage unit corresponds to multiple photoelectric signal conversion units, and includes multiple storage areas to store multiple preset reference values, wherein multiple photoelectric signal conversion units require multiple different preset reference values, multiple storage areas store multiple different preset reference values, and the preset reference value can be replaced by directly switching the storage unit in the storage module; The wake-up module compares each preset reference value with the electrical signal transmitted by the corresponding photoelectric signal conversion unit, and transmits a wake-up signal to the central processing unit module when the electrical signals transmitted by multiple photoelectric signal conversion units are greater than the corresponding preset reference value to wake up the central processing unit module and enter a working state.

4. The image processing method according to claim 3, wherein: Also includes: When the central processing unit module enters the working state, the central processing unit module controls the image sensor module to shoot a video, and periodically obtains a comparison result between a preset reference value and an electrical signal from the wake-up module; If the comparison result shows that the electrical signal is greater than the preset reference value, maintaining the image sensor module to perform video shooting; If the comparison result is that the electrical signal is less than or equal to the preset reference value, the image sensor module is controlled to stop video shooting.

Images