Image acquisition and processing equipment and dormancy method thereof

Abstract

The invention belongs to the technical field of image acquisition equipment, and particularly relates to image acquisition and processing equipment and a dormancy method thereof. Entering a corresponding dormancy state through human-computer interaction operation based on a user, the dormancy state being any one of a shallow dormancy state, a light dormancy state and a deep dormancy state; wherein when the image sensing unit enters the shallow dormancy state, the image sensing unit is made to be dormant; when entering the light dormant state, reading parameters of the image sensing unit and storing the parameters in the main control unit, and powering off the image sensing unit; when the image sensing unit enters the deep sleep state, parameters of the image sensing unit are read and stored in the data storage unit, the image sensing unit is powered off, and the main control unit is made to sleep, and the setting of the sleep modes achieves a good balance between power loss and user experience; and the user experience is greatly improved.

Description

Technical Field

[0001] The present application belongs to the technical field of image acquisition equipment, and in particular, relates to an image acquisition and processing device and a sleep method thereof. Background Art

[0002] Currently, embedded devices with camera functions (i.e., image acquisition and processing devices) are very common devices in life, such as mobile phones, cameras, computers, surveillance cameras, etc., and the sleep and wake-up functions are important functions of image acquisition and processing devices. When the image acquisition function is not in use or suspended, the image sensor unit of the image acquisition and processing device will generally enter sleep mode to reduce the energy consumption of the device and maintain a longer standby time. At the same time, it can also avoid the problem of component loss caused by high temperature caused by high power consumption when not working, thereby extending the overall equipment life.

[0003] The current sleep function generally uses the sleep mode of the image sensor unit. In this mode, the high-frequency module devices (high-power devices) in the image sensor unit will stop working, and some low-frequency modules (low-power devices) are still in working state, waiting to receive the wake-up command to wake up and restore the working state of the image acquisition and processing equipment. However, these low-frequency modules will consume a certain amount of power, so the image sensor unit in sleep mode will still have a certain amount of power loss, which is not conducive to devices that need to sleep for a long time. At the same time, for image acquisition and processing devices in scenarios that do not require long-term sleep, the wake-up speed of sleep is slow, which affects the user experience.

[0004] In summary, due to the contradiction between the sleep power consumption and wake-up speed of the image acquisition and processing equipment, the existing sleep method cannot balance the relationship between the two, resulting in large power loss and poor user experience. Summary of the invention

[0005] In view of this, an embodiment of the present application provides an image acquisition and processing device and a sleep method thereof to solve the problems of large power consumption and poor user experience.

[0006] A first aspect of an embodiment of the present application provides a sleep method for an image acquisition and processing device, the image acquisition and processing device comprising an image sensor unit, a main control unit and a data storage unit, the method comprising:

[0007] Based on the user's human-computer interaction operation, enter a corresponding sleep state, wherein the sleep state is any one of a shallow sleep state, a light sleep state and a deep sleep state;

[0008] Wherein, when entering the shallow sleep state, the image sensing unit is put into sleep;

[0009] When entering the light sleep state, reading the parameters of the image sensor unit and storing them in the main control unit, and powering off the image sensor unit;

[0010] When entering the deep sleep state, the parameters of the image sensor unit are read and stored in the data storage unit, and the image sensor unit is powered off and the main control unit is put into sleep.

[0011] The second aspect of an embodiment of the present application provides an image acquisition and processing device, comprising a memory, a main control unit, and a computer program stored in the memory and executable on the main control unit. When the main control unit executes the computer program, the steps of the sleep method of the image acquisition and processing device provided in the first aspect of the embodiment of the present application are implemented.

[0012] The fourth aspect of the embodiments of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by the main control unit, it implements the steps of the sleep method of the image acquisition and processing device provided in the first aspect of the embodiments of the present application.

[0013] The first aspect of the embodiment of the present application provides a sleep method for an image acquisition and processing device, which enters a corresponding sleep state based on a human-computer interaction operation of a user, and the sleep state is any one of a shallow sleep state, a light sleep state and a deep sleep state; wherein, when entering the shallow sleep state, the image sensor unit is put into sleep; when entering the light sleep state, the parameters of the image sensor unit are read and stored in the main control unit, and the image sensor unit is powered off; when entering the deep sleep state, the parameters of the image sensor unit are read and stored in the data storage unit, and the image sensor unit is powered off and the main control unit is put into sleep. Since the deep sleep mode can completely cut off the power supply of the image sensor when the camera is in sleep mode, and the main control chip enters sleep mode at the same time, the energy consumption during sleep mode is greatly reduced, and the standby time is more effectively extended. The shallow sleep mode retains the original sleep mode of the image sensor, and can quickly sleep and wake up; and in the light sleep mode, the wake-up time and energy consumption are between deep sleep and shallow sleep, which can obtain a more balanced effect. The above sleep mode settings achieve a good balance between power consumption and user experience, thereby greatly improving the user experience.

[0014] It can be understood that the beneficial effects of the second aspect mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0016] Figure 1 This is a structural schematic diagram of an image acquisition and processing device provided by an embodiment of the present application;

[0017] Figure 2 This is a flowchart of a sleep method for an image acquisition and processing device provided by another embodiment of the present application;

[0018] Figure 3 This is a flowchart of a sleep method for an image acquisition and processing device provided by another embodiment of the present application;

[0019] Figure 4 This is a flowchart of a sleep method for an image acquisition and processing device provided by another embodiment of the present application;

[0020] Figure 5 This is a flowchart of a sleep method for an image acquisition and processing device provided by another embodiment of the present application;

[0021] Figure 6 This is a flowchart of a sleep method for an image acquisition and processing device provided by another embodiment of the present application;

[0022] Figure 7 This is a flowchart of a sleep method for an image acquisition and processing device provided by another embodiment of the present application;

[0023] Figure 8 This is a flowchart of a sleep method for an image acquisition and processing device provided by another embodiment of the present application;

[0024] Fig. 9 This is a flowchart of a sleep method for an image acquisition and processing device provided by another embodiment of the present application;

[0025] Fig.10 It is a structural schematic diagram of an image acquisition and processing device provided in yet another embodiment of the present application. DETAILED DESCRIPTION

[0026] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0027] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0028] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0029] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0030] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0031] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0032] The hibernation method of the image acquisition and processing device provided in the embodiment of the present application can be executed by the main control unit of the image acquisition and processing device when running the corresponding computer program, and enter the corresponding hibernation state through the human-computer interaction operation based on the user, and the hibernation state is any one of the shallow hibernation state, the light hibernation state and the deep hibernation state; wherein, when entering the shallow hibernation state, the image sensor unit is put into hibernation; when entering the light hibernation state, the parameters of the image sensor unit are read and stored in the main control unit, and the image sensor unit is powered off; when entering the deep hibernation state, the parameters of the image sensor unit are read and stored in the data storage unit, and the image sensor unit is powered off and the main control unit is put into hibernation. Since the deep hibernation mode can completely cut off the power supply of the image sensor when the camera is in hibernation, and the main control chip enters hibernation at the same time, the energy consumption during hibernation is greatly reduced, and the standby time is more effectively extended. The shallow hibernation mode retains the original hibernation mode of the image sensor, and can quickly hibernate and wake up; and in the light hibernation mode, the wake-up time and energy consumption are between deep hibernation and shallow hibernation, which can obtain a more balanced effect. The above sleep mode settings greatly improve the user experience.

[0033] In applications, the image acquisition and processing device may be a device integrated with a camera module, such as at least one of a camera, a surveillance camera, a smart phone, a tablet computer, a drone, a car dash cam, a smart doorbell, a medical imaging device, and an industrial detection device. The embodiments of the present application do not impose any restrictions on the specific type of the image acquisition and processing device.

[0034] like Figure 1 As shown, the image acquisition and processing device 100 of this embodiment at least includes a main control unit 101 , a data storage unit 102 , an image sensor power supply unit 103 , and an image sensing unit 104 .

[0035] In applications, the main control unit is the core control chip of the image acquisition and processing device, which is used to run programs, operating systems, control other modules, and obtain image sensor data. The data storage unit is used to store data, and it can still save data after power failure. The image sensor power supply unit, controlled by the main control chip, can power the image sensor. The image sensor usually has multiple power supply pins, and there are certain requirements for the power-on and power-off timing between each power supply pin. The main control chip controls the image sensor power supply unit to power on or off the image sensor according to the set power-on or power-off timing. Image sensors are devices used to convert optical image information into electrical signals. They are widely used in image acquisition and processing equipment to acquire and collect images, such as digital cameras and other electronic optical devices.

[0036] This embodiment provides a sleep method for an image acquisition and processing device, wherein the image acquisition and processing device includes an image sensor unit, a main control unit and a data storage unit, and the method includes step S1:

[0037] Step S1, based on the user's human-computer interaction operation, entering a corresponding sleep state, wherein the sleep state is any one of a shallow sleep state, a light sleep state and a deep sleep state;

[0038] Wherein, when entering the shallow sleep state, the image sensing unit is put into sleep;

[0039] When entering the light sleep state, reading the parameters of the image sensor unit and storing them in the main control unit, and powering off the image sensor unit;

[0040] When entering the deep sleep state, the parameters of the image sensor unit are read and stored in the data storage unit, and the image sensor unit is powered off and the main control unit is put into sleep.

[0041] In the application, the main control unit can directly configure the parameters of the image sensor unit through the control interface, and read the configuration parameters of the image sensor unit. In addition, the main control unit can write and read the data storage unit, so that the configuration parameters can be saved in the data storage unit and the stored configuration parameters can be read when waking up.

[0042] In the application, the shallow sleep mode uses the built-in sleep mode of the image sensor unit, does not power off the image sensor unit, can quickly enter sleep and quickly wake up from sleep, but the energy consumption during sleep is the highest compared to the other two sleep modes. The light sleep mode saves the configuration parameters of the image sensor unit in the running memory of the main control unit, and powers off the image sensor unit. When waking up, the image sensor unit is powered on, and the parameters in the running memory are configured back to the image sensor unit to restore the running state. In this mode, the speed of sleep and wake-up is slower than that of shallow sleep, but the energy consumption is lower than that of shallow sleep. The deep sleep mode saves the parameters of the image sensor unit in the data storage unit (i.e., the permanent storage unit), powers off the image sensor unit, and then controls the main control unit to enter the sleep mode. When the main control unit wakes up, the image sensor unit is powered on, and the parameters in the permanent storage unit are configured back to the image sensor unit to restore the running state. The sleep and wake-up speed in this mode is the slowest, but the energy consumption is the lowest. Users can perform specific human-computer interaction operations on the image acquisition and processing equipment according to their needs, such as sleep mode selection, sleep state selection, etc., to enter the corresponding sleep state. The above sleep mode settings have achieved a better balance between power consumption and user experience, thereby greatly improving the user experience.

[0043] like Figure 2 As shown, in one embodiment, step S1 includes the following steps S11 to S14:

[0044] Step S11: if an active sleep operation by the user is detected, the active sleep mode is entered.

[0045] In the application, the active sleep operation refers to the user transmitting a signal to the image acquisition and processing device that he wants to enter the active sleep state through a specific key mode or other preset interaction mode, so that the image acquisition and processing device responds to the user's needs and enters the active sleep mode.

[0046] Step S12, in the active sleep mode, entering a corresponding sleep state based on a sleep state selection operation of the user.

[0047] In the application, after entering the active sleep mode, the image acquisition and processing device does not start to sleep, but outputs a sleep state selection signal to the user through voice or display, so that the user can select the final sleep state. After the user selects the sleep state, it will enter the corresponding sleep state according to the user's sleep state selection operation.

[0048] Step S13: if no active sleep operation by the user is detected and it is detected that the sleep mode preset by the user is the automatic sleep mode, then the automatic sleep mode is entered.

[0049] Step S14, in the automatic sleep mode, entering a corresponding sleep state based on an automatic sleep program.

[0050] In the application, if the user does not send a signal to the image acquisition and processing device that it wants to enter the active sleep state, the image acquisition and processing device enters the automatic sleep mode by default. In the automatic sleep mode, the image acquisition and processing device enters the corresponding sleep state according to the preset automatic sleep program when the sleep conditions are met.

[0051] Step S15: If the active sleep operation of the user is not detected, and it is not detected that the sleep mode preset by the user is the automatic sleep mode, then the sleep mode is not performed.

[0052] like Figure 3 As shown, in one embodiment, step S12 includes the following steps S121 to S124:

[0053] Step S121, when the sleep state selected by the user is not sleep, the sleep state is not entered;

[0054] Step S122, when the sleep state selected by the user is shallow sleep, entering the shallow sleep state;

[0055] Step S123, when the sleep state selected by the user is light sleep, entering the light sleep state;

[0056] Step S124: when the sleep state selected by the user is deep sleep, the deep sleep state is entered.

[0057] In the application, in the active sleep mode, the user can choose not to sleep in addition to the shallow sleep state, light sleep state, and deep sleep state. When the sleep state selected by the user is not to sleep, the sleep state will not be entered. In this state, even if the image acquisition and processing device meets the sleep conditions of the automatic sleep mode, it will not sleep. When the user selects any of the shallow sleep state, light sleep state, and deep sleep state, the image acquisition and processing device will sleep in the specified sleep state, and the sleep mode will not change autonomously during the sleep stage.

[0058] like Figure 4 As shown, in one embodiment, step S14 includes the following steps S141 to S143:

[0059] Step S141, if no wake-up signal is detected within a preset first time period, then enter the shallow sleep state;

[0060] Step S142, in the light sleep state, if no wake-up signal is detected within a preset second time period, entering the light sleep state;

[0061] Step S143: in the light sleep state, if no wake-up signal is detected within a preset third time period, entering the deep sleep state.

[0062] In the application, the first time period t0, the second time period t1, and the third time period t2 are all preset time periods. When the image acquisition and processing device detects a wake-up signal within the corresponding time period, it will exit the current sleep state and reset the timer to restart the current time period. If no wake-up signal is detected within t0, it will first enter a shallow sleep state. If it is not awakened after entering t1, it will enter a light sleep mode. If it is still not awakened after t2, it will enter a deep sleep state. In this way, when there is no operation, the longer the time, the lower the energy consumption will be. If the sleep time is short, it will enter a sleep state with a shorter wake-up time and can be awakened faster.

[0063] In one embodiment, the values ​​of t0, t1, and t2 can be set by the user. You can also use the longest time of inactivity of the user in the historical sleep data as t0, the longest time from shallow sleep state to light sleep state in the user's history as t1, and the longest time from light sleep state to deep sleep state in the user's history as t2. In this case, it can ensure that the user has a good experience of quick wake-up, while also avoiding energy consumption due to being in normal working state for too long. Among t0, t1, and t2, a specific value can be set to represent infinity, so that the sleep mode will stay in the corresponding sleep mode, meeting the user's demand for a balance between energy consumption and response speed. The values ​​of t0, t1, and t2 can also be adjusted dynamically in real time according to other algorithms to meet other user needs.

[0064] In one embodiment, after step S1, the following steps S2 and S3 are included:

[0065] Step S2, if a wake-up signal is detected in the shallow sleep state, waking up the image sensor unit and restoring the image sensor unit to the working state before the shallow sleep state;

[0066] Step S3, if a wake-up signal is detected in the preset sleep state, the image sensor unit is powered on, and the image sensor unit is configured according to the stored parameters to restore the image sensor unit to a working state;

[0067] Wherein, the preset sleep state is a light sleep state or a deep sleep state. When the preset sleep state is the deep sleep state, after detecting the wake-up signal, it also includes making the main control unit exit sleep.

[0068] In the application, when in the deep sleep state, the main control unit is first awakened to make it exit the sleep state, and then the image sensor unit is powered on.

[0069] In one embodiment, configuring the image sensing unit according to the stored parameters to restore the image sensing unit to a working state comprises the following steps S31 and S32:

[0070] Step S31, if the preset parameters are not detected, the image sensor unit is configured according to the stored parameters so that the image sensor unit is restored to the working state before the sleep state;

[0071] Step S32: if the preset parameters are detected, the stored parameters are modified according to the preset parameters, and the image sensor unit is configured based on the modified parameters so that the image sensor unit is restored to the working state corresponding to the modified parameters.

[0072] The preset parameters are parameters of the image sensor unit preset by the user.

[0073] In the application, if the preset sleep state is a light sleep state and the preset parameters are not detected, the parameters stored in the main control unit are read to configure the image sensor unit so that the image sensor unit is restored to the working state before the light sleep state;

[0074] If the preset sleep state is a light sleep state and preset parameters are detected, the parameters stored in the main control unit are modified based on the preset parameters, and the modified parameters are read and the image sensor unit is configured, or the modified parameters in the main control unit are read and the image sensor unit is configured, so that the image sensor unit is restored to the working state corresponding to the modified parameters;

[0075] If the preset sleep state is a deep sleep state and the preset parameters are not detected, the parameters stored in the data storage unit are read back to the main control unit, and the parameters of the main control unit are read and the image sensor unit is configured so that the image sensor unit is restored to the working state before the deep sleep state;

[0076] If the preset sleep state is a deep sleep state and the preset parameters are detected, the parameters stored in the data storage unit are read back to the main control unit, and after the read-back parameters are modified according to the preset parameters, the modified parameters are read and the image sensing unit is configured, or the modified parameters stored in the data storage unit are read back to the main control unit, and the modified parameters are read and the image sensing unit is configured, so that the image sensing unit is restored to the working state corresponding to the modified parameters.

[0077] In the application, modifying the stored parameters according to the preset parameters may be modifying some parameters or adding parameters. For example, the parameters stored before sleep are frame rate 30, exposure time 1000, and other parameters are the same as the default parameters after the image sensor is powered on, so they are not saved; and some parameters of the preset parameters may not be set, such as only setting the frame rate 20, resolution 640*480, and no exposure time. In this case, the parameters stored before sleep need to be modified to: frame rate 20, resolution 640x480, and exposure time 1000 according to the preset parameters.

[0078] In the application, when wake-up is required, the main control unit controls the image sensor unit power supply module to power on according to the power-on sequence required by the image sensor unit, so that the image sensor unit can work normally. In addition, since the image sensor unit may need to be awakened and restored to other parameters and working states when it is awakened, at this time, the parameters stored in the memory or data storage unit can be modified according to the wake-up requirements (which can be achieved by detecting preset parameters or based on other methods) so that it can be restored to other desired working states when awakened.

[0079] In one embodiment, after step S142, the following steps S421 and S422 are also included:

[0080] Step S421, if it is in a normal working state, reading the parameters of the image sensor unit and comparing them with the default parameters of the image sensor unit, storing the different parameters in the main control unit, and powering off the image sensor unit;

[0081] Step S422, if it is in the shallow sleep state, then enter the normal working state, then read the parameters of the image sensor unit and compare them with the default parameters of the image sensor unit, store the different parameters in the main control unit, and power off the image sensor unit;

[0082] When storing different parameters in the main control unit, if a preset parameter is detected, the different parameters are stored in the main control unit, or the different parameters are modified based on the preset parameter and then stored in the main control unit.

[0083] In the application, when the image acquisition and processing device is in a shallow sleep state, no other operations can be performed on it, including data reading and writing. Therefore, it is necessary to exit from the shallow sleep state and enter the normal working state before executing the subsequent step of reading the parameters of the image sensor unit.

[0084] In the application, in order to minimize the amount of data of the image sensor unit parameters that need to be saved to improve the speed of sleep and wake-up, in the embodiment of the present application, the image sensor unit parameters will be compared with the default parameters after the image sensor unit is powered on, and the same parameters will not be saved, thereby reducing the amount of data transmitted and the amount of configured parameters when saving and restoring parameters, and reducing the time consumed in sleep and wake-up.

[0085] In one embodiment, after step S143, the following steps S431 to S434 are also included:

[0086] Step S431, if it is in a normal working state, then read the parameters of the image sensor unit and compare them with the default parameters of the image sensor unit, store the different parameters in the main control unit and then write them into the data storage unit;

[0087] Step S432, if it is in the shallow sleep state, it enters the normal working state, then reads the parameters of the image sensor unit and compares them with the default parameters of the image sensor unit, stores the different parameters in the main control unit and then writes them into the data storage unit.

[0088] Step S433, if in a light sleep state, writing the different parameters stored in the main control unit into the data storage unit;

[0089] Step S434, powering off the image sensor unit and putting the main control unit into sleep mode;

[0090] When storing different parameters in the main control unit, if a preset parameter is detected, the different parameters are stored in the main control unit, or the different parameters are modified based on the preset parameter and then stored in the main control unit.

[0091] In one embodiment, the human-computer interaction operation based on the user, before entering the corresponding dormant state, includes:

[0092] Based on the user's first preset operation, storing the preset parameters; or

[0093] Based on a second preset operation of the user, setting the sleep mode to the automatic sleep mode;

[0094] Wherein, the preset parameters include at least one of the configuration parameters and state parameters of the image sensing unit.

[0095] In the application, the user can perform preset operations at any time while using the image acquisition and processing device, and preset the parameters of the image sensing unit so that the image sensing unit works in the working state expected by the user. When the user performs the preset operation, at least one of the configuration parameters and state parameters of the image sensing unit can be preset. Among them, the configuration parameters may include exposure time, frame rate, resolution, pixel data format, etc., and the state parameters may be open flow, standby and other states. For example, if the user performs a preset operation and sets the frame rate in the configuration parameters to 20 frames, and the operating state in the state parameters to open flow, these data will be stored, and the saved parameters can be modified according to the preset parameters when entering the sleep saving stage, or the parameters of the image sensing unit can be saved normally during the sleep stage, and when reading the stored parameters during the wake-up stage, the saved parameters can be modified according to the preset parameters.

[0096] In the application, the preset operation can also be a preset of the sleep mode, such as the automatic sleep mode. After the user presets the automatic sleep mode, if the user does not actively sleep, it is necessary to check that the user has preset the automatic sleep mode before entering the automatic sleep mode, otherwise it will not sleep.

[0097] like Figure 5 As shown, in one embodiment, when a dormancy method of an image acquisition and processing device is applied to a camera, it may further include the following steps S501 to S521:

[0098] Step S501, start sleeping.

[0099] Step S502, determine whether it is active sleep. When no active sleep operation is received from the user, if it is detected that the sleep mode preset by the user is the automatic sleep mode, step S509 is executed to enter the automatic sleep mode; when the active sleep operation is received from the user, it is determined to be active sleep and enter the active sleep mode. When the user selects shallow sleep in the active sleep mode, step S503 is executed; when the user selects light sleep, step S504 is executed; when the user selects deep sleep, step S505 is executed.

[0100] Step S503: shallow sleep. After entering shallow sleep, execute step S506.

[0101] Step S504, light sleep. After entering light sleep, execute step S507.

[0102] Step S505: deep sleep. After entering deep sleep, execute step S508.

[0103] Step S506, configure the image sensor to enter shallow sleep and wait for wake-up. When a wake-up signal is detected, execute step S518.

[0104] Step S507, the camera enters a light sleep mode and waits for wake-up. When a wake-up signal is detected, step S519 is executed.

[0105] Step S508, entering the deep sleep state according to the sleep process in the deep sleep mode, and waiting for wake-up. When the wake-up signal is detected, executing step S521.

[0106] Step S509, start the timer and set the timing time to t0.

[0107] Step S510, determining whether the camera has been operated within t0. If yes, executing step S517, if no, executing step S511.

[0108] Step S511, configure the image sensor to enter shallow sleep, start the timer, and set the timing time to t1.

[0109] Step S512, determining whether a signal for waking up the camera is received before the timing t1 ends. If yes, executing step S518, if no, executing step S513.

[0110] Step S513, the camera enters a light sleep mode, starts a timer, and sets the timing time to t2.

[0111] Step S514, determining whether a signal for waking up the camera is received before the timing t2 ends. If yes, executing step S519, if no, executing step S515.

[0112] Step S515: entering the deep sleep state according to the sleep process in the deep sleep mode.

[0113] Step S516, waiting to be awakened. If awakened, execute step S520.

[0114] Step S517, reset the timer time t0, and execute step S502.

[0115] Step S518, configuring the image sensor, waking up the sensor to restore the previous working state, and then executing step S517.

[0116] Step S519, restore the camera working state according to the wake-up process of the light sleep mode, and then execute step S517.

[0117] Step S520, restore the camera working state according to the wake-up process of the deep sleep mode, and then return to step S517.

[0118] Step S521, restore the camera working state according to the wake-up process of the deep sleep mode, and then execute step S522.

[0119] Step S522, sleep mode ends.

[0120] like Figure 6 As shown, in one embodiment, when a dormancy method for an image acquisition and processing device is applied to a camera, the process of entering a light dormancy state may further include the following steps S601 to S609:

[0121] Step S601, start light sleep.

[0122] Step S602, determine whether the camera is in a normal working state, if so, execute step S603, if not, execute step S607.

[0123] Step S603, obtaining the configuration parameters of the image sensor. Before entering the sleep state, the main control chip sends a parameter reading instruction to the image sensor to read the current configuration parameters and related status parameters from the image sensor, such as the current operating state of the image sensor, exposure time, frame rate, resolution, pixel data format and other parameters.

[0124] Step S604, comparing the acquired parameters with the default parameters of the image sensor, and writing the different parameters into the operation memory unit in the active chip.

[0125] Step S605, modify the parameters stored in the memory accordingly according to whether the state at the time of awakening needs to be modified.

[0126] Step S606, power off according to the timing required by the image sensor, and then execute step S609.

[0127] Step S607, determining whether the camera is in a shallow sleep state, if so, executing step S608, if not, executing step S609.

[0128] Step S608, wake up the camera to normal working state, and then jump to step S603.

[0129] Step S609, entering the sleep state.

[0130] like Figure 7 As shown, in one embodiment, when a dormancy method for an image acquisition and processing device is applied to a camera, the process of entering a deep dormancy state may further include the following steps S701 to S712:

[0131] Step S701, start deep sleep.

[0132] Step S702, determine whether the camera is in a normal working state, if so, execute step S703, if not, execute step S709.

[0133] Step S703, obtaining the configuration parameters of the image sensor. Before entering the sleep state, the main control chip sends a parameter reading instruction to the image sensor to read the current configuration parameters and related status parameters from the image sensor, such as the current operating state of the image sensor, exposure time, frame rate, resolution, pixel data format and other parameters.

[0134] Step S704, comparing the acquired parameters with the default parameters of the image sensor, and writing the different parameters into the operation memory unit in the active chip.

[0135] Step S705, modify the parameters stored in the memory accordingly according to whether the wake-up state needs to be modified.

[0136] Step S706, writing the parameters stored in the active chip running memory into the permanent data storage unit.

[0137] Step S707 , power off according to the timing required by the image sensor.

[0138] In step S708, the main control chip enters a sleep state, and then executes step S712.

[0139] Step S709, determining whether the camera is in a shallow sleep state, if so, executing step S710, if not, executing step S711.

[0140] Step S710, wake up the camera to a normal working state, and then jump to step S703.

[0141] Step S711, determine whether the camera is in a light sleep state, if so, jump to step S706, if not, execute step S712.

[0142] Step S712, entering the sleep state.

[0143] like Figure 8 As shown, in one embodiment, when a dormancy method for an image acquisition and processing device is applied to a camera, the wake-up process of the light dormancy state may further include the following steps S801 to S806:

[0144] Step S801, start light sleep wake-up.

[0145] Step S802: Power on according to the power-on sequence of the image sensor. The main control chip controls the image sensor power supply module to power on according to the power-on sequence required by the image sensor, so that the image sensor can work normally.

[0146] Step S803 , according to whether the state upon awakening needs to be modified, the parameters of the image sensor before sleep stored in the memory are modified accordingly.

[0147] Step S804, configuring the parameters stored in the memory to the image sensor. The main control chip reads all configuration parameters and state parameters stored before sleep from the running memory unit, and sets the configuration parameters to the image sensor through the control interface with the image sensor.

[0148] Step S805: setting the image sensor to a corresponding operating state according to the state parameters.

[0149] Step S806, restoring the state before hibernation.

[0150] like Fig. 9As shown, in one embodiment, when a dormancy method for an image acquisition and processing device is applied to a camera, the awakening process of a deep dormancy state may further include the following steps S901 to S909:

[0151] Step S901, start waking up from deep sleep.

[0152] Step S902, wake up the main control chip to make the chip work normally.

[0153] Step S903 , power on according to the image sensor power-on sequence.

[0154] Step S904, read all parameters saved before hibernation from the permanent data storage unit into the running memory of the main control chip. The main control chip reads all configuration parameters and state parameters (data saved during hibernation) saved before hibernation from the permanent data storage unit into the running memory of the main control chip.

[0155] Step S905, modify the parameters stored in the memory accordingly according to whether the state at the time of awakening needs to be modified.

[0156] Step S906, writing the parameter configuration read from the operation memory unit into the image sensor. The main control chip sets the configuration parameters in the operation memory into the image sensor through the control interface with the image sensor.

[0157] Step S907: according to the state parameters, the image sensor is configured to a running state corresponding to the parameters.

[0158] Step S908, restore the state before hibernation.

[0159] like Fig.10 As shown, the embodiment of the present application also provides an image acquisition and processing device 100, including: at least one main control unit 101 ( Fig.10 Only one main control unit is shown in the figure), a data storage unit 102, an image sensor power supply unit 103, an image sensing unit 104 and a memory 105, and a computer program 106 stored in the memory 105 and executable on at least one main control unit 101. When the main control unit 101 executes the computer program 106, the steps in the above-mentioned method embodiments are implemented.

[0160] In applications, the image acquisition and processing device may include, but is not limited to, a main control unit and a memory. Those skilled in the art will appreciate that Fig.10 It is merely an example of an image acquisition and processing device and does not constitute a limitation of the image acquisition and processing device. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, it may also include input and output devices, network access devices, etc.

[0161] In applications, the main control unit may be a central processing unit (CPU), or other general-purpose main control units, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose main control unit may be a microprocessor or the main control unit may be any conventional main control unit, etc.

[0162] In applications, the memory may be an internal storage unit of the image acquisition and processing device in some embodiments, such as a hard disk or memory of the image acquisition and processing device. In other embodiments, the memory may also be an external storage device of the image acquisition and processing device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the image acquisition and processing device. Further, the memory may also include both an internal storage unit and an external storage device of the image acquisition and processing device. The memory is used to store operating systems, applications, boot loaders (Boot Loader), data, and other programs, such as program codes of computer programs, etc. The memory may also be used to temporarily store data that has been output or is to be output.

[0163] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0164] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0165] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a main control unit, the steps in the above-mentioned method embodiments can be implemented.

[0166] An embodiment of the present application provides a computer program product. When the computer program product runs on an image acquisition and processing device, the image acquisition and processing device can implement the steps in the above-mentioned method embodiments when executing.

[0167] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the main control unit, the steps of the above-mentioned various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the device / image acquisition and processing device, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0168] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0169] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0170] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0171] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0172] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A sleep method for an image acquisition and processing device, characterized in that: The image acquisition and processing device includes an image sensing unit, a main control unit and a data storage unit, and the method includes: Based on the user's human-computer interaction operation, enter a corresponding sleep state, wherein the sleep state is any one of a shallow sleep state, a light sleep state and a deep sleep state; Wherein, when entering the shallow sleep state, the image sensing unit is put into sleep; When entering the light sleep state, reading the parameters of the image sensor unit and storing them in the main control unit, and powering off the image sensor unit; When entering the deep sleep state, the parameters of the image sensor unit are read and stored in the data storage unit, and the image sensor unit is powered off and the main control unit is put into sleep.

2. The sleep method according to claim 1, characterized in that: The step of entering a corresponding dormant state based on a human-computer interaction operation of a user includes: If the user's active sleep operation is detected, the active sleep mode is entered; In the active sleep mode, based on the user's sleep state selection operation, enter the corresponding sleep state; If no active sleep operation by the user is detected, and it is detected that the sleep mode preset by the user is the automatic sleep mode, the automatic sleep mode is entered; In the automatic sleep mode, entering a corresponding sleep state based on an automatic sleep program; If no active sleep operation by the user is detected, and it is not detected that the sleep mode preset by the user is the automatic sleep mode, sleep will not be performed.

3. The sleep method according to claim 2, characterized in that: In the active sleep mode, entering the corresponding sleep state based on the sleep state selection operation of the user includes: When the user selects the sleep state as non-sleep, the system does not enter the sleep state; When the sleep state selected by the user is light sleep, the system enters the light sleep state; When the sleep state selected by the user is light sleep, it enters light sleep state; When the sleep state selected by the user is deep sleep, the system enters deep sleep state.

4. The sleep method according to claim 2, characterized in that: In the automatic sleep mode, entering a corresponding sleep state based on an automatic sleep program includes: If no wake-up signal is detected within the preset first time period, entering the shallow sleep state; In the light sleep state, if no wake-up signal is detected within a preset second time period, the light sleep state is entered; In the light sleep state, if no wake-up signal is detected within a preset third time period, the deep sleep state is entered.

5. The sleep method according to claim 1, characterized in that: After entering the corresponding dormant state based on the human-computer interaction operation of the user, the method includes: If a wake-up signal is detected in the shallow sleep state, the image sensor unit is woken up and the image sensor unit is restored to the working state before the shallow sleep state; If a wake-up signal is detected in the preset sleep state, the image sensor unit is powered on, and the image sensor unit is configured according to the stored parameters so that the image sensor unit is restored to a working state; Wherein, the preset sleep state is a light sleep state or a deep sleep state. When the preset sleep state is the deep sleep state, after detecting the wake-up signal, it also includes making the main control unit exit sleep.

6. The sleep method according to claim 5, characterized in that: The configuring the image sensing unit according to the stored parameters so as to restore the image sensing unit to a working state includes: If the preset parameters are not detected, configuring the image sensing unit according to the stored parameters so that the image sensing unit is restored to the working state before the sleep state; If the preset parameters are detected, after modifying the stored parameters according to the preset parameters, the image sensing unit is configured based on the modified parameters so that the image sensing unit is restored to the working state corresponding to the modified parameters; The preset parameters are parameters of the image sensor unit preset by the user.

7. The sleep method according to claim 4, characterized in that: In the light sleep state, if no wake-up signal is detected within a preset second time period, then after entering the light sleep state, the method further includes: If it is in a normal working state, reading the parameters of the image sensor unit and comparing them with the default parameters of the image sensor unit, storing the different parameters in the main control unit, and powering off the image sensor unit; If it is in a shallow sleep state, it enters a normal working state, then reads the parameters of the image sensor unit and compares them with the default parameters of the image sensor unit, stores the different parameters in the main control unit, and powers off the image sensor unit; When storing different parameters in the main control unit, if a preset parameter is detected, the different parameters are stored in the main control unit, or the different parameters are modified based on the preset parameter and then stored in the main control unit.

8. The sleep method according to claim 4, characterized in that: In the light sleep state, if no wake-up signal is detected within a preset third time period, then entering the deep sleep state further includes: If it is in a normal working state, the parameters of the image sensor unit are read and compared with the default parameters of the image sensor unit, and the different parameters are stored in the main control unit and then written into the data storage unit; If it is in a shallow sleep state, it enters a normal working state, then reads the parameters of the image sensor unit and compares them with the default parameters of the image sensor unit, stores the different parameters in the main control unit and then writes them into the data storage unit; If it is in a light dormant state, writing the different parameters stored in the main control unit into the data storage unit; Cutting off power to the image sensing unit and putting the main control unit into sleep mode; When storing different parameters in the main control unit, if a preset parameter is detected, the different parameters are stored in the main control unit, or the different parameters are modified based on the preset parameter and then stored in the main control unit.

9. The sleep method according to claim 1, characterized in that: The method based on the human-computer interaction operation of the user, before entering the corresponding dormant state, includes: Based on the user's first preset operation, storing the preset parameters; or Based on a second preset operation of the user, setting the sleep mode to the automatic sleep mode; Wherein, the preset parameters include at least one of the configuration parameters and state parameters of the image sensing unit.

10. An image acquisition and processing device, characterized in that: The invention comprises an image sensing unit, a main control unit and a data storage unit, a memory and a computer program stored in the memory and executable on the main control unit. When the main control unit executes the computer program, the steps of the sleep method as claimed in any one of claims 1 to 9 are implemented.

Images