Camera control methods, devices, electronic equipment and storage media
By adjusting the power supply status of the time-of-flight sensor to match the working status of the camera device, the problem of high power consumption of the time-of-flight sensor was solved, thereby reducing power consumption, maintaining device performance, and extending battery life.
Patent Information
- Application Number
- CN202110295359.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-03-19
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2041-03-19
AI Technical Summary
In mobile terminal camera devices, time-of-flight sensors consume a lot of power, which shortens battery life and affects device performance. Existing technologies have not been able to effectively solve this problem.
By adjusting the power supply status of the time-of-flight sensor according to the operating status of the camera device, including adjusting it to a low-power mode or an ultra-low-power mode, the power supply status is ensured to match the operating status, reducing unnecessary power consumption.
Without affecting the normal use of the camera device, the power consumption of the time-of-flight sensor is significantly reduced, extending battery life and maintaining device performance, while reducing shooting time delay.
Smart Images

Figure CN115118865B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of camera device control technology, and in particular to a camera device control method, device, electronic device and storage medium. Background Technology
[0002] When mobile terminals take photos using camera devices, time-of-flight (TOF) sensors are often used to obtain depth information of the object being photographed.
[0003] According to relevant technologies, the principle of time-of-flight (TOF) technology is that a sensor emits modulated pulsed infrared light based on a vertical-cavity surface-emitting laser (VSCE). When the pulsed infrared light encounters an object, it is reflected and received by a single-photon avalanche diode (SPAD). The sensor calculates the time difference or phase difference between the emission and reflection of the light to determine the distance to the object being photographed, thus generating depth information. In the application of camera devices, the TOF sensor is often powered by the same source. Summary of the Invention
[0004] To overcome the problems existing in the related technologies, this disclosure provides a camera device control method, device, electronic device and storage medium.
[0005] According to a first aspect of the present disclosure, a camera device control method is provided, wherein the camera device is equipped with a time-of-flight sensor, and the camera device control method includes: determining the operating state of the camera device and the power supply state of the time-of-flight sensor; and adjusting the power supply state of the time-of-flight sensor based on the operating state of the camera device and the power supply state of the time-of-flight sensor.
[0006] In one embodiment of this disclosure, adjusting the power supply state of the time-of-flight sensor based on the operating state of the camera device and the power supply state of the time-of-flight sensor includes: adjusting the power supply state of the time-of-flight sensor from a first power supply state to a second power supply state based on the operating state of the camera device; wherein the power consumption of the time-of-flight sensor in the second power supply state is lower than the power consumption of the time-of-flight sensor in the first power supply state.
[0007] In another embodiment of this disclosure, adjusting the power supply state of the time-of-flight sensor from a first power supply state to a second power supply state based on the operating state of the camera device includes: determining a power supply state matching the operating state based on the operating state of the camera device, wherein the operating state includes an inactive state, a standby operating state, an active state, or a power-on start-up state; and adjusting the second power supply state of the time-of-flight sensor to a power supply state matching the operating state.
[0008] In another embodiment of this disclosure, determining a power supply state matching the operating state of the camera device includes: in response to the operating state of the camera device being in an inactive state and the first power supply state being a power-on state, determining a power supply state matching the operating state as a power-off state.
[0009] In another embodiment of this disclosure, determining a power supply state matching the operating state of the camera device includes: in response to the operating state of the camera device being a standby operating state, determining a power supply state matching the operating state as a low-power mode power supply state.
[0010] In another embodiment of this disclosure, adjusting the second power supply state of the time-of-flight sensor to the low-power mode power supply state includes: maintaining the power supply state of the analog voltage input terminal of the time-of-flight sensor in the power-on state, and adjusting the power supply state of the digital voltage input terminal of the time-of-flight sensor to the power-off state.
[0011] In another embodiment of this disclosure, the camera device control method further includes: if the power supply state of the analog voltage input terminal of the time-of-flight sensor is in a power-off state, then adjusting the power supply state of the time-of-flight sensor to an ultra-low power consumption mode power supply state.
[0012] In another embodiment of this disclosure, determining a power supply state matching the operating state of the camera device includes: in response to the camera device being in an enabled state and the flight sensor being in a ranging state, determining the analog input voltage corresponding to the analog voltage input terminal of the time-of-flight sensor; if the analog input voltage is greater than a voltage threshold, then determining that the power supply state matching the operating state is a state in which the charge pump of the internal power supply circuit of the time-of-flight sensor is turned off.
[0013] In another embodiment of this disclosure, determining a power supply state matching the operating state of the camera device includes: in response to the camera device being in a power-on state, determining a power supply state matching the operating state to set the power supply state of the analog voltage input terminal and the digital voltage input terminal of the time-of-flight sensor to be simultaneously powered on.
[0014] According to a second aspect of the present disclosure, a camera device control device is provided, wherein a time-of-flight sensor is installed in the camera device, and the camera device control device includes: a determining module, configured to determine the operating state of the camera device and the power supply state of the time-of-flight sensor; and a processing module, configured to adjust the power supply state of the time-of-flight sensor based on the operating state of the camera device and the power supply state of the time-of-flight sensor.
[0015] In one embodiment of this disclosure, the processing module adjusts the power supply state of the time-of-flight sensor based on the operating state of the camera device and the power supply state of the time-of-flight sensor in the following manner: based on the operating state of the camera device, the power supply state of the time-of-flight sensor is adjusted from a first power supply state to a second power supply state; wherein, the power consumption of the time-of-flight sensor in the second power supply state is lower than the power consumption of the time-of-flight sensor in the first power supply state.
[0016] In another embodiment of this disclosure, the processing module adjusts the power supply state of the time-of-flight sensor from a first power supply state to a second power supply state based on the operating state of the camera device in the following manner: determining a power supply state that matches the operating state based on the operating state of the camera device, wherein the operating state includes an inactive state, a standby operating state, an active state, or a power-on start-up state; and adjusting the second power supply state of the time-of-flight sensor to a power supply state that matches the operating state.
[0017] In another embodiment of this disclosure, the processing module determines a power supply state matching the operating state of the camera device based on the operating state of the camera device in the following manner: in response to the operating state of the camera device being in an inactive state and the first power supply state being a power-on state, the power supply state matching the operating state is determined to be a power-off state.
[0018] In another embodiment of this disclosure, the processing module determines a power supply state matching the operating state of the camera device based on the operating state of the camera device in the following manner: in response to the operating state of the camera device being a standby operating state, the power supply state matching the operating state is determined to be a low-power mode power supply state.
[0019] In another embodiment of this disclosure, the processing module adjusts the second power supply state of the time-of-flight sensor to the low-power mode power supply state in the following manner: keeping the power supply state of the analog voltage input terminal of the time-of-flight sensor in the power-on state, and adjusting the power supply state of the digital voltage input terminal of the time-of-flight sensor to the power-off state.
[0020] In another embodiment of this disclosure, the processing module is further configured to: if the power supply state of the analog voltage input terminal of the time-of-flight sensor is in a power-off state, adjust the power supply state of the time-of-flight sensor to an ultra-low power consumption mode power supply state.
[0021] In another embodiment of this disclosure, the processing module determines a power supply state matching the operating state of the camera device based on the following method: in response to the camera device being in an enabled state and the flight sensor being in a ranging state, the module determines the analog input voltage corresponding to the analog voltage input terminal of the time-of-flight sensor; if the analog input voltage is greater than a voltage threshold, the module determines that the power supply state matching the operating state is the state of shutting down the charge pump of the internal power supply circuit of the time-of-flight sensor.
[0022] In another embodiment of this disclosure, the processing module determines a power supply state matching the operating state of the camera device based on the following method: in response to the operating state of the camera device being in a power-on state, the power supply state matching the operating state is determined to be a state in which the power supply state of the analog voltage input terminal and the digital voltage input terminal of the time-of-flight sensor is set to be simultaneously powered on.
[0023] According to a third aspect of the present disclosure, an electronic device is provided, including a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke instructions to execute the camera device control method described in the first aspect of the present disclosure or any embodiment of the first aspect.
[0024] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, wherein when instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal is enabled to perform the camera device control method described in the first aspect of the present disclosure or any embodiment of the first aspect.
[0025] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects: A camera device control method is applied to a camera device, wherein the camera device is equipped with a time-of-flight sensor. Based on the operating state of the camera device, the power supply state of the time-of-flight sensor is adjusted so that the adjusted power supply state of the time-of-flight sensor matches the operating state of the camera device, and the power consumption of the time-of-flight sensor is adjusted without affecting the normal use of the camera device.
[0026] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0027] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0028] Figure 1 This is a flowchart illustrating a camera device control method according to an exemplary embodiment.
[0029] Figure 2 This is a flowchart illustrating, according to an exemplary embodiment, a process for adjusting the power supply state of a time-of-flight sensor from a first power supply state to a second power supply state.
[0030] Figure 3 This is a flowchart illustrating another camera device control method according to an exemplary embodiment.
[0031] Figure 4 A schematic diagram of a communication transmission with multiple power consumption modes is shown.
[0032] Figure 5 This is a flowchart illustrating, according to an exemplary embodiment, a method for determining a power supply state that matches the operating state of a camera device.
[0033] Figure 6 A schematic diagram of the internal circuit structure of a time-of-flight sensor is shown.
[0034] Figure 7 The power-on timing diagram for a current analog voltage input terminal and a digital voltage input terminal is shown.
[0035] Figure 8 This shows the power-on timing diagram for another type of analog voltage input and digital voltage input.
[0036] Figure 9 This is a block diagram illustrating a camera device control device according to an exemplary embodiment.
[0037] Figure 10This is a block diagram illustrating an electronic device for controlling a camera device according to an exemplary embodiment. Detailed Implementation
[0038] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.
[0039] In the accompanying drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are some, but not all, of the embodiments of this disclosure. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this disclosure, and should not be construed as limiting this disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure. The embodiments of this disclosure will be described in detail below with reference to the accompanying drawings.
[0040] The mainstream solutions for 3D vision technology are time-of-flight (TOF) technology, structured light, and binocular stereo imaging. Among them, TOF technology has unique advantages over structured light and binocular stereo imaging. In application, a TOF sensor, based on the principle of TOF technology, emits a laser of a specific wavelength to the object to be photographed, and focuses the returning laser onto the sensor's imaging plane through a lens. Through the processing and calculation of digital and analog signals, the distance from each pixel of the object to the TOF sensor is obtained, generating depth information. Throughout the operation, the TOF sensor is less affected by ambient light interference, resulting in more accurate depth information of the object. However, during the operation of the camera device, the TOF sensor is often powered by the same source.
[0041] This disclosure provides a camera device control method applicable to a camera device equipped with a time-of-flight sensor. Based on the operating state of the camera device, the power supply state of the time-of-flight sensor is adjusted to match the operating state of the camera device, thus laying the foundation for reducing the power consumption of the time-of-flight sensor without affecting the normal operation of the camera device.
[0042] The camera device control method described in this disclosure can be applied to a camera device. In one example, the camera device may be a camera device installed on a mobile terminal. The camera device has a time-of-flight sensor installed inside, and acquires depth information of the object to be photographed through the time-of-flight sensor.
[0043] Figure 1 This is a flowchart illustrating a camera device control method according to an exemplary embodiment.
[0044] In an exemplary embodiment of this disclosure, as Figure 1 As shown, the camera device control method may include the following steps.
[0045] In step S101, the operating status of the camera device and the power supply status of the time-of-flight sensor are determined.
[0046] In one embodiment, the operating state of the camera device can be determined. For example, the operating state of the camera device may include an inactive state, a standby state, or an active state. Further, the current power supply state of the time-of-flight sensor is determined.
[0047] In step S102, the power supply status of the time-of-flight sensor is adjusted based on the working status of the camera device and the power supply status of the time-of-flight sensor.
[0048] During application, the power supply status of the time-of-flight sensor can be adjusted according to the operating status of the camera device and the current power supply status of the time-of-flight sensor to match the operating status of the camera device. In one example, when the camera device switches from standby mode to startup mode, the power supply status of the time-of-flight sensor can also be adjusted accordingly to match the current operating status of the camera device.
[0049] It should be noted that, without affecting the normal operation of the camera device, the operating state of the time-of-flight sensor will vary depending on the camera device's operating state. For example, when the camera device is in standby mode, since the time-of-flight sensor does not need to calculate the depth information of the object being photographed, it is not necessary for the time-of-flight sensor to be constantly operational, thereby reducing the power consumption generated by the time-of-flight sensor.
[0050] This disclosure provides a camera device control method that adjusts the power supply state of a time-of-flight sensor based on the operating state of the camera device, so that the adjusted power supply state of the time-of-flight sensor can match the operating state of the camera device, and adjusts the power consumption of the time-of-flight sensor without affecting the normal use of the camera device.
[0051] This disclosure will describe, through the following embodiments, the process of adjusting the power supply state of the time-of-flight sensor based on the operating state of the camera device and the power supply state of the time-of-flight sensor.
[0052] In an exemplary embodiment of this disclosure, the power supply state of the time-of-flight sensor can be adjusted based on the operating state of the camera device and the power supply state of the time-of-flight sensor in the following manner: the power supply state of the time-of-flight sensor is adjusted from a first power supply state to a second power supply state based on the operating state of the camera device; wherein the power consumption of the time-of-flight sensor in the second power supply state is lower than the power consumption of the time-of-flight sensor in the first power supply state.
[0053] When the camera device is in different operating states, the power supply state of the time-of-flight sensor installed inside the camera device will also be different accordingly. During application, without affecting the normal operation of the camera device, the power consumption of the time-of-flight sensor can be reduced by changing its power supply state. In this disclosure, for ease of explanation, the power supply state used by the time-of-flight sensor before adjustment can be referred to as the first power supply state, and the power supply state used after adjustment can be referred to as the second power supply state. In one example, the power supply state of the time-of-flight sensor can be adjusted from the first state to the second power supply state based on the operating state of the camera device. The power consumption of the time-of-flight sensor in the second power supply state is lower than that in the first power supply state.
[0054] As described above, when the camera device is in standby mode, since the time-of-flight sensor does not need to calculate the depth information of the object being photographed, it is not necessary for the time-of-flight sensor to be constantly operational, thus reducing its power consumption. In one example, based on the camera device's operating state, the power supply state of the time-of-flight sensor can be adjusted to a second power supply state, so that the power consumption of the time-of-flight sensor in the second power supply state is lower than that in the first power supply state.
[0055] This disclosure provides a camera device control method that adjusts the power supply state of a time-of-flight sensor based on the camera device's operating state, so that the power consumption of the time-of-flight sensor under the adjusted power supply state is lower than that under the unadjusted power supply state. This ensures that the power consumption of the time-of-flight sensor can be reduced without affecting the normal operation of the camera device.
[0056] This disclosure will describe, through the following embodiments, the process of adjusting the power supply state of the time-of-flight sensor from a first power supply state to a second power supply state based on the operating state of the camera device.
[0057] Figure 2This is a flowchart illustrating, according to an exemplary embodiment, a process for adjusting the power supply state of a time-of-flight sensor from a first power supply state to a second power supply state.
[0058] In an exemplary embodiment of this disclosure, as Figure 2 As shown, adjusting the power supply state of the time-of-flight sensor from the first power supply state to the second power supply state may include steps S201 and S202. Each step will be described in detail below.
[0059] In step S201, based on the working state of the camera device, a power supply state matching the working state is determined, wherein the working state includes an inactive state, a standby working state, an active state, or a power-on start-up state.
[0060] In step S202, the second power supply state of the time-of-flight sensor is adjusted to a power supply state that matches the operating state.
[0061] In one embodiment, the time-of-flight sensor can be matched to different power supply states of the camera device under different operating states without affecting its normal operation. During application, the second power supply state of the time-of-flight sensor can be adjusted to match the operating state to ensure reduced power consumption of the time-of-flight sensor without affecting the normal operation of the camera device.
[0062] In an exemplary embodiment of this disclosure, the power supply state matching the operating state of the camera device can be determined in the following manner: in response to the operating state of the camera device being in an inactive state and the first power supply state being a power-on state, the power supply state matching the operating state can be determined to be a power-off state.
[0063] During application, when it is determined that the camera device using the time-of-flight sensor is in an inactive state (i.e., the camera device has not been activated by the user), the time-of-flight sensor does not need to operate. Setting the time-of-flight sensor to power-on or standby mode would result in significant standby power consumption. Therefore, when it is determined that the camera device using the time-of-flight sensor is not activated, the time-of-flight sensor can be directly switched from power-on to power-off mode, i.e., no power is supplied to the time-of-flight sensor. This method effectively reduces the power consumption generated by the time-of-flight sensor.
[0064] In an exemplary embodiment of this disclosure, the power supply state matching the operating state of the camera device can also be determined in the following manner: in response to the operating state of the camera device being a standby operating state, the power supply state matching the operating state can be determined to be a low-power mode power supply state.
[0065] It's understandable that users often have shooting intervals when using camera devices to take pictures or videos. That is, there are time intervals between taking multiple images. To avoid repeatedly turning the camera on and off, users often leave it in standby mode during these intervals. However, in this situation, if the time-of-flight sensor is left on or in working mode, it will be in a high-power (HP) mode, resulting in significant power consumption. It's important to note that in high-power mode, the time-of-flight sensor is always powered on, and it can begin acquiring and calculating depth information once the user initiates the command to do so. It should be understood that when the time-of-flight sensor's power consumption exceeds 2mW, it can be considered to be in high-power mode.
[0066] Furthermore, in order to reduce the power consumption of the time-of-flight sensor when the camera device is in standby mode, the power supply state of the time-of-flight sensor can be adjusted from the high-power mode to the low-power (LP) mode.
[0067] It should be noted that in low-power mode, data stored in the random access memory and registers will not be lost. Furthermore, when the camera device calls the time-of-flight sensor again to acquire depth information of the object being photographed, there is no need for an integrated power management circuit to charge it. It can be understood that if the time-of-flight sensor receives a command from the camera device to call it again while in low-power mode, it can quickly resume its operating state, i.e., the time-of-flight sensor is in high-power mode. Specifically, when the power consumption of the time-of-flight sensor is between 10µW and 2mW, it can be considered that the time-of-flight sensor is in low-power mode.
[0068] As can be seen from the above embodiments, when the camera device is in standby mode, adjusting the time-of-flight sensor to a low-power mode ensures that, on the one hand, there will be no shooting time delay when the camera device calls the time-of-flight sensor again to collect depth information of the object to be photographed, thereby ensuring that the camera device has good shooting performance. On the other hand, it can also reduce the power consumption generated by the time-of-flight sensor.
[0069] This disclosure will describe the process of adjusting the second power supply state of the time-of-flight sensor to a low-power mode power supply state through the following embodiments.
[0070] In an exemplary embodiment of this disclosure, adjusting the second power supply state of the time-of-flight sensor to a low-power mode power supply state can be achieved by maintaining the power supply state of the analog voltage input terminal of the time-of-flight sensor in a powered-on state and adjusting the power supply state of the digital voltage input terminal of the time-of-flight sensor to a powered-off state.
[0071] During application, if the analog voltage input of the time-of-flight sensor is directly powered down when the camera is in standby mode, leakage current will occur in the analog circuitry within the sensor. Furthermore, when the camera uses the time-of-flight sensor again to acquire depth information of the object being photographed, the integrated power management circuitry needs to recharge the sensor for firmware download and register restart. This introduces a time delay, affecting the camera's performance. In one example, when the camera is detected to be in standby mode, the analog voltage input of the time-of-flight sensor can be kept powered on, while the digital voltage input is powered down. This reduces power consumption from the time-of-flight sensor and prevents time delay, thus preserving the camera's performance.
[0072] This disclosure will illustrate the process of another camera device control method through the following embodiments.
[0073] Figure 3 This is a flowchart illustrating another camera device control method according to an exemplary embodiment.
[0074] In an exemplary embodiment of this disclosure, as Figure 3 As shown, the camera device control method may include steps S301 to S304. Step S301 is the same as step S201, and step S303 is the same as step S202. For specific implementation methods and beneficial effects, please refer to steps S201 and S202, which will not be repeated in this embodiment. Steps S302 and S304 will be described in detail below.
[0075] In step S302, in response to the camera device being in standby mode, a power supply state matching the operating state is determined to be a low-power mode power supply state.
[0076] In step S304, if the power supply state of the analog voltage input terminal of the time-of-flight sensor is in the power-off state, then the power supply state of the time-of-flight sensor is adjusted to the ultra-low power mode power supply state.
[0077] In one embodiment, in response to the camera device being in standby mode, the power supply state of the time-of-flight sensor can be adjusted to a low-power mode. Further, if the power supply state of the analog voltage input terminal of the time-of-flight sensor is powered down, the power supply state of the time-of-flight sensor can be adjusted to an ultra-low power (ULP) mode to reduce the power consumption generated by the time-of-flight sensor. It is understood that the power consumption generated by the time-of-flight sensor in ultra-low power mode is less than that in low-power mode, and both the low-power regulator and the high-power regulator are disabled. Specifically, when the power consumption of the time-of-flight sensor is below 10µW, it can be understood that the time-of-flight sensor is in ultra-low power mode.
[0078] Figure 4 A schematic diagram of a communication transmission with multiple power consumption modes is shown.
[0079] In one embodiment, such as Figure 4 The aforementioned method allows for control of the time-of-flight sensor to operate in different power consumption modes based on communication protocol transmission. During application, when the time-of-flight sensor is in a high-power mode, it can switch to ranging mode upon receiving a command to do so. Conversely, when the time-of-flight sensor is in ranging mode, it can switch to a low-power mode upon receiving a command to stop ranging.
[0080] In another example, when the time-of-flight sensor is in a high-power mode, it can be controlled to enter a low-power mode in response to a command to do so. Conversely, when the time-of-flight sensor is in a low-power mode, it can be controlled to enter a high-power mode in response to a command to do so.
[0081] In another example, when the time-of-flight sensor is in a high-power mode, it can be controlled to enter an ultra-low-power mode in response to a command to do so. Conversely, when the time-of-flight sensor is in an ultra-low-power mode, it can be controlled to enter a high-power mode in response to a command to do so.
[0082] This disclosure will describe, in conjunction with the following embodiments, the process of determining a power supply state that matches the operating state of the camera device.
[0083] Figure 5This is a flowchart illustrating, according to an exemplary embodiment, a method for determining a power supply state that matches the operating state of a camera device.
[0084] In an exemplary embodiment of this disclosure, determining a power supply state matching the operating state of the camera device may include steps S401 and S402. Each step will be described below.
[0085] In step S401, in response to the camera device being in the enabled state and the flight sensor being in the ranging state, the analog input voltage corresponding to the analog voltage input terminal of the time-of-flight sensor is determined.
[0086] In step S402, if the analog input voltage is greater than the voltage threshold, the power supply state that matches the working state is determined to be the state where the charge pump of the internal power supply circuit of the time-of-flight sensor is turned off.
[0087] In one embodiment, such as Figure 6 As shown, when the camera device is in the enabled state and the flight sensor is in the ranging state, i.e., when the time-of-flight sensor needs to collect depth information of the object to be photographed, the integrated power management circuit 20 is often required to supply power to the analog circuit 110 and digital circuit 120 inside the time-of-flight sensor 10. It should be noted that a charge pump for the power supply circuit is also present in the analog circuit 110 to increase the analog voltage value on the analog circuit 110 to reach the voltage threshold, ensuring the normal ranging operation of the time-of-flight sensor 10. Since the charge pump generates power consumption during use, if the analog voltage on the analog circuit 110 reaches the voltage threshold before being boosted, turning off the charge pump will not affect the normal ranging operation of the time-of-flight sensor 10 and will also reduce the power consumption generated by activating the charge pump.
[0088] During application, the analog input voltage corresponding to the analog voltage input terminal of the time-of-flight sensor can be determined. If it is determined that the analog input voltage is greater than the voltage threshold, the charge pump of the internal power supply circuit of the time-of-flight sensor can be directly turned off to reduce the power consumption caused by activating the charge pump. Through this embodiment, the power consumption generated by the time-of-flight sensor during operation can be reduced without affecting the normal operation of the time-of-flight sensor's ranging function. It is understood that the voltage threshold can be determined according to the actual situation; for example, the voltage threshold can be 3V. In this disclosure, no specific limitation is made to the voltage threshold.
[0089] Understandably, a time-of-flight (TOF) sensor uses an internal vertical-cavity surface-emitting laser (VCSEL) to emit pulsed infrared light towards the object being photographed, and a microcontroller unit (MCU) to collect and calculate the pulsed infrared light emitted back by the object to obtain its depth information. It's important to note that while the TOF sensor is calculating depth information, i.e., in ranging mode, the VCSEL and MCU are not continuously active within a measurement cycle. In one example, a measurement cycle might be 66ms, with 10ms representing the active period for both the VCSEL and MCU. During these 10ms, the power consumption of the TOF sensor reaches its maximum due to the power emitted by the VCSEL and the computational power generated by the MCU.
[0090] In one embodiment, to reduce power consumption caused by the battery sampling circuit (also known as the AFE circuit) being constantly operational, the battery sampling circuit, the Tx drive circuit, and the microcontroller unit can be switched off and placed in standby mode during the time periods in a ranging cycle when pulsed infrared light emission and depth information calculation are not performed (e.g., other than 10ms). This embodiment reduces the power consumption of the time-of-flight sensor during operation without affecting its normal ranging function.
[0091] This disclosure will describe, through the following embodiments, another process for determining a power supply state that matches the operating state of a camera device.
[0092] In an exemplary embodiment of this disclosure, in response to the camera device being in a power-on startup state, a power supply state matching the operating state can be determined to be a state in which the power supply states of the analog voltage input terminal and the digital voltage input terminal of the time-of-flight sensor are simultaneously powered on.
[0093] Figure 7 The power-on timing diagram for a current analog voltage input terminal and a digital voltage input terminal is shown.
[0094] Combination Figure 7 It is known that if the digital voltage input terminal is set to be powered on first, when its digital voltage is pulled up, it will cause the digital voltage to form a high voltage value, which will lead to leakage current, for example, a leakage current of 250uA.
[0095] In one embodiment, the power-on timing of the analog and digital voltage input terminals within the time-of-flight sensor can be modified to reduce power consumption during camera startup caused by sensor leakage. In one example, the camera starts up by accessing sensor data and the power supply chip that powers the digital circuitry within the time-of-flight sensor. If the power supply chip powers the digital circuitry but not the analog circuitry, the time-of-flight sensor will leak current. This leakage increases the sensor's power consumption. Therefore, during camera startup, the power supply status of the analog and digital voltage input terminals of the time-of-flight sensor can be adjusted to ensure simultaneous power-on, thus addressing the leakage problem and reducing the additional power consumption caused by leakage.
[0096] Figure 8 This shows the power-on timing diagram for another type of analog voltage input and digital voltage input.
[0097] like Figure 8 As shown, according to relevant technologies, the digital voltage input terminal is often powered on later than the analog voltage input terminal, with a delay time of t1. As described above, when the digital voltage input terminal is set to power on first, its digital voltage rises, resulting in a high voltage value and leakage. To avoid this problem, in one embodiment of this disclosure, the power supply state of the analog and digital voltage input terminals of the time-of-flight sensor can be set to a simultaneous power-on state. That is, t1 can be set to 0. In another embodiment, while setting the power supply state of the analog and digital voltage input terminals of the time-of-flight sensor to a simultaneous power-on state, the power supply state of the analog and digital voltage input terminals of the time-of-flight sensor can also be set to a simultaneous power-off state. That is, t2 can be set to 0. This method can solve the leakage problem of the time-of-flight sensor, thereby reducing the additional power consumption caused by leakage.
[0098] As described above, the camera device control method provided in this disclosure can be applied to a camera device, wherein the camera device is equipped with a time-of-flight sensor. Based on the operating state of the camera device, the power supply state of the time-of-flight sensor is adjusted so that the adjusted power supply state of the time-of-flight sensor matches the operating state of the camera device, and the power consumption of the time-of-flight sensor is adjusted without affecting the normal use of the camera device.
[0099] Based on the same concept, embodiments of this disclosure also provide a camera device control device.
[0100] It is understood that the camera control device provided in this disclosure includes hardware structures and / or software modules corresponding to each function in order to achieve the above-mentioned functions. In conjunction with the units and algorithm steps of the various examples disclosed in this disclosure, this disclosure can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the technical solutions of this disclosure.
[0101] Figure 9 This is a block diagram illustrating a camera device control device according to an exemplary embodiment.
[0102] In one exemplary embodiment of this disclosure, a time-of-flight sensor is installed in the camera device. For example... Figure 9 As shown, the camera control device 100 may include a determining module 101 and a processing module 102. Each module will be described in detail below.
[0103] The determination module 101 can be configured to: determine the operating status of the camera device and the power supply status of the time-of-flight sensor.
[0104] The processing module 102 can be configured to: adjust the power supply state of the time-of-flight sensor based on the operating state of the camera device and the power supply state of the time-of-flight sensor.
[0105] In an exemplary embodiment of this disclosure, the processing module 102 may adjust the power supply state of the time-of-flight sensor based on the operating state of the camera device and the power supply state of the time-of-flight sensor in the following manner: based on the operating state of the camera device, the power supply state of the time-of-flight sensor is adjusted from a first power supply state to a second power supply state; wherein, the power consumption of the time-of-flight sensor in the second power supply state is lower than the power consumption of the time-of-flight sensor in the first power supply state.
[0106] In an exemplary embodiment of this disclosure, the processing module 102 may adjust the power supply state of the time-of-flight sensor from a first power supply state to a second power supply state based on the operating state of the camera device in the following manner: determining a power supply state that matches the operating state based on the operating state of the camera device, wherein the operating state includes an inactive state, a standby operating state, an active state, or a power-on start-up state; and adjusting the second power supply state of the time-of-flight sensor to a power supply state that matches the operating state.
[0107] In an exemplary embodiment of this disclosure, the processing module 102 may determine a power supply state matching the working state of the camera device based on the working state of the camera device in the following manner: in response to the working state of the camera device being in an inactive state and the first power supply state being a power-on state, the power supply state matching the working state is determined to be a power-off state.
[0108] In an exemplary embodiment of this disclosure, the processing module 102 may determine a power supply state matching the operating state of the camera device based on the operating state of the camera device in the following manner: in response to the operating state of the camera device being a standby operating state, the power supply state matching the operating state is determined to be a low-power mode power supply state.
[0109] In one exemplary embodiment of this disclosure, the processing module 102 may adjust the second power supply state of the time-of-flight sensor to a low-power mode power supply state by maintaining the power supply state of the analog voltage input terminal of the time-of-flight sensor in a powered-on state and adjusting the power supply state of the digital voltage input terminal of the time-of-flight sensor to a powered-off state.
[0110] In an exemplary embodiment of this disclosure, the processing module 102 may also be configured to: if the power supply state of the analog voltage input terminal of the time-of-flight sensor is in a power-off state, adjust the power supply state of the time-of-flight sensor to an ultra-low power mode power supply state.
[0111] In one exemplary embodiment of this disclosure, the processing module 102 may determine a power supply state matching the operating state of the camera device based on the following method: in response to the camera device being in an enabled state and the flight sensor being in a ranging state, the analog input voltage corresponding to the analog voltage input terminal of the time-of-flight sensor is determined; if the analog input voltage is greater than a voltage threshold, the power supply state matching the operating state is determined to be the state of shutting down the charge pump of the internal power supply circuit of the time-of-flight sensor.
[0112] In an exemplary embodiment of this disclosure, the processing module 102 may determine a power supply state matching the operating state of the camera device based on the operating state of the camera device in the following manner: in response to the operating state of the camera device being a power-on start-up state, the power supply state matching the operating state is determined to be a state in which the power supply state of the analog voltage input terminal and the digital voltage input terminal of the time-of-flight sensor is simultaneously powered on.
[0113] Regarding the camera device control device in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments of the camera device control method, and will not be elaborated here.
[0114] Figure 10This is a block diagram illustrating an electronic device 200 for controlling a camera device according to an exemplary embodiment. For example, the electronic device 200 for controlling a camera device may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.
[0115] Reference Figure 10 The electronic device 200 for controlling the camera device may include one or more of the following components: processing component 202, memory 204, power component 206, multimedia component 208, audio component 210, input / output (I / O) interface 212, sensor component 214, and communication component 216.
[0116] Processing component 202 typically controls the overall operation of electronic device 200 for camera device control, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 202 may include one or more processors 220 to execute instructions to complete all or part of the steps of the camera device control method described above. Furthermore, processing component 202 may also include one or more modules to facilitate interaction between processing component 202 and other components. For example, processing component 202 may also include a multimedia module to facilitate interaction between multimedia component 208 and processing component 202.
[0117] Memory 204 can be configured to store various types of data to support the operation of electronic device 200 for camera device control. Examples of such data include instructions that can be used for any application or method operating on electronic device 200 for camera device control, contact data, phone book data, messages, pictures, videos, etc. Memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0118] The power supply component 206 can provide power to various components of the electronic equipment 200 used for camera device control. The power supply component 206 may also include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic equipment 200 used for camera device control.
[0119] Multimedia component 208 may include a screen that provides an output interface between the electronic device 200 for camera device control and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel may include one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 208 may include a front-facing camera and / or a rear-facing camera. When the electronic device 200 for camera device control is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
[0120] Audio component 210 can be configured to output and / or input audio signals. For example, audio component 210 may include a microphone (MIC) that can be configured to receive external audio signals when the electronic device 200 for camera device control is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 204 or transmitted via communication component 216. In some embodiments, audio component 210 may also include a speaker for outputting audio signals.
[0121] I / O interface 212 can provide an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.
[0122] Sensor assembly 214 may include one or more sensors for providing status assessments of various aspects of the electronic device 200 for camera device control. For example, sensor assembly 214 may detect the on / off state of the electronic device 200, the relative positioning of components (e.g., the display and keypad of the electronic device 200), changes in position of the electronic device 200 or a component thereof, the presence or absence of user contact with the electronic device 200, the orientation or acceleration / deceleration of the electronic device 200, and temperature changes of the electronic device 200. Sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 214 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.
[0123] Communication component 216 can be configured to facilitate wired or wireless communication between electronic device 200 for camera device control and other devices. Electronic device 200 for camera device control can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 216 can receive broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 216 may also include a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
[0124] In an exemplary embodiment, the electronic device 200 for controlling the camera device may also be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the camera device control method described above.
[0125] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, which can be executed by a processor 220 of an electronic device 200 for controlling a camera device to complete the aforementioned camera device control method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.
[0126] It is understood that in this disclosure, "multiple" can refer to two or more, and other quantifiers are similar. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. The singular forms "a," "the," and "the" are also intended to include the plural forms unless the context clearly indicates otherwise.
[0127] It is further understood that the terms "first," "second," etc., can be used to describe various types of information, but this information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another, and do not indicate a specific order or degree of importance. In fact, the expressions "first," "second," etc., are completely interchangeable. For example, without departing from the scope of this disclosure, first information can also be referred to as second information, and similarly, second information can also be referred to as first information.
[0128] In the accompanying drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are some, but not all, of the embodiments of this disclosure. The embodiments described above with reference to the accompanying drawings are exemplary and intended to explain this disclosure, and should not be construed as limiting this disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure. The embodiments of this disclosure have been described in detail above with reference to the accompanying drawings.
[0129] It is further understood that although operations are described in a specific order in the accompanying drawings in the embodiments of this disclosure, this should not be construed as requiring these operations to be performed in the specific order or serial order shown, or requiring all of the shown operations to be performed to obtain the desired result. In certain environments, multitasking and parallel processing may be advantageous.
[0130] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.
[0131] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. A method for controlling a camera device, characterized in that, The camera device is equipped with a time-of-flight sensor, and the camera device control method includes: Determine the operating status of the camera device and the power supply status of the time-of-flight sensor; Based on the operating status of the camera device and the power supply status of the time-of-flight sensor, adjust the power supply status of the time-of-flight sensor. There is a correspondence between the different working states of the camera device and the different power supply states of the time-of-flight sensor, and the power consumption corresponding to the power supply state after the time-of-flight sensor is adjusted is different from the power consumption corresponding to the power supply state before the time-of-flight sensor is adjusted. The step of adjusting the power supply status of the time-of-flight sensor based on the operating status of the camera device and the power supply status of the time-of-flight sensor includes: Based on the working state of the camera device, the power supply state of the time-of-flight sensor is adjusted from the first power supply state to the second power supply state; Wherein, the power consumption of the time-of-flight sensor in the second power supply state is lower than the power consumption of the time-of-flight sensor in the first power supply state; The step of adjusting the power supply state of the time-of-flight sensor from a first power supply state to a second power supply state based on the operating state of the camera device includes: Based on the operating state of the camera device, determine the power supply state that matches the operating state; Adjust the second power supply state of the time-of-flight sensor to match the operating state; The working states include: disabled state, standby state, enabled state, or power-on state. The power supply status of the time-of-flight sensor includes: power-on status, power-off status, high-power mode power supply status, or low-power mode power supply status. The step of determining a power supply state matching the operating state of the camera device includes: In response to the camera device being in an inactive state and the first power supply state being a power-on state, the power supply state matching the operating state is determined to be a power-off state. In response to the camera device being in standby mode, a power supply state matching the operating state is determined to be a low-power mode power supply state. In response to the camera device being in an enabled state or a powered-on state, the power supply state matching the operating state is determined to be either a high-power mode power supply state or a power-on state.
2. The camera device control method according to claim 1, characterized in that, The power supply state matching the operating state is a low-power mode power supply state, and adjusting the second power supply state of the time-of-flight sensor to match the operating state includes: The analog voltage input terminal of the time-of-flight sensor is kept powered on, and the digital voltage input terminal of the time-of-flight sensor is switched off.
3. The camera device control method according to claim 1 or 2, characterized in that, The camera device control method further includes: If the power supply status of the analog voltage input terminal of the time-of-flight sensor is in the power-off state, then the power supply status of the time-of-flight sensor is adjusted to the ultra-low power mode power supply state.
4. The camera device control method according to claim 1, characterized in that, The step of determining a power supply state matching the operating state of the camera device includes: In response to the camera device being in an enabled state and the time-of-flight sensor being in a ranging state, the analog input voltage corresponding to the analog voltage input terminal of the time-of-flight sensor is determined. If the analog input voltage is greater than the voltage threshold, then the power supply state that matches the operating state is determined to be the state where the charge pump of the internal power supply circuit of the time-of-flight sensor is turned off.
5. The camera device control method according to claim 1, characterized in that, The step of determining a power supply state matching the operating state of the camera device includes: In response to the camera device being in a powered-on state, the power supply state matching the working state is determined to be a state in which the analog voltage input terminal and digital voltage input terminal of the time-of-flight sensor are simultaneously powered on.
6. A camera control device, characterized in that, The camera device is equipped with a time-of-flight sensor, and the camera device control device includes: The determination module is used to determine the working status of the camera device and the power supply status of the time-of-flight sensor; The processing module is used to adjust the power supply status of the time-of-flight sensor based on the working status of the camera device and the power supply status of the time-of-flight sensor. The processing module adjusts the power supply status of the time-of-flight sensor based on the operating status of the camera device and the power supply status of the time-of-flight sensor in the following manner: Based on the working state of the camera device, the power supply state of the time-of-flight sensor is adjusted from the first power supply state to the second power supply state; Wherein, the power consumption of the time-of-flight sensor in the second power supply state is lower than the power consumption of the time-of-flight sensor in the first power supply state; The processing module adjusts the power supply state of the time-of-flight sensor from a first power supply state to a second power supply state based on the operating state of the camera device in the following manner: Based on the operating state of the camera device, determine the power supply state that matches the operating state; Adjust the second power supply state of the time-of-flight sensor to match the operating state; There is a correspondence between the different working states of the camera device and the different power supply states of the time-of-flight sensor, and the power consumption corresponding to the power supply state after the time-of-flight sensor is adjusted is different from the power consumption corresponding to the power supply state before the time-of-flight sensor is adjusted. The working states include: disabled state, standby state, enabled state, or power-on state; The power supply status of the time-of-flight sensor includes: power-on status, power-off status, high-power mode power supply status, or low-power mode power supply status. The step of determining a power supply state matching the operating state of the camera device includes: In response to the camera device being in an inactive state and the first power supply state being a power-on state, the power supply state matching the operating state is determined to be a power-off state. In response to the camera device being in standby mode, a power supply state matching the operating state is determined to be a low-power mode power supply state. In response to the camera device being in an enabled state or a powered-on state, the power supply state matching the operating state is determined to be either a high-power mode power supply state or a power-on state.
7. The camera device control device according to claim 6, characterized in that, The power supply state matching the operating state is a low-power mode power supply state. The processing module adjusts the second power supply state of the time-of-flight sensor to match the operating state in the following manner: The analog voltage input terminal of the time-of-flight sensor is kept powered on, and the digital voltage input terminal of the time-of-flight sensor is switched off.
8. The camera device control device according to claim 6 or 7, characterized in that, The processing module is also used for: If the power supply status of the analog voltage input terminal of the time-of-flight sensor is in the power-off state, then the power supply status of the time-of-flight sensor is adjusted to the ultra-low power mode power supply state.
9. The camera device control device according to claim 6, characterized in that, The processing module determines the power supply state that matches the operating state of the camera device using the following method: In response to the camera device being in an enabled state and the time-of-flight sensor being in a ranging state, the analog input voltage corresponding to the analog voltage input terminal of the time-of-flight sensor is determined. If the analog input voltage is greater than the voltage threshold, then the power supply state that matches the operating state is determined to be the state where the charge pump of the internal power supply circuit of the time-of-flight sensor is turned off.
10. The camera device control device according to claim 6, characterized in that, The processing module determines the power supply state that matches the operating state of the camera device using the following method: In response to the camera device being in a powered-on state, the power supply state matching the working state is determined to be a state in which the analog voltage input terminal and digital voltage input terminal of the time-of-flight sensor are simultaneously powered on.
11. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to execute the camera device control method according to any one of claims 1 to 5.
12. A non-transitory computer-readable storage medium, wherein when instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal is able to perform the camera device control method according to any one of claims 1 to 5.
Citation Information
Patent Citations
Camera provided with camera shake correcting function
JP2000284336A
