Control method and apparatus for electronic device
By replacing the specific power management chip with the first PMIC, flexible power management of the AON camera is realized, the problem of insufficient applicability in the prior art is solved, and the power management efficiency of the AON camera is improved and the cost is reduced.
Patent Information
- Application Number
- PCT/CN2024/079467
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-29
- Publication Date
- 2025-09-04
AI Technical Summary
When existing electronic devices use specific power management chips to power AON cameras, they are less applicable and cannot be flexibly adjusted to meet the actual needs of AON services.
The first PMIC is used instead of a specific power management chip, and flexible power management is achieved by controlling the power management interface of the AON camera on the application processor side and the sensor control center side respectively.
It improves the power management applicability of AON cameras, reduces costs, and allows flexible control of the power supply and power-off process of AON cameras according to business needs.
Smart Images

Figure CN2024079467_04092025_PF_FP_ABST
Abstract
Description
Method and device for controlling electronic equipment Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a control method and device for an electronic device. Background Art
[0002] With the development of technology, the functions of electronic devices such as mobile phones are more and more. For example, smart electronic devices such as mobile phones can realize AON business through real-time online (always-on, AON) cameras. Taking the AON business as the screen-watching non-extinguishing business, the AON camera in the normally open state can collect images in real time and detect whether the user is watching the screen by image recognition. When the electronic device detects that the user is watching the screen, the electronic device controls the screen to remain in a long-bright state, or when the electronic device detects that the user is not watching the screen, the electronic device controls the screen brightness to decrease. When the screen brightness is reduced and the electronic device is not locked, when the electronic device detects that the user is watching the screen again, the electronic device can control the screen brightness to increase.
[0003] When using an AON camera to perform AON services, the AON camera needs to use a specific power management chip to manage power supply to ensure the normal operation of the AON camera. However, the applicability of the control method of the above electronic device is low.
[0004] Summary of the Invention
[0005] The embodiments of the present application provide a control method and device for an electronic device, which are applied in the field of terminal technology. A first PMIC can be used to replace a specific power management chip to power an AON camera, thereby improving the applicability of power management for the AON camera.
[0006] In a first aspect, an embodiment of the present application proposes a control method for an electronic device, which is applied to the electronic device, wherein the electronic device includes: a real-time online AON camera and a first power management integrated circuit PMIC, and the method includes: at a first moment, receiving a first operation of the user, wherein the first operation is a power-on operation; in response to the first operation, powering on the first interface in the AON camera through the first PMIC; at a second moment, receiving a second operation of the user, wherein the second operation is an operation to start an AON service; in response to the second operation, powering on the second interface in the AON camera through the first PMIC, wherein the second moment is after the first moment; at a third moment, powering on the third interface in the AON camera, wherein the third moment is after the second moment, and the first interface includes: the second interface and the third interface.
[0007] Thus, the embodiment of the present application provides a control method for an electronic device, which can use a first PMIC to replace a specific power management chip to power an AON camera, thereby improving the applicability of power management for the AON camera while reducing costs. Furthermore, this solution can flexibly manage the power supply of the AON camera based on the actual needs of the AON service. For example, when the electronic device starts the AON service, the second interface and the third interface can be powered on separately.
[0008] In one possible implementation, the power-on duration of the first interface is the first duration, the third interface completes power-on at the fourth moment, the fourth moment is after the third moment, the duration between the second moment and the fourth moment is the second duration, and the second duration is greater than the first duration.
[0009] In one possible implementation, powering on the second interface in the AON camera through the first PMIC includes: on the application processor AP side, powering on the second interface through the first PMIC, the second interface being the power interface of the AON camera; powering on the third interface in the AON camera includes: on the sensor hub side, powering on the third interface, the third interface being the interface for signal control of the AON camera.
[0010] In this way, the electronic device uses the first PMIC on the AP side to power the second interface of the AON camera, ensuring that the power supply process is not affected by a specific power management chip, improving the applicability of the solution. Furthermore, the sensor hub provides power to the third interface of the AON camera, allowing the sensor hub to use the third interface to achieve low-power control of the AON camera.
[0011] In one possible implementation, the electronic device includes: an AON application, an intelligent perception service module, and a first camera driver. After responding to the second operation, the method further includes: the AON application sends a subscription message to the intelligent perception service module, and the subscription message is used to subscribe to the AON service; in response to the subscription message, the intelligent perception service module sends a first message to the first camera driver, and the first message is used to instruct to power on the AON camera.
[0012] In this way, when the smart perception service module in the electronic device detects the subscription message, it can notify the first camera driver through the first message to promptly power the AON camera, thereby reducing abnormal situations of the AON service.
[0013] In one possible implementation, the AP side of the electronic device includes: a first camera driver, a regulator framework, and a first PMIC driver, and powering on the second interface through the first PMIC includes: in response to a first message, the first camera driver obtains the second interface from the device tree; the first camera driver sends the second message along the regulator framework to the first PMIC driver, and in response to the second message, the first PMIC driver powers on the second interface; the method also includes: when the second interface is powered on, the first PMIC driver sends a first response message to the smart perception service module along the first camera driver.
[0014] In this way, the first camera driver, the regulator frame, and the first PMIC driver on the AP side can jointly realize powering on the second interface. Among them, the regulator frame and the first PMIC driver can be set in the AP power driver.
[0015] In one possible implementation, the sensor hub side includes: an AON image signal processor ISP, and the method further includes: in response to a first response message, the intelligent perception service module sends a subscription message to the AON ISP; in response to the subscription message, the AON ISP obtains a third interface from the first configuration file; and powering on the third interface includes: the AON ISP powers on the third interface.
[0016] In this way, the electronic device can also complete the power-on of some interfaces on the sensor hub side. Since the first PMIC driver is not limited to any specific power management chip, the power management process can be flexibly set according to business needs.
[0017] In one possible implementation, when the sensor hub detects that the electronic device is in a dormant state, the AON ISP receives a third message, where the third message includes: a message for instructing the dormant AON camera; and in response to the third message, the AON ISP powers off the third interface.
[0018] In this way, since the sensor hub can acquire and calculate sensor data, when the sensor hub detects the need to sleep based on the sensor data, the sensor hub can send a third message to the AON ISP, so that the AON ISP can power off the interface 2 to achieve the purpose of saving power.
[0019] In one possible implementation, before the second moment, the method further includes: at a fifth moment, powering off the first interface through the first PMIC; after the third moment, the method further includes: at a sixth moment, receiving a third operation from the user, wherein the third operation is an operation of shutting down the AON service; in response to the third operation, powering off the second interface through the first PMIC; at a seventh moment, powering off the third interface, wherein the seventh moment is after the sixth moment.
[0020] In this way, this solution can flexibly manage the power supply of the AON camera according to the actual needs of the AON service. For example, when the electronic device turns off the AON service, the second interface and the third interface can be powered off separately.
[0021] In one possible implementation, the power-off duration of the first interface is the third duration, the third interface completes power-off at the eighth moment, the eighth moment is after the seventh moment, the duration between the sixth moment and the eighth moment is the fourth duration, and the fourth duration is greater than the third duration.
[0022] In one possible implementation, the second interface includes one or more of the following: an input / output voltage IOVDD interface, a digital voltage DVDD interface, or an analog voltage AVDD interface; and the third interface includes: a reset signal RESET interface and / or a master clock signal MCLK interface.
[0023] In a second aspect, the present application implements an embodiment of a control method for another electronic device, which is applied to the electronic device, wherein the electronic device includes: an AON camera and a first PMIC, and the method includes: receiving a second operation of the user, wherein the second operation is an operation of starting an AON service; in response to the second operation, recording the number of times the AON camera is used as a first parameter, and powering on the first interface in the AON camera through the first PMIC; receiving a fourth operation of the user, the fourth operation includes an operation of using the AON camera in a first service, the first service is different from the AON service, and the fourth operation is after the second operation; in response to the fourth operation, recording the number of times the AON camera is used as a second parameter.
[0024] In this way, since the AON camera can indicate at least two AON services at the same time, the electronic device can provide a solution for using the AON camera for multiple services. For example, the electronic device can determine whether to turn off the AON camera when turning off the AON service by recording the number of times the AON camera is used.
[0025] In one possible implementation, after the first interface is powered on, the method further includes: receiving a fifth operation from the user, where the fifth operation is an operation of shutting down the AON service, and the fifth operation is after the fourth operation; in response to the fifth operation, recording the number of times the AON camera is used as a first parameter, and when the first parameter is not equal to a first threshold, the first interface is not powered off.
[0026] In this way, the electronic device can determine that there are other services currently using the AON camera based on the comparison between the first parameter and the first threshold, and therefore does not power off the AON camera.
[0027] In one possible implementation, after the first interface is powered on, the method further includes: receiving a sixth operation from the user, the sixth operation being an operation of shutting down the first service, and the sixth operation being after the fourth operation; in response to the sixth operation, recording the number of times the AON camera is used as a first parameter, and when the second parameter is not equal to the first threshold, the first interface is not powered off; receiving a seventh operation from the user, the seventh operation being an operation of shutting down the AON service, and the seventh operation being after the sixth operation; in response to the seventh operation, recording the number of times the AON camera is used as a third parameter, and when the third parameter is equal to the first threshold, the first interface is powered off.
[0028] In this way, when the electronic device first turns off the first service and then the AON service, the electronic device can determine based on the comparison between the third parameter and the first threshold that only the AON service currently uses the AON camera, and thus can directly power off the AON camera.
[0029] In one possible implementation, the sensor hub of the electronic device includes: an AON ISP, a camera power management module, and a second PMIC driver. The number of times the AON camera is used is recorded as a first parameter, and the first interface in the AON camera is powered on through the first PMIC, including: the AON ISP obtains the first interface from a second configuration file; the AON ISP sends a fourth message to the second PMIC driver along the camera power management module; in response to the fourth message, the camera power management module records the number of times the AON camera is used as the first parameter; in response to the fourth message, the second PMIC driver powers on the first interface.
[0030] In this way, the electronic device can control the power-on of the first interface on the sensor hub side. In addition, a camera power management module is added to the sensor hub side, so that the sensor hub can record the number of times the AON camera is used and maintain conflict scenarios when multiple services use the AON camera.
[0031] In a possible implementation, the first interface includes one or more of the following: an input / output voltage IOVDD interface, a digital voltage DVDD interface, an analog voltage AVDD interface, a reset signal RESET interface, or a main clock signal MCLK interface.
[0032] In a third aspect, an embodiment of the present application provides a control device for an electronic device. The control device for an electronic device may be an electronic device or a chip or chip system within the electronic device. The control device for an electronic device may include a receiving unit and a processing unit. The processing unit is configured to execute processing steps in the control device for the electronic device, and the receiving unit is configured to execute operation reception steps in the control device for the electronic device. When the control device for an electronic device is an electronic device, the processing unit may be a processor. The control device for an electronic device may further include a storage unit, which may be a memory. The storage unit is configured to store instructions, and the processing unit executes the instructions stored in the storage unit to cause the electronic device to implement a control method for an electronic device described in the first aspect or any possible implementation of the first aspect. When the control device for an electronic device is a chip or chip system within the electronic device, the processing unit may be a processor. The processing unit executes the instructions stored in the storage unit to cause the electronic device to implement a control method for an electronic device described in the first aspect or any possible implementation of the first aspect. The storage unit may be a storage unit within the chip (e.g., a register, a cache, etc.) or a storage unit within the electronic device located outside the chip (e.g., a read-only memory, a random access memory, etc.).
[0033] Specifically, at the first moment, the receiving unit is used to receive the user's first operation, wherein the first operation is a power-on operation; in response to the first operation, the processing unit is used to power on the first interface in the AON camera through the first PMIC; at the second moment, the receiving unit is also used to receive the user's second operation, wherein the second operation is an operation to start the AON service; in response to the second operation, the processing unit is also used to power on the second interface in the AON camera through the first PMIC, wherein the second moment is after the first moment; at the third moment, the processing unit is also used to power on the third interface in the AON camera, wherein the third moment is after the second moment, and the first interface includes: the second interface and the third interface.
[0034] In a fourth aspect, an embodiment of the present application provides an electronic device, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method described in the first aspect or any possible implementation of the first aspect, or execute the method described in the second aspect or any possible implementation of the second aspect.
[0035] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are run on an electronic device, the electronic device executes the method described in the first aspect or any possible implementation of the first aspect, or executes the method described in the second aspect or any possible implementation of the second aspect.
[0036] In a sixth aspect, an embodiment of the present application provides a computer program product comprising a computer program. When the computer program product comprises computer program code, when the computer program code runs on an electronic device, the electronic device executes the method described in the first aspect or any possible implementation of the first aspect, or executes the method described in the second aspect or any possible implementation of the second aspect.
[0037] In the seventh aspect, the present application provides a chip system, which is applied to an electronic device. The chip system includes one or more processors, and the one or more processors are used to call computer instructions to enable the electronic device to execute the method described in the first aspect or any possible implementation of the first aspect, or execute the method described in the second aspect or any possible implementation of the second aspect.
[0038] In one possible implementation, the chip system described above in this application further includes at least one memory, in which instructions are stored. The memory may be a storage unit within the chip system, such as a register, a cache, etc., or a storage unit of the chip system (e.g., a read-only memory, a random access memory, etc.).
[0039] It should be understood that the third to seventh aspects of this application correspond to the technical solutions of the first aspect (or second aspect) of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] FIG1 is a schematic diagram of an interface of an AON camera provided in an embodiment of the present application;
[0041] FIG2 is a schematic diagram of a scenario provided by an embodiment of the present application;
[0042] FIG3 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;
[0043] FIG4 is a schematic diagram of a software structure of an electronic device provided in an embodiment of the present application;
[0044] FIG5 is a schematic diagram of a software architecture for power supply management on the AP side provided in an embodiment of the present application;
[0045] FIG6 is a schematic diagram of module interaction of a control method for an electronic device provided in an embodiment of the present application;
[0046] FIG7 is a schematic diagram of module interaction of an AON camera for power-on verification provided by an embodiment of the present application;
[0047] FIG8 is a schematic diagram of a power-on duration provided in an embodiment of the present application;
[0048] FIG9 is a schematic diagram of module interaction of a power-off method provided in an embodiment of the present application;
[0049] FIG10 is a schematic diagram of a software architecture for power supply management on the sensor hub side provided in an embodiment of the present application;
[0050] FIG11 is a schematic diagram of module interaction of another electronic device control method provided by an embodiment of the present application;
[0051] FIG12 is a schematic diagram of an interface using an AON camera provided in an embodiment of the present application;
[0052] FIG13 is a schematic diagram of module interaction of another power-off method provided in an embodiment of the present application;
[0053] FIG14 is a schematic flow chart of a method for controlling an electronic device according to an embodiment of the present application;
[0054] FIG15 is a schematic diagram of the structure of a chip provided in an embodiment of the present application. DETAILED DESCRIPTION
[0055] To facilitate a clear description of the technical solutions of the embodiments of the present application, the following briefly introduces some of the terms and technologies involved in the embodiments of the present application:
[0056] 1. Power management integrated circuit (PMIC)
[0057] A PMIC can be understood as a chip used to manage power devices in a system. A PMIC integrates multiple power management functions, such as voltage regulation, current control, or power conversion. In embodiments of the present application, an electronic device can use a PMIC to manage the power of a camera.
[0058] The PMXXXX chip is a type of PMIC. The PMXXXX chip described in the embodiments of this application is a power management chip of a specific brand. XXXX can be composed of different numbers, letters, or other identifiers. Typically, an electronic device may include a PMXXXX chip and a first PMIC. The PMXXXX chip can control power management for the AON camera, while the first PMIC can control power management for other cameras.
[0059] It is understandable that the control logic of a specific power management chip (such as the PMXXXX chip) for power management of AON cameras is relatively fixed and cannot be adjusted to the actual needs of AON services, resulting in low applicability. In the embodiment of the present application, the first PMIC can be used to replace the PMXXXX, thereby improving the applicability of power management for AON cameras and reducing usage costs.
[0060] 2. AON Camera
[0061] An AON camera can be understood as a camera that can remain on for a long time. It can acquire images in real time and analyze them using algorithms to extract useful information.
[0062] The AON services described in the embodiments of this application are all implemented based on the AON camera. Among them, AON services may include one or more of the following: off-screen display service, staring at the screen without turning off the screen service, air gesture service, eye tracking service, or wrist scanning service, etc.
[0063] In conjunction with the description of the PMIC and AON camera, the PMIC establishes a connection between the AON camera and the power supply. This connection is achieved through circuitry. The PMIC's input is connected to the AON camera's power supply, while the PMIC's output is connected to various circuit components in the AON camera. The PMIC can control the AON camera's power on and off via commands.
[0064] 3. AON camera interface
[0065] In an embodiment of the present application, the interfaces of the AON camera may include: an IOVDD interface, an AVDD interface, a DVDD interface, a RESET interface, and an MCLK interface. In an electronic device, the relationship between each interface and the AON camera can be shown in Figure 1, which is a schematic diagram of the interface of an AON camera provided in an embodiment of the present application.
[0066] As shown in Figure 1, the electronic device may include: a power supply 1, a first PMIC, an AON camera, and a CPU. The power supply 1, the first PMIC, and the AON camera may be connected via an IOVDD interface, an AVDD interface, and a DVDD interface. It is understood that the IOVDD interface, the AVDD interface, and the DVDD interface may all be provided in the power supply 1, the first PMIC, and the AON camera.
[0067] The IOVDD interface, AVDD interface, and DVDD interface are all power supply interfaces in the AON camera.
[0068] Among them, IOVDD can power the integrated circuit bus (inter-integrated circuit, I2C) and other input / output (I / O) interfaces in the AON camera, AVDD can power the photosensor and analog-to-digital converter (analog-to-digital converter, ADC) in the AON camera, and DVDD can power the image signal processor (image signal processor, ISP) chip in the AON camera.
[0069] As shown in Figure 1, the AON camera and the CPU can establish a connection based on the RESET interface and the MCLK interface. It can be understood that the RESET interface and the MCLK interface can both be set in the AON camera and the CPU.
[0070] RESET can be understood as the reset signal of the AON camera, and MCLK can be understood as the master clock signal required by the AON camera. The CPU can control the state of the AON camera through the RESET interface and the MCLK interface.
[0071] The electronic device powering up the IOVDD interface can be understood as the process of the electronic device providing power to the IO interface in the AON camera. During the IOVDD interface powering up process, the PMIC can control the power supply 1 to provide a stable voltage to the IO interface in the AON camera.
[0072] Powering up the AVDD interface can be understood as the process by which the electronic device provides power to the analog circuits in the AON camera. During the AVDD interface powering-up process, the PMIC can provide a stable AVDD voltage to the analog circuits.
[0073] Powering up the DVDD interface can be understood as the process of providing power to the ISP, etc., in the AON camera. During the DVDD interface powering up process, the PMIC can control power supply 1 to provide a stable voltage 1 to the ISP, etc. For example, voltage 1 can be set to 0.95 volts (V) to 1.2V.
[0074] Powering up the RESET interface of an electronic device can be understood as the process of initiating a RESET signal to the AON camera via the CPU. During the RESET interface power-up process, the AON ISP can set the RESET signal to a high level to trigger the AON camera's reset operation. The RESET signal is used to restore the circuit to its initial state. For example, when the camera is started or an abnormality occurs, the RESET signal is activated, resetting the registers and state machine in the circuit to their initial state, ensuring that the camera can start and operate normally.
[0075] Powering up the MCLK interface on an electronic device can be understood as the process of sending an MCLK signal to the AON camera via the CPU. During the MCLK interface power-up process, the AON ISP can set the MCLK signal to a high level. The MCLK signal is used to control and synchronize various circuit operations. The MCLK signal ensures that circuits operate at the correct time, enabling various AON camera functions such as image acquisition, processing, and transmission.
[0076] 4. Other terms
[0077] In the embodiments of this application, terms such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. For example, the terms "first chip" and "second chip" are used solely to distinguish between different chips and do not define their order. Those skilled in the art will understand that terms such as "first" and "second" do not define the quantity or execution order, and do not necessarily define differences.
[0078] It should be noted that in the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0079] In the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.
[0080] 5. Electronic devices
[0081] The electronic devices of the embodiments of the present application may include handheld devices or vehicle-mounted devices with AON cameras. For example, some electronic devices include mobile phones, tablet computers, PDAs, laptop computers, mobile internet devices (MIDs), wearable devices, virtual reality (VR) devices, or augmented reality (AR) devices, but the embodiments of the present application are not limited thereto.
[0082] Electronic devices can also be wearable devices. Wearable devices can also be called wearable smart devices, such as glasses, gloves, watches, clothing, and shoes.
[0083] The electronic device in the embodiments of the present application may also be referred to as: terminal equipment, user equipment (UE), mobile station (MS), mobile terminal (MT), user terminal, or terminal, etc.
[0084] Below, the AON service is used as an example of the screen-on-screen service to schematically illustrate the process of starting the power supply of the AON camera. For example, Figure 2 is a schematic diagram of a scenario provided by an embodiment of the present application. In the embodiment corresponding to Figure 2, the electronic device is taken as an example of a mobile phone, which does not constitute a limitation on the embodiment of the present application.
[0085] In response to the user opening the setting interface of the staring at the screen service, the electronic device displays the interface shown in a of FIG. 2 , which may include: a button 101 for turning on the staring at the screen service.
[0086] In response to a user triggering button 101, the electronic device can obtain the interface corresponding to the AON camera and power on the interface corresponding to the AON camera through a specific power management chip. In addition, in response to the user triggering button 101, the electronic device displays the interface shown in Figure 2b, which may include one or more of the following: button 102 for disabling the "gaze screen without turning off" service, etc.
[0087] In response to the user's triggering operation on button 102, the electronic device can power down the interface corresponding to the AON camera through a specific power management chip, and the electronic device returns to the interface shown in a of FIG.
[0088] Typically, electronic devices use a specific power management chip to manage the power supply for the AON camera, and a first PMIC to manage the power supply for the rear camera. However, the control logic of the specific power management chip for AON camera power management is relatively fixed and cannot be adjusted to the actual needs of AON services, resulting in low applicability.
[0089] In view of this, an embodiment of the present application provides a control method for an electronic device, which can use a first PMIC to replace a specific power management chip to power an AON camera, thereby improving the applicability of power management for the AON camera and reducing costs. For example, in response to a power-on operation, the electronic device can control the first PMIC to power on interface 3 in the AON camera to achieve detection and identification of the AON camera. In response to the operation of starting the AON service, the electronic device can control the first PMIC on the AP side to power interface 1 in the AON camera, and then power interface 2 in the AON camera on the sensor hub side.
[0090] In this way, the electronic device uses the first PMIC on the AP side to power port 1 in the AON camera, ensuring that the power supply process is not affected by a specific power management chip, improving the applicability of the solution. Furthermore, the sensor hub powers port 2 in the AON camera, allowing the sensor hub to use port 2 to control the AON camera's low power consumption.
[0091] It can be understood that interface 3 includes interface 2 and interface 1. When the device is turned on, the power-on duration of interface 3 is the first duration. When the AON service is started, the duration from the start of powering on interface 1 to the completion of powering on interface 2 is the second duration. The second duration is less than the first duration.
[0092] In order to better understand the embodiments of the present application, the structure of the electronic device according to the embodiments of the present application is introduced below.
[0093] The electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, an indicator 192, a camera 193, and a display screen 194, etc.
[0094] In the embodiment of the present application, the sensor module 180 may include: a proximity light sensor and an ambient light sensor, and the proximity light sensor and the ambient light sensor can realize device status detection under the AON service.
[0095] The sensor module 180 may also include one or more of the following: a touch sensor, a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a temperature sensor, a touch sensor, or a bone conduction sensor (not shown in FIG3 ), which is not specifically limited in the embodiments of the present application.
[0096] It is understood that the structures illustrated in the embodiments of the present application do not constitute specific limitations on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0097] The processor 110 may include one or more processing units, and the processor 110 may implement the step of controlling the device to execute corresponding instructions in the control method of the electronic device provided in the embodiment of the present application.
[0098] The USB interface 130 is an interface that complies with USB standard specifications, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.
[0099] The charging management module 140 is used to receive charging input from a charger. The power management module 141 is used to connect the charging management module 140 and the processor 110 .
[0100] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.
[0101] The electronic device realizes the display function through the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor.
[0102] The display screen 194 is used to display images, videos, and the like.
[0103] The electronic device can realize the shooting function through the ISP, camera 193, video codec, GPU, display 194 and application processor.
[0104] The camera 193 is used to capture still images or videos. The camera 193 may include the AON camera described in the embodiments of the present application, a rear camera, etc. The camera 193 is connected to the first PMIC.
[0105] The external memory interface 120 may be used to connect an external memory card.
[0106] The internal memory 121 may be used to store computer executable program codes, where the executable program codes include instructions.
[0107] The electronic device can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0108] The touch sensor can be set on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, or a "touch screen".
[0109] The buttons 190 include a power button, a volume button, and the like.
[0110] The software system of the electronic device can adopt a layered architecture, event-driven architecture, micro-kernel architecture, microservice architecture, or cloud architecture, etc., which will not be described here.
[0111] For example, Figure 4 is a schematic diagram of the software structure of an electronic device provided in an embodiment of the present application. As shown in Figure 4, the layered architecture divides the software into several layers, each with clear roles and divisions of labor. The layers communicate with each other through software interfaces.
[0112] In some embodiments, the Android system is divided into multiple layers, including, from top to bottom, the application (APP) layer, the application framework (FWK) layer, the hardware abstraction layer (HAL), and the kernel layer, etc., which is not limited in the embodiments of the present application.
[0113] The application layer may include a series of application packages. The application layer may include one or more of the following: AON application, camera application, or social application, etc., which is not limited in the embodiments of the present application.
[0114] AON applications can be understood as applications that perform AON services. For example, AON applications may include one or more of the following: screen-off display applications, screen-keeping applications, air gesture applications, eye tracking applications, or wrist-flip scanning applications, etc.
[0115] The camera application can support functions such as taking photos and recording videos. For example, a user can use the rear camera or the front camera to take photos or record videos.
[0116] Social applications can provide functions such as voice chat or video chat. For example, in a scenario where a user uses the video chat function, the user can use the front-facing AON camera to make a video.
[0117] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer.
[0118] The application framework layer includes some predefined interfaces. The application framework layer can include one or more of the following: intelligent perception center, camera service module, etc.
[0119] The smart perception middle platform can forward messages received from the AON application to the smart perception service module, or forward messages received from the smart perception service module to the AON application.
[0120] The camera service module may implement sending a message for using the camera to the camera provision module. The message for using the camera may be the message described in S1110 .
[0121] In a possible implementation, the FWK layer may further include a display compositor, a window manager, a content provider, a resource manager, a view system, or a notification manager (not shown in FIG. 4 ).
[0122] The purpose of the hardware abstraction layer is to abstract the hardware, providing a unified interface for querying hardware devices for upper-layer applications, or providing data storage services for upper-layer applications.
[0123] The hardware abstraction layer may include one or more of the following: an intelligent perception service module, or a camera supply module.
[0124] The Smart Perception Service Module is used to process AON services in electronic devices. For example, upon detecting a subscription message, the Smart Perception Service Module can send a subscription message to QMI and a message to the MISC device management module to power on the AON camera. Upon detecting a cancellation message, the Smart Perception Service Module can send a cancellation message to QMI and a message to the MISC device management module to power off the AON camera.
[0125] The smart perception service module may include one or more of the following: a message subscription module or a message unsubscription module. The message subscription module can be used to initiate a subscription message, and the message unsubscription module can be used to initiate an unsubscription message.
[0126] The camera provisioning module may be configured to forward messages received from the camera service module to a message interface (Qualcomm Messaging Interface, QMI).
[0127] The camera provisioning module may include one or more of the following: a camera management module and a camera capability configuration module. The camera management module may be used to store camera hardware information connected to the electronic device, and the camera capability configuration module may be used to store camera capability information. The capability information may include parameters describing camera performance and functions.
[0128] The kernel layer is the layer between hardware and software. It drives the hardware and enables it to function. It can include one or more of the following: QMI, camera driver 1, device tree, regulator framework, miscellaneous (MISC) device management module, PMIC driver, or camera driver 2.
[0129] QMI, also known as Qualcomm Modem Interface or Qualcomm MSM Interface, is a multiprocessor inter-process communication interface. It serves as an interface for inter-core communication between application processors (APs) and coprocessors (CPs). QMI transfers data via a shared memory driver (SMD). The SMD operates on shared memory (SMEM) to implement physical shared memory operations. Alternatively, the SMD can be understood as using SMEM to transfer messages and data between different processors or processing cores.
[0130] Camera driver 1 manages the operation of the AON camera. In this embodiment, camera driver 1 is a newly added module, and the electronic device uses camera driver 1 to independently manage the power supply of the AON camera. For example, upon receiving a message indicating that the AON camera should be powered on, camera driver 1 can obtain the AON camera's power interface from the device tree and power the AON camera by calling the regulator framework and PMIC driver.
[0131] The device tree can be understood as a data structure that describes the hardware configuration and is used to describe the configuration and properties of the hardware device. In this embodiment of the application, the device tree may include interface information for powering the AON camera (such as interface information for interface 1), as described in S603.
[0132] The MISC device management module is used to forward messages received from the intelligent perception service module to the camera driver 1, or forward messages received from the camera driver 1 to the intelligent perception service module.
[0133] The regulator framework is used to manage power supplies. The regulator framework provides a mechanism that allows the core to regulate individual power outputs.
[0134] The PMIC driver is used to control and regulate the first PMIC and is responsible for managing the power supply of the AON camera.
[0135] The camera driver 2 can be used to perform camera detection or power supply detection on any camera in the electronic device when the device is powered on, as described in Figure 7. Alternatively, the camera driver 2 can also be used to manage the operation of other cameras besides the AON camera.
[0136] It can be understood that the HAL layer and the kernel layer can communicate with each other through QMI.
[0137] The hardware layer may include one or more of the following: a camera module, etc. The camera module may include an AON camera, which may be used to collect image information and transmit the image information to the sensor hub for image processing.
[0138] In a possible implementation, the electronic device may further include: a sensor hub. As a coprocessor, the sensor hub can realize communication with the HAL layer, the kernel layer, and the hardware layer. It can be understood that the sensor hub is a solution that combines software and hardware based on a low-power and lightweight operating system. Its main function is to connect and process data from various sensor devices to achieve low-power state recognition and return the recognition results to the kernel layer. For example, the sensor hub can obtain sensor data and determine to power off the AON camera in advance by analyzing the sensor data. In this way, the sensor hub can identify that the current low-power scenario should be based on the sensor data, and then achieve the purpose of saving power by powering off the camera. The specific process can be found in the description in S616.
[0139] The sensor hub can include one or more of the following: AON ISP. The AON ISP can control the PMIC driver to execute the power supply strategy. The AON ISP can also be used to process image data obtained from the camera module to improve image quality.
[0140] In a possible implementation, the sensor hub may also include a camera power management module. The camera power management module can record the number of times the camera is used and control the camera power-off process based on the number of times the camera is used. For example, the camera power management module can power off the AON camera when it detects that the AON camera is not in use, as described in Figure 13.
[0141] In a possible implementation, the sensor hub may also include a PMIC driver. The function of the PMIC driver can be found in the description of the PMIC driver in the kernel layer and will not be repeated here.
[0142] It is understandable that the embodiments of the present application do not specifically limit the software layers involved in the software architecture, the modules included in the software layers, and the functions of the modules.
[0143] In conjunction with the description of the software architecture in FIG4 , the following describes in detail the technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems using specific embodiments. The following specific embodiments can be implemented independently or in combination with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.
[0144] In an embodiment of the present application, two control methods of electronic devices are provided, including: the electronic device manages the power supply of the AON camera through the first PMIC on the AP side (see the description of scenario one), and the electronic device manages the power supply of the AON camera through the first PMIC on the sensor hub side (see the description of scenario two).
[0145] Scenario 1: The electronic device manages the power supply of the AON camera through the first PMIC on the AP side.
[0146] Figure 5 is a schematic diagram of a software architecture for power management on the AP side provided in an embodiment of the present application. In the embodiment corresponding to Figure 5, the electronic device may include one or more of the following: an AON application, a smart perception middle platform, a smart perception service module, a MISC device management module, a camera driver 1, QMI, an AON ISP, a regulator framework, a PMIC driver, or a camera module. The smart perception service module includes: a message subscription module and a message unsubscription module.
[0147] Among them, the regulator framework and PMIC driver can be set in the AP side power driver of the core layer, and the AP side power driver is used to perform power management for the AON camera on the AP side.
[0148] In one implementation, after the intelligent perception service module senses that the AON service has been started, the intelligent perception service module can send a power-on message (such as the message instructing the AON camera to be powered on in S602) along the MISC device management module to the camera driver 1. The camera driver 1 can obtain all interfaces required to power on the AON camera (such as interface 3), and then instruct the AP-side power driver to power on all interfaces.
[0149] In another implementation, after the intelligent perception service module senses that the AON service is started, the intelligent perception service module can send a power-on message to the camera driver 1 along the MISC device management module. The camera driver 1 can obtain some interfaces (such as interface 1) required to power on the AON camera. The electronic device instructs the AP-side power driver to power on some interfaces of the AON camera on the AP side. And the electronic device instructs the AON ISP to power on another part of the interface (such as interface 2) of the AON camera on the sensor hub side. For the specific power-on process, please refer to the description in Figure 6.
[0150] The interface 3 includes: interface 2 and interface 1. The interface conditions of interface 1 and interface 2 can be referred to the description in FIG6 , and the interface conditions of interface 3 can be referred to the description in FIG7 .
[0151] Based on the software architecture described in Figure 5, the electronic device can power on the AON camera when starting the AON service (see the description in Figure 6), or it can perform power supply detection on the AON camera when the device is turned on (see the description in Figure 7), or it can power off the AON camera when turning off the AON service (see the description in Figure 9).
[0152] For example, FIG6 is a schematic diagram of module interaction of a control method for an electronic device provided in an embodiment of the present application. The modules included in FIG6 can be referred to the description in FIG5 and will not be repeated here.
[0153] As shown in FIG6 , the control method of the electronic device may include the following steps:
[0154] S601: In response to a user starting an AON service, the smart perception service module obtains subscription messages from the AON application.
[0155] The subscription message is used to subscribe to the AON service. The subscription message may include the AON camera identifier and the AON service identifier. It is understood that before the electronic device subscribes to the AON service based on the subscription message, the electronic device may power on the AON camera to ensure normal operation of the AON service after subscription.
[0156] When the AON service is a screen-watching service, the operation of starting the AON service may be: a user triggering operation on the button 101 in the interface shown in a of FIG. 2 .
[0157] For example, in response to the user's operation of starting the AON service, the AON application can send a subscription message to the smart perception middle platform, and the smart perception middle platform sends the subscription message to the smart perception service module.
[0158] After the AON service is started, the electronic device can control interface 1 to be powered on based on S602 - S606 , and then control interface 2 to be powered on based on S607 - S611 .
[0159] In a possible implementation, the smart perception service module can set a delay time, such as 1 second, for received subscription messages. For example, the smart perception service module can receive a subscription message and, after determining that the subscription message waiting time has reached the delay time, send the subscription message via the QMI to the AON ISP. The AON ISP can then execute steps S608-S610. In this scenario, the electronic device can power on interface 1 within 1 second before the subscription message is sent to the AON ISP, and power on interface 2 one second later based on the subscription message.
[0160] S602: The camera driver 1 obtains a message from the intelligent perception service module for instructing to power on the AON camera.
[0161] The message for instructing to power on the AON camera includes: an identifier of the AON camera.
[0162] For example, when the MISC device management module pre-turns on node 1, the camera driver 1 can send a message to the MISC device management module to instruct the AON camera to be powered on, and the MISC device management module can send a message to the camera driver 1 to instruct the AON camera to be powered on based on node 1.
[0163] S603 : The camera driver 1 determines from the device tree the interface 1 required when the AON camera is powered on.
[0164] The device tree is used to describe the hardware configuration of the device so that the operating system can correctly configure and drive the device. For example, the camera driver 1 can obtain the hardware configuration of the AON camera, such as the interface information of the AON camera, from the device tree based on the AON camera identifier.
[0165] The interface information of the AON camera may include: interface 1, a power-on sequence of interface 1, a power-off sequence of interface 1, a power-on time interval of interface 1, and a power-off time interval of interface 1.
[0166] Interface 1 may include: IOVDD interface, AVDD interface, DVDD interface. IOVDD interface, AVDD interface, and DVDD interface can all be understood as power supply interfaces for the AON camera. For example, the content contained in the device tree may be as follows:
[0167] cam_vio_supply = <&L5N>; / / IOVDD interface corresponds to LDO5 interface in the first PMIC
[0168] cam_vdig_supply = <&L2N>; / / DVDD interface corresponds to LDO2 interface in the first PMIC
[0169] cam_vana_supply = <&L3N>; / / AVDD interface corresponds to the LDO3 interface in the first PMIC
[0170] power_on_sequence = "iovdd", "avdd", "dvdd"; / / Power-on sequence for port 1
[0171] power_on_delay = <1,1,1>; / / Interface 1 power-on time interval, the time interval can be 1 millisecond
[0172] power_off_sequence = "dvdd", "avdd", "iovdd"; / / Power-off sequence of interface 1
[0173] power_off_delay = <0,0,0>; / / Power-off time interval of interface 1
[0174] It is understood that the device tree can be pre-configured in the kernel layer for easy access by camera driver 1. For different AON cameras, the device tree can include other interfaces besides interface 1, such as the voice coil motor voltage (VCMVDD) interface or the optical image stabilization voltage (OISVDD) interface. The VCMVDD interface can be understood as the interface that powers the camera's focus motor, and the OISVDD interface can be understood as the interface that powers the camera's optical image stabilization module.
[0175] In a possible implementation, interface 1 may also include: an IOVDD interface, an AVDD interface, a DVDD interface, a RESET interface, and an MCLK interface. In this case, the electronic device can perform power management on all interfaces in the AON camera at the AP side.
[0176] S604 : The PMIC driver obtains a message from the camera driver 1 for instructing to power on the interface 1 .
[0177] The message for instructing to power on the interface 1 may include: the interface 1, the power-on sequence of the interface 1, the power-on time interval of the interface 1, and the like.
[0178] For example, camera driver 1 can send a message to the regulator framework to instruct interface 1 to be powered on. The regulator framework then sends the message to the PMIC driver to instruct interface 1 to be powered on. The PMIC driver can register a low dropout regulator (LDO) structure with the regulator framework and set the voltage value of interface 1. The voltage value of interface 1 may include the voltage corresponding to IOVDD, the voltage corresponding to AVDD, and the voltage corresponding to DVDD.
[0179] S605 : The PMIC driver powers on interface 1 .
[0180] S606. The intelligent perception service module obtains response message 1 from the PMIC driver.
[0181] Response message 1 is used to indicate that the power-on of interface 1 in the AON camera is complete. For example, when the PMIC driver determines that the power-on of interface 1 is complete, the response message 1 is returned to the intelligent perception service module via the camera driver 1 and the MISC device management module.
[0182] It can be understood that the electronic device can power the power supply interface of the AON camera on the AP side through S602-S606. The power supply process is not limited to a specific power management chip, and can thus be widely used in electronic devices using the first PMIC.
[0183] S607 . In response to the response message 1 , the AON ISP obtains a subscription message from the smart perception service module.
[0184] For example, when the smart perception service module receives the response message 1, the smart perception service module may initiate a subscription message and send the subscription message to the AON ISP via the QMI. After the AON ISP receives the subscription message, the AON ISP may execute S608-S610.
[0185] S608 , in response to the subscription message, the AON ISP determines the interface 2 required for powering up the AON camera from the utilization configuration file 1 .
[0186] Configuration file 1 may be a pre-compiled PB file. Configuration file 1 may include: interface 2, the power-on sequence of interface 2, the power-off sequence of interface 2, the power-on interval of interface 2, and the power-off interval of interface 2. Interface 2 may include at least one control signal interface, such as a RESET interface and / or an MCLK interface.
[0187] For example, in configuration file 1, the power-on information for interface 2 may include: configType = RESET, configValue = 1, delayMs = 5, etc.; configType = MCLK; configValue = 19000000 Hz (Hz); delayMs = 1 millisecond (ms). configValue = 1 can be understood as a pull-up, configValue = 19000000 Hz can be understood as the clock frequency, and delayMs can be understood as the delay time. The power-on sequence can be: RESET, then MCLK. It is understood that the power-off information for interface 2 can be similar to the power-on information described above and will not be repeated here.
[0188] It is understood that in a solution where a specific power management chip is used to power an AON camera, configuration file 1 may include settings for the IOVDD interface, AVDD interface, DVDD interface, RESET interface, and MCLK interface. In this embodiment of the present application, the specific power management chip may be replaced with the first PMIC, and the IOVDD interface, AVDD interface, and DVDD interface used to power the AON camera may be configured in the device tree. Only the settings for the RESET interface and MCLK interface may be retained in configuration file 1.
[0189] Alternatively, the embodiment of the present application can also configure the settings of the IOVDD interface, AVDD interface, DVDD interface, RESET interface and MCLK interface into the device tree. In this case, the interface can be set in configuration file 1, that is, the electronic device does not need to execute S608-S609, and this is not limited in the embodiment of the present application.
[0190] S609: AON ISP powers on interface 2.
[0191] S610: When the interface 2 is powered on, the AON ISP subscribes to the AON service.
[0192] It can be understood that when an AON ISP subscribes to the AON service, it establishes a connection between the Smart Perception Service Module, QMI, and the AON ISP. Subsequently, when the AON ISP receives image information from the AON camera, it can return the image information to the Smart Perception Service Module via QMI. The Smart Perception Service Module then recognizes the image information and returns the recognition result to the AON application.
[0193] S611. The intelligent perception service module obtains response message 2 from the AON ISP.
[0194] Response message 2 is used to indicate that the AON service subscription is completed.
[0195] It is understood that the electronic device can complete the power supply for the AON camera based on S601-S611. When the AON camera is powered, the electronic device can perform AON services based on the image information acquired in real time by the AON camera, as described in S612-S615 below.
[0196] S612: When image information is detected, the intelligent perception service module obtains the image information from the camera module.
[0197] S613. The intelligent perception service module identifies the AON instruction corresponding to the image information.
[0198] In conjunction with the "attention screen without turning off the screen" service described in Figure 2, an example of the AON instruction corresponding to the image information is provided. For example, when the intelligent perception service module determines based on the image information that the user is looking at the screen, the intelligent perception service module can generate an AON instruction, in which case the AON instruction is used to increase the screen brightness. Alternatively, when the intelligent perception service module determines based on the image information that the user is not looking at the screen, the intelligent perception service module can generate an AON instruction, in which case the AON instruction is used to reduce the screen brightness.
[0199] It is understandable that in different business scenarios, electronic devices can also generate different AON instructions based on different image information. The specific meaning of the AON instruction is not limited in the embodiments of the present application.
[0200] S614. The AON application obtains the AON instruction from the smart perception service module.
[0201] S615 : In response to the AON instruction, the AON application executes the AON service.
[0202] In a possible implementation, S616 , in response to the message of sleeping the AON, the AON ISP powers off the interface 2 .
[0203] For example, when the sensor hub determines to put the AON camera to sleep based on sensor data such as ambient light data and / or proximity light data, it can send a message to the AON ISP to instruct the AON camera to sleep, and the AON ISP can power off interface 2 to save power. In this scenario, since interface 1 is controlled on the AP side, interface 1 is always powered on. It can be understood that in this scenario, the ambient light data can be less than or equal to the ambient light threshold when the device is in sleep mode, and the proximity light data can be greater than or equal to the proximity light value when the device is in sleep mode.
[0204] Furthermore, when the sensor hub determines to wake up the AON camera based on sensor data such as ambient light data and / or proximity light data, it may also send a message to the AON ISP to instruct it to wake up the AON camera, and the AON ISP may power on interface 2. It is understood that in this scenario, the ambient light data may be greater than the ambient light threshold when the device is in sleep mode, and the proximity light data may be less than the proximity light value when the device is in sleep mode.
[0205] Based on the description of S616 , it can be understood that since the sensor hub can identify the status of the electronic device based on sensor data, etc., setting the interface 2 on the sensor hub side can facilitate low-power control of the AON camera.
[0206] It is understood that the control method of the electronic device provided in the embodiment of the present application is not limited to the influence of a specific brand of power management chip. By establishing a new data path, power management of the AON camera based on the first PMIC is achieved.
[0207] Before S601 , the electronic device may perform a power supply test on the AON camera and a device capability test on the AON camera when the device is turned on, so as to ensure the normal operation of the AON camera.
[0208] For example, Figure 7 is a schematic diagram of module interaction for a power-on verification AON camera provided in an embodiment of the present application. In the embodiment corresponding to Figure 7, the electronic device may include one or more of the following: a camera supply module, a camera driver 2, a regulator framework, a PMIC driver, or a camera module.
[0209] It can be understood that when the electronic device detects that the power is turned on, it can execute the power-on and power-off processes for the AON camera (see the description in S701-S706 for the power-on process, and see the description in S710-S715 for the power-off process), as well as the AON camera capability detection process (see the description in S707-S709) to ensure the normal operation of the AON camera.
[0210] S701: In response to a device power-on operation, the camera supply module determines that the AON camera is powered on.
[0211] The camera supply module can determine the cameras in the electronic device through the camera management module and perform the following power supply detection and capability detection process for each camera. The following uses the AON camera as an example to illustrate the power supply detection and capability detection process of the AON camera.
[0212] S702: The camera driver 2 obtains a message for instructing to power on the AON camera from the camera supply module.
[0213] S703 : Determine the interface 3 required for powering on the AON camera from the configuration file 2 .
[0214] Configuration file 2 may be a pre-compiled BIN file, which includes all interfaces in the AON camera.
[0215] Configuration file 2 may include: interface 3, the power-on sequence of interface 3, the power-off sequence of interface 3, the power-on time interval of interface 3, and the power-off time interval of interface 3. Interface 3 may include: IOVDD interface, AVDD interface, DVDD interface, RESET interface, and MCLK interface.
[0216] For example, in configuration file 2, the power-on information for interface 3 may include: configType = RESET, configValue = 1, delayMs = 5; configType = MCLK, configValue = 19000000, delayMs = 1; configType = IOVDD, configValue = 1, delayMs = 1; configType = AVDD, configValue = 1, delayMs = 1; configType = DVDD, configValue = 1, delayMs = 1. The power-on order may be: RESET, MCLK, IOVDD, AVDD, DVDD. It is understood that the power-off information for interface 3 may be similar to the power-on information for interface 3 and will not be further described here.
[0217] It can be understood that interface 3 includes interface 1 and interface 2, that is, the electronic device can power on all interfaces of the AON camera when it is turned on.
[0218] S704 : The PMIC driver obtains a message from the camera driver 2 for instructing to power on the interface 3 .
[0219] For example, the camera driver 2 may send a message to the regulator framework for instructing to power on the interface 3, and the regulator framework may power on the interface 3 through the PMIC driver. The process of powering on the electronic device based on the regulator framework and the PMIC driver can be referred to the description in S604 and will not be repeated here.
[0220] S705 : The PMIC driver powers on interface 3 .
[0221] S706 : The camera supply module obtains a response message 3 from the PMIC driver.
[0222] The response message 3 is used to indicate that the power-on of the interface 3 in the AON camera is completed. For example, the PMIC driver may return the response message 3 to the camera supply module via the camera driver 2 .
[0223] It is understandable that after the AON camera is powered on, the electronic device can perform a capability test on the AON camera based on S707 to S709.
[0224] S707: The camera module obtains information for detecting the AON camera from the camera supply module.
[0225] The message for detecting the AON camera may include: the identifier of the AON camera. For example, the camera supply module may send the message for detecting the AON camera to the camera driver 2, and the camera driver 2 may send the message for detecting the AON camera to the camera module.
[0226] S708: The camera module reads the camera register, verifies whether the AON camera exists, and obtains the capability information of the AON camera.
[0227] In response to the message indicating camera detection, the camera module can read the camera register based on the AON camera identifier and obtain the camera parameters from the camera register (e.g., obtaining the camera parameters based on the AON camera identifier) to identify whether the camera is an AON camera. In addition, the camera module reads the capability information of the AON camera in the camera register. The capability information may include one or more of the following: image resolution, frame rate, image format, lens parameters, etc. supported by the camera.
[0228] S709: The camera supply module obtains capability information from the camera module.
[0229] For example, the camera module can send capability information to the camera driver 2, which can return the capability information to the camera provisioning module. The camera provisioning module can then store the capability information reported by the camera module in the camera capability configuration module for subsequent use.
[0230] S710: The camera supply module determines that the AON camera is powered off.
[0231] S711 . The camera driver 2 obtains a message from the camera supply module indicating that the AON camera should be powered off.
[0232] S712: The camera driver 2 determines the interface 3 required for powering off the AON camera.
[0233] It is understandable that the camera driver 2 can execute the power-off process for the interface 3 based on the configuration in the configuration file 2 .
[0234] S713 : The PMIC driver obtains a message from the camera driver 2 for instructing to power off the interface 3 .
[0235] S714, the PMIC driver powers off port 3.
[0236] S715 : The camera supply module obtains a response message 4 from the PMIC driver.
[0237] Response message 4 is used to indicate that the AON camera is powered off. For example, the PMIC driver may return response message 4 to the camera supply module via the camera driver 2.
[0238] It is understandable that the power-off process described in S710-S715 may be similar to the power-on process described in S701-S706, and the specific process will not be repeated here.
[0239] Based on this, when the electronic device is turned on, the electronic device can perform power-on detection on all interfaces in the AON camera at one time to ensure the availability of the camera.
[0240] 6 and 7 , the power-on duration of the AON camera in the power-on detection phase is shorter than the power-on duration of the AON camera in the AON service activation phase.
[0241] For example, FIG8 is a schematic diagram of a power-on duration provided in an embodiment of the present application.
[0242] During the device startup phase, the electronic device may sequentially power the five interfaces in interface 3 based on S705 at time 1 and complete the power supply at time 2. The total power supply duration may be duration 1.
[0243] During the AON service activation phase, the electronic device can sequentially power the three interfaces in interface 1 based on step S605 at time 3. After powering interface 1, the electronic device can sequentially power the two interfaces in interface 2 based on step S609, and complete powering interface 2 at time 4. That is, the total power supply duration from the start of powering interface 1 to the completion of powering interface 2 can be duration 2.
[0244] It is understandable that the electronic device can first power interface 1, and power interface 2 after interface 1 is powered. There are steps such as S606-S608 between interface 1 and interface 2, which results in the duration of powering all interfaces of the camera AON being prolonged. Alternatively, the delayed sending time carried in the subscription message (as described in S601) will also cause the duration of powering all interfaces of the camera AON to be prolonged. Therefore, the power supply duration of the AON camera in the device startup phase (such as duration 1) is less than the power supply duration of the AON camera in the AON service startup phase (such as duration 2).
[0245] When the AON camera is powered on based on the embodiment corresponding to FIG6 , the electronic device can power off the AON camera when the AON service is turned off. FIG9 is a module interaction diagram of a power-off method provided in an embodiment of the present application.
[0246] As shown in FIG9 , the power-off method may include the following steps:
[0247] S901. In response to the user's operation of closing the AON service, the intelligent perception service module obtains a subscription cancellation message from the AON application.
[0248] When the AON service is a screen-watching service, the operation of closing the AON service may be: a user triggering operation on the button 102 in the interface shown in b of FIG. 2 .
[0249] For example, in response to the user's operation of closing the AON service, the AON application can send a cancellation message to the smart perception middle station, and the smart perception middle station sends the cancellation message to the smart perception service module.
[0250] After the AON service is closed, the electronic device can control interface 1 to be powered off based on S902 to S906, and then control interface 2 to be powered off based on S907 to S911.
[0251] In a possible implementation, the smart perception service module can set a delayed sending time (such as 1 second) for the received unsubscribe message, so that the unsubscribe message can be sent to the AON ISP along the QMI after the delayed sending time is reached.
[0252] S902. The camera driver 1 obtains a message from the intelligent perception service module indicating that the AON camera should be powered off.
[0253] For example, the camera driver 1 may send a message for instructing to power off the AON camera to the MISC device management module, and the MISC device management module may send a message for instructing to power off the AON camera to the camera driver 1 based on the node 1 .
[0254] S903: The camera driver 1 determines the interface 1 required when the AON camera is powered off.
[0255] The meaning of interface 1 can refer to the description in S603.
[0256] In a possible implementation, when interface 1 includes an IOVDD interface, an AVDD interface, a DVDD interface, a RESET interface, and an MCLK interface, the electronic device can also power off all interfaces in the AON camera based on the steps shown in S903-S906.
[0257] S904 : The PMIC driver obtains a message from the camera driver 1 , indicating that the interface 1 should be powered off.
[0258] The message for instructing to power off the interface 1 may include: the interface 1, the power-off sequence of the interface 1, the power-off time interval of the interface 1, and the like.
[0259] For example, camera driver 1 may send a message to the regulator framework to instruct interface 1 to be powered off. The regulator framework then powers off interface 1 through the PMIC driver. The power-off process of the electronic device based on the regulator framework and the PMIC driver is similar to the power-on process described in S604 and is not further described here.
[0260] S905: The PMIC driver powers off interface 1.
[0261] S906. The intelligent perception service module obtains a response message 5 from the PMIC driver.
[0262] Response message 5 is used to indicate that the power-off of interface 1 in the AON camera is complete. For example, when the PMIC driver determines that the power-off of interface 1 is complete, it can return response message 5 to the smart perception service module via camera driver 1 and MISC device management module.
[0263] S907. AON ISP obtains a subscription cancellation message from the intelligent perception service module.
[0264] The unsubscribe message may include the identifier of the AON service. For example, when the intelligent sensing service module receives response message 5, the intelligent sensing service module may initiate a unsubscribe message and send the unsubscribe message to the AON ISP via QMI. After the AON ISP receives the unsubscribe message, it may execute S908-S910.
[0265] S908 . In response to the unsubscribe message, the AON ISP determines the interface 2 required for powering off the AON camera from the utilization profile 1 .
[0266] S909, AON ISP powers off interface 2.
[0267] S910 : When the power-off of interface 2 is completed, the AON ISP cancels the subscription to the AON service.
[0268] It is understandable that when an AON ISP cancels its subscription to the AON service, it is equivalent to destroying the path between the intelligent perception service module, QMI, and the AON ISP.
[0269] S911. The intelligent perception service module obtains a response message 6 from the AON ISP.
[0270] Response message 6 is used to indicate that the AON service subscription cancellation is complete.
[0271] 6 and 9 , similarly, the power-off duration of the AON camera in the power-on detection phase is shorter than the power-off duration of the AON camera in the AON service shutdown phase.
[0272] Scenario 2: The electronic device manages the power supply of the AON camera through the first PMIC on the sensor hub side.
[0273] Figure 10 is a schematic diagram of a software architecture for power management on the sensor hub side, provided in an embodiment of the present application. In the embodiment corresponding to Figure 10, the electronic device may include one or more of the following: a social application, an AON application, a smart perception middleware, a camera service module, a camera supply module, a smart perception service module, QMI, a camera driver 2, an AON ISP, a regulator framework, a camera supply management module, or a PMIC driver. The smart perception service module includes a message subscription module and a message unsubscription module.
[0274] Among them, the camera power management module and the PMIC driver can be set in the sensor hub side power driver on the sensor hub side, and the sensor hub side power driver is used to manage the power of the AON camera on the sensor hub side.
[0275] For example, after the intelligent sensing service module detects the start of the AON service, it can send a subscription message along the QMI to the AON ISP. The AON ISP can obtain all interfaces required to power up the AON camera (such as interface 3) and then instruct the sensor hub side power driver to power up all interfaces. The specific power-up process can be seen in the description of Figure 11.
[0276] In a possible implementation, the camera power management module can implement the management of the number of times the AON camera is used. After the power driver on the sensor hub side powers on interface 3, the camera power management module can record the number of times the AON camera is used as number 1 (or understood as the number of businesses using the AON camera as number 1). When the electronic device detects that the user is using the AON camera in other applications (such as social applications), the social application can notify the camera power management module along the camera service module, the camera supply module and the QMI to use the AON camera, and the camera power management module can record the number of times the AON camera is used as number 2 (or understood as the number of businesses using the AON camera as number 2). In this way, by recording the number of times the AON camera is used, it can be avoided that the electronic device powers off the AON camera when the AON business is turned off, resulting in other applications being unable to continue to use the AON camera. The specific conflict scenario for shutting down the AON business can be seen in the description in Figure 13.
[0277] In a possible implementation, when the electronic device detects that a user is using the rear camera to perform video operations in a social application, the social application can also notify the camera driver 2 along the camera service module and the camera supply module to power the rear camera, and then the camera driver 2 instructs the regulator framework to power the rear camera.
[0278] Based on the software architecture described in FIG10 , the electronic device can power on the AON camera when starting the AON service (see the description in FIG11 ), and can also power off the AON camera when shutting down the AON service (see the description in FIG13 ).
[0279] For example, Figure 11 is a schematic diagram of module interaction of another electronic device control method provided by an embodiment of the present application. The modules included in Figure 11 can be found in the description of Figure 10 and will not be repeated here.
[0280] As shown in FIG11 , the control method of the electronic device may include the following steps:
[0281] S1101. In response to a user starting an AON service, the intelligent perception service module obtains a subscription message from the AON application.
[0282] S1102. AON ISP obtains subscription information from the intelligent perception service module.
[0283] S1103 : AON ISP determines, from configuration file 3 , interface 3 required when the AON camera is powered on.
[0284] The content included in configuration file 3 may be the same as the content included in configuration file 2. Please refer to the description in S703 and will not be repeated here.
[0285] S1104 : The camera power management module obtains a message from the AON ISP for instructing to power on the interface 3 .
[0286] S1105 . The camera power management module records the number of times the AON camera is used as number 1.
[0287] The value of times 1 may be 1. When times 1 is 1, it can be understood that the AON camera has been used once, or that there is currently one business using the AON camera.
[0288] S1106 : The PMIC driver obtains a message from the camera power management module indicating that the interface 3 is powered on.
[0289] S1107 , the PMIC driver powers on interface 3.
[0290] S1108. The AON ISP subscribes to the AON service.
[0291] S1109. The intelligent perception service module obtains a response message 7 from the AON ISP.
[0292] Response message 7 is used to indicate that the AON service subscription is completed.
[0293] After S1109 , the electronic device may also detect image information based on the steps shown in S612 - S615 , and generate an AON instruction based on the image information. The specific process will not be repeated here.
[0294] S1110 : In response to an operation of using the AON camera, the camera power management module obtains a message instructing to turn on the AON camera from a social application.
[0295] Taking social applications as an example, the operation of using the AON camera can be: an operation for using the AON camera to make a video, or an operation for using the AON camera to take a photo, etc.
[0296] For example, in response to an operation using the AON camera, the social application may send a message for turning on the AON camera along the camera service module, the camera supply module, and the QMI to the camera power management module.
[0297] In a possible implementation, when the camera provisioning module detects a message indicating that the AON camera should be turned on, the camera provisioning module can power on the AON camera using the camera driver 2 and the regulator framework. Since the AON camera is already powered on, the electronic device does not need to perform the power-on process again.
[0298] S1111. The camera power management module records the number of times the AON camera is used as number 2.
[0299] The value of times 2 may be 2. Times 2 being 2 may be understood to mean that the AON camera has been used twice, or that two businesses are currently using the AON camera.
[0300] After S1111, the electronic device can collect real-time images based on the AON camera and display them in the social application. For example, Figure 12 is a schematic diagram of an interface using an AON camera provided in an embodiment of the present application. In a scenario where a user uses an AON camera for video, the electronic device can display an interface as shown in Figure 12, which may include: window 1201, which may include video content acquired based on the AON camera.
[0301] It is understood that the AON camera can be a device that supports time-sharing multiplexing. For example, when an electronic device needs to use the AON camera for video, the electronic device can display the image captured by the AON camera in real time on the interface. Alternatively, when an electronic device needs to use the AON camera to perform AON services, the electronic device can also perform image recognition on the image information captured by the AON camera and generate AON instructions.
[0302] Possible implementations include the AON camera supporting at least two AON services simultaneously. For example, while an electronic device is recording a video using an AON camera, the AON camera can be controlled to end the recording through air gestures. Alternatively, while an electronic device is making a video call using an AON camera, other interfaces can be viewed through air gestures.
[0303] Similarly, in the scenario shown in Figure 11, since the interfaces of the AON camera are all managed on the sensor hub side, the sensor hub can also determine based on sensor data when to put the AON camera to sleep and send a message to the AON ISP to instruct it to sleep. The AON ISP can then power off interface 3 to save power.
[0304] It can be understood that the sensor hub can realize power management for AON cameras, and because the sensor hub can process the data sent by each sensor, it can perform more intelligent power management for AON cameras based on sensor data.
[0305] Based on the embodiment corresponding to FIG. 11 , when the electronic device turns off the AON service, the electronic device may determine whether to power off the AON camera according to the use of the AON camera.
[0306] For example, Figure 13 is a schematic diagram of module interaction of another power-off method provided in an embodiment of the present application. In the embodiment corresponding to Figure 13, S1301-S1305 can be a conflict scenario for shutting down the AON camera, and S1311-S1319 can be a normal scenario for shutting down the AON camera.
[0307] Disabling a conflict scenario with an AON camera may include the following steps:
[0308] S1301. In response to the operation of shutting down the AON service, the intelligent perception service module obtains a message instructing to shut down the AON service from the AON application.
[0309] S1302: The AON ISP obtains a message from the intelligent perception service module to instruct the AON camera to power off.
[0310] S1303: AON ISP determines that it is interface 3 required when the AON camera is powered off.
[0311] S1304: The camera supply management module obtains a message from the AON ISP for instructing to power off the interface 3.
[0312] S1305: The camera supply management module records the number of times the AON camera is used as 1, and determines not to power off the AON camera.
[0313] It is understood that the camera supply management module can record the number of times the AON camera has been used when receiving a power-on command or a power-off command. For example, the camera supply management module can record the number of times the AON camera has been used plus 1 when receiving a power-on command; or record the number of times the AON camera has been used minus 1 when receiving a power-off command, and then execute the power-off process when the number of times the AON camera has been used reaches 0.
[0314] For example, in response to a message instructing to power off interface 3, the camera provisioning management module may record the number of times the AON camera has been used, minus 1. This means that the current number of times the AON camera has been used is number 1. If the value of number 1 is greater than a first threshold, the camera provisioning management module determines not to power off the AON camera to ensure normal use of the AON camera in social applications. The first threshold may be a value such as 0.
[0315] In a possible implementation, after S1305, when the electronic device detects that the user has turned off the camera service (such as hanging up the video), the electronic device can record the number of times the AON camera has been used as number 3 and power off the AON camera. Number 3 is 0, which can be understood as the number of times the AON camera has been used 0 times, or it can be understood that there is no business using the AON camera.
[0316] A normal scenario for shutting down an AON camera may include the following steps:
[0317] S1311. The camera power management module obtains a message instructing to turn off the camera from a social application.
[0318] S1312: The camera power management module records the number of times the AON camera is used as 1, and determines not to power off the AON camera.
[0319] S1313: In response to the operation of shutting down the AON service, the intelligent perception service module obtains a message instructing to shut down the AON service from the AON application.
[0320] S1314. The AON ISP obtains a message from the intelligent perception service module for instructing to power off the AON camera.
[0321] S1315: AON ISP determines that it is interface 3 required when the AON camera is powered off.
[0322] S1316 : The camera supply management module obtains a message from the AON ISP for instructing to power off the interface 3 .
[0323] Among them, the specific processes in S1313-S1316 can be found in the description of S1301-S1304, and will not be repeated here.
[0324] S1317: The camera power management module records that the number of times the AON camera has been used is 3, and determines that the AON camera is powered off.
[0325] The value of times 3 may be 0. It is understood that when the usage times of the AON camera is 0, the camera power management module may determine that no business uses the AON camera, and then execute the step shown in S1318.
[0326] S1318. The PMIC driver obtains a message from the camera power management module indicating that the interface 3 should be powered off.
[0327] S1319, PMIC driver powers off port 3.
[0328] Based on this, the electronic device can record the number of times the AON camera is used and power off the AON camera when it is determined that no business is using the AON camera, thereby reducing the situation where the AON camera is powered off in advance and other businesses cannot use the AON camera.
[0329] In combination with the description in Figures 5 to 13 of the embodiments of the present application, Figure 14 is a flow chart of a control method of an electronic device provided in an embodiment of the present application.
[0330] As shown in FIG14 , the control method is applied to an electronic device, which includes a real-time online AON camera and a first power management integrated circuit PMIC. The control method may include the following steps:
[0331] S1401: At a first moment, receiving a first operation from a user.
[0332] The first operation is a power-on operation, such as the device power-on operation described in S701.
[0333] S1402 : In response to the first operation, power on the first interface in the AON camera through the first PMIC.
[0334] The first interface may be interface 3 described in the embodiment of the present application. For a description of interface 3, please refer to FIG. 7 .
[0335] S1403: At the second moment, receive a second operation from the user.
[0336] The second operation is to start the AON service, as described in S601.
[0337] S1404 . In response to the second operation, power on the second interface in the AON camera through the first PMIC.
[0338] The second moment is after the first moment.
[0339] The second interface may be the interface 1 described in the embodiment of the present application. For a description of the interface 1, please refer to FIG. 6 .
[0340] S1405: At the third moment, power on the third interface in the AON camera.
[0341] The third moment is after the second moment, and the first interface includes: the second interface and the third interface.
[0342] The third interface may be interface 2 described in the embodiment of the present application. For a description of interface 2, please refer to FIG. 6 .
[0343] Thus, the embodiment of the present application provides a control method for an electronic device, which can use a first PMIC to replace a specific power management chip to power an AON camera, thereby improving the applicability of power management for the AON camera while reducing costs. Furthermore, this solution can flexibly manage the power supply of the AON camera based on the actual needs of the AON service. For example, when the electronic device starts the AON service, the second interface and the third interface can be powered on separately.
[0344] In one possible implementation, the power-on duration of the first interface is the first duration, the third interface completes power-on at the fourth moment, the fourth moment is after the third moment, the duration between the second moment and the fourth moment is the second duration, and the second duration is greater than the first duration.
[0345] The first duration may be duration 1 described in the embodiment of the present application, and the second duration may be duration 2 described in the embodiment of the present application.
[0346] It is understandable that, compared with the power-on time of the first interface during the startup phase, when the electronic device supplies power to the second interface and the third interface separately, the power supply time of the separate power supply may be extended.
[0347] In one possible implementation, powering on the second interface in the AON camera through the first PMIC includes: on the application processor AP side, powering on the second interface through the first PMIC, where the second interface is the power interface of the AON camera; powering on the third interface in the AON camera includes: on the sensor hub side, powering on the third interface, where the third interface is the interface for signal control of the AON camera.
[0348] In this way, the electronic device uses the first PMIC on the AP side to power the second interface of the AON camera, ensuring that the power supply process is not affected by a specific power management chip, improving the applicability of the solution. Furthermore, the sensor hub provides power to the third interface of the AON camera, allowing the sensor hub to use the third interface to achieve low-power control of the AON camera.
[0349] In one possible implementation, the electronic device includes: an AON application, an intelligent perception service module, and a first camera driver. After responding to the second operation, the method further includes: the AON application sends a subscription message to the intelligent perception service module, and the subscription message is used to subscribe to the AON service; in response to the subscription message, the intelligent perception service module sends a first message to the first camera driver, and the first message is used to instruct to power on the AON camera.
[0350] The first camera driver may be the camera driver 1 described in the embodiment of the present application.
[0351] For a description of the subscription message, please refer to Figure 6. The first message may be the message in S602 for instructing to power on the AON camera.
[0352] In this way, when the smart perception service module in the electronic device detects the subscription message, it can notify the first camera driver through the first message to promptly power the AON camera, thereby reducing abnormal situations of the AON service.
[0353] In one possible implementation, the AP side of the electronic device includes: a first camera driver, a regulator framework, and a first PMIC driver, and powering on the second interface through the first PMIC includes: in response to a first message, the first camera driver obtains the second interface from the device tree; the first camera driver sends the second message along the regulator framework to the first PMIC driver, and in response to the second message, the first PMIC driver powers on the second interface; the method also includes: when the second interface is powered on, the first PMIC driver sends a first response message to the smart perception service module along the first camera driver.
[0354] The first camera driver may be the camera driver 1 described in Figure 6, and the second message may be the message in S604 for instructing to power on the interface 1. The first response message may be the response message 1 in S606.
[0355] It is understood that the first camera driver, the regulator frame, and the first PMIC driver on the AP side can jointly realize powering on the second interface. Among them, the regulator frame and the first PMIC driver can be set in the AP power driver.
[0356] In one possible implementation, the sensor hub side includes: an AON image signal processor ISP, and the method further includes: in response to a first response message, the intelligent perception service module sends a subscription message to the AON ISP; in response to the subscription message, the AON ISP obtains a third interface from the first configuration file; and powering on the third interface includes: the AON ISP powers on the third interface.
[0357] It is understandable that the electronic device can also complete the power-on of some interfaces on the sensor hub side. Since the first PMIC driver is not limited to any specific power management chip, the power management process can be flexibly set according to business needs.
[0358] In one possible implementation, when the sensor hub detects that the electronic device is in a dormant state, the AON ISP receives a third message, where the third message includes: a message for instructing the dormant AON camera; and in response to the third message, the AON ISP powers off the third interface.
[0359] The third message may be a message for sleeping the AON in S616.
[0360] It is understandable that since the sensor hub can acquire and calculate sensor data, when the sensor hub detects the need to sleep based on the sensor data, the sensor hub can send a third message to the AON ISP, so that the AON ISP can power off the interface 2 to save power.
[0361] In one possible implementation, before the second moment, the method further includes: at a fifth moment, powering off the first interface through the first PMIC; after the third moment, the method further includes: at a sixth moment, receiving a third operation from the user, wherein the third operation is an operation of shutting down the AON service; in response to the third operation, powering off the second interface through the first PMIC; at a seventh moment, powering off the third interface, wherein the seventh moment is after the sixth moment.
[0362] For the third operation, please refer to the description of S901.
[0363] In this way, this solution can flexibly manage the power supply of the AON camera according to the actual needs of the AON service. For example, when the electronic device turns off the AON service, the second interface and the third interface can be powered off separately.
[0364] In one possible implementation, the power-off duration of the first interface is the third duration, the third interface completes power-off at the eighth moment, the eighth moment is after the seventh moment, the duration between the sixth moment and the eighth moment is the fourth duration, and the fourth duration is greater than the third duration.
[0365] It is understandable that compared with the power-off time of the first interface during the startup phase, when the electronic device powers on the second interface and the third interface separately, the power-off time of the separate power-offs may also be extended.
[0366] In one possible implementation, the second interface includes one or more of the following: an input / output voltage IOVDD interface, a digital voltage DVDD interface, or an analog voltage AVDD interface; and the third interface includes: a reset signal RESET interface and / or a master clock signal MCLK interface.
[0367] The present application embodiment provides another control method for an electronic device, which is applied to the electronic device, wherein the electronic device includes: an AON camera and a first PMIC, and the method includes: receiving a second operation of the user, wherein the second operation is an operation of starting an AON service; in response to the second operation, recording the number of times the AON camera is used as a first parameter, and powering on the first interface in the AON camera through the first PMIC; receiving a fourth operation of the user, the fourth operation including an operation of using the AON camera in a first service, the first service being different from the AON service, and the fourth operation being after the second operation; in response to the fourth operation, recording the number of times the AON camera is used as a second parameter.
[0368] The fourth operation may be the operation described in S1110 , the first parameter may be the number 1 described in S1105 , and the second parameter may be the number 2 described in S1111 .
[0369] It is understood that since the AON camera can indicate at least two AON services simultaneously, the electronic device can provide a solution for using the AON camera for multiple services. For example, the electronic device can determine whether to turn off the AON camera when turning off the AON service by recording the number of times the AON camera is used.
[0370] In one possible implementation, after the first interface is powered on, the method further includes: receiving a fifth operation from the user, where the fifth operation is an operation of shutting down the AON service, and the fifth operation is after the fourth operation; in response to the fifth operation, recording the number of times the AON camera is used as a first parameter, and when the first parameter is not equal to a first threshold, the first interface is not powered off.
[0371] The fifth operation may be the operation described in S1301.
[0372] See the description of S1301 to S1305. Since the first service still uses the AON camera at this time, the electronic device cannot power off the AON camera when the AON service is turned off.
[0373] In one possible implementation, after the first interface is powered on, the method further includes: receiving a sixth operation from the user, the sixth operation being an operation of shutting down the first service, and the sixth operation being after the fourth operation; in response to the sixth operation, recording the number of times the AON camera is used as a first parameter, and when the second parameter is not equal to the first threshold, the first interface is not powered off; receiving a seventh operation from the user, the seventh operation being an operation of shutting down the AON service, and the seventh operation being after the sixth operation; in response to the seventh operation, recording the number of times the AON camera is used as a third parameter, and when the third parameter is equal to the first threshold, the first interface is powered off.
[0374] The sixth operation may be the operation described in S1311. The seventh operation may be the operation described in S1313. The third parameter may be the number 3 described in S1317.
[0375] See description of S1311-S1319. In the case that the electronic device first turns off the first service and then turns off the AON service, the electronic device can determine based on the third parameter that only the AON service currently uses the AON camera, and thus can directly power off the AON camera.
[0376] In one possible implementation, the sensor hub of the electronic device includes: an AON ISP, a camera power management module, and a second PMIC driver. The number of times the AON camera is used is recorded as a first parameter, and the first interface in the AON camera is powered on through the first PMIC, including: the AON ISP obtains the first interface from a second configuration file; the AON ISP sends a fourth message to the second PMIC driver along the camera power management module; in response to the fourth message, the camera power management module records the number of times the AON camera is used as the first parameter; in response to the fourth message, the second PMIC driver powers on the first interface.
[0377] The second PMIC driver may be a PMIC driver in a sensor hub.
[0378] It is understandable that the electronic device can control the power-on of the first interface on the sensor hub side. And by adding a camera power management module on the sensor hub side, the sensor hub can record the number of times the AON camera is used and maintain conflict scenarios when multiple services use the AON camera.
[0379] In a possible implementation, the first interface includes one or more of the following: an input / output voltage IOVDD interface, a digital voltage DVDD interface, an analog voltage AVDD interface, a reset signal RESET interface, or a main clock signal MCLK interface.
[0380] It should be noted that the sequential relationship between the steps described in the embodiments of the present application is only an example and does not constitute a limitation on the embodiments of the present application.
[0381] It should be noted that the module names involved in the embodiments of the present application can be defined as other names as long as the functions of each module can be achieved, and there is no specific restriction on the names of the modules.
[0382] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of the present application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0383] The above description describes the control method for an electronic device according to an embodiment of the present application. The following describes the control device for executing the above electronic device according to an embodiment of the present application. Those skilled in the art will appreciate that the method and device can be combined and referenced with each other, and the related device provided in the embodiment of the present application can perform the steps in the above-mentioned list sorting method.
[0384] In order to realize the above functions, the control device for realizing the electronic device includes hardware structures and / or software modules corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the method steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0385] In the embodiment of the present application, the control device for implementing the electronic device can be divided into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0386] FIG15 is a schematic diagram of the structure of a chip provided in an embodiment of the present application. The chip 150 includes one or more (including two) processors 1501 , a communication line 1502 , a communication interface 1503 , and a memory 1504 .
[0387] In some embodiments, the memory 1504 stores the following elements: executable modules or data structures, or a subset thereof, or an extended set thereof.
[0388] The method described in the above embodiment of the present application can be applied to the processor 1501, or implemented by the processor 1501. The processor 1501 may be an integrated circuit chip with signal processing capabilities. During the implementation process, the steps of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 1501. The above-mentioned processor 1501 can be a general-purpose processor (for example, a microprocessor or a conventional processor), a digital signal processor (digital signal processing, DSP), an application specific integrated circuit (application specific integrated circuit, ASIC), a field-programmable gate array (field-programmable gate array, FPGA) or other programmable logic devices, discrete gates, transistor logic devices or discrete hardware components. The processor 1501 can implement or execute the methods, steps and logic block diagrams related to each processing disclosed in the embodiment of the present application.
[0389] The steps of the method disclosed in the embodiments of the present application can be directly implemented as being executed by a hardware decoding processor, or can be implemented by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium mature in the art, such as a random access memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable read-only memory (EEPROM). The storage medium is located in the memory 1504, and the processor 1501 reads the information in the memory 1504 and performs the steps of the above method in combination with its hardware.
[0390] The processor 1501 , the memory 1504 , and the communication interface 1503 can communicate with each other via the communication line 1502 .
[0391] In the above embodiment, the instructions stored in the memory for execution by the processor may be implemented in the form of a computer program product, wherein the computer program product may be pre-written in the memory or downloaded and installed in the memory in the form of software.
[0392] The present application also provides a computer program product including one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or data center that includes one or more available media integrated. For example, the available medium can include magnetic media (e.g., floppy disk, hard disk or tape), optical media (e.g., digital versatile disc (DVD)), or semiconductor media (e.g., solid state disk (SSD)).
[0393] The present application also provides a computer-readable storage medium. The methods described in the above embodiments can be implemented in whole or in part via software, hardware, firmware, or any combination thereof. Computer-readable media can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one location to another. The storage medium can be any target medium that can be accessed by a computer.
[0394] As one possible design, computer-readable media may include compact disc read-only memory (CD-ROM), RAM, ROM, EEPROM or other optical disc storage; computer-readable media may include magnetic disk storage or other magnetic disk storage devices. Moreover, any connecting line may also be appropriately referred to as a computer-readable medium. For example, if the software is transmitted from a website, server or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL or wireless technologies such as infrared, radio and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technologies such as infrared, radio and microwave are included in the definition of medium. Disk and disc as used herein include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, where disks usually reproduce data magnetically, while discs reproduce data optically using lasers.
[0395] The present application embodiment is described with reference to the flow chart and / or block diagram according to the method, device (system) and computer program product of the embodiment of the present application.It should be understood that each flow process and / or box in the flow chart and / or block diagram and the combination of the flow process and / or box in the flow chart and / or block diagram can be realized by computer program instructions.These computer program instructions can be provided to the processing unit of general-purpose computer, special-purpose computer, embedded processing machine or other programmable data processing equipment to produce a machine, so that the instruction executed by the processing unit of computer or other programmable data processing equipment produces the device for realizing the function specified in one flow chart flow chart or multiple flow charts and / or one block or multiple blocks of block diagram.
Claims
1. A method for controlling an electronic device, characterized in that: Applied to an electronic device, the electronic device includes: a real-time online AON camera and a first power management integrated circuit PMIC, the method includes: At a first moment, receiving a first operation of a user, wherein the first operation is a power-on operation; In response to the first operation, powering on a first interface in the AON camera through the first PMIC; At a second moment, a second operation of the user is received, wherein the second operation is an operation of starting the AON service; In response to the second operation, powering on a second interface in the AON camera through the first PMIC, wherein the second time is after the first time; At a third moment, the third interface in the AON camera is powered on, wherein the third moment is after the second moment, and the first interface includes: the second interface and the third interface.
2. The method according to claim 1, characterized in that The power-on duration of the first interface is the first duration, the third interface completes power-on at a fourth moment, the fourth moment is after the third moment, the duration between the second moment and the fourth moment is the second duration, and the second duration is greater than the first duration.
3. The method according to claim 1 or 2, characterized in that The powering on the second interface in the AON camera through the first PMIC includes: on the application processor AP side, powering on the second interface through the first PMIC, where the second interface is a power interface of the AON camera; The step of powering on the third interface in the AON camera includes powering on the third interface at a sensor hub side, where the third interface is an interface for performing signal control on the AON camera.
4. The method according to claim 3, characterized in that The electronic device includes: an AON application, a smart perception service module, and a first camera driver. After responding to the second operation, the method further includes: The AON application sends a subscription message to the smart perception service module, where the subscription message is used to subscribe to the AON service; In response to the subscription message, the smart perception service module sends a first message to the first camera driver, where the first message is used to instruct to power on the AON camera.
5. The method according to claim 4, characterized in that The AP side of the electronic device includes: a first camera driver, a regulator frame and the first PMIC driver, The powering on the second interface by using the first PMIC includes: In response to the first message, the first camera driver obtains the second interface from a device tree; The first camera driver sends a second message to the first PMIC driver along the regulator framework; In response to the second message, the first PMIC driver powers on the second interface; The method also includes: when the second interface is powered on, the first PMIC driver drives the first camera to send a first response message to the smart perception service module.
6. The method according to claim 5, characterized in that The sensor hub side includes: AON image signal processor ISP, The method further includes: in response to the first response message, the smart perception service module sending the subscription message to the AON ISP; In response to the subscription message, the AON ISP obtains the third interface from the first configuration file; The step of powering on the third interface includes: the AON ISP powering on the third interface.
7. The method according to claim 6, characterized in that The method further comprises: When the sensor hub detects that the electronic device is in a dormant state, the AON ISP receives a third message, the third message including: a message for instructing to dormant the AON camera; In response to the third message, the AON ISP powers off the third interface.
8. The method according to any one of claims 1 to 7, characterized in that Before the second moment, the method further includes: at a fifth moment, powering off the first interface by using the first PMIC; After the third moment, the method further includes: at a sixth moment, receiving a third operation of the user, wherein the third operation is an operation of shutting down the AON service; In response to the third operation, powering off the second interface through the first PMIC; At a seventh moment, the third interface is powered off, wherein the seventh moment is after the sixth moment.
9. The method according to claim 8, characterized in that The power-off duration of the first interface is the third duration, the third interface completes power-off at the eighth moment, the eighth moment is after the seventh moment, the duration between the sixth moment and the eighth moment is the fourth duration, and the fourth duration is greater than the third duration.
10. The method according to any one of claims 1 to 9, characterized in that The second interface includes one or more of the following: an input / output voltage IOVDD interface, a digital voltage DVDD interface, or an analog voltage AVDD interface. The third interface includes: a reset signal RESET interface and / or a main clock signal MCLK interface.
11. A method for controlling an electronic device, characterized in that: Applied to an electronic device, the electronic device includes: an AON camera and a first PMIC, the method includes: receiving a second operation of the user, wherein the second operation is an operation of starting an AON service; In response to the second operation, recording the number of times the AON camera is used as a first parameter, and powering on a first interface in the AON camera through the first PMIC; receiving a fourth operation of the user, the fourth operation including an operation of using the AON camera in a first service, the first service being different from the AON service, and the fourth operation being after the second operation; In response to the fourth operation, the number of times the AON camera is used is recorded as a second parameter.
12. The method according to claim 11, characterized in that After the first interface is powered on, the method further includes: receiving a fifth operation of the user, where the fifth operation is an operation of shutting down the AON service, and the fifth operation occurs after the fourth operation; In response to the fifth operation, the number of times the AON camera is used is recorded as the first parameter, and when the first parameter is not equal to a first threshold, the first interface is not powered off.
13. The method according to claim 11, characterized in that After the first interface is powered on, the method further includes: receiving a sixth operation of the user, where the sixth operation is an operation of closing the first service, and the sixth operation occurs after the fourth operation; In response to the sixth operation, recording the number of times the AON camera is used as the first parameter, and when the second parameter is not equal to the first threshold, not powering off the first interface; Receive the seventh operation of the user, the seventh operation is the operation of closing the AON service, the seventh operation is The operation is performed after the sixth operation; In response to the seventh operation, the number of times the AON camera is used is recorded as a third parameter, and when the third parameter is equal to the first threshold, the first interface is powered off.
14. The method according to any one of claims 11 to 13, characterized in that: The sensor hub of the electronic device includes: an AON ISP, a camera power management module, and a second PMIC driver. The recording of the number of times the AON camera is used as a first parameter, and powering on a first interface in the AON camera through the first PMIC include: The AON ISP obtains the first interface from a second configuration file; The AON ISP sends a fourth message to the second PMIC driver along the camera power management module; In response to the fourth message, the camera power management module records the number of times the AON camera is used as the first parameter; In response to the fourth message, the second PMIC drives to power on the first interface.
15. The method according to any one of claims 1 to 14, characterized in that The first interface includes one or more of the following: an input / output voltage IOVDD interface, a digital voltage DVDD interface, an analog voltage AVDD interface, a reset signal RESET interface, or a main clock signal MCLK interface.
16. An electronic device, characterized in that: The electronic device includes: one or more processors and memory; The memory is coupled to the one or more processors, and the memory is used to store computer program code, wherein the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method as described in any one of claims 1 to 10, or execute the method as described in any one of claims 11 to 15.
17. A chip system, characterized in that: The chip system is applied to an electronic device, and the chip system includes one or more processors, and the one or more processors are used to call computer instructions to enable the electronic device to execute the method as described in any one of claims 1 to 10, or execute the method as described in any one of claims 11 to 15.
18. A computer-readable storage medium, characterized in that The computer-readable storage medium includes computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 10 or the method according to any one of claims 11 to 15.
19. A computer program product, characterized in that The computer program product comprises a computer program code, and when the computer program code is run on an electronic device, the electronic device executes the method according to any one of claims 1 to 10 or the method according to any one of claims 11 to 15.
Citation Information
Patent Citations
Ultra low power architecture to support always on path to memory
CN106471433A
Intelligent television system startup method, device thereof and intelligent television
CN109168088A
A power management system applied to SSD
CN109358740A
Management method of control chip, electronic equipment and computer readable storage medium
CN116996765A
Independent asynchronous framework for embedded subsystems
US20160132097A1