A sensor operating mode control method, electronic device, and storage medium

Abstract

The application provides a sensor working mode control method, an electronic device and a storage medium. The method comprises the following steps: when a first condition is met, the electronic device controls the sensor to be in a first working mode; when a second condition is met, the electronic device controls the sensor to be in a second working mode; the first condition is different from the second condition, and the first working mode is different from the second working mode; the first working mode and the second working mode comprise any one of the following: a proximity mode, a light compensation mode and a measurement mode. The proximity mode comprises emitting infrared light through a light emitting source and receiving reflected infrared light through a photodetector. The light compensation mode comprises emitting infrared light through the light emitting source. The measurement mode comprises emitting red light and infrared light through the light emitting source and receiving reflected red light and reflected infrared light through the photodetector. Through the method, the sensor can be in different working modes, and the utilization rate of the sensor is improved.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a sensor operating mode control method, electronic device and storage medium. Background Technology

[0002] With the development of terminal technology, electronic devices can integrate photoplethysmography (PPG) modules and proximity sensors. Users can conveniently measure health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation using the PPG module. The proximity sensor can detect the approach of objects when the user is not operating the device, preventing accidental activation. However, the PPG module only activates when measuring the user's health data, and the proximity sensor only activates to prevent accidental activation. Further research is needed to improve the utilization rate of PPG modules and proximity sensors in electronic devices. Summary of the Invention

[0003] This application provides a sensor operating mode control method, electronic device, and storage medium, which enable the sensor to operate in different modes, thereby improving the utilization rate of the sensor.

[0004] In a first aspect, this application provides a method for controlling the operating mode of a sensor. The electronic device includes a sensor, which includes a light source and a photodetector. The light source emits red light and / or infrared light, and the photodetector receives reflected red light and / or reflected infrared light. The method includes: in response to the electronic device satisfying a first condition, the electronic device controls the sensor to be in a first operating mode; in response to the electronic device satisfying a second condition, the electronic device controls the sensor to be in a second operating mode. The first condition and the second condition are different, and the first operating mode and the second operating mode are different. The first operating mode and the second operating mode include any one of the following: a proximity mode, a supplementary lighting mode, and a measurement mode. The proximity mode includes emitting infrared light through the light source and receiving reflected infrared light through the photodetector; the supplementary lighting mode includes emitting infrared light through the light source; and the measurement mode includes emitting red light and infrared light through the light source and receiving reflected red light and reflected infrared light through the photodetector.

[0005] In some embodiments, the supplemental lighting mode may also include controlling the photodetector to stop receiving reflected infrared light, which can further save the power consumption of the sensor.

[0006] In some embodiments, the sensor may also include a suspended mode. In suspended mode, the light source does not emit red or infrared light, and the photodetector does not receive reflected red or infrared light, resulting in the lowest sensor efficiency.

[0007] In some embodiments, the sensor may be a proximity light sensor or a PPG module, and this application does not limit the specific sensor to either.

[0008] The sensor in this application can operate in different working modes. For example, the sensor can operate in proximity mode to prevent accidental activation when the electronic device is in a pocket or backpack. The sensor can operate in supplemental lighting mode to improve the success rate of face unlock. The sensor can operate in measurement mode to measure health data such as blood pressure, blood oxygen, and respiratory rate. The sensor can operate in suspend mode when not in use. This method not only improves the utilization rate of the sensor but also saves its power consumption.

[0009] In conjunction with the first aspect, in one possible implementation, the electronic device includes a first display screen, with the sensor located in the display area above the first display screen; the first operating mode and the second operating mode include either a proximity mode or a supplementary lighting mode.

[0010] Thus, when the electronic device has a non-foldable screen and the sensor is a proximity sensor, the proximity sensor's operating modes can include proximity mode and supplementary light mode. For example, the sensor can operate in proximity mode to prevent accidental touches when the electronic device is in a pocket or backpack. The sensor can operate in supplementary light mode to improve the success rate of face unlock.

[0011] In some embodiments, the proximity sensor may also include a suspended mode. In suspended mode, the light source does not emit red or infrared light, and the photodetector does not receive reflected red or infrared light, resulting in the lowest efficiency of the proximity sensor.

[0012] This method can not only improve the utilization rate of proximity sensors, but also save power consumption of proximity sensors.

[0013] In conjunction with the first aspect, in one possible implementation, the first operating mode includes a supplementary lighting mode. In response to the electronic device meeting a first condition, the electronic device controls the sensor to be in the first operating mode, specifically including: in response to recognizing a face image through the front-facing camera, the electronic device controls the sensor to be in the supplementary lighting mode; the first condition includes the electronic device recognizing a face image through the front-facing camera.

[0014] In other embodiments, the electronic device may also control the proximity sensor to be in different supplementary lighting modes based on one or more conditions such as ambient brightness and facial image clarity.

[0015] In this way, when facial recognition is required, the electronic device can control the proximity sensor to work in supplemental lighting mode to improve the success rate of facial unlocking.

[0016] In conjunction with the first aspect, in one possible implementation, the second operating mode includes a proximity mode, wherein in response to the electronic device meeting a second condition, the electronic device controls the sensor to be in the second operating mode, specifically including: in response to the electronic device being in a screen-off state, the electronic device controls the sensor to be in the proximity mode; the second condition includes the electronic device being in a screen-off state.

[0017] The second condition is not limited to the electronic device being in a screen-off state and the proximity sensor being in proximity mode. It can also include other conditions, such as the user not operating the electronic device for a certain period of time or the electronic device's screen being off for a certain duration.

[0018] In this way, when the user is not operating the electronic device, the electronic device can control the proximity sensor to work in proximity mode to prevent accidental touches.

[0019] In conjunction with the first aspect, in one possible implementation, the electronic device includes a foldable screen and a second display screen, the foldable screen includes a third display screen and a fourth display screen, and the second display screen and the sensor are located on the back of the third display screen; when the physical state of the foldable screen is unfolded, the third display screen and the fourth display screen are on the same horizontal plane; when the physical state of the foldable screen is folded, the second display screen and the third display screen are face-to-face; when the physical state of the foldable screen is unfolded, the first operating mode or the second operating mode includes a measurement mode; when the physical state of the foldable screen is folded, the first operating mode and the second operating mode include either a proximity mode or a supplementary lighting mode.

[0020] Thus, in the case of electronic devices with foldable screens, including smaller foldable screens, the sensor is the PPG module of the electronic device. The operating modes of the PPG module can include proximity mode, measurement mode, and supplementary lighting mode. For example, the PPG module can operate in proximity mode to prevent accidental touches when the electronic device is in a pocket or backpack. The sensor can operate in supplementary lighting mode to improve the success rate of face unlock. For example, the PPG module can operate in measurement mode to measure the user's health data such as heart rate, blood oxygen, and respiratory rate.

[0021] In some embodiments, the PPG module may also include a suspended mode. In suspended mode, the light source does not emit red or infrared light, and the photodetector does not receive reflected red or infrared light, resulting in the lowest operating efficiency of the PPG module.

[0022] In conjunction with the first aspect, in one possible implementation, when the physical state of the foldable screen is folded, the first operating mode includes a proximity mode; in response to the electronic device satisfying a first condition, the electronic device controls the sensor to be in the first operating mode, specifically including: in response to the physical state of the foldable screen being folded and the second display screen being off, the electronic device controls the sensor to be in the proximity mode; the first condition includes the physical state of the foldable screen being folded and the second display screen being off.

[0023] The first condition is not limited to the electronic device being in a screen-off state and the PPG module being in proximity mode. Other conditions may also be included, such as the user not operating the electronic device for a certain period of time or the electronic device's screen-off time exceeding a certain duration.

[0024] In this way, when the user is not operating the electronic device, the electronic device can control the PPG module to work in proximity mode to prevent accidental touches.

[0025] In conjunction with the first aspect, in one possible implementation, after the electronic device controls the sensor to enter proximity mode, the method further includes: when it is determined by receiving reflected infrared light through a photodetector that an object is approaching within a continuous first time period, the electronic device controls the second display screen to not respond to screen touch events. This prevents accidental touches in proximity mode.

[0026] In conjunction with the first aspect, in one possible implementation, when the physical state of the foldable screen is folded, the second operating mode includes a supplementary light mode. In response to the electronic device satisfying the second condition, the electronic device controls the sensor to be in the second operating mode, specifically including: in response to the physical state of the foldable screen being folded and the electronic device recognizing a face image, the electronic device controls the sensor to be in the supplementary light mode; the second condition includes the physical state of the foldable screen being folded and the electronic device recognizing a face image.

[0027] In this way, when facial recognition is required, the electronic device can control the PPG module to work in supplementary lighting mode to improve the success rate of facial recognition.

[0028] In conjunction with the first aspect, in one possible implementation, when the physical state of the foldable screen is folded, the second operating mode includes a supplementary lighting mode. In response to the electronic device meeting a second condition, the electronic device controls the sensor to be in the second operating mode, specifically including: in response to the physical state of the foldable screen being folded, the electronic device recognizing a face image and the clarity of the face image being less than a preset clarity, the electronic device controls the sensor to be in the supplementary lighting mode; the second condition includes the physical state of the foldable screen being folded, the electronic device recognizing a face image and the clarity of the face image being less than a preset clarity.

[0029] In conjunction with the first aspect, in one possible implementation, when the physical state of the foldable screen is folded, the second operating mode includes a supplementary lighting mode. In response to the electronic device meeting a second condition, the electronic device controls the sensor to be in the second operating mode, specifically including: in response to the physical state of the foldable screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a first threshold, the electronic device controls the sensor to be in the supplementary lighting mode; the second condition includes the physical state of the foldable screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a first threshold.

[0030] In conjunction with the first aspect, in one possible implementation, when the physical state of the foldable screen is folded, the second operating mode includes a supplementary lighting mode. In response to the electronic device meeting a second condition, the electronic device controls the sensor to operate in the second operating mode. Specifically, this includes: in response to the physical state of the foldable screen being folded, the electronic device recognizing a face image, the clarity of the face image being less than a preset clarity, and the ambient brightness being less than a first threshold, the electronic device controls the sensor to operate in the supplementary lighting mode; the second condition includes the physical state of the foldable screen being folded, the electronic device recognizing a face image, the clarity of the face image being less than a preset clarity, and the ambient brightness being less than a first threshold.

[0031] In conjunction with the first aspect, in one possible implementation, the supplementary lighting mode is a first supplementary lighting mode; the first supplementary lighting mode includes emitting infrared light of a first intensity through a light source; in response to the physical state of the folded screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a first threshold, the electronic device controls the sensor to be in the supplementary lighting mode, specifically including: in response to the physical state of the folded screen being folded, the electronic device recognizing a face image and the ambient brightness being greater than a second threshold and less than the first threshold, the electronic device controls the sensor to be in the first supplementary lighting mode; the second condition includes the physical state of the folded screen being folded, the electronic device recognizing a face image, the clarity of the face image being less than a preset clarity and the ambient brightness being greater than the second threshold and less than the first threshold.

[0032] In conjunction with the first aspect, in one possible implementation, the supplementary lighting mode is a second supplementary lighting mode; the second supplementary lighting mode includes emitting infrared light of a second intensity through a light source, the second intensity being greater than the first intensity; in response to the physical state of the folded screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a first threshold, the electronic device controls the sensor to be in the supplementary lighting mode, specifically including: in response to the physical state of the folded screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a second threshold, the electronic device controls the sensor to be in the second supplementary lighting mode; the second condition includes the physical state of the folded screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a second threshold.

[0033] In this way, electronic devices can control the PPG module to enter different supplementary lighting modes based on different ambient brightness levels.

[0034] In conjunction with the first aspect, in one possible implementation, after the electronic device controls the sensor to be in the supplementary lighting mode, the method further includes: when the electronic device is successfully unlocked and the second display screen is on, the electronic device controls the sensor to be in a suspend mode; wherein, the suspend mode includes stopping the emission of infrared light by the light source.

[0035] In this way, after successful face unlock, the electronic device can control the PPG module to enter suspend mode. In suspend mode, the PPG module consumes the least power, which can save the power consumption of the PPG module.

[0036] In conjunction with the first aspect, in one possible implementation, after the electronic device controls the sensor to be in a suspend mode, the method further includes: in response to the electronic device being in a screen-off state, the electronic device controls the sensor to be in a proximity mode.

[0037] Not only in the screen-off state, electronic devices can also control the PPG module to enter proximity mode based on conditions such as the screen being off for a certain period of time or the user not operating the electronic device for a certain period of time.

[0038] In this way, after the electronic device controls the PPG module to enter suspend mode, the electronic device can monitor the screen status and control the PPG module to enter proximity mode again, so as to prevent accidental touch when the user is not operating the electronic device.

[0039] In conjunction with the first aspect, in one possible implementation, when the physical state of the foldable screen is unfolded, the first operating mode includes a measurement mode. In response to the electronic device satisfying a first condition, the electronic device controls the sensor to be in the first operating mode, specifically including: in response to the physical state of the foldable screen being unfolded and a user operation to receive measured health data, the electronic device controls the sensor to be in the measurement mode; the first condition includes the physical state of the foldable screen being unfolded and a user operation to receive measured health data.

[0040] In this way, when the electronic device is in the unfolded state, when the electronic device receives user input to measure health data such as blood oxygen, heart rate, and respiratory rate, the electronic device can control the PPG module to enter the measurement mode to realize the measurement of health data such as blood oxygen, heart rate, and respiratory rate.

[0041] In conjunction with the first aspect, in one possible implementation, after the electronic device controls the sensor to enter measurement mode, the method further includes:

[0042] After the electronic device acquires health data, it controls the sensor to switch from measurement mode to suspension mode. The suspension mode includes stopping the emission of red and infrared light by the light source and stopping the reception of reflected red and infrared light by the photodetector.

[0043] In this way, after the electronic device acquires the user's health data to be measured, it can control the PPG module to enter a suspend mode to save power consumption. When the electronic device is in the deployed state, the PPG module can switch back and forth between measurement mode and suspend mode.

[0044] In conjunction with the first aspect, in one possible implementation, the light source includes a first light source and a second light source, and the photodetector includes a first photodetector and a second photodetector. The first light source is used to emit red light, the second light source is used to emit infrared light, the first photodetector is used to receive reflected red light, and the second photodetector is used to receive reflected infrared light.

[0045] In conjunction with the first aspect, in one possible implementation, the light source includes a first light source, the photodetector includes a first photodetector, the first light source is used to emit red light and infrared light in a time-division manner, and the first photodetector is used to receive reflected red light and infrared light in a time-division manner.

[0046] In a second aspect, this application provides a sensor, one or more processors, and one or more memories; wherein the sensor, one or more memories are coupled to one or more processors, and the one or more memories are used to store computer program code, the computer program code including computer instructions, and when the one or more processors execute the computer instructions, the electronic device performs a sensor operating mode control method provided in any possible implementation of the first aspect.

[0047] Thirdly, this application provides a chip system applied to an electronic device, the chip system including one or more processors, characterized in that the processors are used to invoke computer instructions to cause the electronic device to execute a sensor operating mode control method provided in any possible implementation of the first aspect.

[0048] Fourthly, this application provides a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform a sensor operating mode control method provided in any possible implementation of the first aspect.

[0049] For a description of the beneficial effects in the second to fourth aspects, please refer to the description of the beneficial effects in the first aspect; this application will not repeat them here. Attached Figure Description

[0050] Figures 1A-1D Schematic diagrams of the composition structure of several PPG modules provided in the embodiments of this application;

[0051] Figure 1E A schematic diagram of the form of the electronic device 100 provided in the embodiments of this application;

[0052] Figures 2A-2C This is a schematic diagram of the device configuration of the electronic device 100 provided in the embodiments of this application;

[0053] Figure 3 This diagram illustrates how the electronic device 100 controls the PPG module to switch operating modes when the electronic device 100 is in the deployed state.

[0054] Figures 4A-4G A UI diagram showing how an electronic device 100 receives health data measured by user operation is shown.

[0055] Figures 5A-5C This diagram illustrates how the electronic device 100 controls the PPG module to switch operating modes when the electronic device 100 is in a folded state.

[0056] Figures 6A-6C A schematic diagram illustrating how a foldable small screen responds to user actions is shown;

[0057] Figure 7 A schematic diagram is shown of an electronic device 100 controlling a PPG module to switch operating modes;

[0058] Figure 8A A flowchart of a method for an electronic device 100 to control a PPG module to switch working modes is provided in this application;

[0059] Figure 8B Flowchart of another method for controlling a PPG module to switch working modes by an electronic device 100 provided in this application;

[0060] Figure 8C Flowchart of a method for controlling a PPG module to switch working modes by an electronic device 100 provided in this application;

[0061] Figures 9A-9C This diagram illustrates the device configuration when the electronic device 100 is a foldable screen.

[0062] Figure 10 A schematic diagram is shown of an electronic device 100 controlling a PPG module to switch operating modes;

[0063] Figure 11 A flowchart illustrating another method for an electronic device 100 to control a PPG module to switch operating modes is shown.

[0064] Figures 12-14A schematic diagram of the structure of the electronic device 100 is shown;

[0065] Figure 15 A schematic diagram is shown of an electronic device 100 controlling a PPG module to switch operating modes;

[0066] Figure 16 A schematic diagram is shown of another electronic device 100 controlling the PPG module to switch operating modes;

[0067] Figure 17 A schematic diagram is shown of an electronic device 100 controlling a proximity light sensor to switch operating modes;

[0068] Figure 18 A flowchart illustrating a sensor operating mode control method is shown.

[0069] Figure 19 A schematic diagram of the structure of the electronic device 100 is shown;

[0070] Figure 20 This is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention. Detailed Implementation

[0071] The technical solutions in the embodiments of this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the word "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0072] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.

[0073] The term "user interface (UI)" used in the following embodiments of this application refers to the medium interface through which an application or operating system interacts and exchanges information with the user. It realizes the conversion between the internal form of information and the form that the user can accept. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation that is displayed graphically. It can be visible interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets displayed on the screen of an electronic device.

[0074] First, the technical terms used in this application will be explained.

[0075] The sensors involved in this application may include proximity sensors and photoplethysmography (PPG) modules. The proximity sensors and PPG modules will be introduced first.

[0076] 1. Photoplethysmography (PPG)

[0077] PPG (Photoplethysmography) is a non-invasive method for detecting health data based on the principle that the amount of light absorbed by arterial blood changes with arterial fluctuations. Users can use the pre-installed PPG module on electronic devices to detect health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation (SaO2).

[0078] For example, blood oxygen saturation (SaO2) refers to the percentage of oxygenated hemoglobin (HbO2) in the blood that is bound to oxygen, relative to the total amount of hemoglobin (Hb) that can bind to oxygen. Therefore, blood oxygen saturation (SaO2) can be obtained by detecting the amount of oxygenated hemoglobin (HbO2) and hemoglobin (Hb) in the blood. Oxyhemoglobin (HbO2) and hemoglobin (Hb) have different absorption characteristics for light with wavelengths of 600–1000 nm. For light with wavelengths between 600 and 800 nm, oxyhemoglobin (HbO2) has a higher absorption coefficient. For light with wavelengths between 800 and 1000 nm, hemoglobin (Hb) has a higher absorption coefficient. Therefore, red light (600-800nm) and infrared light (800-1000nm) can be used to detect the PPG signals of oxyhemoglobin (HbO2) and hemoglobin (Hb) respectively. Then, the ratio of oxyhemoglobin (HbO2) to hemoglobin (Hb) can be calculated by algorithm processing, thus obtaining blood oxygen saturation (SaO2).

[0079] For example, blood oxygen saturation is calculated based on the ratio of the perfusion index of the red PPG signal to the perfusion index of the infrared PPG signal. The perfusion index of the red PPG signal refers to the ratio of the AC signal to the DC signal of the red light collected by the electronic device. Similarly, the perfusion index of the infrared PPG signal refers to the ratio of the AC signal to the DC signal of the infrared light collected by the electronic device.

[0080] 2. PPG module

[0081] The PPG module in this application may include at least one light source and at least one photodetector. The at least one light source emits light, which can be partially absorbed by the human body and partially reflected. The at least one photodetector receives the reflected light and obtains a PPG signal based on the reflected light, thereby achieving the purpose of measuring health data.

[0082] The at least one light source can emit different light sources to achieve the purpose of detecting different health data.

[0083] Figures 1A-1D A schematic diagram of the composition structure of several PPG modules is shown.

[0084] For example, such as Figure 1A As shown, the PPG module includes a processor, a light source, and a photodetector.

[0085] The number of light sources can be one or more, and the number of photodetectors can be one or more; this application does not limit this.

[0086] Different lights can be emitted from the same light source, and different light sources can be emitted through time-division multiplexing.

[0087] The light source can emit red light, infrared light, or other light sources. In some embodiments, the light source can be a light-emitting diode (LED) or other light-emitting device.

[0088] Different types of light can be received by the same photodetector, and time-division multiplexing can be used to receive different light sources. In some embodiments, the photodetector can be a receiving device such as a photodiode (PD).

[0089] For example, when a light source emits red light, a photodetector can receive the reflected red light.

[0090] When the light source emits infrared light, the photodetector can receive the reflected infrared light.

[0091] The processor can obtain PPG signals based on the reflected red light and / or reflected infrared light collected by the photodetector, and obtain health data detection data based on the PPG signals.

[0092] For example, such as Figure 1B As shown, the PPG module includes a processor, a light source, a first photodetector, and a second photodetector.

[0093] The number of light sources can be one or more, the number of first photodetectors can be one or more, and the number of second photodetectors can be one or more; this application does not limit the number of light sources.

[0094] Different lights can be emitted from the same light source, and different light sources can be emitted through time-division multiplexing.

[0095] The light source can emit red light, infrared light, or other light sources. In some embodiments, the light source can be a light-emitting device such as a light-emitting diode.

[0096] Different types of light require different photodetectors. In some embodiments, the photodetector may be a receiving device such as a photodiode (PD).

[0097] For example, when the light source emits red light, the first photodetector can receive the reflected red light.

[0098] When the light source emits infrared light, the second photodetector can receive the reflected infrared light.

[0099] The processor can obtain PPG signals based on the reflected red light collected by the first photodetector and / or the reflected infrared light collected by the second photodetector, and obtain health data detection data based on the PPG signals.

[0100] For example, such as Figure 1C As shown, the PPG module includes a processor, a red light source, an infrared light source, and a photodetector.

[0101] Different types of light require different light sources to emit.

[0102] The red light source can emit red light, and there can be one or more red light sources. In some embodiments, the infrared light source can be a light-emitting device such as a light-emitting diode.

[0103] An infrared light source can emit infrared light, and there can be one or more infrared light sources. In some embodiments, the infrared light source can be a light-emitting device such as a light-emitting diode.

[0104] Different types of light can be received by the same photodetector. In some embodiments, the photodetector may be a receiving device such as a photodiode (PD).

[0105] For example, when a red light source emits red light, a photodetector can receive the reflected red light.

[0106] When an infrared light source emits infrared light, a photodetector can receive the reflected infrared light.

[0107] The processor can obtain PPG signals based on the reflected red light and / or reflected infrared light collected by the photodetector, and obtain health data detection data based on the PPG signals.

[0108] For example, such as Figure 1D As shown, the PPG module includes a processor, a red light source, an infrared light source, a first photodetector, and a second photodetector.

[0109] Different types of light require different light sources to emit.

[0110] The red light source can emit red light, and there can be one or more red light sources. In some embodiments, the infrared light source can be a light-emitting device such as a light-emitting diode.

[0111] An infrared light source can emit infrared light, and there can be one or more infrared light sources. In some embodiments, the infrared light source can be a light-emitting device such as a light-emitting diode.

[0112] Different types of light can be received by the same photodetector, and time-division multiplexing can be used to receive different light sources. In some embodiments, the photodetector can be a receiving device such as a photodiode (PD).

[0113] For example, when a red light source emits red light, the first photodetector can receive the reflected red light.

[0114] When the infrared light source emits infrared light, the second photodetector can receive the reflected infrared light.

[0115] The processor can obtain PPG signals based on the reflected red light collected by the first photodetector and / or the reflected infrared light collected by the second photodetector, and obtain health data detection data based on the PPG signals.

[0116] The above Figures 1A-1D Several structural schematic diagrams of PPG modules are shown above. Figures 1A-1D This is only for the purpose of explaining this application and should not be construed as limiting it.

[0117] When it is necessary to detect a user's health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation (SaO2), the electronic device can control the light source in the PPG module to emit red and infrared light. It also controls the photodetector in the PPG module to receive the reflected red and infrared light. The electronic device 100 obtains the PPG signal based on the reflected red and infrared light, and then analyzes the PPG signal to obtain the user's health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation (SaO2).

[0118] 3. Proximity light sensor

[0119] like Figure 1E As shown, the electronic device 100 includes a display screen 1200, and a proximity sensor may be located in the upper region 1100 of the display screen 1200. For example, the proximity sensor may be located near the area where the front-facing camera of the electronic device 100 is located. The proximity sensor may also be located in other areas of the display screen 1200 on the electronic device 100, and this application does not limit this location.

[0120] A proximity sensor may include, for example, a light source (e.g., a light-emitting diode) and a light detector (e.g., a photodetector). Electronic device 100 emits infrared light outward through the light-emitting diode. Electronic device 100 uses the photodetector to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that an object is near electronic device 100. When insufficient reflected light is detected, electronic device 100 can determine that no object is near electronic device 100. Electronic device 100 can detect whether it is in a pocket by proximity detection to prevent accidental activation.

[0121] In this application, the proximity light sensor can not only detect whether an object is approaching and prevent accidental touch, but also utilize the characteristic that the light-emitting diode in the proximity light sensor can emit infrared light. The electronic device 100 can use the infrared light emitted by the light-emitting diode in the proximity light sensor to supplement the light, thereby improving the success rate of face unlock.

[0122] This application provides a method for controlling the operating mode of a sensor, applied to an electronic device including a PPG module and / or a proximity sensor. The PPG module contains a light source, which allows it to not only detect health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation (SaO2), but also improve its utilization rate in other scenarios requiring light sources. The proximity sensor also contains a light source, enabling it to not only detect approaching objects and prevent accidental touches, but also provide supplementary lighting during face unlock to improve its success rate.

[0123] In this application, the sensor can be controlled to operate in different modes based on different application scenarios.

[0124] When the sensor is a PPG module, the operating modes of the PPG module include, but are not limited to: measurement mode, supplementary lighting mode, proximity mode, and suspension mode.

[0125] When the sensor is a PPG module and is a proximity sensor, the working modes of the proximity sensor include, but are not limited to: proximity mode, supplementary light mode, and suspension mode.

[0126] The different operating modes of the PPG module and the proximity sensor can be understood as the different working states of the light source and photodetector in the proximity sensor. The following sections will detail the specific operating modes of the light source and photodetector in each PPG module and proximity sensor.

[0127] First, we will introduce the specific operating modes of the light source and photodetector in each different operating mode of the PPG module.

[0128] I. Measurement Mode

[0129] In some embodiments, when preset conditions are met, the electronic device 100 can control the PPG module to be in measurement mode.

[0130] For example, the preset condition could be that when the electronic device 100 is detected to actively trigger the user to start measuring health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation (SaO2), the electronic device 100 can control the PPG module to be in measurement mode.

[0131] In the measurement mode, the electronic device 100 needs to control the light source in the PPG module to emit red light and infrared light simultaneously, and control the photodetector in the PPG module to turn on and receive the reflected red light and reflected infrared light.

[0132] Table 1

[0133] Light source It turns on and emits red and infrared light in time-sharing mode. Photodetector It is activated and receives reflected red light and reflected infrared light in a time-division manner.

[0134] Table 1 shows the operating status of each component in the PPG module in measurement mode.

[0135] Table 1 shows that the PPG module includes a light source and a photodetector. In measurement mode, the light source in the PPG module is on and emits red and infrared light in a time-division manner. The photodetector in the PPG module is also on and receives the reflected red and infrared light in a time-division manner.

[0136] Electronic device 100 can obtain PPG signal based on the reflected red light and reflected infrared light received by photodetector, and determine the corresponding health data detection data based on PPG signal and corresponding health data type.

[0137] Table 2

[0138] Light source It turns on and emits red and infrared light in time-sharing mode. First photodetector Turn on and receive reflected red light Second photodetector Turn on and receive reflected infrared light

[0139] Table 2 shows the operating status of each component in the PPG module in another measurement mode.

[0140] Table 2 shows that the PPG module includes a light source, a first photodetector, and a second photodetector. In measurement mode, the light source in the PPG module is on and emits red and infrared light in a time-division multiplexing manner. The first photodetector in the PPG module is also on and receives the reflected red light. The second photodetector in the PPG module is also on and receives the reflected infrared light.

[0141] The electronic device 100 can obtain a PPG signal based on the reflected red light received by the first photodetector and the reflected infrared light received by the second photodetector, and determine the corresponding health data detection data based on the PPG signal and the corresponding health data type.

[0142] Table 3

[0143] Red light source Turn on and emit red light Infrared light source Turn on and emit infrared light Photodetector It is activated and receives reflected red light and reflected infrared light in a time-division manner.

[0144] Table 3 shows the operating status of each component in the PPG module in another measurement mode.

[0145] Table 3 shows that the PPG module includes a red light source, an infrared light source, and a photodetector. In measurement mode, the red light source in the PPG module is turned on and emits red light. The infrared light source in the PPG module is also turned on and emits infrared light. The photodetector in the PPG module is also turned on and receives the reflected red light and reflected infrared light in a time-division manner.

[0146] Electronic device 100 can obtain PPG signal based on the reflected red light and reflected infrared light received by photodetector, and determine the corresponding health data detection data based on PPG signal and corresponding health data type.

[0147] Table 4

[0148] Red light source Turn on and emits red and infrared light. Infrared light source Turn on and emit infrared light First photodetector Turn on and receive reflected red light Second photodetector Turn on and receive reflected infrared light

[0149] Table 4 shows the operating status of each component in the PPG module in another measurement mode.

[0150] Table 4 shows that the PPG module includes a red light source, an infrared light source, a first photodetector, and a second photodetector. In measurement mode, the red light source in the PPG module is on and emits red light. The infrared light source in the PPG module is on and emits infrared light. The first photodetector in the PPG module is also on and receives reflected red light. The second photodetector in the PPG module is also on and receives reflected infrared light.

[0151] The electronic device 100 can obtain a PPG signal based on the reflected red light received by the first photodetector and the reflected infrared light received by the second photodetector, and determine the corresponding health data detection data based on the PPG signal and the corresponding health data type.

[0152] II. Fill Light Mode

[0153] In some embodiments, when preset conditions are met, the electronic device 100 can control the PPG module to be in a supplementary lighting mode.

[0154] For example, in a face unlock scenario, due to low light, the face image captured by the electronic device 100 may be unclear, leading to face unlock failure. To improve the success rate of face unlock, when face unlock is detected, infrared light emitted by the light source in the PPG module can be used for supplementary lighting to improve the clarity of the face image captured by the electronic device 100, thereby increasing the success rate of face unlock.

[0155] Optionally, when the camera capturing the face image is a hyperspectral camera, the electronic device 100 can control the infrared light emitted by the light source in the PPG module to provide supplementary illumination when face unlock is detected.

[0156] In other words, in the supplementary lighting mode, the electronic device 100 only needs to control the light source in the PPG module to emit infrared light to achieve the purpose of supplementary lighting. The photodetector in the PPG module can be turned off to save the power consumption of the PPG module.

[0157] In some embodiments, the photodetector in the PPG module can also be turned on, and this application does not limit this.

[0158] Table 5

[0159] Light source Turn on and infrared light Photodetector Off / On

[0160] Table 5 shows the operating status of each component in the PPG module in supplemental lighting mode.

[0161] Table 5 shows that the PPG module includes a light source and a photodetector. In supplementary lighting mode, the light source in the PPG module is on and emits infrared light, eliminating the need for red light, thus providing supplementary lighting for face unlocking. The photodetector in the PPG module is off, eliminating the need to receive reflected light and saving power.

[0162] In some embodiments, the photodetector in the PPG module can also be turned on, and this application does not limit this.

[0163] Table 6

[0164] Light source Turn on and emit infrared light First photodetector Off / On Second photodetector Off / On

[0165] Table 6 shows the operating status of each component in the PPG module in another supplementary lighting mode.

[0166] Table 6 shows that the PPG module includes a light source, a first photodetector, and a second photodetector. In supplementary lighting mode, the light source in the PPG module is on, emitting infrared light instead of red light, to provide supplementary lighting for face unlocking. Both the first and second photodetectors in the PPG module are off, eliminating the need to receive reflected light and conserving power.

[0167] In some embodiments, the first photodetector and the second photodetector in the PPG module may also be turned on, and this application does not limit this.

[0168] Table 7

[0169] Red light source closure Infrared light source Turn on and emit infrared light Photodetector Off / On

[0170] Table 7 shows another working state of the various components in the PPG module in the supplementary lighting mode.

[0171] Table 7 shows that the PPG module includes a red light source, an infrared light source, and a photodetector. In supplementary lighting mode, the red light source in the PPG module is off and does not emit red light. The infrared light source in the PPG module is on and emits infrared light to provide supplementary lighting for face unlocking. The photodetector in the PPG module is off and does not need to receive reflected light, thus saving power consumption.

[0172] In some embodiments, the photodetector in the PPG module can also be turned on, and this application does not limit this.

[0173] Table 8

[0174] Red light source closure Infrared light source Turn on and emit infrared light First photodetector Off / On Second photodetector Off / On

[0175] Table 8 shows the operating status of each component in the PPG module in another supplementary lighting mode.

[0176] Table 8 shows that the PPG module includes a red light source, an infrared light source, a first photodetector, and a second photodetector. In supplementary lighting mode, the red light source in the PPG module is off and does not emit red light. The infrared light source in the PPG module is on and emits infrared light. Both the first and second photodetectors in the PPG module are off, as they do not need to receive reflected light, thus saving power consumption.

[0177] In some embodiments, the first photodetector and the second photodetector in the PPG module may also be turned on, and this application does not limit this.

[0178] Tables 5-8 show that in supplementary lighting mode, the light source in the PPG module is turned on and emits infrared light to achieve the purpose of supplementary lighting.

[0179] III. Proximity Mode

[0180] In some embodiments, when preset conditions are met, the electronic device 100 can control the PPG module to be in proximity mode.

[0181] In proximity mode, the electronic device 100 can control the light source in the PPG module to emit infrared light, without emitting red light. The photodetector in the PPG module needs to be activated and receive the reflected infrared light. It then detects whether there is physical proximity based on the received reflected infrared light. If an object is detected approaching, it enters the anti-accidental touch mode.

[0182] For example, when there is physical proximity, the photodetector in the PPG module receives a high signal intensity of reflected infrared light. When the signal intensity of the reflected infrared light is detected to be greater than a preset intensity for a continuous first time period, the electronic device 100 can control the PPG module to be in proximity mode.

[0183] Table 9

[0184] Light source Turn on and emit infrared light Photodetector Turn on and receive reflected infrared light

[0185] Table 9 shows the operating status of each component in the PPG module in proximity mode.

[0186] Table 9 shows that the PPG module includes a light source and a photodetector. In proximity mode, the light source in the PPG module is on and emits infrared light. The photodetector in the PPG module is also on and receives reflected infrared light.

[0187] Electronic device 100 can obtain PPG signal based on the reflected infrared light received by photodetector, and detect whether an object is approaching based on the PPG signal.

[0188] Table 10

[0189]

[0190]

[0191] Table 10 shows another operating state of the components in the PPG module in proximity mode.

[0192] Table 10 shows that the PPG module includes a light source, a first photodetector, and a second photodetector. In proximity mode, the light source in the PPG module is on and emits infrared light. The first photodetector in the PPG module is off and does not need to receive reflected red light. The second photodetector in the PPG module is on and receives reflected infrared light.

[0193] The electronic device 100 can obtain a PPG signal based on the reflected infrared light received by the second photodetector, and detect whether an object is approaching based on the PPG signal.

[0194] Table 11

[0195] Red light source closure Infrared light source Turn on and emit infrared light Photodetector Turn on and receive reflected infrared light

[0196] Table 11 shows another operating state of the various components in the PPG module in proximity mode.

[0197] Table 11 shows that the PPG module includes a red light source, an infrared light source, and a photodetector. In proximity mode, the red light source in the PPG module is off and does not emit red light. The infrared light source in the PPG module is on and emits infrared light. The photodetector in the PPG module is also on and receives reflected infrared light.

[0198] Electronic device 100 can obtain PPG signal based on the reflected infrared light received by photodetector, and detect whether an object is approaching based on the PPG signal.

[0199] Table 12

[0200] Red light source closure Infrared light source Turn on and emit infrared light First photodetector closure Second photodetector Turn on and receive reflected infrared light

[0201] Table 12 shows the operating status of the various components in the PPG module in another proximity mode.

[0202] Table 12 shows that the PPG module includes a red light source, an infrared light source, a first photodetector, and a second photodetector. In proximity mode, the red light source in the PPG module is off and does not emit red light. The infrared light source in the PPG module is on and emits infrared light. The first photodetector in the PPG module is off and does not need to receive reflected red light. The second photodetector in the PPG module is on and receives reflected infrared light.

[0203] Electronic device 100 can obtain PPG signal based on the reflected infrared light received by photodetector, and detect whether an object is approaching based on the PPG signal.

[0204] IV. Suspend Mode

[0205] In some embodiments, when preset conditions are met, the electronic device 100 can control the PPG module to be in a suspend mode.

[0206] In suspend mode, electronic device 100 can control the light source in the PPG module to not emit red light and visible light, and the photodetector in the PPG module will not be turned on. At this time, the PPG module does not need to be used, so that the power consumption of the PPG module is minimized.

[0207] Table 13

[0208] Light source closure Photodetector closure

[0209] Table 13 shows the operating status of each component in the PPG module in suspend mode.

[0210] Table 13 shows that the PPG module includes a light source and a photodetector. In suspend mode, the light source in the PPG module is turned off, so there is no need to emit red or infrared light, and the photodetector in the PPG module is also turned off, so there is no need to receive reflected light, thus minimizing the power consumption of the PPG module.

[0211] Table 14

[0212]

[0213]

[0214] Table 14 shows the operating status of each component in the PPG module in suspend mode.

[0215] Table 14 shows that the PPG module includes a light source, a first photodetector, and a second photodetector. In suspend mode, the light source in the PPG module is turned off, so there is no need to emit red or infrared light. Both the first and second photodetectors in the PPG module are in the off state, so there is no need to receive reflected light, thus minimizing the power consumption of the PPG module.

[0216] Table 15

[0217] Red light source closure Infrared light source closure Photodetector closure

[0218] Table 15 shows another working state of the various components in the PPG module in suspended mode.

[0219] Table 15 shows that the PPG module includes a red light source, an infrared light source, and a photodetector. In suspend mode, the red light source is off and does not emit red light. The infrared light source is also off and does not emit infrared light. The photodetector is also off and does not receive reflected light, thus minimizing the power consumption of the PPG module.

[0220] Table 16

[0221] Red light source closure Infrared light source Turn on and emit infrared light First photodetector closure Second photodetector closure

[0222] Table 16 shows the working status of each component in the PPG module in another supplementary lighting mode.

[0223] Table 16 shows that the PPG module includes a red light source, an infrared light source, a first photodetector, and a second photodetector. In suspend mode, the red light source is off and does not emit red light. The infrared light source is also off and does not emit infrared light. Both the first and second photodetectors in the PPG module are off, eliminating the need to receive reflected light, thus minimizing the power consumption of the PPG module.

[0224] This application provides a method for controlling the operating mode of a sensor. The electronic device includes a sensor, which includes a light source and a photodetector. The light source emits red light and / or infrared light, and the photodetector receives reflected red light and / or reflected infrared light. The method includes: in response to the electronic device satisfying a first condition, the electronic device controls the sensor to be in a first operating mode; in response to the electronic device satisfying a second condition, the electronic device controls the sensor to be in a second operating mode. The first condition and the second condition are different, and the first operating mode and the second operating mode are different. The first operating mode and the second operating mode include any one of the following: proximity mode, supplementary lighting mode, and measurement mode. The proximity mode includes emitting infrared light through the light source and receiving reflected infrared light through the photodetector; the supplementary lighting mode includes emitting infrared light through the light source; and the measurement mode includes emitting red light and infrared light through the light source and receiving reflected red light and reflected infrared light through the photodetector.

[0225] In some embodiments, the supplemental lighting mode may also include controlling the photodetector to stop receiving reflected infrared light, which can further save the power consumption of the sensor.

[0226] In some embodiments, the sensor may also include a suspended mode. In suspended mode, the light source does not emit red or infrared light, and the photodetector does not receive reflected red or infrared light, resulting in the lowest sensor efficiency.

[0227] In some embodiments, the sensor may be a proximity light sensor or a PPG module, and this application does not limit the specific sensor to either.

[0228] The sensor in this application can operate in different working modes. For example, the sensor can operate in proximity mode to prevent accidental activation when the electronic device is in a pocket or backpack. The sensor can operate in supplemental lighting mode to improve the success rate of face unlock. The sensor can operate in measurement mode to measure health data such as blood pressure, blood oxygen, and respiratory rate. The sensor can operate in suspend mode when not in use. This method not only improves the utilization rate of the sensor but also saves its power consumption.

[0229] The sensor may include a PPG module or a proximity light sensor.

[0230] Next, we will explain how the electronic device 100 switches between the different working modes of the PPG module.

[0231] Optionally, the various operating modes of the PPG module can be related to the device type of the electronic device 100.

[0232] When the electronic device 100 is a wearable device (such as a smartwatch), the operating modes of the PPG module on the electronic device 100 may include, but are not limited to, suspend mode and measurement mode.

[0233] When the electronic device 100 is a non-wearable device and does not include a foldable small screen, the operating modes of the PPG module on the electronic device 100 may include, but are not limited to, suspend mode, proximity mode, and measurement mode.

[0234] When the electronic device 100 is a non-wearable device and includes a foldable small screen, the operating modes of the PPG module on the electronic device 100 may include, but are not limited to, hanging mode, proximity mode, supplementary light mode, and measurement mode.

[0235] The following sections will explain how the three types of electronic devices control the PPG module to switch between different operating modes.

[0236] Electronic device 100 is a non-wearable device and includes a foldable small screen.

[0237] When the electronic device 100 is a non-wearable device and includes a foldable small screen, the PPG module on the electronic device 100 can support, but is not limited to, hanging mode, proximity mode, supplementary light mode, and measurement mode.

[0238] I. Device form of electronic equipment 100

[0239] Figures 2A-2C A schematic diagram of the device configuration of electronic device 100 is shown.

[0240] When the electronic device 100 includes a foldable small screen, the electronic device 100 is a foldable device, and the device form of the electronic device 100 includes, but is not limited to, unfolded state, intermediate state and folded state.

[0241] in, Figures 2A-2B A schematic diagram of the electronic device 100 in its deployed state is shown.

[0242] The electronic device 100 provided in this application embodiment can be either an outward-folding folding screen device or an inward-folding folding screen device. An outward-folding folding screen device achieves folding of the electronic device by folding outwards, while an inward-folding folding screen device achieves folding of the electronic device by folding inwards.

[0243] This application uses an inward-folding screen device as an example for illustration.

[0244] Figure 2A Image (a) shows a front view of the electronic device 100 in its deployed state. Figure 2AAs shown in (a), the electronic device 100 includes a display screen 1, a display screen 2, and a folding line 201.

[0245] Optionally, display screen 1 and display screen 2 can be a single, complete display screen.

[0246] In some embodiments, display screen 1 and display screen 2 may also be referred to as foldable screens. In some embodiments, display screen 1 may be referred to as a third display screen. In some embodiments, display screen 2 may be referred to as a fourth display screen.

[0247] In the unfolded state, display screens 1 and 2 face the user, and the angle between them is approximately 180°, meaning that the plane containing display screen 1 and the plane containing display screen 2 are on the same horizontal plane. In this unfolded state, the electronic device 100 can simultaneously display images on both display screens 1 and 2. This allows the user to view images from both display screens at the same time.

[0248] Figure 2A (b) shows a rear view of the electronic device 100 in its deployed state. Figure 2A As shown in (b), the electronic device 100 includes a lens assembly 202 and a display screen 203.

[0249] In some embodiments, the display screen 203 may also be referred to as a foldable mini-screen. In some embodiments, the display screen 203 may also be referred to as a second display screen.

[0250] The lens group 202 may include multiple lenses. These lenses include lenses from three cameras and a lens 204 from the PPG module. In some embodiments, the three cameras may be a main camera, a wide-angle camera, and a telephoto camera. The electronic device 100 is not limited to three cameras; it may also include more or fewer cameras, such as two or four cameras, etc., which is not limited in this application.

[0251] In some embodiments, in order to distinguish the lens of the camera from the lens 204 of the PPG module, the lens 204 may be configured with a special structure such as a protrusion, a depression, or a frosted finish to differentiate it from the lens of the camera.

[0252] In some embodiments, the external shape of the lens 204 may also differ from that of the camera lens, making it easier for users to distinguish the lens of the PPG module.

[0253] When the electronic device 100 is in the unfolded state, the display screen 203 is in an off state and cannot be operated.

[0254] Figure 2B The intermediate state of electronic device 100 is shown. For example... Figure 2BAs shown, in the intermediate state, there is a certain angle between the plane where display screen 1 is located and the plane where display screen 2 is located, and the angle is greater than 0° and less than 180°.

[0255] In an intermediate state, the electronic device 100 can display an image only on display screen 1 or display screen 2. This allows the user to view only the image from display screen 1 or display screen 2. Alternatively, the electronic device 100 can display different images on display screen 1 and display screen 2 simultaneously. This allows the user to selectively view the image from display screen 1 or display screen 2 from the two displays.

[0256] Figure 2C The folded state of the electronic device 100 is shown. For example... Figure 2C As shown, in the folded state, the angle between the plane where display screen 1 is located and the plane where display screen 2 is located is close to 0°, and display screen 1 and display screen 2 are folded face to face.

[0257] In the folded state, display screens 1 and 2 are no longer facing the user and cannot display anything. Electronic device 100 can display images through display screen 203.

[0258] When folded, the display screen 203 is lit and operable, for example, the display screen 203 can be used to display information such as time and date.

[0259] Here, the display 203 is in a lit state, which can mean that the display 203 is in an unlocked and lit state.

[0260] It should be noted that, Figures 2A-2C This explanation uses a vertically folding screen as an example. In other embodiments, the electronic device 100 may also be a horizontally folding screen. This application only uses a horizontally folding screen as an example and does not constitute a limitation.

[0261] Furthermore, this application does not limit the location of the PPG module; the PPG module can also be located in other positions within the lens assembly 202. Not limited to the lens assembly 202, the PPG module can also be located in other positions on the electronic device 100, and this application does not limit this as well.

[0262] II. Electronic equipment 100 controls the PPG module to switch working modes.

[0263] When the electronic device 100 is in the deployed state, the PPG module is controlled to switch operating modes.

[0264] Next, we will explain how the PPG module on the electronic device 100 switches between different working modes when the electronic device 100 is a non-wearable device and includes a foldable small screen.

[0265] in, Figure 3 This diagram illustrates how the electronic device 100 controls the PPG module to switch operating modes when the electronic device 100 is in the deployed state.

[0266] When the electronic device 100 is in the unfolded state, the PPG module in the electronic device 100 supports both suspend mode and measurement mode.

[0267] When the electronic device 100 is in the deployed state, it can receive health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation (SaO2) measured by the user.

[0268] Figures 4A-4G A UI diagram is shown for an electronic device 100 that receives user-operated health measurement data.

[0269] like Figure 4A As shown, the electronic device 100 displays a main interface. The main interface may include: a status bar, a tray with icons of commonly used applications, and other application icons. The status bar may include a time indicator, a battery status indicator, one or more Wi-Fi signal strength indicators, and one or more cellular signal strength indicators. The tray with icons of commonly used applications may display: a camera icon, a phone icon, a contacts icon, and an SMS icon. Other application icons may include, for example: a clock icon, a calendar icon, a gallery icon, a memo icon, a Huawei Video icon, and a fitness tracking icon. The fitness tracking icon, along with icons for other applications (such as the gallery), is also included. Any application icon can be used in response to a user action (e.g., a click), causing the electronic device 100 to launch the application corresponding to that icon. The fitness tracking icon can be used to launch the fitness tracking application. The electronic device 100 can display the user's exercise data through the fitness tracking application.

[0270] Electronic device 100 receives and responds to user actions (e.g., clicks) on an icon related to fitness and health; electronic device 100 may display, for example... Figure 4B The user interface 420 for sports health is shown.

[0271] like Figure 4B As shown, the user interface 420 may include a status bar and interface viewing options. These options may include motion options, device options, discovery options, and a "My" option. Any option can be used in response to a user action (e.g., a click), causing the electronic device 100 to display the corresponding content on the user interface 420. For example, the content corresponding to the device option may include information about devices already added to the electronic device and controls for adding new devices.

[0272] The user interface 420 displays cards containing various measured health data, as well as options for measuring health data. For example, the user interface 420 may include cards for weight management, heart health, stress, and blood oxygen saturation. The weight management card shows the user's physical fitness level. The blood oxygen saturation card shows a blood oxygen saturation of 99%.

[0273] The user interface 420 also displays options 401 for measuring blood oxygen saturation, 402 for measuring heart rate, and 403 for measuring respiratory rate. Users can measure their blood oxygen saturation using option 401. Users can also measure their heart rate using option 402. Users can also measure their respiratory rate using option 403.

[0274] Optionally, the electronic device 100 can also receive the user's swipe operation to allow the electronic device 100 to display other health data measurement options.

[0275] For example, such as Figure 4B As shown, the electronic device 100 can receive user input (e.g., a click) for the blood oxygen saturation measurement option 401, and in response to the user's input, the electronic device 100 can display... Figure 4C The user interface shown is 430.

[0276] like Figure 4C As shown, the user interface 430 may include measurement animations and measurement indication information.

[0277] The measurement animation is used to indicate the location of the PPG module in the user's electronic device 100, as well as measurement gestures.

[0278] Measurement instructions are used to guide users to the correct measurement posture to improve the accuracy of measurement results. For example, measurement instructions may include "place naturally, do not press, when there are multiple cameras, cover the main camera and flash, ensure the screen detection area is red, and if there is no signal, try placing it only on the camera, etc."

[0279] The user interface 430 also includes a start measurement option 4301, through which the user can start measuring the user's blood oxygen saturation.

[0280] For example, such as Figure 4C As shown, the electronic device 100 can receive user input (e.g., a click) for the start measurement option 4301 in the user interface 430, and in response to the user's input, the electronic device 100 can display... Figure 4D The user interface 440 shown is used to demonstrate the blood oxygen saturation measurement process.

[0281] Optionally, in response to a user input operation (e.g., a click) to the start measurement option 4301 in the user interface 430, the electronic device 100 may control the PPG module to emit a red light to prompt the user to place their finger at the location where the red light is emitted.

[0282] like Figure 4D As shown, the user interface 440 includes a ball 404, measurement progress 405, measurement data waveform 406, and prompt information 407.

[0283] Among them, the ball 404 is used to indicate whether the electronic device 100 remains stable. Only when the electronic device 100 remains stable will the measurement result be accurate.

[0284] When a user shakes the electronic device 100 back and forth, the ball 404 will move back and forth in the display area according to the direction of the user's shaking, thus prompting the user that the electronic device 100 is not stable.

[0285] When the user holds the electronic device 100 without shaking and keeps it stable, the ball 404 will remain stable in the center of the display area, thus indicating to the user that the electronic device 100 is currently stable.

[0286] In this way, by using the trajectory of the ball 404 to reflect whether the electronic device 100 remains stable, the user's attention can be focused, thereby keeping the phone stable and improving the measurement results.

[0287] The measurement progress 405 in the user interface 440 is used to reflect the measurement duration or the amount of measurement data collected by the electronic device 100.

[0288] The measurement data waveform 406 is used to indicate the quality of the acquired measurement data. When the quality of the measurement data acquired by the electronic device 100 is poor, the electronic device 100 can display the measurement data waveform in a first color (e.g., yellow), and at the same time, the electronic device 100 can display a prompt message 407 to remind the user that the current posture is incorrect, resulting in poor quality of the measurement data acquired by the electronic device 100, and to prompt the user to adjust the posture and start the measurement again.

[0289] In some embodiments, the electronic device 100 may display the following information after the user adjusts their posture and remeasures their blood oxygen saturation: Figure 4E The user interface 450 shown may include a measurement data waveform 408, which is used to indicate the quality of the acquired measurement data. When the quality of the measurement data acquired by the electronic device 100 meets the requirements, the electronic device 100 may display the measurement data waveform in a second color (e.g., green).

[0290] like Figure 4FAs shown, when the measurement data collected by the electronic device 100 reaches a preset duration or a preset number of measurement data collected by the electronic device 100, the electronic device 100 can display... Figure 4F The user interface 460 shown in the user interface 460 is used to indicate that the measurement data collected by the electronic device 100 has reached a preset duration or a preset number of measurement data collected by the electronic device 100.

[0291] Afterwards, the electronic device 100 can save the measurement data and display the measurement results based on the measurement data.

[0292] Optionally, the electronic device 100 can display Figure 4G The user interface shown is 470.

[0293] The user interface 470 may include display area 4701, display area 4702 and display area 4703.

[0294] The display area 4701 may include a chart showing the relationship between standard blood oxygen saturation and age, as well as real-time blood oxygen saturation. The blood oxygen saturation shown in display area 4701 is 60%. The standard blood oxygen saturation-age relationship curve may include a standard curve, an upper limit curve, and a lower limit curve. If the real-time blood oxygen saturation is near the standard curve, it indicates that the user's blood oxygen saturation is normal. If the real-time blood oxygen saturation is near or below the lower limit curve, it indicates that the user's blood oxygen saturation is too low and does not meet the standard. If the real-time blood oxygen saturation is near or above the upper limit curve, it indicates that the user's blood oxygen saturation is very good and exceeds the standard.

[0295] In some embodiments, the electronic device 100 may not display the standard curve or the upper limit curve.

[0296] Display area 4702 includes blood oxygen saturation measurement data, for example, the measured blood oxygen saturation is 60%.

[0297] Users can see whether their real-time blood oxygen saturation is normal or abnormal from display area 4701. Real-time blood oxygen saturation near or below the lower limit curve is considered abnormal. Real-time blood oxygen saturation at a certain distance from the lower limit curve is considered normal.

[0298] Display area 4703 includes targeted suggestions based on the user's blood oxygen saturation test data. For example, the suggestion could be, "It is recommended that the user engage in appropriate exercise (such as jogging, swimming, etc.) or breathing exercises to improve blood oxygen saturation, inhale more oxygen, adjust their diet, pay attention to their own condition, and seek medical attention promptly if they feel unwell."

[0299] It should be noted that, Figures 4A-4GThis is merely an illustrative diagram of one method for measuring a user's health data. The electronic device 100 can also measure the user's health data in other ways, and this application does not limit this method.

[0300] like Figure 3 As shown, when the electronic device 100 is in the deployed state, and when the electronic device 100 has not received a user operation to start measuring health data, the electronic device 100 can control the PPG module to be in a suspended mode to save the power consumption of the PPG module, thereby saving the power of the electronic device 100. For details on how the electronic device 100 controls the PPG module to be in the suspended mode, please refer to the descriptions in Tables 13 to 16 of the embodiments; these details will not be repeated here.

[0301] When the electronic device 100 is in the deployed state, and upon receiving a user's operation to begin measuring health data, the electronic device 100 can control the PPG module to switch from the suspended mode to the measurement mode, enabling the electronic device 100 to detect the user's health data based on the PPG module in the measurement mode. For details on how the electronic device 100 controls the PPG module to be in the measurement mode, please refer to the descriptions in Tables 1 to 4 of the embodiments; these details will not be repeated here.

[0302] When the electronic device 100 is in the deployed state, after the electronic device 100 has completed the health data detection, the electronic device 100 can control the PPG module to return to the suspend mode to save the power consumption of the PPG module, thereby saving the power of the electronic device 100.

[0303] When the electronic device 100 is in an unfolded / folded state, the PPG module is controlled to switch operating modes.

[0304] Figures 5A-5C This diagram illustrates how the electronic device 100 controls the PPG module to switch operating modes when the electronic device 100 is in a folded state.

[0305] like Figure 5A As shown, when the electronic device 100 is in a folded state, the PPG module in the electronic device 100 supports proximity mode, hanging mode and fill light mode.

[0306] In the folded state, the folded small screen of the electronic device 100 is lit and operable, and can be used to display information such as time and date.

[0307] Users can also play music or take photos using the foldable small screen.

[0308] For example, such as Figure 6AAs shown, the electronic device 100 can receive a swipe operation (e.g., a right swipe) performed by a user on the display screen 203, and in response to the user's swipe operation, the electronic device 100 can display... Figure 6B The user interface 205 shown.

[0309] like Figure 6B As shown, the user interface 205 can be a music playback interface. This interface includes the name of the music to be played, "AAA," the playback progress of "AAA" at 42 seconds, and the total playback time of "AAA" being 4 minutes and 42 seconds. The user interface 205 also includes options to switch to the previous track, the next track, and a play / pause option. Users can use the play / pause option to start or pause music playback on the electronic device 100. Currently, the electronic device 100 is pausing playback of the music "AAA."

[0310] In other words, when the electronic device 100 is in a folded state, in addition to displaying information such as time and date on the display screen 203, the user can also control the electronic device 100 to perform some operations through the display screen 203, such as controlling the electronic device 100 to pause / play music, controlling the electronic device 100 to turn on the camera and take pictures, etc. This application does not limit this.

[0311] In some embodiments, when the electronic device 100 is in a folded state, if a user places the folded electronic device 100 in a backpack or clothing pocket, accidental touches may occur due to friction from clothing or skin, especially if the folded screen is not equipped with a proximity sensor. For example, an accidental touch might cause the electronic device 100 to start playing music or taking pictures, resulting in a poor user experience.

[0312] For example, to avoid accidental touches on the foldable screen, after recognizing that the electronic device 100 has changed from an unfolded state to a folded state, the electronic device 100 can control the PPG module to enter proximity mode.

[0313] After the electronic device 100 controls the PPG module to enter proximity mode, the electronic device 100 can determine whether an object is approaching. If an object is detected to be approaching continuously for a period of time, the electronic device 100 can enter the anti-accidental touch mode. After the electronic device 100 enters the anti-accidental touch mode, the foldable screen of the electronic device 100 becomes non-touchable to prevent accidental touches.

[0314] Optionally, in some embodiments, after the electronic device 100 is in anti-mistouch mode, the electronic device 100 may display... Figure 6CThe user interface 206 shown includes the prompt message "Anti-accidental touch mode, swipe twice below to force exit". This prompt message is used to inform the user that the electronic device 100 is in anti-accidental touch mode.

[0315] Optionally, in some embodiments, after the electronic device 100 is in the anti-accidental touch mode, the electronic device 100 can turn off the folding small screen and make it untouchable, so as to prevent accidental touch.

[0316] When the foldable screen becomes untouchable, it means that the foldable screen is not responding to touch events.

[0317] In some embodiments, if it is determined that no object is approaching for a continuous period of time, the electronic device 100 can determine that no accidental touch will occur, and the electronic device 100 may not be in the anti-accidental touch mode.

[0318] like Figure 5A As shown, after the electronic device 100 switches from the unfolded state to the folded state, with the folded small screen in the on state, the electronic device 100 controls the PPG module to be in a suspended mode. For details on how the electronic device 100 controls the PPG module to be in the suspended mode, please refer to the descriptions in Tables 13 to 16 of the embodiments; these will not be repeated here.

[0319] After the electronic device 100 controls the PPG module to be in suspend mode, if the electronic device 100 detects no user operation within the first time period, it can determine that the user is not currently using the foldable small screen. Then the electronic device 100 can control the PPG module to be in proximity mode to prevent accidental touches.

[0320] Optionally, after the electronic device 100 controls the PPG module to be in suspend mode, if the electronic device 100 detects that the folding small screen is off or detects that the duration of the folding small screen being off exceeds a first duration, the electronic device 100 can control the PPG module to be in proximity mode to prevent accidental touches.

[0321] "Foldable small screen off" can refer to a foldable small screen being locked and off.

[0322] After the electronic device 100 controls the PPG module to enter proximity mode, and after the foldable small screen is locked, if the electronic device 100 recognizes a face image or continuously recognizes a face image for a period of time, it can be determined that the current user needs to perform an unlocking operation on the foldable small screen. The electronic device 100 can control the PPG module to enter supplementary light mode to improve the success rate of face unlocking. For details on how the electronic device 100 controls the PPG module to enter supplementary light mode, please refer to the descriptions in Tables 5 to 8 of the embodiments; these will not be repeated here.

[0323] Optionally, if the electronic device 100 recognizes a face image or recognizes a face image for a continuous period of time, and if the electronic device 100 is already in the anti-mistouch mode, the electronic device 100 can automatically deactivate the anti-mistouch mode. In other embodiments, the electronic device 100 may also leave the anti-mistouch mode in place, allowing the user to manually deactivate it.

[0324] After the PPG module is in fill light mode, and the foldable small screen successfully unlocks with face recognition, the foldable small screen returns to a lit state, and electronic device 100 can control the PPG module to enter suspend mode. The foldable small screen then becomes operable, allowing the user to control electronic device 100, such as playing music or taking photos.

[0325] Subsequently, when the electronic device 100 is in a folded state, the electronic device 100 can control the PPG module to switch back and forth between proximity mode, hanging mode and fill light mode.

[0326] like Figure 5B As shown, after the electronic device 100 switches from the unfolded state to the folded state, while the folded small screen is on, the electronic device 100 can also control the PPG module to be in proximity mode to prevent accidental touches.

[0327] After the electronic device 100 controls the PPG module to enter proximity mode, and after the foldable small screen is locked, if the electronic device 100 recognizes a face image or continuously recognizes a face image for a period of time, it can be determined that the current user needs to perform an unlocking operation on the foldable small screen. The electronic device 100 can control the PPG module to enter supplementary light mode to improve the success rate of face unlocking. For details on how the electronic device 100 controls the PPG module to enter supplementary light mode, please refer to the descriptions in Tables 5 to 8 of the embodiments; these will not be repeated here.

[0328] Optionally, if the electronic device 100 recognizes a face image or recognizes a face image for a continuous period of time, and if the electronic device 100 is already in the anti-mistouch mode, the electronic device 100 can automatically deactivate the anti-mistouch mode. In other embodiments, the electronic device 100 may also leave the anti-mistouch mode in place, allowing the user to manually deactivate it.

[0329] After the PPG module is in fill light mode, and the foldable small screen successfully unlocks with face recognition, the foldable small screen returns to a lit state, and electronic device 100 can control the PPG module to enter suspend mode. The foldable small screen then becomes operable, allowing the user to control electronic device 100, such as playing music or taking photos.

[0330] After the electronic device 100 controls the PPG module to be in suspend mode, if the electronic device 100 detects no user operation within a first time period, it can determine that the user is not currently using the foldable screen. Alternatively, if the electronic device 100 detects that the foldable screen is off or the electronic device 100 detects that the foldable screen has been off for more than the first time period, the electronic device 100 can control the PPG module to be in proximity mode to prevent accidental touches.

[0331] Subsequently, when the electronic device 100 is in a folded state, the electronic device 100 can control the PPG module to switch back and forth between proximity mode, hanging mode and fill light mode.

[0332] like Figure 5C As shown, after the electronic device 100 switches from the unfolded state to the folded state, the electronic device 100 can also control the PPG module to be in proximity mode to prevent accidental touch.

[0333] After the electronic device 100 controls the PPG module to enter proximity mode, if the electronic device 100 recognizes a face image or continuously recognizes a face image for a period of time, it can determine that the current user needs to perform an unlocking operation on the foldable small screen. The electronic device 100 can control the PPG module to enter supplementary light mode to improve the success rate of face unlocking. For details on how the electronic device 100 controls the PPG module to enter supplementary light mode, please refer to the descriptions in Tables 5 to 8 of the embodiments; these will not be repeated here.

[0334] Optionally, if the electronic device 100 recognizes a face image or recognizes a face image for a continuous period of time, and if the electronic device 100 is already in the anti-mistouch mode, the electronic device 100 can automatically deactivate the anti-mistouch mode. In other embodiments, the electronic device 100 may also leave the anti-mistouch mode in place, allowing the user to manually deactivate it.

[0335] After the PPG module is in fill light mode, and the foldable small screen face unlock is successful, the electronic device 100 can control the PPG module to be in proximity mode.

[0336] Subsequently, when the electronic device 100 is in a folded state, the electronic device 100 can control the PPG module to switch back and forth between proximity mode and fill light mode.

[0337] Optionally, in some embodiments, before the electronic device 100 controls the PPG module to be in the fill light mode, the electronic device 100 may determine the ambient brightness and / or the clarity of the facial image captured by the camera on the foldable small screen.

[0338] In some embodiments, if the electronic device 100 detects that the clarity of the facial image captured by the camera on the foldable screen is less than a preset value, the electronic device 100 can control the PPG module to be in supplementary lighting mode. If the electronic device 100 detects that the clarity of the facial image captured by the camera on the foldable screen is greater than a preset value, supplementary lighting is not required, and the electronic device 100 may not control the PPG module to be in supplementary lighting mode.

[0339] In some embodiments, if the electronic device 100 detects that the ambient light brightness is greater than a first preset brightness, the electronic device 100 may not control the PPG module to be in supplementary lighting mode, and supplementary lighting is not required. This reduces the power consumption of the PPG mode.

[0340] When the electronic device 100 detects that the ambient light brightness is less than the first preset brightness, the electronic device 100 can control the PPG module to be in supplementary light mode to improve the clarity of the face image captured by the camera and improve the success rate of face unlock.

[0341] In some embodiments, if the electronic device 100 detects that the clarity of the facial image captured by the camera on the foldable screen is less than a preset value, the electronic device 100 then monitors the ambient light brightness. If the electronic device 100 detects that the ambient light brightness is less than a first preset brightness, the electronic device 100 can control the PPG module to be in supplementary lighting mode. If the electronic device 100 detects that the ambient light brightness is greater than the first preset brightness, the electronic device 100 can control the PPG module to be out of supplementary lighting mode.

[0342] Optionally, if the electronic device 100 detects that the ambient light brightness is less than the first preset brightness, the electronic device 100 may not distinguish between ambient light levels and simply control the PPG module to be in supplementary lighting mode.

[0343] In other embodiments, the electronic device 100 can sense the ambient light intensity and control the PPG module to be in different supplementary lighting modes based on different ambient light intensity.

[0344] For example, when the electronic device 100 detects that the ambient light brightness is greater than the second preset brightness but less than the first preset brightness, the electronic device 100 can control the PPG module to be in a first supplementary lighting mode. The first supplementary lighting mode can be to control the light source in the PPG module to emit infrared light of a first intensity for supplementary lighting.

[0345] When the electronic device 100 detects that the ambient light brightness is less than the second preset brightness, the electronic device 100 can be in the second supplementary lighting mode. The second supplementary lighting mode can be to control the light source in the PPG module to emit infrared light of the second intensity for supplementary lighting.

[0346] The second preset brightness is lower than the first preset brightness, and the second intensity is greater than the first intensity. In this way, the electronic device 100 can adjust the intensity of the infrared light emitted by the light source in the PPG module based on the ambient brightness level, which can improve the success rate of face unlocking and save power consumption of the PPG module.

[0347] It should be noted that, in addition to two ambient brightness levels, the electronic device 100 can also control the light source in the PPG module to emit infrared light of different intensities based on more different ambient brightness levels, and this application does not limit this.

[0348] In this way, when the electronic device 100 is in folded mode, the electronic device 100 can control the PPG module to be in different working modes, which can not only improve the utilization rate of the PPG module, but also save the power consumption of the PPG module.

[0349] Figure 7 A schematic diagram is shown of an electronic device 100 controlling the switching of operating modes of a PPG module.

[0350] like Figure 7 As shown, when the electronic device 100 is in the unfolded state, and the electronic device 100 has not received a user operation to start measuring health data, the electronic device 100 can control the PPG module to be in the suspended mode.

[0351] After the electronic device 100 controls the PPG module to be in suspend mode, when the electronic device 100 is in the unfolded state, the electronic device 100 can control the PPG module to switch between suspend mode and measurement mode. For details, please refer to... Figure 3 Description in the embodiments.

[0352] In some embodiments, when the electronic device 100 is in an unfolded state, the electronic device 100 may receive a user operation to switch from the unfolded state to the folded state.

[0353] When the electronic device 100 switches from an unfolded state to a folded state, and the folded small screen is in a lit state, the electronic device 100 can control the PPG module to be in a suspended mode.

[0354] Optionally, when the electronic device 100 switches from the unfolded state to the folded state, the electronic device 100 can also control the PPG module to be in the proximity mode, and this application does not limit this.

[0355] When the electronic device 100 is in a folded state, it can control the PPG module to switch between suspended mode, fill light mode, and proximity mode. For details, please refer to... Figure 5A and Figure 5B Description in the embodiments.

[0356] Optionally, when the electronic device 100 is in a folded state, the electronic device 100 can control the PPG module to switch between supplementary lighting mode and proximity mode. For details, please refer to... Figure 5C Description in the embodiments.

[0357] Figure 8A This application provides a flowchart of a method for an electronic device 100 to control a PPG module to switch working modes.

[0358] S801, Electronic device 100 needs to determine whether electronic device 100 is in an unfolded state or a folded state.

[0359] If it is determined that the electronic device 100 is in the deployed state, S802-S804 are executed.

[0360] If it is determined that the electronic device 100 is in a folded state, S805-S810 are executed.

[0361] S802, Electronic device 100 controls the PPG module to be in suspend mode.

[0362] When the electronic device 100 needs to determine that the electronic device 100 is in the deployed state, the electronic device 100 can control the PPG module to be in the suspended mode.

[0363] When the PPG module is in suspend mode, both the light source and photodetector in the PPG module are turned off. This reduces the power consumption of the PPG module, saving 100% of the power of electronic devices.

[0364] S803, Electronic device 100 needs to determine whether electronic device 100 receives user operation to start measuring health data.

[0365] Optionally, users can start measuring health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation (SaO2) in the sports and health app.

[0366] For example, it can be done according to Figures 4A-4G The method shown begins the measurement of health data.

[0367] In some embodiments, the electronic device 100 may determine whether the user has started measuring health data based on whether the user clicks the blood oxygen saturation measurement option 401 or whether the user clicks the start measurement option 4301.

[0368] Once it is determined that health data should be measured, execute S804.

[0369] If it is determined that no health data has been measured, proceed with S802.

[0370] S804, Electronic Device 100 controls the PPG module to be in measurement mode.

[0371] Once it is determined that health data measurement should begin, the electronic device 100 can control the PPG module to enter measurement mode. This allows the electronic device 100 to detect the user's health data based on the PPG module in measurement mode.

[0372] S805, Electronic Device 100 controls the PPG module to be in suspend mode.

[0373] After the electronic device 100 switches from the unfolded state to the folded state, the electronic device 100 can control the PPG module to be in the suspended mode.

[0374] S806, Electronic device 100 needs to determine whether the foldable small screen is off.

[0375] After the electronic device 100 switches from the unfolded state to the folded state, the folded screen of the electronic device 100 is lit and operable, for example, it can be used to display information such as time and date. Alternatively, users can also play music or open the camera application to take pictures through the folded screen.

[0376] For example, a user can follow Figures 6A-6B It plays music via a foldable small screen.

[0377] After the electronic device 100 controls the PPG module to be in suspend mode, if the electronic device 100 detects no user operation within a first time period, or if the electronic device 100 detects that the foldable screen is off, or if the electronic device 100 detects that the foldable screen has been off for more than the first time period, it can be determined that the user is not currently using the foldable screen. In this case, the electronic device 100 can control the PPG module to be in proximity mode to prevent accidental touches.

[0378] In other words, S807 is executed when the electronic device 100 detects that the folded small screen is off.

[0379] If the electronic device 100 detects that the foldable small screen is not turned off, S805 is executed.

[0380] S807, Electronic Device 100 controls the PPG module to be in proximity mode.

[0381] After the electronic device 100 controls the PPG module to enter proximity mode, the electronic device 100 can determine whether an object is approaching. If an object is detected to be approaching continuously for a period of time, the electronic device 100 can enter the anti-accidental touch mode. After the electronic device 100 enters the anti-accidental touch mode, the foldable screen of the electronic device 100 becomes non-touchable to prevent accidental touches.

[0382] Optionally, in some embodiments, after the electronic device 100 is in anti-mistouch mode, the electronic device 100 may display... Figure 6C The user interface 206 shown includes the prompt message "Anti-accidental touch mode, swipe twice below to force exit". This prompt message is used to inform the user that the electronic device 100 is in anti-accidental touch mode.

[0383] Optionally, in some embodiments, after the electronic device 100 is in the anti-accidental touch mode, the electronic device 100 can turn off the folding small screen and make it untouchable, so as to prevent accidental touch.

[0384] In some embodiments, if it is determined that no object is approaching for a continuous period of time, the electronic device 100 can determine that no accidental touch will occur, and the electronic device 100 may not be in the anti-accidental touch mode.

[0385] S808. After the foldable small screen is locked, the electronic device 100 needs to determine whether a face image has been recognized.

[0386] After the foldable small screen is locked, if the electronic device 100 recognizes a face image or recognizes a face image for a period of time, S809 is executed.

[0387] After the foldable small screen is locked, if the electronic device 100 does not recognize a face image, S807 is executed, that is, the PPG module still maintains proximity mode to prevent accidental touch.

[0388] Optionally, after the electronic device 100 controls the PPG module to be in proximity mode, if the foldable screen is not locked, even if the electronic device 100 recognizes a face image or recognizes a face image for a period of time, the electronic device 100 will still control the PPG module to remain in proximity mode to prevent accidental touches.

[0389] S809 and electronic device 100 control the PPG module to be in supplementary lighting mode.

[0390] After the electronic device 100 controls the PPG module to be in proximity mode, if the electronic device 100 recognizes a face image or recognizes a face image for a period of time, it can determine that the current user needs to perform an unlocking operation on the foldable small screen. The electronic device 100 can control the PPG module to be in fill light mode to improve the success rate of face unlocking.

[0391] Optionally, if the electronic device 100 recognizes a face image or recognizes a face image for a continuous period of time, and if the electronic device 100 is already in the anti-mistouch mode, the electronic device 100 can automatically deactivate the anti-mistouch mode. In other embodiments, the electronic device 100 may also leave the anti-mistouch mode in place, allowing the user to manually deactivate it.

[0392] Optionally, in some embodiments, before the electronic device 100 controls the PPG module to be in the fill light mode, the electronic device 100 may determine the ambient brightness and / or the clarity of the facial image captured by the camera on the foldable small screen.

[0393] In some embodiments, if the electronic device 100 detects that the clarity of the facial image captured by the camera on the foldable screen is less than a preset value, the electronic device 100 can control the PPG module to be in supplementary lighting mode. If the electronic device 100 detects that the clarity of the facial image captured by the camera on the foldable screen is greater than a preset value, supplementary lighting is not required, and the electronic device 100 may not control the PPG module to be in supplementary lighting mode.

[0394] In some embodiments, when the electronic device 100 detects that the ambient light brightness is greater than a first preset brightness, the electronic device 100 may not control the PPG module to be in supplementary lighting mode, thus eliminating the need for supplementary lighting. This reduces the power consumption of the PPG mode. When the electronic device 100 detects that the ambient light brightness is less than the first preset brightness, the electronic device 100 may control the PPG module to be in supplementary lighting mode to improve the clarity of the face image captured by the camera and increase the success rate of face unlock.

[0395] In some embodiments, if the electronic device 100 detects that the clarity of the facial image captured by the camera on the foldable screen is less than a preset value, the electronic device 100 then monitors the ambient light brightness. If the electronic device 100 detects that the ambient light brightness is less than a first preset brightness, the electronic device 100 can control the PPG module to be in supplementary lighting mode. If the electronic device 100 detects that the ambient light brightness is greater than the first preset brightness, the electronic device 100 can control the PPG module to be out of supplementary lighting mode.

[0396] Optionally, if the electronic device 100 detects that the ambient light brightness is less than the first preset brightness, the electronic device 100 may not distinguish between ambient light levels and simply control the PPG module to be in supplementary lighting mode.

[0397] In other embodiments, the electronic device 100 can sense the ambient light intensity and control the PPG module to be in different supplementary lighting modes based on different ambient light intensity.

[0398] For example, when the electronic device 100 detects that the ambient light brightness is greater than the second preset brightness but less than the first preset brightness, the electronic device 100 can control the PPG module to be in a first supplementary lighting mode. The first supplementary lighting mode can be to control the light source in the PPG module to emit infrared light of a first intensity for supplementary lighting.

[0399] When the electronic device 100 detects that the ambient light brightness is less than the second preset brightness, the electronic device 100 can be in the second supplementary lighting mode. The second supplementary lighting mode can be to control the light source in the PPG module to emit infrared light of the second intensity for supplementary lighting.

[0400] The second preset brightness is lower than the first preset brightness, and the second intensity is greater than the first intensity. In this way, the electronic device 100 can adjust the intensity of the infrared light emitted by the light source in the PPG module based on the ambient brightness level, which can improve the success rate of face unlocking and save power consumption of the PPG module.

[0401] It should be noted that, in addition to two ambient brightness levels, the electronic device 100 can also control the light source in the PPG module to emit infrared light of different intensities based on more different ambient brightness levels, and this application does not limit this.

[0402] After the electronic device 100 controls the PPG module to be in the fill light mode, and after the electronic device 100 detects that the foldable small screen face unlock is successful, the electronic device 100 can then control the PPG module to be in the suspend mode.

[0403] In this way, when the electronic device 100 is in folded mode, the electronic device 100 can control the PPG module to be in different working modes, which can not only improve the utilization rate of the PPG module, but also save the power consumption of the PPG module.

[0404] S810 and electronic devices 100 need to confirm whether face unlock is successful.

[0405] If face unlock is successful, S805 can be executed.

[0406] If face unlock fails, continue executing S809.

[0407] After the electronic device 100 is in the fill light mode, the electronic device 100 needs to determine whether the foldable small screen face unlock is successful. If the face unlock is successful, the foldable small screen of the electronic device 100 is in a lit and operable state. Then, the electronic device 100 can execute S805, that is, control the PPG module to return to the suspend mode, and the foldable small screen can perform corresponding operations based on the user's operation.

[0408] After the electronic device 100 is in the fill light mode, the PPG module remains in the fill light mode until the foldable small screen face unlock is successful. Only after the foldable small screen face unlock is successful will the electronic device 100 control the PPG module to switch working modes.

[0409] Figure 8B A flowchart illustrating another method for controlling a PPG module to switch operating modes, provided in this application by an electronic device 100.

[0410] For a description of S901-S904, please refer to the detailed description in S801-S804. This application will not repeat it here.

[0411] S905, Electronic Device 100 controls the PPG module to be in proximity mode.

[0412] After the electronic device 100 switches from the unfolded state to the folded state, the electronic device 100 can also control the PPG module to be in the proximity mode.

[0413] S906. After the foldable small screen is locked, the electronic device 100 needs to determine whether a face image has been recognized.

[0414] After the foldable small screen is locked, if the electronic device 100 recognizes a face image or recognizes a face image for a period of time, S907 is executed.

[0415] After the foldable small screen is locked, if the electronic device 100 does not recognize a face image, S905 is executed, that is, the PPG module still maintains proximity mode to prevent accidental touch.

[0416] Optionally, after the electronic device 100 controls the PPG module to be in proximity mode, if the foldable screen is not locked, even if the electronic device 100 recognizes a face image or recognizes a face image for a period of time, the electronic device 100 will still control the PPG module to remain in proximity mode to prevent accidental touches.

[0417] S907, Electronic Device 100 controls the PPG module to be in supplementary lighting mode.

[0418] After the electronic device 100 controls the PPG module to be in proximity mode, if the electronic device 100 recognizes a face image or recognizes a face image for a period of time, it can determine that the current user needs to perform an unlocking operation on the foldable small screen. The electronic device 100 can control the PPG module to be in fill light mode to improve the success rate of face unlocking.

[0419] Optionally, if the electronic device 100 recognizes a face image or recognizes a face image for a continuous period of time, and if the electronic device 100 is already in the anti-mistouch mode, the electronic device 100 can automatically deactivate the anti-mistouch mode. In other embodiments, the electronic device 100 may also leave the anti-mistouch mode in place, allowing the user to manually deactivate it.

[0420] For an introduction to S907, please refer to the description in S809; this application will not repeat it here.

[0421] S908, Electronic device 100 needs to confirm whether face unlock is successful.

[0422] If face unlock is successful, S909 can be executed.

[0423] If face unlock fails, continue executing S907.

[0424] S909, Electronic Device 100 controls the PPG module to be in suspend mode.

[0425] After the electronic device 100 confirms that the face unlock is successful, the electronic device 100 can control the PPG module to be in suspend mode.

[0426] S910 and Electronic Device 100 need to determine whether the foldable small screen is off.

[0427] After the electronic device 100 controls the PPG module to be in suspend mode, if the electronic device 100 detects no user operation within a first time period, or if the electronic device 100 detects that the foldable screen is off, or if the electronic device 100 detects that the foldable screen has been off for more than the first time period, it can be determined that the user is not currently using the foldable screen. In this case, the electronic device 100 can control the PPG module to be in proximity mode to prevent accidental touches.

[0428] In other words, S909 is executed when the electronic device 100 detects that the folded small screen is off.

[0429] If the electronic device 100 detects that the foldable small screen is not turned off, S905 is executed.

[0430] Figure 8C A flowchart illustrating a method for controlling a PPG module to switch operating modes, provided in this application, using an electronic device 100.

[0431] Optionally, when the electronic device 100 is in a folded state, the electronic device 100 may not support the hanging mode, but only switch between proximity mode and fill light mode.

[0432] For a description of S1001-S1004, please refer to the detailed description in S801-S804. This application will not repeat it here.

[0433] For a description of S1005-S1007, please refer to the detailed description in S905-S907. This application will not repeat it here.

[0434] S1008, Electronic device 100 needs to confirm whether face unlock is successful.

[0435] If face unlock is successful, S1005 can be executed, which controls the PPG module to enter proximity mode.

[0436] If face unlock fails, continue executing S1007, which controls the PPG module to be in fill light mode.

[0437] In other words, under these circumstances, the PPG module can only be controlled to enter fill light mode when face unlock is required. When face unlock is not needed, the PPG module always operates in proximity mode.

[0438] Electronic device 100 is a non-wearable device and does not include foldable small screens.

[0439] If the electronic device 100 is a non-wearable device and does not include a foldable screen, the electronic device 100 can be a foldable screen or a non-foldable screen. The PPG module on the electronic device 100 can support, but is not limited to, suspend mode and measurement mode.

[0440] I. Device form of electronic equipment 100

[0441] in, Figures 9A-9C A schematic diagram of the device form when the electronic device 100 is a foldable screen is shown.

[0442] in, Figures 9A-9B A schematic diagram of the electronic device 100 in its deployed state is shown.

[0443] The electronic device 100 provided in this application embodiment can be either an outward-folding folding screen device or an inward-folding folding screen device. An outward-folding folding screen device achieves folding of the electronic device by folding outwards, while an inward-folding folding screen device achieves folding of the electronic device by folding inwards.

[0444] This application uses an inward-folding screen device as an example for illustration.

[0445] Figure 9A Image (a) shows a front view of the electronic device 100 in its deployed state. Figure 9A As shown in (a), the electronic device 100 includes a display screen 1, a display screen 2, and a folding line 901.

[0446] Optionally, display screen 1 and display screen 2 can be a single, complete display screen.

[0447] In the unfolded state, display screens 1 and 2 face the user, and the angle between them is approximately 180°, meaning that the plane containing display screen 1 and the plane containing display screen 2 are on the same horizontal plane. In this unfolded state, the electronic device 100 can simultaneously display images on both display screens 1 and 2. This allows the user to view images from both display screens at the same time.

[0448] Figure 9A (b) shows a rear view of the electronic device 100 in its deployed state. Figure 9A As shown in (b), the electronic device 100 includes a lens assembly 902. The electronic device 100 does not include a folding screen.

[0449] The lens group 202 may include multiple lenses. These lenses include lenses from three cameras and a lens 903 from the PPG module. In some embodiments, the three cameras may be a main camera, a wide-angle camera, and a telephoto camera. The electronic device 100 is not limited to three cameras; it may also include more or fewer cameras, such as two or four cameras, etc., which is not limited in this application.

[0450] In some embodiments, in order to distinguish the lens of the camera from the lens 903 of the PPG module, the lens 903 may be configured with a special structure such as a protrusion, a depression, or a frosted finish to differentiate it from the lens of the camera.

[0451] In some embodiments, the external shape of the lens 903 may also differ from that of the camera lens, making it easier for users to distinguish the lens of the PPG module.

[0452] Figure 9B The intermediate state of electronic device 100 is shown. For example... Figure 9B As shown, in the intermediate state, there is a certain angle between the plane where display screen 1 is located and the plane where display screen 2 is located, and the angle is greater than 0° and less than 180°.

[0453] In an intermediate state, the electronic device 100 can display an image only on display screen 1 or display screen 2. This allows the user to view only the image from display screen 1 or display screen 2. Alternatively, the electronic device 100 can display different images on display screen 1 and display screen 2 simultaneously. This allows the user to selectively view the image from display screen 1 or display screen 2 from the two displays.

[0454] Figure 9C The folded state of the electronic device 100 is shown. For example... Figure 9C As shown, in the folded state, the angle between the plane where display screen 1 is located and the plane where display screen 2 is located is close to 0°, and display screen 1 and display screen 2 are folded face to face.

[0455] In the folded state, display screen 1 and display screen 2 are no longer facing the user, and display screen 1 and display screen 2 cannot be displayed.

[0456] It should be noted that, Figures 9A-9C This explanation uses a vertically folding screen as an example. In other embodiments, the electronic device 100 may also be a horizontally folding screen. This application only uses a horizontally folding screen as an example and does not constitute a limitation.

[0457] Furthermore, this application does not limit the location of the PPG module; the PPG module can also be located in other positions within the lens assembly 902. Not limited to the lens assembly 902, the PPG module can also be located in other positions on the electronic device 100, and this application does not limit this as well.

[0458] II. Electronic equipment 100 controls the PPG module to switch working modes.

[0459] When the electronic device 100 is a non-wearable device and does not include a foldable small screen, the operating mode of the PPG module in the electronic device 100 when the electronic device 100 is in the unfolded state can include a measurement mode and a hanging mode. When the electronic device 100 is in the folded state, the operating mode of the PPG module in the electronic device 100 can include a hanging mode.

[0460] Figure 10 A schematic diagram is shown of an electronic device 100 controlling the switching of operating modes of a PPG module.

[0461] like Figure 10 As shown, when the electronic device 100 is in the unfolded state, and the electronic device 100 has not received a user operation to start measuring health data, the electronic device 100 can control the PPG module to be in the suspended mode.

[0462] After the electronic device 100 controls the PPG module to be in the suspended mode, when the electronic device 100 is in the deployed state, when the electronic device 100 receives the user's operation to start measuring health data, the electronic device 100 can control the PPG module to switch from the suspended mode to the measurement mode, so that the electronic device 100 can detect the user's health data based on the PPG module in the measurement mode.

[0463] When the electronic device 100 is in the deployed state, after the electronic device 100 has completed the health data detection, the electronic device 100 can control the PPG module to return to the suspend mode to save the power consumption of the PPG module, thereby saving the power of the electronic device 100.

[0464] In some implementations, when the electronic device 100 receives a user operation to switch from an unfolded state to a folded state, the electronic device 100 can control the PPG module to be in a suspended mode to save the power consumption of the PPG module.

[0465] Figure 11 A flowchart of another method for controlling the PPG module to switch operating modes by an electronic device 100 is shown.

[0466] S1101, Electronic device 100 needs to determine whether electronic device 100 is in an unfolded state or a folded state.

[0467] If it is determined that the electronic device 100 is in the deployed state, S1102-S1104 are executed.

[0468] If it is determined that the electronic device 100 is in a folded state, S1105 is executed.

[0469] S1102, Electronic device 100 controls the PPG module to be in suspend mode.

[0470] When the electronic device 100 needs to determine that the electronic device 100 is in the deployed state, the electronic device 100 can control the PPG module to be in the suspended mode.

[0471] When the PPG module is in suspend mode, both the light source and photodetector in the PPG module are turned off. This reduces the power consumption of the PPG module, saving 100% of the power of electronic devices.

[0472] S1103. Electronic device 100 needs to determine whether electronic device 100 receives user operation to start measuring health data.

[0473] Optionally, users can start measuring health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation (SaO2) in the sports and health app.

[0474] For example, it can be done according to Figures 4A-4G The method shown begins the measurement of health data.

[0475] In some embodiments, the electronic device 100 may determine whether the user has started measuring health data based on whether the user clicks the blood oxygen saturation measurement option 401 or whether the user clicks the start measurement option 4301.

[0476] Once it is determined that health data should be measured, proceed to step S1104.

[0477] If it is determined that no health data has been measured, proceed to S1102.

[0478] S1104, Electronic device 100 controls the PPG module to be in measurement mode.

[0479] Once it is determined that health data measurement should begin, the electronic device 100 can control the PPG module to enter measurement mode. This allows the electronic device 100 to detect the user's health data based on the PPG module in measurement mode.

[0480] S1105, Electronic device 100 controls the PPG module to be in suspend mode.

[0481] After the electronic device 100 switches from the unfolded state to the folded state, the electronic device 100 can control the PPG module to be in the suspended mode.

[0482] Electronic device 100 is a wearable device (such as a smartwatch).

[0483] When the electronic device 100 is a wearable device, the PPG module on the electronic device 100 can support, but is not limited to, suspend mode, measurement mode, etc.

[0484] I. Device form of electronic equipment 100

[0485] Figures 12-14 A schematic diagram of the structure of the electronic device 100 is shown.

[0486] in, Figure 12 A front view of the electronic device 100 is shown.

[0487] Please see Figure 12 The electronic device 100 may include a device body 1201 and a wearable component 1202.

[0488] The main body of the device 1201 may include a display screen 1203. The display screen 1203 can be used to display the time, the battery level of the main body of the device 1201, the Bluetooth identifier, received messages, and user activity data, etc. Optionally, the display screen 1203 can be a touch screen, which can be used to receive user clicks to turn on the display screen, etc.

[0489] The main body of the device 1201 can also record the number of steps the user moves and the calories consumed, and has basic functions such as call reminders and message notifications.

[0490] Wearable component 1202 is used to mount the main body of device 1201. For example, wearable component 1202 can be a wristband or watch strap, etc. Wearable component 1202 is a device that allows the main body of device 1201 to be attached to the user's wrist. Electronic device 100 is attached to the user's wrist, which facilitates the collection of the user's health data and the user's wrist movement data, etc.

[0491] Figure 13A rear view of the electronic device 100 is shown.

[0492] Please see Figure 13 The electronic device 100 may include a device body 1201 and a wearable component 1202. The device body 1201 may have a pre-installed PPG module.

[0493] like Figure 14 When the electronic device 100 is worn on the user's wrist, the electronic device 100 can detect the user's health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation (SaO2) through the PPG module pre-installed on the back of the device body 1201.

[0494] II. Electronic equipment 100 controls the PPG module to switch working modes.

[0495] When the electronic device 100 is a wearable device, the operating modes of the PPG module in the electronic device 100 may include suspend mode and measurement mode, etc.

[0496] Figure 15 A schematic diagram is shown of an electronic device 100 controlling the switching of operating modes of a PPG module.

[0497] like Figure 15 As shown, when the electronic device 100 does not receive a user operation to start measuring health data, the electronic device 100 can control the PPG module to be in a suspend mode.

[0498] When the electronic device 100 receives a user's operation to start measuring health data, the electronic device 100 can control the PPG module to switch from suspend mode to measurement mode, so that the electronic device 100 can detect the user's health data based on the PPG module in measurement mode.

[0499] After the electronic device 100 has completed the health data detection, the electronic device 100 can control the PPG module to be put into suspend mode again to save the power consumption of the PPG module, thereby saving the power of the electronic device 100.

[0500] Figure 16 This diagram illustrates another type of electronic device 100 controlling the switching of operating modes of a PPG module.

[0501] S1601, Electronic device 100 controls the PPG module to be in suspend mode.

[0502] When the electronic device 100 does not receive a user instruction to start measuring health data, it can control the PPG module to be in a suspend mode. In suspend mode, the light source and photodetector in the PPG module are both turned off. This reduces the power consumption of the PPG module, saving power for the electronic device 100.

[0503] S1602, Electronic device 100 needs to determine whether electronic device 100 receives user operation to start measuring health data.

[0504] Optionally, users can start measuring health data such as heart rate, blood oxygen, respiratory rate, and blood oxygen saturation (SaO2) in the sports and health app.

[0505] For example, it can be done according to Figures 4A-4G The method shown begins the measurement of health data.

[0506] In some embodiments, the electronic device 100 may determine whether the user has started measuring health data based on whether the user clicks the blood oxygen saturation measurement option 401 or whether the user clicks the start measurement option 4301.

[0507] Once it is determined that health data should be measured, proceed to step S1603.

[0508] If it is determined that no health data has been measured, proceed with S1601.

[0509] S1603, Electronic device 100 controls the PPG module to be in measurement mode.

[0510] Once it is determined that health data measurement should begin, the electronic device 100 can control the PPG module to enter measurement mode. This allows the electronic device 100 to detect the user's health data based on the PPG module in measurement mode.

[0511] After the health data detection is completed, the electronic device 100 can once again control the PPG module to be in suspend mode.

[0512] The following section introduces the specific operating modes of the light source and photodetector in different working modes of the proximity sensor.

[0513] The operating modes of a proximity sensor may include, but are not limited to, proximity mode, supplemental lighting mode, and suspend mode.

[0514] First, we will introduce the specific operating modes of the light source and photodetector in each different operating mode of the proximity light sensor.

[0515] I. Fill Light Mode

[0516] In some embodiments, when preset conditions are met, the electronic device 100 can control the proximity sensor to be in a supplementary lighting mode.

[0517] For example, in a face unlock scenario, due to low light, the facial image captured by the electronic device 100 may be unclear, leading to face unlock failure. To improve the success rate of face unlock, when the front-facing camera of the electronic device 100 detects the need for face unlock, it can use infrared light emitted from the light source in the proximity sensor to provide supplementary illumination, thereby improving the clarity of the facial image captured by the electronic device 100 and thus increasing the success rate of face unlock.

[0518] Optionally, when the camera capturing the face image is a hyperspectral camera, the electronic device 100 can control the infrared light emitted by the light source in the proximity sensor to provide supplementary illumination when face unlock is detected.

[0519] In other words, in the supplementary lighting mode, the electronic device 100 only needs to control the light source in the proximity sensor to emit infrared light to achieve the purpose of supplementary lighting. The photodetector in the proximity sensor can be turned off to save the power consumption of the PPG module.

[0520] In some embodiments, the photodetector in the proximity light sensor may also be turned on, and this application does not limit this.

[0521] Table 17

[0522] Light source Turn on and infrared light Photodetector Off / On

[0523] Table 17 shows the operating status of the various components in the proximity light sensor in supplemental lighting mode.

[0524] Table 17 shows that the proximity sensor includes a light source and a photodetector. In supplemental lighting mode, the light source in the proximity sensor is on and emits infrared light, eliminating the need for red light, thus providing supplemental lighting for face unlocking. The photodetector in the proximity sensor is off, eliminating the need to receive reflected light and saving power.

[0525] In some embodiments, the photodetector in the proximity light sensor may also be turned on, and this application does not limit this.

[0526] II. Proximity Mode

[0527] In some embodiments, when preset conditions are met, the electronic device 100 can control the proximity sensor to be in proximity mode.

[0528] In proximity mode, the electronic device 100 can control the light source in the proximity light sensor to emit infrared light, without emitting red light. The photodetector in the proximity light sensor group needs to be turned on and receive the reflected infrared light. It then detects whether there is physical proximity based on the received reflected infrared light. When an object is detected approaching, it enters the accidental touch prevention mode.

[0529] For example, when there is physical proximity, the photodetector in the proximity light sensor receives a high signal intensity of reflected infrared light. When the signal intensity of the reflected infrared light is detected to be greater than a preset intensity for a continuous first time period, the electronic device 100 can control the proximity light sensor to be in proximity mode.

[0530] Table 18

[0531] Light source Turn on and emit infrared light Photodetector Turn on and receive reflected infrared light

[0532] Table 18 shows the operating status of the various components in the proximity light sensor in proximity mode.

[0533] Table 18 shows that the proximity light sensor includes a light source and a photodetector. In proximity mode, the light source in the proximity light sensor is turned on and emits infrared light. The photodetector in the proximity light sensor is also turned on and receives reflected infrared light.

[0534] Electronic device 100 can detect whether an object is approaching based on the reflected infrared light received by a photodetector.

[0535] III. Suspend Mode

[0536] In some embodiments, when preset conditions are met, the electronic device 100 can control the proximity sensor to be in a suspended mode.

[0537] In suspend mode, electronic device 100 can control the light source in the proximity light sensor to not emit infrared light, and the photodetector in the proximity light sensor will not be turned on. At this time, the proximity light sensor does not need to be used, so that the power consumption of the proximity light sensor is minimized.

[0538] Table 19

[0539] Light source closure Photodetector closure

[0540] Table 19 shows the operating status of the various components in the proximity light sensor in suspend mode.

[0541] Table 19 shows that the proximity light sensor includes a light source and a photodetector. In the suspend mode, the light source in the proximity light sensor is turned off, so there is no need to emit infrared light, and the photodetector in the proximity light sensor is also turned off, so there is no need to receive reflected light, thus minimizing the power consumption of the proximity light sensor.

[0542] Figure 17 A schematic diagram is shown of an electronic device 100 controlling a proximity sensor to switch operating modes.

[0543] First, when the electronic device 100 is in the screen-on state, the electronic device 100 can control the proximity sensor to be in the suspend mode.

[0544] After the electronic device 100 controls the proximity sensor to be in suspend mode, if the electronic device 100 detects that the display screen 1200 has not received user operation for a certain period of time, or the display screen 1200 is off, or the display screen 1200 has been off for a certain period of time, the electronic device 100 can control the proximity sensor to be in proximity mode to prevent accidental touch.

[0545] After the electronic device 100 controls the proximity sensor to be in proximity mode, if the electronic device 100 recognizes a face image through the front-facing camera or recognizes a face image for a period of time, it can be determined that the current user needs to perform an unlocking operation on the electronic device 100. The electronic device 100 can then control the electronic device 100 to be in supplementary light mode to improve the success rate of face unlocking.

[0546] Optionally, if the electronic device 100 recognizes a face image or recognizes a face image for a continuous period of time, and if the electronic device 100 is already in the anti-mistouch mode, the electronic device 100 can automatically deactivate the anti-mistouch mode. In other embodiments, the electronic device 100 may also leave the anti-mistouch mode in place, allowing the user to manually deactivate it.

[0547] After the electronic device 100 is in the fill light mode, and after the face unlock is successful, the electronic device 100 is back in the screen-on state. The electronic device 100 can control the proximity sensor to be in the suspend mode.

[0548] In this way, the electronic device 100 can control the proximity sensor to switch back and forth between proximity mode, hanging mode and supplementary light mode.

[0549] Optionally, in some embodiments, the operating mode of the proximity sensor may not include the suspend mode, and the operating mode of the proximity sensor may switch back and forth between proximity mode and supplementary lighting mode. This application does not limit this.

[0550] Figure 18This is a flowchart illustrating a sensor operating mode control method provided in this application.

[0551] S1801. In response to the electronic device meeting the first condition, the electronic device controls the sensor to be in the first operating mode.

[0552] S1802. In response to the electronic device satisfying the second condition, the electronic device controls the sensor to be in a second operating mode; the first condition is different from the second condition, and the first operating mode is different from the second operating mode. The first operating mode and the second operating mode include any one of the following: proximity mode, supplementary lighting mode, and measurement mode; wherein, the proximity mode includes emitting infrared light through a light source and receiving the reflected infrared light through a photodetector; the supplementary lighting mode includes emitting infrared light through a light source; and the measurement mode includes emitting red light and infrared light through a light source and receiving the reflected red light and reflected infrared light through a photodetector.

[0553] In some embodiments, the supplemental lighting mode may also include controlling the photodetector to stop receiving reflected infrared light, which can further save the power consumption of the sensor.

[0554] In some embodiments, the sensor may also include a suspended mode. In suspended mode, the light source does not emit red or infrared light, and the photodetector does not receive reflected red or infrared light, resulting in the lowest sensor efficiency.

[0555] In some embodiments, the sensor may be a proximity light sensor or a PPG module, and this application does not limit the specific sensor to either.

[0556] The sensor in this application can operate in different working modes. For example, the sensor can operate in proximity mode to prevent accidental activation when the electronic device is in a pocket or backpack. The sensor can operate in supplemental lighting mode to improve the success rate of face unlock. The sensor can operate in measurement mode to measure health data such as blood pressure, blood oxygen, and respiratory rate. The sensor can operate in suspend mode when not in use. This method not only improves the utilization rate of the sensor but also saves its power consumption.

[0557] In one possible implementation, the electronic device includes a first display screen, with the sensor located in the display area above the first display screen; the first operating mode and the second operating mode include either a proximity mode or a supplementary lighting mode.

[0558] Thus, when the electronic device has a non-foldable screen and the sensor is a proximity sensor, the proximity sensor's operating modes can include proximity mode and supplementary light mode. For example, the sensor can operate in proximity mode to prevent accidental touches when the electronic device is in a pocket or backpack. The sensor can operate in supplementary light mode to improve the success rate of face unlock.

[0559] In some embodiments, the proximity sensor may also include a suspended mode. In suspended mode, the light source does not emit red or infrared light, and the photodetector does not receive reflected red or infrared light, resulting in the lowest efficiency of the proximity sensor.

[0560] This method can not only improve the utilization rate of proximity sensors, but also save power consumption of proximity sensors.

[0561] In one possible implementation, the first operating mode includes a supplementary lighting mode. In response to the electronic device meeting a first condition, the electronic device controls the sensor to be in the first operating mode, specifically including: in response to recognizing a face image through the front-facing camera, the electronic device controls the sensor to be in the supplementary lighting mode; the first condition includes the electronic device recognizing a face image through the front-facing camera.

[0562] In other embodiments, the electronic device may also control the proximity sensor to be in different supplementary lighting modes based on one or more conditions such as ambient brightness and facial image clarity.

[0563] In this way, when facial recognition is required, the electronic device can control the proximity sensor to work in supplemental lighting mode to improve the success rate of facial unlocking.

[0564] In one possible implementation, the second operating mode includes a proximity mode, wherein the electronic device controls the sensor to be in the second operating mode in response to the electronic device meeting a second condition, specifically including: the electronic device controlling the sensor to be in the proximity mode in response to the electronic device being in a screen-off state; the second condition includes the electronic device being in a screen-off state.

[0565] The second condition is not limited to the electronic device being in a screen-off state and the proximity sensor being in proximity mode. It can also include other conditions, such as the user not operating the electronic device for a certain period of time or the electronic device's screen being off for a certain duration.

[0566] In this way, when the user is not operating the electronic device, the electronic device can control the proximity sensor to work in proximity mode to prevent accidental touches.

[0567] In one possible implementation, the electronic device includes a foldable screen and a second display screen. The foldable screen includes a third display screen and a fourth display screen. The second display screen and the sensor are located behind the third display screen. When the foldable screen is in an unfolded state, the third and fourth display screens are on the same horizontal plane. When the foldable screen is in a folded state, the second and third display screens are face-to-face. When the foldable screen is in an unfolded state, a first or second operating mode includes a measurement mode. When the foldable screen is in a folded state, the first and second operating modes include either a proximity mode or a supplementary lighting mode.

[0568] Thus, in the case of electronic devices with foldable screens, including smaller foldable screens, the sensor is the PPG module of the electronic device. The operating modes of the PPG module can include proximity mode, measurement mode, and supplementary lighting mode. For example, the PPG module can operate in proximity mode to prevent accidental touches when the electronic device is in a pocket or backpack. The sensor can operate in supplementary lighting mode to improve the success rate of face unlock. For example, the PPG module can operate in measurement mode to measure the user's health data such as heart rate, blood oxygen, and respiratory rate.

[0569] In some embodiments, the PPG module may also include a suspended mode. In suspended mode, the light source does not emit red or infrared light, and the photodetector does not receive reflected red or infrared light, resulting in the lowest operating efficiency of the PPG module.

[0570] In one possible implementation, when the physical state of the foldable screen is folded, the first operating mode includes a proximity mode; in response to the electronic device satisfying a first condition, the electronic device controls the sensor to be in the first operating mode, specifically including: in response to the physical state of the foldable screen being folded and the second display screen being off, the electronic device controls the sensor to be in the proximity mode; the first condition includes the physical state of the foldable screen being folded and the second display screen being off.

[0571] The first condition is not limited to the electronic device being in a screen-off state and the PPG module being in proximity mode. Other conditions may also be included, such as the user not operating the electronic device for a certain period of time or the electronic device's screen-off time exceeding a certain duration.

[0572] In this way, when the user is not operating the electronic device, the electronic device can control the PPG module to work in proximity mode to prevent accidental touches.

[0573] In one possible implementation, after the electronic device controls the sensor to enter proximity mode, the method further includes: when it is determined by receiving reflected infrared light through a photodetector that an object is approaching within a continuous first time period, the electronic device controls the second display screen to not respond to screen touch events. This prevents accidental touches in proximity mode.

[0574] In one possible implementation, when the physical state of the foldable screen is folded, the second operating mode includes a supplementary light mode. In response to the electronic device satisfying a second condition, the electronic device controls the sensor to be in the second operating mode, specifically including: in response to the physical state of the foldable screen being folded and the electronic device recognizing a face image, the electronic device controls the sensor to be in the supplementary light mode; the second condition includes the physical state of the foldable screen being folded and the electronic device recognizing a face image.

[0575] In this way, when facial recognition is required, the electronic device can control the PPG module to work in supplementary lighting mode to improve the success rate of facial recognition.

[0576] In one possible implementation, when the physical state of the foldable screen is folded, the second operating mode includes a supplementary lighting mode. In response to the electronic device meeting a second condition, the electronic device controls the sensor to be in the second operating mode, specifically including: in response to the physical state of the foldable screen being folded, the electronic device recognizing a face image and the clarity of the face image being less than a preset clarity, the electronic device controls the sensor to be in the supplementary lighting mode; the second condition includes the physical state of the foldable screen being folded, the electronic device recognizing a face image and the clarity of the face image being less than a preset clarity.

[0577] In one possible implementation, when the physical state of the foldable screen is folded, the second operating mode includes a supplementary lighting mode. In response to the electronic device meeting a second condition, the electronic device controls the sensor to be in the second operating mode, specifically including: in response to the physical state of the foldable screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a first threshold, the electronic device controls the sensor to be in the supplementary lighting mode; the second condition includes the physical state of the foldable screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a first threshold.

[0578] In one possible implementation, when the foldable screen is in a folded state, the second operating mode includes a supplementary lighting mode. In response to the electronic device meeting a second condition, the electronic device controls the sensor to be in the second operating mode, specifically including: in response to the foldable screen being in a folded state, the electronic device recognizing a face image, the face image having a resolution less than a preset resolution and the ambient brightness being less than a first threshold, the electronic device controls the sensor to be in the supplementary lighting mode; the second condition includes the foldable screen being in a folded state, the electronic device recognizing a face image, the face image having a resolution less than a preset resolution and the ambient brightness being less than a first threshold.

[0579] In one possible implementation, the supplementary lighting mode is a first supplementary lighting mode; the first supplementary lighting mode includes emitting infrared light of a first intensity through a light source; in response to the physical state of the foldable screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a first threshold, the electronic device controls the sensor to be in the supplementary lighting mode, specifically including: in response to the physical state of the foldable screen being folded, the electronic device recognizing a face image and the ambient brightness being greater than a second threshold and less than the first threshold, the electronic device controls the sensor to be in the first supplementary lighting mode; the second condition includes the physical state of the foldable screen being folded, the electronic device recognizing a face image, the clarity of the face image being less than a preset clarity and the ambient brightness being greater than the second threshold and less than the first threshold.

[0580] In one possible implementation, the supplementary lighting mode is a second supplementary lighting mode; the second supplementary lighting mode includes emitting infrared light of a second intensity through a light source, the second intensity being greater than the first intensity; in response to the physical state of the folded screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a first threshold, the electronic device controls the sensor to be in the supplementary lighting mode, specifically including: in response to the physical state of the folded screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a second threshold, the electronic device controls the sensor to be in the second supplementary lighting mode; the second condition includes the physical state of the folded screen being folded, the electronic device recognizing a face image and the ambient brightness being less than a second threshold.

[0581] In this way, electronic devices can control the PPG module to enter different supplementary lighting modes based on different ambient brightness levels.

[0582] In one possible implementation, after the electronic device controls the sensor to be in the supplementary lighting mode, the method further includes: when the electronic device is successfully unlocked and the second display screen is on, the electronic device controls the sensor to be in a suspend mode; wherein, the suspend mode includes stopping the emission of infrared light by the light source.

[0583] In this way, after successful face unlock, the electronic device can control the PPG module to enter suspend mode. In suspend mode, the PPG module consumes the least power, which can save the power consumption of the PPG module.

[0584] In one possible implementation, after the electronic device controls the sensor to be in a suspended mode, the method further includes: in response to the electronic device being in a screen-off state, the electronic device controls the sensor to be in a proximity mode.

[0585] Not only in the screen-off state, electronic devices can also control the PPG module to enter proximity mode based on conditions such as the screen being off for a certain period of time or the user not operating the electronic device for a certain period of time.

[0586] In this way, after the electronic device controls the PPG module to enter suspend mode, the electronic device can monitor the screen status and control the PPG module to enter proximity mode again to prevent accidental touch when the user is not operating the electronic device.

[0587] In one possible implementation, when the physical state of the foldable screen is unfolded, the first operating mode includes a measurement mode. In response to the electronic device satisfying a first condition, the electronic device controls the sensor to be in the first operating mode, specifically including: in response to the physical state of the foldable screen being unfolded and a user operation to receive measured health data, the electronic device controls the sensor to be in the measurement mode; the first condition includes the physical state of the foldable screen being unfolded and a user operation to receive measured health data.

[0588] In this way, when the electronic device is in the unfolded state, when the electronic device receives user input to measure health data such as blood oxygen, heart rate, and respiratory rate, the electronic device can control the PPG module to enter the measurement mode to realize the measurement of health data such as blood oxygen, heart rate, and respiratory rate.

[0589] In one possible implementation, after the electronic device controls the sensor to enter measurement mode, the method further includes:

[0590] After the electronic device acquires health data, it controls the sensor to switch from measurement mode to suspension mode. The suspension mode includes stopping the emission of red and infrared light by the light source and stopping the reception of reflected red and infrared light by the photodetector.

[0591] In this way, after the electronic device acquires the user's health data to be measured, it can control the PPG module to enter a suspend mode to save power consumption. When the electronic device is in the deployed state, the PPG module can switch back and forth between measurement mode and suspend mode.

[0592] In one possible implementation, the light source includes a first light source and a second light source, and the photodetector includes a first photodetector and a second photodetector. The first light source is used to emit red light, the second light source is used to emit infrared light, the first photodetector is used to receive reflected red light, and the second photodetector is used to receive reflected infrared light.

[0593] In some embodiments, the first light source may be referred to as a red light source.

[0594] In some embodiments, the second light source may be referred to as an infrared light source.

[0595] In one possible implementation, the light source includes a first light source, and the photodetector includes a first photodetector. The first light source is used to emit red light and infrared light in a time-division manner, and the first photodetector is used to receive reflected red light and infrared light in a time-division manner.

[0596] This application provides an electronic device, including a sensor, one or more processors, and one or more memories; wherein the sensor, one or more memories, and one or more processors are coupled together, and the one or more memories are used to store computer program code, the computer program code including computer instructions, which, when executed by the one or more processors, cause the electronic device to perform... Figure 18 A method for controlling the operating mode of a sensor is provided.

[0597] This application provides a chip system applied to an electronic device. The chip system includes one or more processors, characterized in that the processors are used to invoke computer instructions to cause the electronic device to execute... Figure 18 A method for controlling the operating mode of a sensor is provided.

[0598] This application provides a computer-readable storage medium, including instructions that, when executed on an electronic device, cause the electronic device to perform... Figure 18 A method for controlling the operating mode of a sensor is provided.

[0599] This application provides a computer program product containing instructions that, when executed on an electronic device, causes the electronic device to perform... Figure 18 A method for controlling the operating mode of a sensor is provided.

[0600] refer to Figure 19 , Figure 19 A schematic diagram of the structure of the electronic device 100 is shown.

[0601] Electronic device 100 can be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, as well as cellular phone, personal digital assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, artificial intelligence (AI) device, wearable device, in-vehicle device, smart home device and / or smart city device. This application embodiment does not impose any special limitations on the specific type of electronic device. The following embodiments of this application use a mobile phone as an example for illustration.

[0602] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0603] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0604] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0605] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0606] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0607] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0608] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0609] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0610] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0611] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0612] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0613] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0614] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0615] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0616] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0617] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0618] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0619] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0620] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0621] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0622] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0623] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0624] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0625] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0626] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0627] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise and brightness. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0628] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0629] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0630] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0631] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0632] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM).

[0633] Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), and double data rate synchronous dynamic random access memory (DDR SDRAM, such as fifth-generation DDR SDRAM, which is generally called DDR5 SDRAM). Non-volatile memory can include disk storage devices and flash memory.

[0634] Flash memory can be classified according to its operating principle, including NOR FLASH, NAND FLASH, 3D NAND FLASH, etc.; according to the level of the storage cell, including single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc.; and according to the storage specification, including universal flash storage (UFS) and embedded multimedia card (eMMC), etc.

[0635] The random access memory can be directly read and written by the processor 110. It can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data.

[0636] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110.

[0637] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, music, video, and other files can be stored in the external non-volatile memory.

[0638] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0639] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0640] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0641] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0642] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0643] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0644] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0645] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0646] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0647] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0648] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0649] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0650] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodetector. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodetector to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 may use the proximity sensor 180G to detect when a user holds the electronic device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.

[0651] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0652] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0653] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs thermal protection by reducing the performance of a processor located near temperature sensor 180J to reduce power consumption. In other embodiments, when the temperature is below another threshold, electronic device 100 heats battery 142 to prevent abnormal shutdown of electronic device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, electronic device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0654] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0655] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.

[0656] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0657] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0658] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0659] The SIM card interface 195 is used to connect the SIM card.

[0660] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.

[0661] Figure 20 This is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention.

[0662] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0663] The application layer can include a series of application packages.

[0664] like Figure 20 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0665] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0666] like Figure 20 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0667] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0668] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0669] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0670] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).

[0671] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0672] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0673] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0674] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0675] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0676] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0677] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0678] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0679] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0680] A 2D graphics engine is a graphics engine for 2D drawing.

[0681] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0682] The various embodiments of this application can be combined arbitrarily to achieve different technical effects.

[0683] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0684] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0685] In summary, the above description is merely an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made according to the disclosure of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for controlling the operating mode of a sensor, characterized in that, The method is applied to an electronic device, the electronic device including a sensor, the sensor including a light source and a photodetector, the light source emitting red light and / or infrared light, and the photodetector receiving reflected red light and / or reflected infrared light; the method includes: In response to the electronic device satisfying a first condition, the electronic device controls the sensor to enter a proximity mode; In response to the electronic device meeting the second condition, the electronic device controls the sensor to be in a supplementary lighting mode; In response to the electronic device satisfying the third condition, the electronic device controls the sensor to enter the measurement mode; The first condition, the second condition, and the third condition are different; The proximity mode includes emitting infrared light through the light source and receiving the reflected infrared light through the photodetector; The supplemental lighting mode includes emitting infrared light through the light source; The measurement mode includes emitting red light and infrared light through the light source, and receiving the reflected red light and reflected infrared light through the photodetector; The electronic device includes a foldable screen and a second display screen. The foldable screen includes a third display screen and a fourth display screen. The second display screen and the sensor are located on the back of the third display screen. When the foldable screen is in an unfolded state, the third display screen and the fourth display screen are on the same horizontal plane. When the foldable screen is in a folded state, the second display screen and the third display screen are face to face. The first condition includes: the physical state of the foldable screen is the folded state and the second display screen is in the off state; The second condition includes: the physical state of the foldable screen is the folded state, the electronic device recognizes a face image, and one or more of the following: the clarity of the face image is less than a preset clarity, and the ambient brightness is less than a first threshold. The third condition includes: the physical state of the foldable screen is the unfolded state and the user operation is receiving measured health data.

2. The method according to claim 1, characterized in that, After the electronic device controls the sensor to be in the proximity mode, the method further includes: When the photodetector detects that an object is approaching within a continuous first time period by receiving reflected infrared light, the electronic device controls the second display screen to not respond to screen touch events.

3. The method according to claim 1 or 2, characterized in that, The supplementary lighting mode includes a first supplementary lighting mode and a second supplementary lighting mode; the first supplementary lighting mode includes emitting infrared light of a first intensity through the light source, and the second supplementary lighting mode includes emitting infrared light of a second intensity through the light source, wherein the second intensity is greater than the first intensity; When the fill light mode includes the first fill light mode, the second condition includes: the physical state of the foldable screen is the folded state, the electronic device recognizes a face image, the clarity of the face image is less than a preset clarity and the ambient brightness is greater than a second threshold and less than the first threshold; When the fill light mode includes the second fill light mode, the second condition includes: the physical state of the foldable screen is the folded state, the electronic device recognizes the face image and the ambient brightness is less than the second threshold.

4. The method according to any one of claims 1-3, characterized in that, After the electronic device controls the sensor to be in the supplementary lighting mode, the method further includes: When the electronic device is successfully unlocked and the second display screen is on, the electronic device controls the sensor to be in a suspended mode; The suspension mode includes stopping the emission of infrared light from the light source.

5. The method according to claim 4, characterized in that, After the electronic device controls the sensor to be in a suspend mode, the method further includes: In response to the electronic device being in the screen-off state, the electronic device controls the sensor to be in the proximity mode.

6. The method according to any one of claims 1-3, characterized in that, After the electronic device controls the sensor to be in the measurement mode, the method further includes: After the electronic device acquires the health data, the electronic device controls the sensor to switch from the measurement mode to the suspension mode; The suspension mode includes stopping the emission of red and infrared light by the light source and stopping the reception of reflected red and infrared light by the photodetector.

7. The method according to any one of claims 1-6, characterized in that, The light source includes a first light source and a second light source, and the photodetector includes a first photodetector and a second photodetector. The first light source emits red light, the second light source emits infrared light, the first photodetector receives reflected red light, and the second photodetector receives reflected infrared light.

8. The method according to any one of claims 1-6, characterized in that, The light source includes a first light source, and the photodetector includes a first photodetector. The first light source is used to emit red light and infrared light in a time-division manner, and the first photodetector is used to receive reflected red light and infrared light in a time-division manner.

9. An electronic device, characterized in that, The device includes a sensor, one or more processors, and one or more memories; wherein the sensor, the one or more memories, and the one or more processors are coupled together, and the one or more memories are used to store computer program code, the computer program code including computer instructions, which, when executed by the one or more processors, cause the electronic device to perform the method as described in any one of claims 1-8.

10. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system comprising one or more processors, characterized in that the processors are configured to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-8.

11. A computer-readable storage medium comprising instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-8.

Images