User posture detection and reminding method and electronic equipment

Abstract

The invention provides a user posture detection and reminding method and electronic equipment, relates to the technical field of electronics, and is used for monitoring and reminding the posture of a user using the electronic equipment. The method is applied to the electronic equipment, and comprises the following steps: in response to screen lightening of the electronic equipment, starting a camera under the condition that a preset condition is met; the preset conditions are met and include one or more conditions that a target user using the electronic equipment is in a state of using the electronic equipment in a non-lying posture and the ambient light brightness is greater than a brightness threshold value. And acquiring an image acquired by the camera. And outputting prompt information under the condition that the user posture indicated by the image acquired by the camera is a head-lowering use posture. Wherein the prompt information is used for prompting the user that the user is currently in a head-lowering using posture.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of electronic technology, and in particular to a method for detecting and reminding a user's posture and an electronic device. Background Art

[0002] Looking down at electronic devices for a long time can have a variety of negative effects on individual health, such as cervical spine disease, shoulder and back problems, and decreased attention and cognitive abilities. In addition, looking down at electronic devices for a long time can reduce visual attention to the surrounding environment.

[0003] Therefore, in the process of users using electronic devices, monitoring and reminding the user's posture when using the electronic device becomes a problem that needs to be solved urgently. Summary of the invention

[0004] The embodiments of the present application provide a user posture detection and reminder method and an electronic device, which are used to monitor and remind the user's posture when using an electronic device.

[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions: In a first aspect, a user posture detection and reminder method is provided, which is applied to an electronic device, and the method comprises: In response to the screen of the electronic device being turned on, the camera is started when preset conditions are met. Wherein, meeting the preset conditions includes: the target user using the electronic device is in a non-lying position using the electronic device, and the ambient light brightness is greater than one or more of the brightness thresholds. Then, the image captured by the camera is obtained. In the case where the user posture indicated by the image captured by the camera is a head-down use posture, a prompt message is output. The prompt message is used to prompt the user that the user is currently in a head-down use posture. In this solution, the electronic device will only start the camera for image acquisition and recognition to detect whether the user is in a head-down use posture when the screen is turned on and the preset conditions are met. The detection and reminder of the user's posture when using the electronic device will only be performed in some cases. In this way, the power consumption of the electronic device can be reduced under the premise of being able to detect and remind the user's posture.

[0006] In a possible implementation of the first aspect, before outputting the prompt information, the method further includes: when the user posture indicated by the image captured by the camera is a head-down use posture, obtaining the duration of the user posture remaining in the head-down use posture. In this solution, outputting the prompt information may specifically include: when the duration of the user posture remaining in the head-down use posture exceeds a time threshold, outputting the prompt information. The prompt information is used to remind the user that the user is currently in the head-down use posture. In this solution, the electronic device will only output the prompt information when it detects that the cumulative duration of the user's continuous head-down use posture exceeds a certain threshold. Thereby, it is possible to remind the user of the situation where the user is in the head-down use posture for a long time. At the same time, through this processing method, it is possible to avoid the possibility that a moment in a certain action of the user is recognized by the electronic device as a head-down use posture, and an inappropriate reminder is output.

[0007] In a possible implementation of the first aspect, after the image captured by the camera indicates that the user posture is the head-down use posture, the electronic device continuously acquires new images captured by the camera to determine whether the user posture remains in the head-down use posture. If the image captured by the camera indicates that the user posture is the head-down use posture, the electronic device can start timing, and if the user posture does not remain in the head-down use posture during the timing process, the timing can be stopped.

[0008] In a possible implementation manner of the first aspect, the prompt information is used to prompt the user that the user is currently in a head-down usage posture for a long period of time.

[0009] In a possible implementation of the first aspect, the electronic device starts the camera when the preset conditions are met, specifically, the electronic device starts the normally-on camera when the preset conditions are met. The normally-on camera can be understood as a low-power mode of the camera, which can perform continuous sensing and monitoring under ultra-low power consumption. In this way, even if the normally-on camera remains on for a long time, it will not consume too much power consumption of the electronic device.

[0010] In a possible implementation of the first aspect, the target user using the electronic device is in a state of using the electronic device in a non-lying position, which can be determined specifically by obtaining the posture angle data of the electronic device. For example, the electronic device can determine whether the user is in a state of using the electronic device in a non-lying position based on the pitch angle and / or roll angle in the posture angle of the electronic device. Specifically, when it is detected that the posture angle of the electronic device satisfies the following conditions, it is determined that the user is in a lying state: the pitch angle of the electronic device is in a first angle range, and / or the roll angle of the electronic device is in a second angle range. In this way, judging whether the user is in a lying position using the electronic device by the posture angle of the electronic device is simple and accurate.

[0011] In a possible implementation manner of the first aspect, the target user using the electronic device is in a non-lying position using the electronic device, and whether the target user is in a non-lying position using the electronic device can also be determined by collecting images and analyzing them.

[0012] In a possible implementation of the first aspect, the electronic device may obtain the attitude angle of the electronic device through an inertial measurement unit of the electronic device. The electronic device may obtain the ambient light brightness through an ambient light sensor of the electronic device.

[0013] In a possible implementation of the first aspect, after acquiring the image captured by the camera, the method further includes: acquiring the attitude angle of the face of the target user using the electronic device relative to the electronic device and the attitude angle of the electronic device based on the image captured by the camera. Determine the absolute attitude angle of the target user's face based on the attitude angle of the target user's face relative to the electronic device and the attitude angle of the electronic device. Finally, determine whether the user's posture is a head-down posture based on the absolute attitude angle of the target user's face. The absolute attitude angle of the target user's face specifically refers to the attitude angle of the target user's face relative to the world coordinate system. In this way, using the absolute attitude angle of the target user's face to judge the head-down posture can ensure the accuracy of user posture detection.

[0014] In a possible implementation of the first aspect, when the image captured by the camera includes facial images of multiple users, the target user is a user that meets one or more of the following conditions: the facial images of multiple users account for the largest proportion, the facial images of multiple users account for a proportion greater than a first proportion threshold, and the facial images of multiple users are closest to the center of the image captured by the camera. When the image captures facial images of multiple users, the electronic device filters out the target user from the multiple users according to the above conditions, and then detects and reminds the target user of the posture. This ensures that the electronic device detects and reminds the user who is using the electronic device, and avoids the situation where the user posture determined by the facial image of a non-target user is detected and the target user is reminded.

[0015] In a possible implementation manner of the first aspect, the target user may be a user.

[0016] In a possible implementation of the first aspect, when the image captured by the camera includes a facial image of a user, the electronic device may also detect the facial image of the user. The electronic device will determine the user as a target user only if the facial image of the user satisfies the following condition: the facial image proportion of the user is greater than a first proportion threshold.

[0017] In a possible implementation of the first aspect, when the image captured by the camera does not include a user's facial image, or when the image captured by the camera includes facial images of one or more users but the facial images of the users do not meet corresponding conditions, it indicates that no user is using the electronic device. In this case, the electronic device will not detect the user's posture and will not output prompt information.

[0018] In a possible implementation of the first aspect, after starting the camera, the method further includes: the electronic device periodically detects whether a preset condition is met. Furthermore, when the electronic device is in a screen-on state and the result of the periodic detection indicates that the preset condition is met, the camera is controlled to remain in the started state. That is, after starting the camera to capture images for image analysis and recognition, the electronic device can continue to detect whether the preset conditions are met. When the electronic device exits the screen-on state, or when the result of the periodic detection indicates that the preset conditions are not met, the camera is turned off. Once it is detected that the preset conditions are no longer met, or the electronic device screen is turned off, the electronic device can turn off the camera and no longer continue to capture images for analysis and recognition to detect user postures. In this way, the power consumption of the electronic device can be saved.

[0019] In a possible implementation of the first aspect, when the duration of the user's posture being maintained in the head-down use posture exceeds a time threshold, a prompt message is output, which may specifically include: when the duration of the user's posture being maintained in the head-down use posture exceeds a first time threshold, a first prompt message is issued. After issuing the first prompt message, the electronic device continues to time the duration of the user's posture being maintained in the head-down use state. When the duration of the user's posture being maintained in the head-down use posture exceeds a second time threshold, a second prompt message is issued. Wherein, the second time threshold is greater than the first time threshold, and the urgency of the second prompt message is higher than the urgency of the first prompt message. By setting different time thresholds and prompt messages of different urgency, prompt messages of different urgency can be output for different durations of the user's posture being maintained in the head-down use posture. The longer the duration of the user's posture being maintained in the head-down use posture, the more urgent the urgency of the output prompt message.

[0020] In a possible implementation manner of the first aspect, the first prompt information may be non-interruptive prompt information, and the second prompt information may be interruptive prompt information.

[0021] In a possible implementation of the first aspect, the electronic device pre-stores a plurality of age intervals and one or more time thresholds corresponding to each age interval. In this solution, after acquiring the image captured by the camera, the method may further include: acquiring the age interval of the target user using the electronic device based on the image captured by the camera. Determine the first time threshold and the second time threshold based on the age interval of the target user. The first time threshold corresponding to different age intervals may be different, and the second time threshold corresponding to different age intervals may also be different. Setting different time thresholds for different age intervals can provide personalized reminders for different users.

[0022] In a possible implementation of the first aspect, obtaining the age range of target users using the electronic device based on images captured by a camera can specifically include: determining the age of the target user based on the images captured by the camera, and then determining the age range to which the age belongs, thereby determining the age range of the target user.

[0023] In a possible implementation of the first aspect, the electronic device can periodically determine the age range of target users using the electronic device based on images captured by the camera. In this way, when multiple users take turns using the same electronic device at different time points, the electronic device can also accurately identify the age range of target users currently using the electronic device. Thus, accurate time thresholds can be used to detect and remind users when they are in a head-down posture.

[0024] In a possible implementation of the first aspect, the electronic device determines the age range of the target user using the electronic device based on the image captured by the camera after activating the camera each time in response to the screen being lit up when a preset condition is met. Thereafter, if the electronic device keeps the screen on, the electronic device can determine the age range of the target user using the electronic device based on the image captured by the camera at intervals. In this way, under the premise of being able to update the age range of the target user in real time, the number of times the age of the target user is detected is reduced, thereby saving the power consumption of the electronic device.

[0025] In a possible implementation of the first aspect, the electronic device stores a plurality of application usage scenarios, and prompting methods of prompting information corresponding to different application usage scenarios. In this solution, before outputting the prompting information, the method further includes: obtaining the application currently running on the electronic device. Determine the target application usage scenario to which the application belongs. According to the target application usage scenario, determine the target prompting method of the corresponding prompting information. Wherein, outputting the prompting information includes: outputting the prompting information according to the target prompting method. In this solution, the electronic device pre-sets corresponding prompting methods for different application usage scenarios, and the prompting methods may be different in different application usage scenarios. When the electronic device determines that the prompting information needs to be output, the prompting method for outputting the prompting information is selected according to the current application usage scenario. Wherein, the prompting method of the prompting information may include an interrupting prompting method and a non-interrupting prompting method. The urgency of the interrupting prompting method is higher than that of the non-interrupting prompting method. Alternatively, the prompting method of the prompting information includes: one or more of a ringing prompting method, a voice prompting method, a vibration prompting method, a display prompting method, or a flashing light prompting method.

[0026] In a possible implementation of the first aspect, the method further includes: obtaining statistical information of user postures when the user uses the electronic device within a preset period. Displaying the statistical information of user postures within the preset period. In this solution, the electronic device can collect statistics on the user postures when the user uses the electronic device within a period of time, and then display the statistical information of the user postures within this period of time to the user. In this way, the user can be provided with a simple and clear usage situation for viewing.

[0027] In a second aspect, the present application further provides an electronic device. The electronic device may include: a camera, a processor, and a memory. The camera is used to capture images. The memory is used to store computer-executable instructions. When the electronic device is running, the processor executes the computer-executable instructions stored in the memory, so that the electronic device performs the user's posture detection and reminder method as described in any one of the first aspects above.

[0028] In a third aspect, the present application provides a computer-readable storage medium, which stores instructions. When the computer-readable storage medium is run on a computer, the computer can execute the user posture detection and reminder method of any one of the above-mentioned first aspects.

[0029] In a fourth aspect, a computer program product comprising instructions is provided, which, when executed on an electronic device, enables the electronic device to execute any one of the user gesture detection and reminder methods of the first aspect.

[0030] In a fifth aspect, a device (for example, the device may be a chip system) is provided, the device including a processor for supporting an electronic device to implement the functions involved in the first aspect. In a possible design, the device also includes a memory for storing program instructions and data necessary for the electronic device. When the device is a chip system, it may be composed of a chip, or may include a chip and other discrete devices.

[0031] Among them, the technical effects brought about by any design method in the second to fifth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 A schematic diagram of a scenario in which a user uses an electronic device provided in an embodiment of the present application; Figure 2 A flowchart of a user posture detection and reminder method provided in an embodiment of the present application; Figure 3 A schematic diagram of the attitude angle of a mobile phone provided in an embodiment of the present application; Figure 4 A schematic diagram of the pitch angle of a mobile phone provided in an embodiment of the present application; Figure 5 A schematic diagram of a roll angle of a mobile phone provided in an embodiment of the present application; Figure 6 A schematic diagram of a posture of a user lying down and using a mobile phone provided in an embodiment of the present application; Figure 7 A schematic diagram of another posture of a user lying down and using a mobile phone provided in an embodiment of the present application; Figure 8 A schematic diagram of different display prompting methods provided in an embodiment of the present application; Fig. 9 A flowchart of another method for detecting and reminding a user's posture provided in an embodiment of the present application; Fig.10 A flowchart of another method for detecting and reminding a user's posture provided in an embodiment of the present application; Fig.11 A schematic diagram of a scenario of a method for detecting and reminding a user's posture provided in an embodiment of the present application; Fig.12 A schematic diagram of an interface of a switch for a head-down detection function provided in an embodiment of the present application; Fig.13 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application; Fig.14 A framework diagram of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0033] When a user uses an electronic device, the user may have various postures. A common posture of a user using an electronic device is as follows: Figure 1 As shown, user 10 is using electronic device 11 with head lowered. Using electronic devices with head lowered for a long time can cause multiple negative effects on individual health, such as easily leading to cervical spine diseases. Specifically, when the head is lowered, the cervical spine is in a forward tilted state, the natural curvature of the cervical spine is broken, and the weight of the head will impose additional burden on the cervical spine. Related studies have shown that when the head tilts forward more than a certain degree, the pressure on the cervical spine will increase to a higher level. Moreover, as the forward tilt angle of the user's head increases when using electronic devices, the pressure on the cervical spine will also increase accordingly. Figure 1 As shown, when the user 10 lowers his head to use the electronic device 11, the angle of the head leaning forward can be expressed as angle AOB (∠AOB). The larger ∠AOB is, the greater the pressure on the user's cervical vertebra. If the pressure on the cervical vertebra is in a large state for a long time, it is easy to cause symptoms such as neck pain, stiffness, headache, shoulder discomfort, etc., and increase the risk of cervical spondylosis. In addition, bowing your head to use electronic devices for a long time may also cause shoulder and back problems. For example, a long-term bowed posture will increase the burden on the shoulder muscles, causing shoulder muscle tension and pain, and cause problems such as hunchback and forward shoulder leaning. This not only affects the appearance, but may also cause long-term muscle and bone problems. Bowing your head to use electronic devices for a long time will also reduce visual attention to the surrounding environment, resulting in a decrease in the user's attention and cognitive ability.

[0034] Users of different ages are at different stages of physical development. If they use their phones with their heads down for a long time, their bodies may be affected to varying degrees. Children's bones are not fully developed yet. If they keep their heads down for a long time, it will cause abnormal curvature of the cervical spine and spine, affecting the normal development of bones. Teenagers who keep their heads down for a long time browsing content on social media and other applications can easily lead to anxiety and depression. The bones and muscles of the elderly have already degenerated. Keeping their heads down for a long time will accelerate the degeneration of the cervical spine and spine, leading to cervical spondylosis and spinal problems.

[0035] Therefore, users lowering their heads to use electronic devices for a long time is a usage habit with many adverse effects. In order to reduce users lowering their heads to use electronic devices for a long time, the embodiment of the present application proposes a user posture detection and reminder method for detecting the posture of the user when using an electronic device. Specifically, when the electronic device is in the screen-on state and detects that a preset condition is met, the posture of the user using the electronic device is detected. Moreover, when it is detected that the user lowers his head to use the electronic device for a long time, the user can be reminded to achieve the effect of monitoring and reminding the user of the long-term use of the electronic device with his head lowered.

[0036] Exemplarily, the electronic device may be a mobile phone, a tablet computer, a personal computer (PC), a smart screen, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a smart watch and other wearable devices, an artificial intelligence (AI) speaker and a vehicle-mounted device, or various teaching aids (such as learning machines, early education machines), smart toys, portable robots, personal digital assistants (PDA), augmented reality (AR) and virtual reality (VR) devices, media players and other devices, or devices with mobile office functions, devices with smart home functions, devices with audio and video entertainment functions, devices that support smart travel, etc. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device. In some embodiments, the electronic device includes a front camera.

[0037] In the following embodiments, the electronic device is taken as an example for description.

[0038] As an example, the mobile phone can detect the user's posture when using the mobile phone (hereinafter referred to as user posture) when the screen is on. When it is detected that the user is in a head-down posture, the timer starts, and when the duration of the user's head-down posture exceeds the time threshold, a prompt message is output. The prompt message is used to remind the user that the user has been using the mobile phone with his head down for a long time.

[0039] As an example, the preset condition may include whether the user is in a non-lying position using the mobile phone, and / or whether the ambient light brightness is greater than a brightness threshold. For example, taking the case where the preset condition includes whether the user is in a non-lying position using the mobile phone as an example, if the user is in a non-lying position using the mobile phone, it means that the preset condition is satisfied. Taking the case where the preset condition includes whether the ambient light brightness is greater than a brightness threshold as an example, if the ambient light brightness is greater than the brightness threshold, it means that the preset condition is satisfied.

[0040] As an example, the mobile phone detects the user's posture with the help of images captured by the mobile phone's camera. Specifically, after the mobile phone starts the user's posture detection algorithm (hereinafter referred to as the posture detection algorithm), it can capture images through the front camera and determine the user's posture by recognizing the images.

[0041] As an example, the time thresholds set for different age groups can be different. When the mobile phone detects that the age of the user currently using the mobile phone is in the first age range, the mobile phone reminds the user to lower his head to use the mobile phone according to the time threshold corresponding to the first age range. Similarly, when the mobile phone detects that the age of the user currently using the mobile phone is in the second age range, the mobile phone reminds the user to lower his head to use the mobile phone according to the time threshold corresponding to the second age range, and so on. For younger users, the set time threshold can be shorter. In this way, personalized settings are achieved for reminders to lower their heads to use the mobile phone, which is more in line with user needs and actual conditions.

[0042] The user posture detection and reminder method proposed in the embodiment of the present application is described in detail below with reference to the accompanying drawings.

[0043] Figure 2 A flow chart of a method for detecting and reminding a user's gesture in some embodiments is shown.

[0044] S300. In response to the mobile phone screen being turned on, obtaining first data of the mobile phone.

[0045] The phone screen turns on when the phone turns off. The phone screen turns on in many ways, including but not limited to pressing the power button, double-clicking the screen, picking up the phone, or unlocking the phone (such as password unlocking, fingerprint unlocking, or face unlocking, etc.).

[0046] In some embodiments, the first data may specifically include the state information of the mobile phone, such as the attitude angle of the mobile phone. In other embodiments, the first data may include environmental information detected by the mobile phone, such as the ambient light brightness. In other embodiments, the first data may include the state information of the mobile phone, such as the attitude angle of the mobile phone, and environmental information detected by the mobile phone, such as the ambient light brightness.

[0047] S301. Determine whether a preset condition is met based on the first data.

[0048] If the mobile phone keeps the gesture detection algorithm on for a long time, it will easily consume a lot of power. Therefore, the mobile phone can set a preset condition, and only start the gesture detection algorithm when it detects that the mobile phone is in the screen-on state and meets the preset condition. In this way, the power consumption of the mobile phone can be reduced.

[0049] The specific settings of the preset conditions are described below.

[0050] In an embodiment where the first data includes the posture angle of the mobile phone, the preset condition may include whether the user is in a non-lying position using the mobile phone. Specifically, when the mobile phone is in a bright screen state and detects that the user is in a non-lying position using the mobile phone, the mobile phone can turn on the posture detection algorithm. In some scenarios, the user may use the mobile phone in a lying position. Usually, when the user is in a lying position, the head and neck can be supported, such as the head and neck leaning on the sofa. Therefore, in the scenario where the user is in a lying position using the mobile phone, the posture detection algorithm may not be turned on, that is, the user's posture is not detected and reminded. In this way, for scenarios where the user's head and neck can be supported, the mobile phone does not turn on the posture detection algorithm, which can reduce the power consumption of the mobile phone. For scenarios where the user's head and neck are likely to be unable to be supported, the mobile phone turns on the posture detection algorithm to detect and remind the user's posture.

[0051] The mobile phone detects whether the user is using the mobile phone in a non-lying position, which can be determined by the posture angle of the mobile phone. Figure 3 Schematic diagram of several attitude angles of a mobile phone. The attitude angle of a mobile phone generally refers to the direction of the mobile phone in space. Exemplarily, the attitude angle of a mobile phone may include yaw, pitch, and roll. These angles describe the orientation of the mobile phone relative to the Earth's coordinate system.

[0052] In some examples, pitch angle is used to describe the degree to which the phone is tilted up or down relative to the horizontal plane. In other words, pitch angle refers to the angle of the phone around the axis along which its short side lies (such as Figure 3 The rotation angle of the X-axis is shown.

[0053] The roll angle is used to describe the left-right tilt of a mobile phone relative to a plane perpendicular to the horizontal plane (plumb plane). In other words, the roll angle is the tilt of the mobile phone around the axis of its thickness (such as Figure 3 The angle of rotation of the Z-axis (shown).

[0054] The yaw angle refers to the rotation of the phone around an axis perpendicular to the horizontal plane (such as Figure 3 The angle of rotation of the phone about the Y-axis (as shown), usually used to describe the orientation of the phone on a horizontal plane.

[0055] Under the zy′-x″ internal rotation rule, pitch and roll are calculated as shown in Formula 1 and Formula 2, respectively. The internal rotation rule means that when describing the rotation of an object, each rotation is performed relative to the object's own coordinate system, that is, the object's coordinate system changes with each rotation.

[0056] (Formula 1); (Formula 2); Among them, x, y and z represent the components of gravity on the X-axis, Y-axis and Z-axis of the mobile phone respectively.

[0057] Different mobile phones may have different attitudes when the pitch angle, roll angle and yaw angle are defined as 0. Figure 4 and Figure 5 Explain one of the definitions.

[0058] exist Figure 4 In the example shown in (a), when the user's head is aligned with the direction of gravity, the front of the phone (i.e., the screen) is in an upright position facing the user's face. In this state, the pitch angle of the phone is 0°. Figure 4 In (b), the phone starts from posture A0 and gradually tilts (or rotates) around the X axis toward the back of the phone, and the pitch angle gradually changes from 0° to 90°. For example, in posture A1, the pitch angle of the phone is an angle value between (0°, 90°). Figure 4 In (b), the pitch angle of the phone is angle YOC (∠YOC). Figure 4 In (c), the phone starts from posture A0 and gradually tilts (or rotates) around the X axis toward the front of the phone (i.e., the screen), and the pitch angle gradually changes from 0° to -90°. For example, in posture A2, the pitch angle of the phone is an angle value in (-90°, 0°). Figure 4 In (c), the pitch angle of the mobile phone is ∠YOC.

[0059] Figure 5 (a) is a schematic diagram of the X-axis, Y-axis and Z-axis of the mobile phone at another angle. Figure 5 In the example shown in (a) of FIG. 1 , the front face (i.e., screen) of the mobile phone is in an upright position facing the user's face, and the roll angle of the mobile phone in this state is 0°. Figure 5 In (b), the phone starts from posture B0, and the screen gradually tilts (or rotates) to the left around the Z axis, and the roll angle gradually changes from 0° to 90°. For example, in posture B1, the roll angle of the phone is an angle value between (0°, 90°). Figure 5 In (b), the roll angle of the phone is angle YOD (∠YOD). Figure 5 In (c), the phone starts from posture B0, and the screen gradually tilts to the right (or rotates) around the Z axis, and the roll angle gradually changes from 0° to -90°. For example, in posture B2, the roll angle of the phone is an angle value between (-90°, 0°). Figure 5 In (c), the roll angle of the mobile phone is specifically ∠YOD.

[0060] Combination Figure 4and Figure 5 ,exist Figure 6 In the figure, when the user uses the phone in a supine position, it can be seen that the phone's pitch angle ∠YOC is an angle value in the range of (-90°, 0°). Figure 4 and Figure 5 ,exist Figure 7 In the figure, when the user uses the mobile phone in a side-lying posture, it can be seen that the roll angle ∠YOD of the mobile phone is an angle value of (0°, 90) or (-90°, 0°). When the user is in a state of lying down to use the mobile phone, the roll angle of the mobile phone is larger than the deflection angle when the roll angle is 0°. Therefore, the mobile phone can determine that the user is in a lying state when the roll angle of the mobile phone is a larger angle value in (0°, 90), or the roll angle of the mobile phone is a smaller angle value in (-90°, 0°). It can be determined that when the user is in a lying state to use the mobile phone, the pitch angle and / or roll angle of the mobile phone are usually within a certain angle range. Therefore, in some embodiments, the mobile phone can determine whether the user is in a lying state based on the pitch angle and / or roll angle of the mobile phone.

[0061] It should be noted that the mobile phone screen involved in the above embodiments refers to a screen that the user is currently using and viewing.

[0062] Furthermore, the mobile phone determines that the user is in a lying state when it detects that the posture angle of the mobile phone meets the following conditions: the pitch angle of the mobile phone is within a first angle range, and / or the roll angle of the mobile phone is within a second angle range. On the contrary, the mobile phone determines that the user is in a non-lying state when it detects that the posture angle of the mobile phone does not meet the above conditions; that is, the pitch angle of the mobile phone is outside the first angle range, and the roll angle of the mobile phone is outside the second angle range. The first angle range and the second angle range can both be set according to actual conditions. For example, Figure 6 In the example shown, the first angle range can be set to (-90°, 0°). Figure 7 In the example shown, the second angle range can be set to the union of (-90°, -45°) and (45°, 90°). The above-mentioned first angle range and second angle range are examples. In other embodiments, the first angle range and the second angle range can also be set to other numerical ranges. Since the user uses the mobile phone in a lying position, the posture of the mobile phone will also change with the user's head and neck. When the user is in a lying position using the mobile phone, the pitch angle and / or roll angle of the mobile phone are within a fixed range. Therefore, it can be judged whether the user is in a lying position using the mobile phone by the size of the pitch angle and / or roll angle of the mobile phone.

[0063] The sensor of the mobile phone can obtain data such as the attitude angle of the mobile phone. For example, the inertial measurement unit (IMU) of the mobile phone can obtain data such as the attitude angle of the mobile phone. The x, y and z in the above formulas 1 and 2 respectively represent the components of gravity on the three axes of the mobile phone's X-axis, Y-axis and Z-axis in the data measured by the IMU.

[0064] In other embodiments, the mobile phone may also determine whether the user is in a lying position using the mobile phone in other ways. For example, the mobile phone may determine whether the user is in a lying position using the mobile phone by collecting and analyzing images; for example, the mobile phone may determine whether the user's head and neck are close to a supporting object (such as a sofa) by analyzing images; if so, it means that the user is in a lying position using the mobile phone.

[0065] In an embodiment where the first data includes ambient light brightness, the preset condition may include whether the ambient light brightness is greater than a brightness threshold. Specifically, when the mobile phone is in a bright screen state and detects that the ambient light brightness is greater than the brightness threshold, the mobile phone may start a posture detection algorithm. As can be seen from the above description, in an embodiment of the present application, the mobile phone needs to determine the user posture by collecting images and performing image recognition. The quality of the collected image is affected by the environment. If the environment is too dark, the collected image is darker, that is, the image quality is not high. If the image quality is not high, the mobile phone may not be able to accurately recognize the user posture in the image. Therefore, in this embodiment, the preset condition includes whether the ambient light brightness is greater than the brightness threshold. When the ambient light brightness is greater than the brightness threshold, it is determined that the preset condition is met; when the ambient light brightness is less than or equal to the brightness threshold, it is determined that the preset condition is not met. In this way, the posture detection algorithm may not be turned on when the ambient light brightness is low (less than or equal to the brightness threshold), thereby avoiding the problem of inaccurate recognition of the posture detection algorithm due to low ambient light brightness.

[0066] The sensor of the mobile phone can obtain data such as ambient light of the mobile phone. For example, the ambient light sensor (ALS) of the mobile phone obtains data such as ambient light.

[0067] Alternatively, the preset condition can also be set to whether the user is in a non-lying position using the mobile phone, and whether the ambient light brightness is greater than a brightness threshold. In this embodiment, when the mobile phone detects that the user is in a non-lying position using the mobile phone, and the ambient light brightness is greater than the brightness threshold, it is determined that the preset condition is met. On the contrary, if the user is in a lying position using the mobile phone, or the ambient light brightness is less than or equal to the brightness threshold, it is determined that the preset condition is not met. That is, in this scheme, the posture detection algorithm is not turned on in the lying position use state where posture detection is not required and the ambient light brightness is low. In this way, the accuracy of the posture detection algorithm can be guaranteed, and excessive power consumption of the mobile phone can be avoided.

[0068] In an embodiment of the present application, when a preset condition is met, the mobile phone can start a posture detection algorithm. The posture detection algorithm can specifically include collecting images through a camera, analyzing the images to determine whether the user is in a posture of lowering the head to use the mobile phone (also referred to as a lowered head use posture), etc.

[0069] In some embodiments, when the mobile phone is continuously in the screen-on state, the mobile phone can periodically obtain the first data and determine whether the first data meets the preset condition. When the preset condition is periodically determined to be met based on the first data, the mobile phone can maintain the posture detection algorithm in the on state, such as controlling the camera to remain on. When the mobile phone enters the screen-off state and / or the mobile phone determines that the preset condition is not met based on the first data, the mobile phone turns off the posture detection algorithm, such as turning off the camera.

[0070] If the result of S301 is no, it means that the condition for starting the posture detection algorithm is not met at present, and no other operations are required. Figure 2 Not shown.

[0071] If the judgment result of S301 is yes, it means that the condition for starting the posture detection algorithm is currently met, and the following S302 can be executed.

[0072] S302. Start the camera.

[0073] The camera specifically refers to the front camera of the mobile phone. It should be noted that starting the camera means starting the camera in the background to collect data, which is not perceived by the user.

[0074] Starting the camera specifically means starting the always-on camera (AO camera). AO camera is a technology that allows mobile devices to identify changes in the surrounding environment and its content, and implement an autonomous user interface based on the acquired information. AO camera can be understood as a low-power mode of the camera, which can perform continuous sensing and monitoring under ultra-low power consumption. In some embodiments, when the mobile phone turns on the AO camera, the camera captures low-resolution grayscale images. In this solution, the posture detection algorithm is implemented through the AO camera. The AO camera remains turned on for a long time and does not consume too much power of the mobile phone, thereby avoiding excessive power consumption of the mobile phone when running the posture detection algorithm.

[0075] S303. Obtain the image captured by the camera.

[0076] The camera can capture images at a certain frequency for image analysis. It is understandable that in this scenario, the images captured by the camera are used to analyze whether the user is in a head-down posture. The camera can capture one or more images each time. In an embodiment where the camera captures multiple images each time, the camera can capture M images each time (M≥2), or in other words, the camera can capture multiple images within a preset time period each time.

[0077] S304. Analyze the images collected by the camera to determine the user's posture.

[0078] Although the mobile phone is in the screen-on state, the user may not be using the mobile phone. Therefore, in some embodiments, the mobile phone analyzes the image captured by the camera, which may not include the user's image. The above S304 specifically analyzes the image captured by the camera, and when it is determined that the image includes the user's image, determines the user's posture. Specifically, the mobile phone analyzes whether the image includes the user's image, which means whether the image includes the user's face image.

[0079] The image captured by the camera may include images of one or more users. Specifically, the image captured by the camera includes facial images of one or more users. In the above S304, the image captured by the camera is analyzed, and when it is determined that the image includes an image of a user, the user posture of the target user is determined.

[0080] When the image captured by the camera includes an image of a user, the mobile phone can directly determine the user as the target user. Alternatively, the mobile phone can also analyze the proportion of the user's facial image in the image when it detects that the image captured by the camera includes an image of a user. Furthermore, when the proportion of the user's facial image in the image is greater than a first proportion threshold, the mobile phone determines the user as the target user. If the mobile phone detects an image of a user in the image, but the proportion of the user's facial image is very small, it is possible that no user is currently using the mobile phone. Therefore, by adding a judgment of whether the proportion of the facial image in the image is greater than the first proportion threshold, the accuracy of image analysis can be further improved.

[0081] When the images collected by the camera include images of multiple users, the mobile phone can determine one of them as the target user. The mobile phone determines the target user as the user currently using the mobile phone.

[0082] Optionally, as an example, the mobile phone may analyze the proportion of each user's face image in the image, and select a user whose face image has the highest proportion in the image as the target user.

[0083] As another example, the mobile phone can analyze the proportion of each user's face image in the image, select a user whose face image has the highest proportion in the image and whose face image proportion in the image is greater than a first proportion threshold, and determine it as the target user. If the mobile phone detects multiple users in the image, but the proportion of each user's face image is very small, it is possible that no user is currently using the mobile phone. Therefore, by adding the judgment of whether the proportion of face images in the image is greater than the first proportion threshold, the accuracy of image analysis can be further improved.

[0084] Alternatively, the mobile phone may also determine the target user by analyzing the position of the user's facial image in the image. Usually, the facial image of a user who uses a mobile phone should be located close to the center of the image. Therefore, the mobile phone may also determine the target user by analyzing whether the position of the user's facial image in the image is within a preset range of the center point of the image. For example, the mobile phone may determine the user whose facial image is closest to the center point of the image as the target user. In other embodiments, the mobile phone may also determine the target user based on the proportion of the user's facial image in the image and the position of the user's facial image in the image.

[0085] In some embodiments, in the above S304, the mobile phone analyzes the image to determine the user's posture, specifically determining the posture angle of the user's face. The posture angle of the user's face refers to the absolute posture angle of the user's face relative to the world coordinate system.

[0086] Further, in some embodiments, the above S304 may specifically include: detecting key points of the face of the target user in the image. Exemplarily, key points of the face may include face contour, eyes, eyebrows, lips, and nose contour, etc. Afterwards, the mobile phone calculates the pitch angle of the target user's face relative to the mobile phone screen based on the key points of the face of the target user. Finally, the mobile phone determines the absolute pitch angle of the target user's face relative to the world coordinate system based on the pitch angle of the target user's face relative to the mobile phone screen and the pitch angle of the mobile phone. Among them, the definition of pitch, yaw and roll of the face relative to the mobile phone screen is similar to the definition of the attitude angle of the mobile phone. Among them, the pitch angle of the mobile phone can be obtained from the sensor. In addition, the mobile phone detects key points of the face of the target user in the image, and calculates the pitch angle of the target user's face relative to the mobile phone screen based on the key points of the face of the target user. The specific implementation process of these two steps can refer to the description in the relevant technology.

[0087] For example, the mobile phone can calculate the absolute pitch angle of the user's face relative to the world coordinate system, such as pitch3, based on the pitch angle of the mobile phone, such as pitch1, and the pitch angle of the user's face relative to the mobile phone, such as pitch2. Pitch3 = pitch1 + pitch2. Afterwards, the mobile phone can determine whether the user is in a head-down posture based on the absolute pitch angle pitch3.

[0088] S305: Determine whether the user's posture conforms to the head-down usage posture.

[0089] From the above description, it can be seen that the user posture determined by the mobile phone analyzing the image is specifically the posture angle of the user's face. Therefore, in the embodiment of the present application, in the above S305, it is possible to judge whether the user posture conforms to the head-down usage posture by judging the size of the posture angle of the user's face.

[0090] like Figure 1As shown, usually when the user is in the posture of lowering his head to use the mobile phone, the absolute pitch angle of the user's face relative to the world coordinate system is large. Therefore, the above S305 may specifically include: judging whether the absolute pitch angle of the user's face relative to the world coordinate system is greater than or equal to the angle threshold. After S304, the mobile phone determines the absolute pitch angle pitch3 of the user's face relative to the world coordinate system. In S305, the mobile phone can compare the absolute pitch angle pitch3 of the user's face relative to the world coordinate system with the angle threshold to determine whether the user is in the posture of lowering his head to use the mobile phone. Specifically, if the absolute pitch angle pitch3 is greater than or equal to the angle threshold, it means that the user is currently in the posture of lowering his head to use the mobile phone. If the absolute pitch angle pitch3 is less than the angle threshold, it means that the user is not currently in the posture of lowering his head to use the mobile phone. Among them, the angle threshold can be set according to the actual situation; for example, the angle threshold can be set to 40°, 42° or 45°, etc.

[0091] In order to save the computing power and power consumption of the mobile phone, the mobile phone can run the posture detection algorithm once every first preset time, such as S303-S305. Among them, the first preset time can be set according to actual conditions, for example, the first preset time can be set to 8s, 10 seconds (s) or 12s.

[0092] In order to improve the accuracy of the posture detection algorithm, the mobile phone can obtain multiple images collected by the camera for analysis each time, and for each image, it can be obtained whether the user posture in the image meets the head-down use posture. Further, in this embodiment, the mobile phone can determine that the current target user is detected to be in the head-down use posture when the number of user postures in the multiple images detected to meet the head-down use posture is greater than the number threshold. Among them, the number threshold can be set according to the number of images detected by the mobile phone each time. For example, the mobile phone obtains M (M≥2) images collected by the camera for analysis each time, and the number threshold can be set to (M-1); or the number threshold can be set to M / 2. Taking M=5 as an example, the mobile phone can determine that the target user is currently detected to be in the head-down use posture when there are 3 or more images in the 5 frames of images in which the target user posture meets the head-down use posture. That is, in this embodiment, the above S304 specifically includes: analyzing multiple images and determining the user posture in each image respectively. The above S305 specifically includes: judging whether the number of images in which the user posture meets the head-down use posture in the multiple images reaches the number threshold. Specifically, if the judgment result of S305 is yes, that is, the number of images in which the user posture conforms to the head-down use posture in the multiple images reaches the quantity threshold, it indicates that the current user is in the head-down use posture. If the judgment result of S305 is no, that is, the number of images in which the user posture conforms to the head-down use posture in the multiple images does not reach the quantity threshold, it indicates that the current target user is not in the head-down use posture.

[0093] If the judgment result of S305 is no, it means that the current target user is not lowering his head to use the phone. In this case, no reminder is needed. As an example, in this case, the phone can return to continue to obtain the image captured by the camera, and detect again whether the user has changed the posture of using the phone to lowering his head to use the phone, so as to continuously monitor whether the user is lowering his head to use the phone when the phone screen is on and the preset conditions are met. Figure 2 Not shown.

[0094] If the judgment result of S305 is yes, it means that the current user is in a posture of lowering his head to use the mobile phone, and S306 is executed.

[0095] S306. Start timing.

[0096] During the timing process, the mobile phone can continue to determine whether the user's posture meets the head-down usage posture. If the user's posture no longer meets the head-down usage posture, the mobile phone should stop timing.

[0097] S307: When the duration exceeds the time threshold, output a prompt message.

[0098] The time threshold can be pre-set according to actual conditions and stored in the mobile phone.

[0099] Furthermore, the time threshold can be set to different time thresholds according to different ages. As an example, the mobile phone can pre-set and store different age intervals, and the time thresholds corresponding to different age intervals. For example, the age interval of children: 0-12 years old; the age interval of teenagers: 13-18 years old; the age interval of young people: 19-34 years old; the age interval of middle-aged people: 35-59 years old; the age interval of the elderly: 60 years old and above. It should be noted that the setting of the above age intervals is only an example. The time thresholds corresponding to each age interval are described in the subsequent embodiments.

[0100] In this embodiment, the mobile phone also needs to detect the age range of the user. The mobile phone can determine the user's age by analyzing the image captured by the camera, and then determine the user's age range. Among them, the mobile phone can estimate the user's age through the image captured by the camera based on a deep learning algorithm, such as an age detection algorithm. Specifically, the mobile phone can crop the image captured by the camera to obtain a partial image of the face area of ​​the target user in the image, and then analyze the partial image of the face area of ​​the target user through the age detection algorithm to determine the user's age. The specific implementation process of the age detection algorithm can refer to the description in the relevant technology.

[0101] Usually, users generally use mobile phones for a period of time. For the same mobile phone, the user who uses the mobile phone is usually the same person over a period of time. Therefore, the age detection algorithm used by the mobile phone to detect the age range of the user can be run at a lower frequency to reduce the power consumption of the mobile phone. In some embodiments, the mobile phone can run the age detection algorithm once every second preset time. The second preset time can be set according to actual conditions. For example, the second preset time can be set to 1 hour (h), etc. In this way, the power consumption of the mobile phone can be reduced under the premise of setting different time thresholds according to different age intervals to monitor whether the user bows his head for a long time.

[0102] In order to improve the accuracy of the result output by the age detection algorithm, if the result output by the mobile phone when running the age detection algorithm this time is significantly different from the result output when running the age detection algorithm last time, the mobile phone can temporarily increase the frequency of running the age detection algorithm, for example, switching to running the age detection algorithm once every third preset time interval. The third preset time can be set to 5 minutes (min).

[0103] The results of the two runs of the age detection algorithm output are significantly different, specifically, the age difference in the results of the two runs of the age detection algorithm output is greater than a threshold, such as 10 years old. Alternatively, the results of the two runs of the age detection algorithm output are significantly different, specifically, the user age intervals determined by the results of the two runs of the age detection algorithm output are different. For example, the age interval determined by the result of the first age detection algorithm output is the age interval of children, and the age interval determined by the result of the second age detection algorithm output is the age interval of the elderly.

[0104] As an example, after the mobile phone temporarily increases the frequency of running the age detection algorithm, the mobile phone can determine the user's age based on the ages output by the age detection algorithm for multiple consecutive times. For example, after the mobile phone runs the age detection algorithm once every third preset time, it obtains the results output by the age detection algorithm for three consecutive times and calculates the arithmetic mean. Then, the mobile phone determines the arithmetic mean of the results output by the age detection algorithm for the three times as the user's age. Then, the mobile phone determines the user's age range based on the user's age. In this way, the accuracy of the results output by the age detection algorithm can be improved.

[0105] As another example, after the mobile phone temporarily increases the frequency of running the age detection algorithm, the mobile phone can determine that the current user has changed, and the age range of the user before and after the change is different when the result of the age detection algorithm output is the same after N consecutive detections. Among them, N can be set according to actual conditions, for example, N can be set to 2, 3 or 4. Since different time thresholds are set for different age ranges, when the mobile phone detects that the age range of the user has changed, the currently used time threshold will be updated. Exemplarily, the mobile phone runs the age detection algorithm for the first time, and determines that the age range of the user is a child's age range according to the result output by the age detection algorithm. After the second preset time, the mobile phone runs the age detection algorithm for the second time, and determines that the age range of the user is a middle-aged age range according to the result output by the second age detection algorithm. Since the age range of this user is different from the age range of the previous user, the mobile phone will increase the frequency of running the age detection algorithm, such as adjusting the mobile phone to run the age detection algorithm once every third preset time. After the second run of the age detection algorithm, the mobile phone runs the age detection algorithm for the third time at a third preset time, and determines that the age range of the user is a middle-aged age range according to the result output by the age detection algorithm. After the third preset time interval after the third running of the age detection algorithm, the mobile phone runs the age detection algorithm for the fourth time, and determines that the user's age range is the middle-aged age range according to the result output by the age detection algorithm. That is, after the user's age range is detected as the middle-aged age range for three consecutive times, the mobile phone updates the user's age range to the middle-aged age range. Afterwards, the mobile phone can monitor whether the user is in a posture of lowering his head to use the mobile phone for a long time according to the time threshold of the age range being the middle-aged age range. In this way, the accuracy of the output result of the age detection algorithm can be improved.

[0106] In addition, each time the user starts the phone, such as after unlocking the phone, the user who uses the phone for a period of time generally does not change. Therefore, in some embodiments, the phone can run an age detection algorithm each time it detects that the phone screen is on. Afterwards, if the phone is always in the screen-on state, the phone runs the age detection algorithm once every second preset time interval. If the user's age is detected to be significantly different from the user's age detected when the phone is started, the frequency of the age detection algorithm is increased to determine whether the user's age has changed. In this way, under the premise of setting different time thresholds according to different age intervals to monitor whether the user has been using the phone with his head down for a long time, the accuracy of the output results of the age detection algorithm can be improved and the power consumption of the phone can be reduced.

[0107] Next, the prompt information is explained.

[0108] The prompt information can be pre-stored in the mobile phone according to the actual situation. Specifically, the mobile phone can pre-store the prompt method, prompt content, and prompt duration of the prompt information.

[0109] The prompting method of the prompting information may be one or more of a ring tone prompting method, a voice prompting method, a vibration prompting method, a display prompting method, or a flashing light prompting method. In the case where the prompting information includes a display prompting method, the prompting content may be preset. The prompting duration indicates the duration of the prompting information. For example, in the ring tone prompting method, the duration of the ring tone prompting information issued by the mobile phone, etc.

[0110] Prompt messages can be divided into prompt messages of different urgency. For example, prompt messages are divided into non-interruptive prompt messages and interruptive prompt messages. Among them, the urgency of interruptive prompt messages is higher than that of non-interruptive prompt messages. For example, non-interruptive prompt messages can be implemented in any of the following ways: notification bar pop-up window display prompt method, smart island animation display prompt method, voice prompt method, ringtone prompt method or vibration prompt method. Figure 8 The prompt information 20 shown in (a) is a schematic diagram of a notification bar pop-up window display prompt method. The interruptive prompt information can be implemented in any of the following ways: a foreground pop-up window display prompt method, forced exit of an application (APP), screen lock, etc. Figure 8 The prompt information 21 shown in (b) is an illustration of a foreground pop-up window display prompt method.

[0111] The mobile phone can send out prompt messages of different urgency levels according to the length of time the user keeps his head down to use the phone. For example, when the user keeps his head down to use the phone for a short period of time, a prompt message of lower urgency level, such as a non-interruption prompt message, is sent out. Afterwards, the mobile phone can continue to detect whether the user is still in the posture of using the phone with his head down, and if so, continue timing. When the user keeps his head down to use the phone for a long period of time, the mobile phone can again send out a prompt message of higher urgency level, such as an interruption prompt message. By detecting the length of time the user keeps his head down to use the phone and distinguishing prompt messages of different urgency levels, a better prompt effect can be achieved.

[0112] Table 1 is an example of time thresholds corresponding to prompt information of different age ranges and different urgency levels. In other embodiments, the time threshold may also be set to other values.

[0113] Table 1

[0114] Combined with Table 1, when the mobile phone detects that the user's age range belongs to the children's age range, if it is detected that the user is in the mobile phone with his head down for more than 10 minutes, a non-interrupting prompt message is issued. Further, if it is detected that the user is in the mobile phone with his head down for more than 20 minutes, an interrupting prompt message is issued. Similarly, when the mobile phone detects that the user's age range belongs to the teenagers, if it is detected that the user is in the mobile phone with his head down for more than 15 minutes, a non-interrupting prompt message is issued. Further, if it is detected that the user is in the mobile phone with his head down for more than 30 minutes, an interrupting prompt message is issued. And so on. According to some research results, long-term use of mobile phones with the head down causes the greatest harm to children, which may cause permanent body posture problems, followed by the harm to teenagers, and the bones and muscles of middle-aged people are relatively stable, and the harm is relatively minimal. Therefore, the length of the time threshold is set to the time thresholds corresponding to the children's age range, the teenagers' age range, the middle-aged age range, and the elderly age range, which increase in sequence. Among them, for the same age range, the non-interruptive prompt information can be recorded as the first prompt information, and the time threshold corresponding to the non-interruptive prompt information can be recorded as the first time threshold. The time threshold of the interruptive prompt information can be recorded as the second prompt information, and the time threshold corresponding to the interruptive prompt information can be recorded as the second time threshold.

[0115] The mobile phone can also send out prompt messages of different urgency according to different usage scenarios. In this embodiment, the mobile phone can pre-store different types of APPs, and the proportion of the time the user bows his head to use the mobile phone to the total usage time of this type of APP. If the proportion of the time of bowing the head to use a certain type of APP is greater than the second proportion threshold, it means that the user is accustomed to bowing his head to use the mobile phone when using this type of APP, or needs to bow his head to use the mobile phone for a long time. In this case, the user usually does not want to be interrupted by the prompt message when using this type of APP. As an example, the mobile phone can set an identification for this type of APP. Afterwards, when the mobile phone detects that the currently running APP is set with an identification, if it monitors that the user bows his head to use the mobile phone for a long time, the mobile phone sends a prompt message in a non-interruption way. This can make the prompt message sent by the mobile phone more in line with the user's usage habits.

[0116] When a user is using a conference-type APP, it usually means that the user is in a meeting. When the user is in a meeting, he usually does not want to be interrupted by prompt information. Therefore, for conference-type APPs, the mobile phone can be set to not display prompt information when it detects that the user is using the phone with his head down for a long time; or the mobile phone can block prompt information, such as not popping up prompt information. This can make the prompt information sent by the mobile phone more in line with the user's usage habits.

[0117] The mobile phone can obtain the ID of the APP currently running on the mobile phone from the operating system, and search the lookup table for the APP type corresponding to the ID of the APP according to the ID of the APP. The lookup table can be pre-set and stored in the mobile phone. Alternatively, the APP types can be divided into different application usage scenarios. Different prompting methods are used for different application usage scenarios.

[0118] In addition, if users lower their heads to use their phones for a long time, it is easy for the users' attention and cognitive abilities to decline, and their visual attention to the surrounding environment to decrease. Therefore, in some scenarios that require users to pay more attention, if the phone detects that the user lowers his head to use the phone for a long time, it can issue a prompt message with a higher degree of urgency. As an example, the phone can obtain the location information of the global positioning system (GPS) to determine whether it is currently in a scene of crossing the road. In the scenario of crossing the road determined by the GPS location information, if the phone detects that the user lowers his head to use the phone for a long time, it can issue a prompt message with a higher degree of urgency, such as outputting the prompt message in the form of a foreground pop-up window, forcing the APP to exit, or locking the screen.

[0119] In the technical solution proposed in the embodiment of the present application, the mobile phone determines whether the preset conditions are met according to the first data in response to the screen being turned on, and starts the posture detection algorithm when the preset conditions are met. The posture detection algorithm can detect whether the user is in a posture of lowering his head to use the mobile phone through the image captured by the camera. When it is detected that the user is in a posture of lowering his head to use the mobile phone and the duration exceeds the time threshold, the mobile phone outputs a prompt message to remind the user to pay attention to the posture of using the mobile phone. Therefore, not only can the user be reminded of the posture of lowering his head to use the mobile phone for a long time, but when the posture detection algorithm is turned on when the preset conditions are met, it can also avoid consuming too much power consumption of the mobile phone.

[0120] In an embodiment where the mobile phone obtains the posture angle of the mobile phone through an IMU sensor, obtains the ambient light brightness through an ambient light sensor, and determines whether a preset condition is met based on the posture angle of the mobile phone and the ambient light brightness, the mobile phone integrates data from multiple sensors to monitor and remind the user of using the mobile phone with their head down for a long time. In addition, the mobile phone selectively turns on the posture detection algorithm, which can reduce the power consumption of the mobile phone while monitoring and reminding the user of using the mobile phone with their head down for a long time.

[0121] In the embodiment of setting different time thresholds for different age ranges, the mobile phone estimates the user's age range by combining an age detection algorithm. In addition, the mobile phone sets different time limit thresholds for non-interruptive prompt messages and interruptive prompt messages according to different age ranges, which can achieve better prompt effects and avoid the bad experience of users caused by too frequent prompt messages according to actual conditions.

[0122] In the embodiment of sending out different prompt information in combination with the scenario, the mobile phone can obtain the information of the currently running APP from the system. After the mobile phone detects that the user has been using the mobile phone with his head down for a long time, it sends out different prompt information according to the different APP types of the currently running APP. In this way, the prompt information sent by the mobile phone can be more in line with the user's usage habits.

[0123] In some embodiments, the mobile phone includes a switch for the head-down detection function. When the head-down detection function is turned on, the mobile phone can obtain the first data in response to the mobile phone screen being turned on, and execute the posture detection algorithm when the first data meets the preset conditions. When the head-down detection function is turned off, the mobile phone will not obtain the first data in response to the mobile phone screen being turned on to determine whether the preset conditions are met. The operation process of the user turning on the head-down detection function in the mobile phone can refer to the description in the subsequent embodiments.

[0124] Fig. 9 It shows the implementation method in which, after the timing starts, the mobile phone continuously detects whether the user's posture conforms to the head-down usage posture, and issues prompt information of different urgency levels.

[0125] S400. In response to the mobile phone screen being turned on, obtaining first data of the mobile phone.

[0126] S401. Determine whether a preset condition is met based on the first data.

[0127] If the result of S401 is no, it means that the condition for starting the posture detection algorithm is not met at present, and no other operations are required. Fig. 9 Not shown.

[0128] If the judgment result of S401 is yes, it means that the condition for starting the posture detection algorithm is currently met, and S402 is executed.

[0129] S402. Start the camera.

[0130] S403: Obtain the image captured by the camera.

[0131] S404. Analyze the images collected by the camera to determine the user's posture.

[0132] S405: Determine whether the user's posture conforms to the head-down usage posture.

[0133] Among them, if the judgment result of S405 is no, Fig. 9 Not shown.

[0134] If the judgment result of S405 is yes, it means that the current user is in a posture of lowering his head to use the mobile phone, and S406 is executed.

[0135] S406. Start timing.

[0136] S407. Obtain the image captured by the camera.

[0137] S408. Analyze the images collected by the camera to determine the user's posture.

[0138] S409: Determine whether the user's posture conforms to the head-down usage posture.

[0139] If the judgment result of S409 is yes, then S410 is executed.

[0140] S410: Determine whether the duration exceeds a time threshold.

[0141] The duration is specifically the duration of the timing. If the judgment result of S410 is no, the mobile phone can continue to count. While the timing continues, the mobile phone still periodically executes S407-S409. If the judgment result of S410 is yes, S411 is executed.

[0142] S411. Output prompt information.

[0143] If the judgment result of S409 is no, then S412 is executed.

[0144] S412. The timer is reset.

[0145] Afterwards, as long as the phone is still in the screen-on posture and meets the preset conditions, the phone can re-acquire and analyze the images captured by the camera to determine whether the user's posture meets the head-down posture.

[0146] In this solution, the mobile phone starts timing after detecting that the user is in a posture of lowering his head to use the mobile phone. During the timing process, it continuously monitors whether the user keeps lowering his head to use the mobile phone. If the user keeps lowering his head to use the mobile phone, and the duration exceeds the time threshold, the mobile phone will output a prompt message. In this way, it is ensured that the user can be reminded after the user keeps lowering his head to use the mobile phone for a period of time. If the user no longer lowers his head to use the mobile phone after the timing starts, the timing is reset. If the user lowers his head to use the mobile phone for a short period of time, the mobile phone will not remind him. Thereby, the possibility of false reminders can be reduced.

[0147] In addition, in some embodiments, the mobile phone can also count the proportion, frequency, and duration of the user's head-down use of the mobile phone within a period of time. Afterwards, the mobile phone can form healthy usage data according to the statistical information according to a preset period (such as weekly, monthly, etc.), and display the healthy usage data to the user. Exemplarily, the healthy usage data counted by the mobile phone may include: the duration of head-down use, the proportion of head-down use, the duration and proportion of low-light use, the duration and proportion of side-lying use, etc. Further, the mobile phone can also generate corresponding suggestions for healthy use of the mobile phone based on the statistical health usage data. Among them, when generating suggestions, the mobile phone can also generate corresponding suggestions in combination with the user's occupation, living habits, and mobile phone usage habits. Healthy usage data can also include: blinking frequency, gaze distance when using a mobile phone, etc. Among them, the specific implementation method of detecting blinking frequency and gaze distance when using a mobile phone can refer to the description in the relevant technology. In this scheme, the mobile phone can provide multi-dimensional health usage data and corresponding suggestions in combination with the user's use of the mobile phone over a period of time.

[0148] Fig.10 A simple process of the user's posture detection and reminder method in some embodiments is shown. The method includes: determining the posture angle of the mobile phone according to the data detected by the inertial measurement unit, and judging the lying posture according to the posture angle of the mobile phone. The ambient light brightness is judged according to the data detected by the ambient light sensor. When it is determined that the non-lying posture is and the ambient light brightness is greater than the brightness threshold, the posture detection algorithm is turned on. It should be noted that the mobile phone obtains the data detected by the inertial measurement unit and the data detected by the ambient light sensor, and analyzes the data for judgment, which can be executed when the mobile phone is on. Afterwards, when the mobile phone is in the screen-on state, the mobile phone can periodically obtain data and analyze and judge. When it is determined that the lying posture is or the ambient light brightness is less than or equal to the brightness threshold, the posture detection algorithm is turned off.

[0149] After turning on the posture detection algorithm, the mobile phone can start the always-on camera. Perform face detection through the always-on camera to determine whether a face image is included. If a face image is included, the mobile phone further determines whether multiple face images are included. If the result of face detection is that the image includes only one face image, the face key points are detected for the face image, and the posture angle of the face relative to the mobile phone screen is calculated based on the face key points. If the result of face detection is that the image includes multiple face images, the user with the largest proportion of face images among the multiple face images is determined as the target user, the face key points of the target user are detected, and the posture angle of the target user's face relative to the mobile phone screen is calculated.

[0150] Then, the mobile phone calculates the absolute posture angle α of the face by combining the posture angle of the mobile phone and the posture angle of the face relative to the mobile phone screen. It is determined whether α is greater than or equal to threshold 1. If the judgment result is that α is greater than or equal to threshold 1, it means that the user is in a head-down posture. If the judgment result is that α is less than threshold 1, it means that the user is in a non-head-down posture. Among them, threshold 1 corresponds to the angle threshold in the above embodiment.

[0151] Finally, the mobile phone can count down when it detects the user's head-down usage state, and output a prompt message when the duration of the user's head-down usage state exceeds the time threshold.

[0152] Fig.11 A schematic diagram of a scene of a user's posture detection and reminder method in some embodiments is shown. In this embodiment, the user's posture detection and reminder method integrates data from multiple sensors, including an ambient light sensor, an inertial measurement unit, and a normally open camera. In addition, the mobile phone also needs to obtain information about the APP usage scenario from the system. Secondly, the mobile phone integrates multiple perception algorithms (fusion perception algorithms), including APP usage scenario judgment, ambient light brightness judgment, whether the user is in a lying position judgment, face detection algorithm, key point detection algorithm, and age estimation algorithm. Combined with the results of ambient light brightness judgment, lying position judgment, face detection algorithm, and key point detection algorithm, the judgment of bowing posture is performed. Finally, the mobile phone provides the user with interaction based on the result of bowing posture judgment, including: bowing reminder according to the scene, bowing reminder according to age, and health usage data.

[0153] It should be noted that the posture detection algorithm used in the present application to detect whether the user is lowering their head to use the device can also be applied to other scenarios, such as action recognition scenarios.

[0154] Fig.12 FIG. 1 shows the operation flow of a user turning on the head-down detection function in a mobile phone in some embodiments. Fig.12As shown, the mobile phone displays a desktop, and the desktop includes an icon of a setting application. In response to the user's triggering operation on the icon of the setting application, the mobile phone can display a setting application interface 901. The setting application interface 901 includes a head-down detection option 902. In response to the user's triggering operation on the head-down detection option 902, the mobile phone can display a setting interface 903 for head-down detection. In the setting interface 903 for head-down detection, a switch 904 for the head-down detection function and a switch for user posture information statistics are included. In response to the user's triggering operation on the switch 904 for the head-down detection function, the mobile phone can turn on the head-down detection function, such as the head-down detection function switch 905 is turned on. It can be understood that after the mobile phone turns on the head-down detection function in response to the user's operation, the first data can be obtained in response to the light screen, and whether the preset conditions are met according to the first data, and the camera is started to detect and remind the user's posture when the preset conditions are met. Before the mobile phone turns on the head-down detection function in response to the user's operation, the mobile phone will not respond to the light screen to obtain the first data to determine whether the preset conditions are met.

[0155] The above embodiments introduce the specific implementation process of the user posture detection and reminder method. The following introduces the hardware structure of the electronic device to which the user posture detection and reminder method is applied.

[0156] like Fig.13 The figure shows a hardware structure diagram of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, a camera 192, a display screen 193, and a subscriber identification module (SIM) card interface 194. Among them, the sensor module 180 may include a pressure sensor 180A, a touch sensor 180B, an inertial measurement unit 180C, and an ambient light sensor 180D.

[0157] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0158] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural network processor (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. For example, the processor 110 is used to execute the user's posture detection and reminder method in the embodiment of the present application.

[0159] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0160] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0161] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0162] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system and an application required for at least one function (such as a sound playback function, an image playback function, etc.).

[0163] In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), and the like.

[0164] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 193, the camera 192, and the wireless communication module 160.

[0165] In some other embodiments, the power management module 141 may also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 may also be disposed in the same device.

[0166] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0167] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0168] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.

[0169] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as Wi-Fi), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and filters it, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0170] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0171] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170 and the application processor.

[0172] The audio module 170 is used to convert digital audio signals into analog audio signals for output, and is also used to convert analog audio inputs into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110. In an embodiment of the present application, the mobile phone can output prompt information in the ring tone prompt mode and voice prompt mode through devices such as speakers in the audio module 170.

[0173] The inertial measurement unit 180C infers the motion state of an object, including position, speed, attitude, etc., by measuring the acceleration and angular velocity of the object. The accelerometer measures the linear acceleration of the object on three axes, while the gyroscope measures the angular velocity of the object around three axes. By solving these data, information such as the attitude, speed, and displacement of the carrier can be obtained. In an embodiment of the present application, the mobile phone can obtain the attitude angle of the mobile phone through the inertial measurement unit 180C, which is used to analyze whether the user is in a lying position using the mobile phone, and to calculate the absolute attitude angle of the face relative to the world coordinate system.

[0174] The ambient light sensor 180D is used to sense the ambient light brightness. The electronic device can adaptively adjust the brightness of the display screen 193 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180D can also cooperate with the proximity light sensor to detect whether the electronic device is in a pocket to prevent accidental touch. In an embodiment of the present application, the mobile phone can obtain the ambient light brightness through the ambient light sensor 180D to determine whether the ambient light brightness is greater than a threshold.

[0175] Buttons 190 include a power button, a volume button, and the like.

[0176] The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. In the embodiment of the present application, the mobile phone can output prompt information in the form of a vibration prompt through the motor 191.

[0177] The camera 192 is used to capture static images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 192, where N is a positive integer greater than 1. In an embodiment of the present application, when the mobile phone determines that the preset condition is met according to the first data, it can call the front camera in the camera 192, specifically the AO camera, to capture an image for detecting the user's posture.

[0178] The electronic device 100 implements the display function through a GPU, a display screen 193, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen 193 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information. In an embodiment of the present application, the mobile phone can output a prompt information of a display prompt mode through a motor 191.

[0179] The display screen 193 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include 1 or N display screens 193 , where N is a positive integer greater than 1.

[0180] The SIM card interface 194 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting or removing the SIM card interface 194. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1.

[0181] The user's posture detection and reminder methods in the above embodiments can all be implemented in the electronic device 100 having the above hardware structure.

[0182] It should be noted that the personal information used in the technical solution of this application is limited to information for which the individual's separate consent has been obtained, including but not limited to notifying and reminding the user to read the relevant user agreement (notification) and sign the agreement (authorization) including authorization of relevant user information before the user uses the function.

[0183] In the technical solutions disclosed in this application, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the relevant laws and regulations and do not violate public order and good morals.

[0184] Some other embodiments of the present application provide an electronic device (such as a mobile phone). The electronic device may include: a memory and one or more processors. The memory is coupled to the processor. The memory is also used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device may execute the various functions or steps executed by the mobile phone in the above method embodiment. The structure of the electronic device can refer to Fig.13 The structure of the electronic device 100 is shown.

[0185] The present application also provides a chip system, such as Fig.14 As shown, the chip system 1000 includes at least one processor 1001 and at least one interface circuit 1002. The processor 1001 and the interface circuit 1002 can be interconnected through lines. For example, the interface circuit 1002 can be used to receive signals from other devices (such as a computer memory). For another example, the interface circuit 1002 can be used to send signals to other devices (such as the processor 1001). Exemplarily, the interface circuit 1002 can read instructions stored in the memory and send the instructions to the processor 1001. When the instruction is executed by the processor 1001, the computer can execute the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0186] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned electronic device (such as a mobile phone), the electronic device executes each function or step executed by the mobile phone in the above-mentioned method embodiment.

[0187] The present application also provides a computer program product, which, when executed on a computer, enables the computer to execute the functions or steps executed by the mobile phone in the above method embodiment. The computer may be an electronic device, such as a mobile phone.

[0188] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0189] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0190] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0191] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0192] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0193] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A user posture detection and reminder method, characterized in that: Applied to electronic equipment, the method comprises: In response to the screen of the electronic device being turned on, the camera is started if a preset condition is met; the preset condition being met includes: the target user using the electronic device is in a non-lying position using the electronic device, and the ambient light brightness is greater than one or more of a brightness threshold; Acquire an image captured by the camera; When the user posture indicated by the image captured by the camera is a head-down usage posture, a prompt message is output; the prompt message is used to prompt the user that the user is currently in the head-down usage posture.

2. The method according to claim 1, characterized in that Before outputting the prompt information, the method further includes: When the user posture indicated by the image captured by the camera is the head-down usage posture, obtaining a duration for which the user posture remains in the head-down usage posture; The output prompt information includes: When the duration of the user posture being maintained in the head-down usage posture exceeds a time threshold, the prompt information is output.

3. The method according to claim 1 or 2, characterized in that: After acquiring the image captured by the camera, the method further includes: Acquire, based on the image captured by the camera, a posture angle of a face of a target user using the electronic device relative to the electronic device, and acquire a posture angle of the electronic device; Determining an absolute posture angle of the target user's face according to the posture angle of the target user's face relative to the electronic device and the posture angle of the electronic device; Determine whether the user posture is the head-down usage posture according to the absolute posture angle of the target user's face.

4. The method according to claim 3, characterized in that In the case where the image captured by the camera includes facial images of multiple users, the target user is a user that meets one or more of the following conditions: The facial images of the multiple users account for the largest proportion, the facial images of the multiple users account for a proportion greater than a first proportion threshold, and the facial images of the multiple users are closest to the center position of the image captured by the camera.

5. The method according to claim 1 or 2, characterized in that: After starting the camera, the method further includes: The electronic device periodically detects whether the preset condition is met; When the electronic device is in a screen-on state and the result of the periodic detection indicates that a preset condition is met, controlling the camera to remain in an activated state; When the screen of the electronic device is turned off, or the result of the periodic detection indicates that a preset condition is not met, the camera is turned off.

6. The method according to claim 2, characterized in that When the duration of the user posture being maintained as the head-down posture exceeds a time threshold, outputting the prompt information includes: When the duration of the user posture being maintained in the head-down posture exceeds a first time threshold, issuing a first prompt message; When the duration of the user posture being maintained in the head-down posture exceeds a second time threshold, issuing a second prompt message; The second time threshold is greater than the first time threshold, and the urgency of the second prompt information is higher than the urgency of the first prompt information.

7. The method according to claim 6, characterized in that The electronic device pre-stores a plurality of age intervals and one or more time thresholds corresponding to each of the age intervals; After acquiring the image captured by the camera, the method further includes: Obtaining an age range of target users using the electronic device based on the image captured by the camera; The first time threshold and the second time threshold are determined according to the age range of the target user.

8. The method according to claim 1 or 2, characterized in that: The electronic device stores a plurality of application usage scenarios and prompting methods of prompting information corresponding to different application usage scenarios; Before outputting the prompt information, the method further includes: Obtaining an application currently running on the electronic device; Determine a target application usage scenario to which the application belongs; Determine a target prompt mode of the corresponding prompt information according to the target application usage scenario; The outputting of the prompt information includes: outputting the prompt information according to the target prompt mode.

9. The method according to any one of claims 2, 4, 6 or 7, characterized in that: The method further comprises: Obtaining statistical information of a user's posture when the user uses the electronic device within a preset period; The statistical information of the user's posture within the preset period is displayed.

10. An electronic device, characterized in that: The electronic device comprises: a camera, a processor, a memory, and a computer program stored in the memory; the camera and the memory are respectively coupled to the processor; When the electronic device is running, the processor executes the computer program to implement the method according to any one of claims 1 to 9.

11. A computer-readable storage medium, characterized in that: A computer program is stored, and when the computer program is executed by a processor of an electronic device, the method according to any one of claims 1 to 9 is implemented.

12. A computer program product, characterized in that The method comprises a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

Images