A display picture adjusting method and an electronic device
By detecting and adjusting the pixel distribution in the display interface, the problem of neck problems caused by users looking down for long periods of time was solved, the time users spent in a healthy neck posture was increased, cervical spine health was improved, and the user experience was enhanced.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HONOR DEVICE CO LTD
- Filing Date
- 2024-01-29
- Publication Date
- 2026-05-22
AI Technical Summary
In existing technologies, prolonged use of portable electronic devices with the user's head down can lead to neck muscle strain and poor blood flow. Furthermore, existing reminder methods offer a poor user experience and are easily ignored.
By detecting the user's cervical spine tilt angle and identifying poor neck posture, the display interface is switched to a second display interface. The changes in the number of pixels in each row are used to create a three-dimensional effect, guiding the user to adjust their neck posture, including displaying images where the far end is larger than the near end or vice versa.
It increased the proportion of time users spent in a healthy neck posture, improved cervical spine health, and enhanced the user experience.
Smart Images
Figure CN120434328B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to a method for adjusting a display screen and an electronic device. Background Technology
[0002] With the rapid development of modern technology, portable electronic devices such as mobile phones and tablets have become indispensable items in people's daily lives. However, this ubiquity has also brought about problems that cannot be ignored. Users who look down at mobile phones, tablets, and other portable electronic devices for extended periods of time are prone to neck muscle strain, poor blood flow, and other cervical spine problems.
[0003] Therefore, to protect users' health, some solutions involve electronic devices reminding users to adjust their neck posture via pop-up windows or voice prompts when the device detects that the user has been in a poor neck posture for an extended period. However, users often choose to simply close the pop-up window or interrupt the voice prompts, meaning these reminder methods are not very effective in guiding users. Summary of the Invention
[0004] This application provides a method for adjusting a display screen and an electronic device, which improves the guidance effect when reminding users to adjust their neck posture, enabling users to be in or maintain a healthy neck posture more likely, and helping to improve users' cervical spine problems.
[0005] In a first aspect, embodiments of this application provide a method for adjusting a display screen, the method comprising:
[0006] The system detects whether the user's cervical spine tilt angle exceeds a preset angle range. If the duration of the detected cervical spine tilt angle exceeding the preset angle range exceeds a first preset time, the electronic device switches from a first display interface to a second display interface. The first display interface has the same number of pixels per row. The second display interface includes a first display area and a second display area. The number of pixels per row in the first display area gradually decreases or increases from the bottom to the top of the electronic device. The first display area displays the content of the first display interface. This embodiment detects that the user's neck posture is in a poor posture for an extended period. The system switches from the first display interface to the second display interface, and displays the content of the first display interface through the first display area of the second display interface. The number of pixels per row in the first display area gradually decreases or increases from the bottom to the top of the electronic device. This creates a three-dimensional effect where the content of the first display interface appears larger at the far end and smaller at the near end, or vice versa, creating the effect of the content being drawn on the screen of the electronic device. This guides the user to automatically adjust their neck posture, improving the user experience.
[0007] Optionally, the angle can be increased or decreased proportionally, with the increase or decrease factor being positively correlated with the user's cervical spine tilt angle. This further enhances the user experience.
[0008] Optionally, the second display area is used to display prompts to remind the user to adjust their neck posture. This further enhances the guidance effect and improves the user experience.
[0009] Optionally, when the device is determined to be held, the number of pixels in each row of the first display area of the second display interface is controlled to gradually decrease from the bottom to the top of the current electronic device; when the device is determined to be stationary, the number of pixels in each row of the first display area of the second display interface is controlled to gradually increase from the bottom to the top of the current electronic device. Thus, the display effect of the first display area in the second display interface is adjusted for different scenarios, further enhancing the user experience.
[0010] In one possible implementation, the holding state can be determined as follows: when the gyroscope's detection data fluctuates continuously, it is determined to be in a holding state; when the gyroscope's detection data remains unchanged, it is determined to be stationary.
[0011] In one possible implementation, image capture data is acquired, which includes the user's head. Based on the image capture data, a first distance and a second distance are determined. The first distance represents the distance between the user's eyes in the captured image, and the second distance represents the distance between the user's head reference point and the lower boundary of the captured image. Based on the first distance, a third distance is determined between the head reference point and the screen of the electronic device. Based on the second and third distances, it is determined whether the user's cervical spine tilt angle is greater than a preset angle range. This embodiment does not require focal length measurement or user-defined target posture, therefore, it has strong versatility.
[0012] In another possible implementation, the background area is determined based on the shooting data, where the background area represents the area of the background region outside the user's head in the shooting image; based on the third distance, a first reference value and a second reference value are matched from a pre-stored first data table; the first reference value represents the first distance when the cervical spine tilt angle corresponding to the third distance is less than or equal to a preset angle range, and the second reference value represents the background area when the cervical spine tilt angle corresponding to the third distance is less than or equal to the preset angle range; the first distance is compared to see if it is greater than the first reference value and the background area is less than the second reference value; if the first distance is greater than the first reference value and the background area is less than the second reference value, it is determined that the user's cervical spine tilt angle is greater than the preset angle range; if the first distance is less than or equal to the first reference value, or the background area is greater than or equal to the second reference value, it is determined that the user's cervical spine tilt angle is less than or equal to the preset angle range.
[0013] In another possible implementation, the head area is determined based on the captured data, whereby the head area represents the area of the user's head in the captured image. Based on a third distance, a first reference value and a third reference value are matched from a pre-stored second data table. The first reference value represents the first distance at which the cervical spine tilt angle corresponding to the third distance is less than or equal to a preset angle range, and the third reference value represents the head area at which the cervical spine tilt angle corresponding to the third distance is less than or equal to a preset angle range. The system compares whether the first distance is greater than the first reference value and whether the head area is greater than the third reference value. If the first distance is greater than the first reference value and the head area is greater than the second reference value, it is determined that the user's cervical spine tilt angle is greater than the preset angle range. If the first distance is less than or equal to the first reference value, or the head area is less than or equal to the third reference value, it is determined that the user's cervical spine tilt angle is less than or equal to the preset angle range.
[0014] In another possible implementation, the device tilt angle of the current electronic device is obtained, which represents the angle between the electronic device and the baseline. Based on the device tilt angle, the projected distance of the third distance in the direction perpendicular to the baseline is obtained, and the projected distance is negatively correlated with the device tilt angle. If the projected distance is greater than the health baseline distance, it is determined that the user's cervical spine tilt angle is greater than a preset angle range; if the projected distance is less than or equal to the health baseline distance, it is determined that the user's cervical spine tilt angle is less than or equal to a preset angle range. This embodiment further incorporates relative position distance judgment, thus improving the accuracy of judgment from multiple dimensions. Optionally, the third distance is determined based on the first distance and the inverse proportional relationship between the third distance and the first distance. In yet another possible implementation, it is determined whether the device tilt angle is less than an angle threshold. If it is less than the angle threshold, the first distance, the second distance, and the background area in the user's portrait are obtained. When the device tilt angle is greater than the angle threshold, the user's posture is considered normal, thus improving processing efficiency.
[0015] Furthermore, if the tilt angle of the device is not less than the angle threshold, the neck posture is determined to be healthy.
[0016] The system uses the front-facing camera of the electronic device to capture the user's image; the front-facing camera is a fixed-focus camera.
[0017] All of the neck posture recognition devices, electronic devices, computer-readable storage media, or computer program products provided above are used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description
[0018] Figure 1 Schematic diagram of different cervical spine testing angles;
[0019] Figure 2 This is a schematic diagram of a pop-up notification interface.
[0020] Figure 3 A schematic diagram showing a blurred image provided in an embodiment of this application;
[0021] Figure 4 A flowchart illustrating a neck posture recognition method provided in this application embodiment;
[0022] Figure 5A This is a diagram illustrating how a user uses an electronic device.
[0023] Figure 5B This is an illustration of a user avatar.
[0024] Figure 6 A schematic diagram including relative positional distances is provided for an embodiment of this application;
[0025] Figure 7 A flowchart illustrating a method for adjusting neck posture as provided in this application embodiment;
[0026] Figure 8A A schematic diagram of a second display interface provided in an embodiment of this application;
[0027] Figure 8B A schematic diagram illustrating another second display interface provided in an embodiment of this application;
[0028] Figure 8C A schematic diagram illustrating yet another second display interface provided in an embodiment of this application;
[0029] Figure 8D A schematic diagram illustrating yet another second display interface provided in an embodiment of this application;
[0030] Figure 9AA schematic diagram illustrating yet another second display interface provided in an embodiment of this application;
[0031] Figure 9B A schematic diagram illustrating another second display interface provided in an embodiment of this application;
[0032] Figure 9C A schematic diagram illustrating yet another second display interface provided in an embodiment of this application;
[0033] Figure 10A A schematic diagram of a second display interface of a landscape mobile phone provided in an embodiment of this application;
[0034] Figure 10B Flowchart for selecting different second display interfaces;
[0035] Figure 11 This is a schematic diagram of a second display interface;
[0036] Figure 12 This is a schematic diagram illustrating the implementation of the cervical spine detection function provided in an embodiment of this application;
[0037] Figure 13 Schematic diagram of the electronic device;
[0038] Figure 14 A schematic diagram of the terminal software architecture provided in the embodiments of this application;
[0039] Figure 15 This is a schematic diagram of a neck posture adjustment device provided in an embodiment of this application. Detailed Implementation
[0040] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. The terminology used in the following embodiments is for the purpose of describing specific embodiments only and is not intended to be a limitation of this application. As used in the specification and appended claims of this application, the singular expressions "a," "an," "the," "the," "the," and "this" are intended to also include expressions such as "one or more," unless the context clearly indicates otherwise. It should also be understood that in the embodiments of this application, "one or more" refers to one, two, or more; "and / or" describes the relationship between related objects, indicating that three relationships may exist; for example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.
[0041] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0042] The "multiple" mentioned in the embodiments of this application refers to two or more. It should be noted that in the description of the embodiments of this application, terms such as "first" and "second" are used only for the purpose of distinguishing descriptions and should not be construed as indicating or implying relative importance, nor should they be construed as indicating or implying order.
[0043] First, the technical terms involved in the embodiments of this application will be explained.
[0044] Neck posture: This describes the position and posture of a user's head and neck when using an electronic device. In this embodiment, neck posture includes healthy and unhealthy states. A healthy state refers to a neck posture where the cervical spine detection angle is not greater than a healthy reference angle, or where the cervical spine detection angle is greater than the healthy reference angle but the duration is less than a preset duration threshold. An unhealthy state refers to a neck posture where the cervical spine detection angle is greater than the healthy reference angle and the duration is not less than a preset duration threshold. The cervical spine detection angle refers to the angle between the user's head and body. For ease of explanation, a neck posture with a cervical spine detection angle not greater than a preset angle range is referred to as a normal neck posture, and a neck posture with a cervical spine detection angle greater than the healthy reference angle is referred to as an unhealthy neck posture.
[0045] See Figure 1 This figure is a schematic diagram of different cervical spine testing angles. Figure 1 This explanation uses the cervical spine detection angle corresponding to when the user lowers their head as an example. Figure 1 (a) through (e) show the cervical spine detection angle B as 0°, 15°, 30°, 45°, and 60°, respectively. There is a correspondence between the cervical spine detection angle and the user's cervical spine load-bearing capacity. Table 1 shows the correspondence between the cervical spine detection angle and the cervical spine load-bearing capacity.
[0046] Table 1
[0047]
[0048] The larger the cervical spine detection angle, the greater the load on the cervical spine. When the cervical spine detection angle is 15°, the load on the cervical spine has doubled compared to when the cervical spine detection angle is 0°. When the cervical spine detection angle increases to 45°, the load on the cervical spine is four times that corresponding to the cervical spine load at the 0° detection angle, reaching 22 kg, which greatly increases the probability of neck muscle strain. Therefore, in this embodiment, the healthy baseline angle can be set to 15°, that is, when the cervical spine detection angle is greater than 15° and the duration is not less than a preset duration threshold, the user's neck posture is determined to be unhealthy.
[0049] When users look down at their phones while walking, commuting on the subway, or working at their desks, the cervical spine angle can easily reach 15° or more. If this angle remains at 15° or higher for extended periods, it can easily lead to neck muscle strain, poor blood flow, and other cervical spine problems. Therefore, when users are in an unhealthy neck posture, reminding them to adjust their posture to a normal one can effectively address the cervical spine issues common among "smartphone addicts."
[0050] In Solution 1, the method for reminding users to adjust their neck posture can be through voice prompts or pop-up notifications. For example, a voice prompt could say, "You are currently in a poor neck posture, which can easily lead to cervical spine problems. Please adjust your neck posture." Figure 2 The image shows a schematic diagram of a pop-up reminder interface. A small prompt window appears on the running interface, reminding the user that "You are currently in a poor neck posture, which can easily lead to cervical spine problems. Please adjust your neck posture."
[0051] In related solution 2, the method of reminding users to adjust their neck posture is by blurring the image. See also Figure 3 This is a schematic diagram of a blurred image provided in an embodiment of this application. Figure 3 (a) in the image shows the user's normal browsing interface on the phone. Figure 3 (b) in the image shows a blurred image when the electronic device detects that the user is in an unhealthy state.
[0052] The prompts shown in Option 1 or Option 2 can only remind users of poor neck posture, resulting in a poor user experience.
[0053] In view of the above problems, this application embodiment displays a second display interface when it detects that the user's neck posture has been in a poor posture for a long time. The content of the second display interface is presented in a three-dimensional effect with the far end larger and the near end smaller, or vice versa, creating the effect that the content of the image is drawn on the screen of the electronic device, thereby guiding the user to subconsciously adjust their neck posture and improving the user experience.
[0054] The method for adjusting neck posture provided in the embodiments of this application will be described in detail below with reference to the accompanying drawings.
[0055] It should be noted that the causes of neck posture include various scenarios such as the flexion and extension of the user's head, tilting left and right, or rotating left and right. This application embodiment only uses the example of the user looking down to illustrate the situation. The implementation principle of other scenarios is the same as looking down, and will not be discussed here.
[0056] First, we will introduce the recognition method for determining neck posture.
[0057] See Figure 4 This figure is a flowchart of a neck posture recognition method provided in an embodiment of this application. The method is applied to electronic devices and specifically includes the following steps:
[0058] Optionally, S41: Obtain the device tilt angle.
[0059] The equipment tilt angle refers to the angle between the equipment and the baseline. For example, see... Figure 5A This diagram illustrates a user's use of an electronic device, specifically user 101 browsing mobile phone 102. The baseline is a line parallel to the horizontal plane. The device tilt angle is the angle A between the mobile phone and the horizontal line.
[0060] It should be noted that the baseline can also be a line in other directions, and this application does not specifically limit it.
[0061] In one possible implementation, the electronic device includes a gyroscope sensor (also known as a gyroscope). The electronic device can determine its tilt angle A using the gyroscope sensor.
[0062] In this embodiment, when the electronic device determines whether the device tilt angle is less than an angle threshold, if so, it performs neck posture recognition and adjustment, and executes step S42. When the device tilt angle is not less than the threshold, the user's neck posture is assumed to be healthy, and the electronic device no longer performs subsequent operations. This reduces the memory consumption of the electronic device.
[0063] The embodiments of this application do not specifically limit the angle threshold value. For example, the angle threshold value can be 75°, 80°, etc.
[0064] S42: Acquire shooting data.
[0065] In this system, electronic devices utilize a front-facing camera to capture image data, including a view of the user's head. For example, for... Figure 5A The mobile phone 102 uses its front-facing camera to capture the head of the user 101 and obtain shooting data. A diagram illustrating the shooting data is shown below. Figure 5B As shown, it includes an avatar area 501 and a background area 502.
[0066] This application does not specifically limit the type of front-facing camera; for example, the front-facing camera may be a fixed-focus camera. A fixed-focus camera is a camera with a fixed focal length.
[0067] In one specific implementation, an electronic device can perform shooting functions through an image signal processor, a front-facing camera, a video codec, a display screen, and an application processor. The ISP (Image Signal Processor) processes data fed back from the front-facing camera. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into a visible image. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be integrated into the front-facing camera.
[0068] The front-facing camera is used to capture still images or videos. An object is projected onto a photosensitive element through the lens, creating an optical image. This photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to the ISP (Image Signal Processor) for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP (Digital Signal Processor) for further processing. The DSP converts the digital image signal into standard image signals in formats such as RGB and YUV.
[0069] S43: Get the first distance, second distance and background area of the user's avatar.
[0070] like Figure 5B As shown, the first distance L is the distance between the user's eyes in the captured image, such as the distance from one pupil to the other.
[0071] The second distance H is the distance from the user's head reference point to the lower boundary 503 of the captured image. The reference point can be a point in the eye area or a point in the chin area. Figure 5B The second distance H shown is the distance from a point in the human eye region to the lower boundary of the user's avatar at 503. There is a positive correlation between the second distance H and the cervical spine detection angle; the larger the cervical spine detection angle, the larger the value of the second distance H.
[0072] Background area S refers to the area of the background region. There is a negative correlation between background area S and cervical spine detection angle; the larger the cervical spine detection angle, the smaller the value of background area S.
[0073] S44: Determine the third distance based on the first distance.
[0074] The third distance refers to the distance from the user's face to the screen of the electronic device. Optionally, the third distance can be the distance from the user's eyes to the screen of the electronic device. Figure 5A As shown, the third distance D between the human eye and the screen of an electronic device is illustrated.
[0075] In this embodiment of the application, the third distance D is calculated and obtained through the first distance H and the correspondence between the third distance and the first distance H.
[0076] Example description: The front-facing camera of the electronic device is a fixed-focus camera with a fixed focal length f. Figure 5A and Figure 5B The information shown indicates that the first distance L / the fourth distance La = f / the third distance D. Therefore, D = f. La / L. Here, the fourth distance La is the actual distance between the user's eyes, specifically 6.5cm. For example, if the focal length f is 50 and the first distance L is 1.3cm, then the third distance D is 25cm.
[0077] In other words, the method of obtaining the third distance through the first distance in this application embodiment does not require the front-facing camera of the electronic device to be zoomed, nor does it require a front-facing distance sensor of the electronic device, thus having better versatility. In addition, considering the user's eye distance, it can avoid the problem of not being able to obtain the distance of other areas of the face when wearing a mask.
[0078] S45: Determine the first reference value and the second reference value based on the third distance.
[0079] The first reference value refers to the second distance H corresponding to a normal neck posture at the third distance. When the cervical spine detection angle increases, that is, when the second distance H determined in step S42 is greater than the first reference value Hc, it indicates that the user's neck posture is poor. If the user remains in a poor posture for a preset duration, the electronic device determines that the user's neck posture is unhealthy. If the second distance H is not greater than the first reference value Hc, it indicates that the user's neck posture is healthy. The first reference value Hc changes with the third distance D. Specifically, if the third distance D increases, the first reference value Hc decreases, that is, the first reference value Hc and the third distance are negatively correlated.
[0080] The second reference value Sc refers to the background area S corresponding to a healthy neck posture at the third distance. When the cervical spine detection angle increases, if the background area S determined in step S42 is less than the second reference value Sc, it indicates that the user's neck posture is poor. If the user remains in a poor posture for a preset duration, the electronic device determines that the user's neck posture is unhealthy. If the background area S is not less than the second reference value Sc, it indicates that the user's neck posture is healthy. The second reference value Sc changes with the third distance D. Specifically, if the third distance D increases, the second reference value Sc increases, meaning that the second reference value Sc and the third distance are positively correlated.
[0081] In this embodiment, a data table of the first reference value Hc and the second reference value Sc corresponding to different third distances D in a healthy neck posture can be constructed using offline methods or deep learning. Table 2 shows the data representation obtained in this embodiment.
[0082] Table 2
[0083]
[0084] As shown in Table 2, D1, D2, ..., Dn represent different values of the third distance D. Hc1, Hc2, ..., Hcn represent different first reference values Hc. Sc1, Sc2, ..., Scn represent different second reference values Sc. n is an integer greater than 3.
[0085] The electronic device has a pre-embedded data table as shown in Table 2. After obtaining the third distance D in step S23, the first reference value and the second reference value corresponding to the third distance D can be matched from the data table.
[0086] S46: Determine whether the second distance is less than or equal to the first reference value. If yes, execute S47; otherwise, execute S412.
[0087] against Figure 5A When the device tilt angle A remains constant and the third distance D is fixed, the larger the cervical spine detection angle B is, the smaller the second distance H is in the user's head image captured by the phone's front camera. That is, the cervical spine detection angle B and the second distance H are negatively correlated, so the neck posture can be determined by judging the second distance H.
[0088] In this embodiment of the application, if the second distance obtained in step S43 is less than the first reference value, it can be determined that the head is tilted excessively and the neck posture is poor. If the second distance is greater than the first reference value, the neck posture can be determined to be healthy.
[0089] S47: Determine if the background area is less than the second reference value. If not, execute S412.
[0090] Considering that judging neck posture solely based on the second distance may lead to judgment bias, this application embodiment also provides a method to further utilize the background area S to assist in determining whether the neck posture is healthy.
[0091] against Figure 5A When the device tilt angle A remains constant and the third distance D is fixed, the larger the cervical spine detection angle B, the smaller the background area S in the user's head image captured by the phone's front-facing camera. That is, the cervical spine detection angle B and the background area S are negatively correlated. Therefore, electronic devices use the background area S to assist in determining neck posture, which yields a more accurate result compared to judging only the second distance.
[0092] Example: If the background area obtained from the user image is S=100cm², and the second reference value is Sc=150cm², then S < Sc, and the neck posture is determined to be unhealthy. If the background area obtained from the user image is S=160cm², and the second reference value is Sc=150cm², then S > Sc, and the neck posture is determined to be healthy.
[0093] Optional S48: Based on the device tilt angle and the third distance, obtain the relative position distance corresponding to the third distance.
[0094] The relative position distance refers to the position distance obtained by projecting the third distance D onto the direction perpendicular to the first reference line. In this embodiment, the relative position distance Y corresponding to the third distance D can be obtained based on the device tilt angle A and the third distance D, and the mapping relationship Y=f(A,D) between the relative position distance Y and the device tilt angle A and the third distance D. The relative position distance Y has a mapping relationship with the device tilt angle A and the third distance D.
[0095] Example illustration: such as Figure 6 This figure is a schematic diagram of a relative position distance provided in an embodiment of this application. The device tilt angle of the electronic device is A, and the third distance is D. The relative position distance is Y, which is the projection of D in the vertical and horizontal directions. At this time, Y = f(A, D) = D sin(90°-A). For example, if A is 60° and D is 60cm, then Y = 30cm.
[0096] S49: Determine if the relative position distance is greater than the health baseline distance. If yes, execute S410; otherwise, execute S412.
[0097] The relative positional distance Y can also serve as an important condition for determining neck posture. When the user's third distance D is fixed, the larger the cervical spine detection angle B, the smaller the device tilt angle A, meaning the smaller the relative distance Y value corresponding to the third distance D. Therefore, the relative positional distance Y value can be used to further determine neck posture and improve the accuracy of the determination.
[0098] In this embodiment, the electronic device determines the relationship between the relative position distance Y and the health reference distance. If Y is greater than the health reference distance, the neck posture is determined to be an unhealthy neck posture. For example, if the calculated relative position distance Y = 30cm and the healthy safety value is 20cm, and Y > the health reference distance, the neck posture is determined to be unhealthy.
[0099] S410: Detect whether the duration of the neck posture is less than the preset duration. If yes, execute S411. Otherwise, execute S412.
[0100] Optionally, a timer can be embedded within the electronic device to detect the duration of an unhealthy neck posture. If the duration is not less than a preset duration, the neck posture is determined to be unhealthy.
[0101] The embodiments of this application do not specifically limit the preset duration; for example, it can be 10 minutes, 20 minutes, 25 minutes, etc.
[0102] S411: If the duration is not less than the preset duration, the neck posture is determined to be unhealthy.
[0103] S412: Determine that the neck posture is healthy.
[0104] This application embodiment determines the distance from the user's face to the electronic device screen by obtaining the distance between the user's eyes in the user's avatar. Then, using the distance from the face to the electronic device screen, a first reference value and a second reference value are obtained. The neck posture is determined by using the relationship between the second distance from the reference point to the lower boundary line of the user's avatar and the first reference value, and the relationship between the background area in the user's avatar and the second reference value. This application does not require calculating the cervical spine detection angle; the neck posture can be inferred from the second distance in the user's avatar and the background area. Furthermore, this application embodiment can be completed using only a fixed-focus camera, with low computational load and no reliance on other sensors or special-specification hardware, exhibiting high versatility.
[0105] The following is a detailed description of the method for adjusting the display interface provided in the embodiments of this application.
[0106] See Figure 7 This figure is a flowchart of a method for adjusting a display interface according to an embodiment of this application. The method specifically includes the following:
[0107] S71: Identify whether the user's neck posture is unhealthy.
[0108] Specific identification methods are as follows: Figure 4 As shown, this will not be discussed further here.
[0109] S72: When the user's neck posture is unhealthy, switch the first display interface to the second display interface.
[0110] In the first display interface, the number of pixels in each row is the same.
[0111] The second display interface includes a first display area and a second display area. The first display area is used to display the content of the first display interface. The number of pixels in each row of pixels in the first display area gradually increases or decreases from the bottom to the top of the electronic device.
[0112] For example, the number of pixels in each row is scaled down proportionally from the bottom to the top of the electronic device, with the scaling factor being positively correlated with the user's cervical spine detection angle. This creates a 3D effect where the image is smaller at the far end and larger at the near end. The near end is the end closest to the bottom of the electronic device, and the far end is the end furthest from the bottom of the electronic device, creating the effect that the image content is drawn on the screen of the electronic device, thereby guiding the user to automatically adjust their neck posture and improving the user experience.
[0113] For example, the number of pixels in each row is proportionally enlarged from the bottom to the top of the electronic device, with the magnification factor being positively correlated with the user's cervical spine detection angle. This creates a three-dimensional effect where the image appears larger at the far end and smaller at the near end, making it seem as if the image content is drawn on the screen of the electronic device, thereby guiding the user to automatically adjust their neck posture and improving the user experience.
[0114] In one specific implementation, the electronic device implements the display function of the second display interface through a graphics processing unit (GPU), a display screen, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor may include one or more GPUs, which execute program instructions to generate or modify display information.
[0115] The display screen is used to display a second display interface. The display screen includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device may include one or N displays, where N is a positive integer greater than 1.
[0116] The second display interface in this application embodiment can display multiple types.
[0117] Example 1: See Figure 8A This figure is a schematic diagram of a second display interface provided in an embodiment of this application. The mobile phone in the figure is a portrait-oriented phone, and the second display interface 800 is tilted forward, subconsciously prompting the user to raise their hand to adjust their neck posture.
[0118] The second display interface 800 of the mobile phone includes a first display area 801, a second display area 802, and a mobile phone bounding box 803. The first display area 801 includes a screen content bounding box 801-1. The first display area is presented in a three-dimensional manner, with the content appearing smaller at the far end and larger at the near end (referred to as "far-small, near-large"). Specifically, the number of pixels in each row of the screen content bounding box 801-1 increases linearly from the far end to the near end, and the screen content in the first display area 801 is presented in a far-small, near-large manner. For example... Figure 8A As shown, the content on the screen is text, and the font size of the text increases linearly from the far end to the near end.
[0119] against Figure 8A As shown in the second display interface, in order to comfortably browse the phone, users will subconsciously raise their hands to increase the device's tilt angle, thereby magnifying the content of the distant screen. This increases the effect of adjusting the neck posture to a normal walking posture.
[0120] In another example, to further enhance the guiding effect, see [link to relevant documentation]. Figure 8B This figure is a schematic diagram of another second display interface provided in an embodiment of this application. Figure 8B (a) in the diagram represents the second display interface corresponding to the initial neck posture before neck posture adjustment. Figure 8B In the diagram, (b) to (d) represent the second display interface corresponding to the neck posture adjustment every 1ms. The auxiliary animation can further render the outward sliding effect of the screen content, further enhancing the guidance effect.
[0121] In another example, a prompt message is added to the second display area 802 to remind the user to make neck adjustments. See also Figure 8C This is a schematic diagram illustrating another second display interface provided in an embodiment of this application. Figure 8C The prompt (a) is an arrow, pointing to the direction the user should adjust their cervical spine. Figure 8C The prompt message in (b) is a text prompt. Optionally, the content may be "Please adjust your neck to a healthy neck position." The prompt message may also be supplemented with animation. This application's embodiments are not specifically limited.
[0122] In yet another example, see Figure 8D This is a schematic diagram of another second display interface provided in this application embodiment. The screen content boundary frame 801-1 is protruding, and the user can determine whether the adjusted neck posture is a normal neck posture by checking whether the screen content boundary frame 801-1 and the mobile phone boundary frame 803 overlap during the neck posture adjustment process. This further improves the user experience.
[0123] The raised display method can be to bold the bounding box 801-1 of the screen content, or to distinguish it by different colors. For example, the bounding box 801-1 of the screen content can be distinguished by a "red" line, while the bounding box 803 of the phone can be distinguished by a "black" line. This application embodiment is not specifically limited.
[0124] Example 2: See Figure 9A This figure is a schematic diagram of another second display interface provided in an embodiment of this application. The second display interface 800 of the mobile phone in this figure is tilted backward. This subconsciously encourages the user to look up or move away from the phone, guiding the user to adjust their neck posture.
[0125] In this embodiment, the content of the screen is presented in a three-dimensional manner where the content is larger at the far end and smaller at the near end (referred to as far-large and near-small). Specifically, the content bounding box 801-1 decreases linearly from the far end to the near end, and the content of the screen in the first display area 801 is presented in a far-small and near-large manner.
[0126] In another example, a prompt message is added in the second display area 802 to remind the user to make neck adjustments. See also Figure 9B This is a schematic diagram illustrating another second display interface provided in an embodiment of this application. Figure 9BThe prompt (a) is an arrow, pointing to the direction the user should adjust their cervical spine. Figure 9B The prompt message in (b) is a text prompt. Optionally, the content may be "Please adjust your neck to a healthy neck position." The prompt message may also be supplemented with animation. This application's embodiments are not specifically limited.
[0127] In yet another example, see Figure 9C This is a schematic diagram of another second display interface provided in this application embodiment. The screen content boundary frame 801-1 is protruding, and the user can determine whether the adjusted neck posture is a normal neck posture by checking whether the screen content boundary frame 801-1 and the mobile phone boundary frame 803 coincide during the neck posture adjustment process. This further improves the user experience.
[0128] In addition, the second display interface can also be a landscape-oriented display interface. See also Figure 10A This figure is a schematic diagram of the second display interface of a landscape mobile phone according to an embodiment of this application. The content of the screen is presented in a scaled-down manner from the bottom to the top of the portrait mobile phone.
[0129] It should be noted that the content displayed in Figures 8b to 9c can also be achieved on landscape-mode mobile phones.
[0130] This application embodiment presents the screen content in a stereoscopic manner, with the far end larger and the near end smaller, or vice versa. The near end is the end closest to the user, and the far end is the end furthest from the user. In this way, this application embodiment creates the effect of the screen content resembling the electronic device screen, thereby guiding the user to automatically adjust their neck posture and improving the user experience.
[0131] In practical use, the "far-small, near-large" display method guides users to adjust the device's orientation and neck posture, making it more suitable for handheld devices. Conversely, the "far-large, near-small" display method adjusts the user's position relative to the phone, altering neck posture, making it more suitable for stationary devices, such as those placed on a table or stand. To further enhance the user experience, different secondary display interfaces can be used for different scenarios.
[0132] See Figure 10B This diagram illustrates the flowchart for selecting different second display interfaces. The method specifically includes:
[0133] S101: Identify application scenarios.
[0134] Electronic devices include gyroscope sensors. These gyroscope sensors can determine whether the electronic device is shaking. If shaking is present, the application scenario is determined to be a user-held device scenario. Otherwise, the application scenario is determined to be a stationary device scenario.
[0135] S102: When the application scenario is a user holding the device, the content is presented in a way that makes distant objects appear smaller and near objects appear larger.
[0136] Specifically, if the application scenario is a user-held scenario, then utilize Figures 8A-8C The presentation shown depicts the interface content of an electronic device. Users adjust their neck posture by changing the device's tilt angle.
[0137] S103: When the application scenario is a static scenario, the electronic device is used to present a backward tilting effect.
[0138] Specifically, if the application scenario is a static scenario, utilize Figures 9A-9B The presentation prompts the user to adjust their position relative to the electronic device, thereby changing their neck posture.
[0139] In addition, the electronic device includes a cervical spine detection function to achieve the neck posture adjustment method described above.
[0140] In one example, the cervical spine detection function is enabled by default when the electronic device is powered on.
[0141] In another example, the electronic device has a built-in function to disable cervical spine detection. For example... Figure 11 The diagram shown illustrates a second display interface. The second display interface includes a close button 1101. By clicking the close button 1101, the user can disable the cervical spine detection function, allowing the user to use the electronic device normally.
[0142] In another example, users can configure the cervical spine detection function to be on or off via a settings interface. See also Figure 12 This figure is a schematic diagram illustrating the implementation of the cervical spine detection function provided in an embodiment of this application. Figure 12 As shown in (a), the user opens the "Settings" application and enters... Figure 12 In the settings interface shown in (b), users can find the cervical spine detection function, which is displayed as turned off, indicating that the cervical spine detection function is disabled.
[0143] Users can click the expand button corresponding to "Cervical Spine Detection Function" to enter... Figure 12 The settings interface for the cervical spine detection function is shown in (c). Users make settings on this interface.
[0144] in, Figure 12(c) indicates that the cervical spine detection function is off. The user performs an on operation to turn on the cervical spine detection function. The on operation can be performed by sliding from the "off" side to the "on" side.
[0145] The neck posture adjustment method provided in this application is applied to electronic devices with a front-facing camera. In the embodiments provided in this application, the electronic device can be a mobile phone, tablet computer, computer with wireless transceiver capabilities, virtual reality (VR) terminal device, augmented reality (AR) terminal device, wireless terminal device in industrial control, vehicle-mounted terminal device, wireless terminal device in self-driving vehicles, wearable terminal device, etc.
[0146] Figure 13 A schematic diagram of the electronic device is shown. The electronic device includes a processor 110, a front-facing camera 193, a display screen 194, and a gyroscope sensor 180B, etc.
[0147] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0148] The processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. For example, the processor provided in this embodiment is used to implement neck posture adjustment and neck posture recognition.
[0149] The processor 110 may also include a memory for storing instructions and data for neck posture recognition and adjustment. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or is reusing. If the processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the processor 110's waiting time, and thus improves system efficiency.
[0150] In some embodiments, the processor 110 may further include a mobile industry processor interface (MIPI). The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the front-facing camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the front-facing camera 193 communicate via the CSI interface to enable the electronic device 100 to perform its shooting function. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to perform its display function.
[0151] Electronic device 100 can perform shooting functions through an image signal processor (ISP), a front-facing camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0152] The ISP (Image Signal Processor) is used to process data fed back from the front-facing camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the front-facing camera 193.
[0153] The front-facing camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0154] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100's shake, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 through reverse movement, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios. In this embodiment, the gyroscope sensor 180B is used to obtain the device tilt angle of the electronic device and the application scenario of the electronic device.
[0155] In addition, this application also provides a schematic diagram of the software architecture of an electronic device.
[0156] See Figure 14 This figure is a schematic diagram of the terminal software architecture provided in the embodiments of this application.
[0157] The application layer may include a series of application packages. For example, it may include a transit card.
[0158] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0159] The Android Runtime consists of the core libraries and the virtual machine. The Android runtime is responsible for scheduling and managing the Android system. The core libraries consist of two parts: one part contains the functionalities that Java needs to call, and the other part is the core Android library itself. The application layer and application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0160] The Hardware Abstraction Layer (HAL) can contain multiple library modules. The Android system loads the corresponding library modules for the device hardware, thereby enabling the application framework layer to access the device hardware. The kernel layer is the layer between hardware and software. The kernel layer includes at least display drivers, camera drivers, audio drivers, and sensor drivers.
[0161] It should be noted that although the embodiments of this application are described using the Android system as an example, the basic principles are also applicable to electronic devices 100 based on operating systems such as iOS and Windows.
[0162] See Figure 15 This figure is a schematic diagram of a display screen adjustment device provided in an embodiment of this application. The adjustment device 1500 includes: a detection unit 1501, used to detect that the duration of a user's cervical spine tilt angle being greater than a preset angle range exceeds a preset duration; and a switching unit 1502, used to control the electronic device to switch from a first display interface to a second display interface when the duration of the detection that the user's cervical spine tilt angle is greater than the preset angle range exceeds the preset duration; the first display interface has the same number of pixels per row, and the second display interface includes a first display area and a second display area, wherein the number of pixels per row in the first display area is proportionally reduced or proportionally enlarged from the bottom to the top of the electronic device, and the first display area is used to display the content of the first display interface.
[0163] This application embodiment detects when a user's neck posture is in a poor posture for a long time and displays a second display interface. The content of the second display interface is presented in a three-dimensional effect with the far end larger and the near end smaller, or vice versa, creating the effect that the content of the image is drawn on the screen of the electronic device, thereby guiding the user to automatically adjust their neck posture and improving the user experience.
[0164] This application also provides a computer-readable storage medium storing a computer program or instructions. When the computer program or instructions are run, they implement the various functions or steps performed by the electronic device in the above method embodiments.
[0165] Another embodiment of this application provides a computer program product containing instructions. When the computer program product is run on a computer or processor, it causes the computer or processor to perform one or more steps of any of the methods described above.
[0166] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, apparatuses, or modules, and may be electrical, mechanical, or other forms.
[0167] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.
[0168] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.
[0169] If the integrated module is implemented as a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the essential contribution of the technical solution of this application, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the processes of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory, random access memory, magnetic disks, or optical disks.
[0170] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A method for adjusting a display screen, characterized in that, The method includes: Detect whether the user's cervical spine tilt angle is greater than the preset angle range; If the cervical spine tilt angle is greater than the preset angle range and the duration exceeds the preset duration, the control display interface switches from the first display interface to the second display interface; the second display interface includes a first display area and a second display area, wherein the number of pixels in each row of pixels in the first display area gradually decreases or gradually increases from the bottom to the top of the current electronic device, and the first display area is used to display the content of the first display interface; the electronic device is used to display the display interface; The detection of whether the user's cervical spine tilt angle is greater than a preset angle range includes: Acquire shooting data, wherein the shooting data includes shooting data of the user's head; Based on the captured data, a first distance and a second distance are determined; wherein, the first distance represents the distance between the user's pupils in the captured image, and the second distance represents the distance between the user's head reference point in the captured image and the lower boundary of the captured image; the head reference point includes either a point in the eye region or a point in the chin region; Based on the first distance, the actual distance between the user's pupils and the focal length, a third distance is determined between the head reference point and the screen of the electronic device; the third distance is the quotient of the product of the focal length and the actual distance and the first distance. Based on the captured data, the background area is determined, wherein the background area represents the area of the background region outside the user's head in the captured image; Based on the third distance, a first reference value and a second reference value are matched from a pre-stored first data table; the first reference value represents the second distance when the cervical spine tilt angle corresponding to the third distance is less than or equal to the preset angle range, and the second reference value represents the background area when the cervical spine tilt angle corresponding to the third distance is less than or equal to the preset angle range; Compare whether the second distance is greater than the first reference value and whether the background area is less than the second reference value; if the second distance is greater than the first reference value and the background area is less than the second reference value, determine that the user's cervical spine tilt angle is less than the preset angle range; if the second distance is less than or equal to the first reference value, or the background area is greater than or equal to the second reference value, determine that the user's cervical spine tilt angle is greater than or equal to the preset angle range.
2. The method according to claim 1, characterized in that, The method further includes: displaying prompt information in the second display area, the prompt information being used to prompt the user to adjust their neck posture.
3. The method according to claim 1, characterized in that, The control display interface switches from the first display interface to the second display interface, specifically including: When it is determined that the device is in a holding state, the number of pixels in each row of pixels in the first display area of the second display interface is controlled to gradually decrease from the bottom of the current electronic device to the top of the current electronic device; When it is determined that the device is stationary, the number of pixels in each row of pixels in the first display area of the second display interface is controlled to gradually increase from the bottom of the current electronic device to the top of the current electronic device.
4. The method according to claim 3, characterized in that, The determination of being in a holding state specifically includes: When the gyroscope's detection data fluctuates continuously, it indicates that the device is in a holding state; Determining that it is placed at rest includes: When the gyroscope's detection data remains unchanged, it is determined that the device is stationary.
5. The method according to claim 1, characterized in that, The method further includes: Obtain the current device tilt angle of the electronic device, where the device tilt angle represents the angle between the electronic device and the baseline; Based on the device tilt angle of the current electronic device, the projected distance of the third distance in the direction perpendicular to the baseline is obtained, and the projected distance is negatively correlated with the device tilt angle; If the projected distance is greater than the health reference distance, the user's cervical spine tilt angle is determined to be greater than the preset angle range; if the projected distance is less than or equal to the health reference distance, the user's cervical spine tilt angle is determined to be less than or equal to the preset angle range.
6. The method according to claim 1, characterized in that, Before acquiring the captured data, the method further includes: Determine whether the device tilt angle of the electronic device is less than an angle threshold value; The acquisition of shooting data includes: If the device tilt angle of the electronic device is less than the angle threshold, the captured data is acquired.
7. An electronic device, characterized in that, The electronic device includes: A memory and a processor, wherein the memory is coupled to the processor; The memory stores program instructions that, when executed by the processor, cause the electronic device to perform the method according to any one of claims 1-6.
8. A computer-readable storage medium, characterized in that, Includes computer-readable instructions that, when executed on a computing device, cause the computing device to perform the method of any one of claims 1-6.