Interface display method and electronic equipment

By detecting the hinge angle of the electronic device and user operation, intelligently switching the display screen, the problem of folding screen devices displaying in the vertical lower half of the screen is solved, achieving a flexible and coherent user experience.

CN119248392AActive Publication Date: 2025-01-03HONOR DEVICE CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202410547011.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-04-30
Publication Date
2025-01-03
Estimated Expiration
2044-04-30

AI Technical Summary

Technical Problem

The folding screen device may have a half-screen display problem in a vertical state, affecting the user's user experience.

Method used

An interface display method is provided, by detecting the hinge angle of the electronic device and the user operation, intelligently switching the first display screen and the second display screen to ensure the consistency and usability of the user interface.

Benefits of technology

In the vertical state, the display screen is intelligently switched according to the physical state of the device and the hinge corner, providing a flexible and coherent user experience, solving the half-screen display problem and improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119248392A_ABST
    Figure CN119248392A_ABST
Patent Text Reader

Abstract

The invention discloses an interface display method and electronic equipment, and belongs to the technical field of terminals. The interface display method is applied to the electronic equipment comprising a hinge, a first machine body and a second machine body, and the hinge is used for linking the first machine body and the second machine body; at a first moment, in response to a screen-on operation of a user, the electronic equipment is in a screen-on state, a user interface is displayed on the first display screen, and the electronic equipment is in a folded state at the first moment; at the second moment, the user is responded to unfold the electronic equipment, the user interface is displayed on the second display screen, and the hinge angle between the first machine body and the second machine body is the first angle at the second moment; at the third moment, in response to folding the electronic equipment by the user, displaying a user interface on the first display screen, and at the second moment and the third moment, the electronic equipment is in a vertical state; at the fourth moment, after the user unfolds the electronic equipment, the user interface is displayed on the first display screen, at the fourth moment, the hinge angle is the first angle, and the display area of the second display screen is larger than that of the first display screen.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an interface display method and an electronic device. Background Art

[0002] Currently, foldable screen technology is an important innovation in the field of mobile devices in recent years. It allows the screen to bend and fold without damage, allowing the device to switch between compact and extended forms, providing users with a larger screen area and new ways of interaction while maintaining portability.

[0003] However, foldable devices face unique challenges in design and function implementation, one of which is how to manage and display the user interface in different folding states.

[0004] The current solution is to suspend posture data reporting in the vertical state, but this may cause a half-screen display problem in the expanded state. Once the half-screen display problem occurs, this problem will continue to exist in the vertical state, thus affecting the user experience. Summary of the invention

[0005] The present application provides an interface display method and an electronic device. When a user unfolds or folds the electronic device, the interface display method can automatically switch between a first display screen and a second display screen to accurately display a user interface according to changes in a hinge angle of the electronic device even in a vertical state, thereby ensuring the continuity and usability of the user interface and solving the half-screen display problem that may occur in a folding screen device in a vertical state.

[0006] The technical solution is as follows:

[0007] In a first aspect, the present application provides an interface display method, which is applied to an electronic device, wherein the electronic device comprises a hinge, a first body and a second body, and the hinge is used to connect the first body and the second body; the method comprises:

[0008] At a first moment, in response to a screen-lighting operation by a user, the electronic device lights up the screen and displays a user interface on a first display screen. At the first moment, the electronic device is in a folded state;

[0009] At a second moment, in response to the user unfolding the electronic device, the user interface is displayed on the second display screen, at the second moment, the hinge angle between the first body and the second body is a first angle, the electronic device is in a vertical state, and the second moment is after the first moment;

[0010] At a third moment, in response to the user folding the electronic device, the user interface is displayed on the first display screen, and at the third moment, the electronic device is in a vertical state;

[0011] At a fourth moment, after the user unfolds the electronic device, the user interface is displayed on the first display screen. At the fourth moment, the electronic device is not in a vertical state, the hinge angle between the first body and the second body is a first angle, the display area of ​​the second display screen is larger than the display area of ​​the first display screen, and the fourth moment is after the third moment.

[0012] In this implementation, the electronic device (or device, folding screen device, etc.) is in a vertical state, which can be understood as a standing state similar to a book. In the vertical state, the hinge angle between the display plane of the electronic device and the horizontal plane is close to 90°, or the hinge angle between the central axis or central rotation axis of the hinge of the electronic device and the horizontal plane is close to 90°.

[0013] It should be understood that when a user unfolds the electronic device, it means that the electronic device is switched from a folded state or a stand state to an unfolded state.

[0014] At the second moment, the hinge angle θ between the first body and the second body of the electronic device is [93°, 180°].

[0015] Taking the electronic device as a smartphone with an outward folding screen as an example, the first display screen in the folded state can be a part of the entire screen (second display screen) of the smartphone, which is used to quickly view notifications or perform simple operations. In addition, taking the above-mentioned electronic device as a smartphone with an inward folding screen as an example, the first display screen in the folded state can be the outer screen of the smartphone, which is used to quickly view notifications or perform simple operations.

[0016] The interface display method provided in the embodiment of the present application is applicable to a foldable electronic device with a hinge, such as a foldable smartphone or tablet computer. First moment: the user performs a screen-on operation, the electronic device lights up in the folded state, and displays a user interface on the first display screen. Second moment: the user unfolds the electronic device, and the electronic device is in a vertical state, which is detected by the Hall sensor, and the user interface is displayed on the second display screen. At this time, the hinge angle between the first body and the second body is the first angle, and this moment occurs after the first moment. Third moment: the user folds the electronic device, and the electronic device still displays the user interface on the first display screen in the vertical state. The fourth moment occurring after the third moment: the user unfolds the electronic device again, and the electronic device is not in a vertical state at this time. The screen switching strategy is determined according to the hinge angle between the first body and the second body. Since the hinge angle between the first body and the second body is the first angle, the user interface is displayed on the first display screen, although the display area of ​​the second display screen is larger than the display area of ​​the first display screen. By adopting the above method, the electronic device can intelligently switch the display screen according to its physical state (folded or unfolded) and the hinge angle in the vertical state, thereby providing a flexible and coherent user experience.

[0017] As an optional example, at the second moment, the electronic device is in a vertical state, which means that at the second moment, the electronic device may be vertically unfolded or partially unfolded; the time length from the user starting to operate the device to light up the screen (first moment) to unfolding the device (second moment) exceeds a preset time length (for example, 10S or 15S, etc.). If both conditions are met, the electronic device will display the user interface on the second display screen. It should be understood that the above preset time length can be a time threshold set by the device manufacturer according to user habits and device usage, which is used to determine whether the user wants to enter a new working mode or view more content. Through the above example, the user's operation and time interval are detected to intelligently decide when to display the user interface on the second display screen, thereby providing a more personalized and user-friendly device usage experience.

[0018] As another optional example, at the fourth moment, after the user unfolds the electronic device and it is determined that the electronic device is not in a vertical state and the first angle is less than a preset angle, the user interface is displayed on the first display screen.

[0019] In the example of this application, "not being in a vertical state or a non-vertical state" can be understood as a state in which the electronic device is not completely vertical. The above preset angle is set by the manufacturer according to the device design and usage scenario, and is used to determine whether the device is in a state suitable for displaying the user interface. Since the hinge angle θ between the first body and the second body is [0°, 33°] during the process of the electronic device being unfolded by the user, the electronic device is considered to be in a folded state. If the hinge angle θ between the first body and the second body of the electronic device is [33°, 93°], it is considered that the electronic device is switched from a folded state to a bracket state. If the hinge angle θ between the first body and the second body of the electronic device is [93°, 180°], it is considered that the electronic device is switched from a bracket state to an unfolded state. Therefore, the above preset angle can be 93°, and when the electronic device is not in a vertical state and the unfolding angle is less than 93°, the user interface is displayed on the first display screen. Furthermore, the display system of the electronic device can intelligently adjust the display content according to the physical state of the device to ensure that the user can obtain a suitable interface display in different usage modes.

[0020] By adopting the interface display method of the electronic device provided in the example of this application, the electronic device can intelligently respond to the user's operation and the physical state of the device in the vertical state, ensure the consistency and usability of the user interface, and make the switching of the display screen more in line with the user's actual usage. Regardless of whether the electronic device is in a vertical state or not, folded or unfolded, it can provide users with the best interface layout and function access in different usage scenarios, solving the problem of inconsistent interface display and usage status when users use folding screen devices.

[0021] According to the first aspect, or any implementation of the first aspect above, the method further includes:

[0022] At a fifth moment, in response to the user unfolding the electronic device, the user interface is displayed on the second display screen. At the fifth moment, the electronic device is not in a vertical state, the hinge angle between the first body and the second body is a second angle, the second angle is greater than the first angle, and the fifth moment is after the first moment or the third moment.

[0023] In this implementation, at the fifth moment, when the user unfolds the electronic device again, the hinge angle of the electronic device is adjusted to a second angle that is larger than the first angle. At this time, the second display screen will display the user interface, providing a different viewing angle and a larger display area than before. It can be seen that the display interface of the electronic device can be dynamically adjusted according to the folding and unfolding state of the device, providing users with a coherent and consistent user experience.

[0024] According to the first aspect, or any implementation of the first aspect above, the method further includes:

[0025] At the sixth moment, after the user unfolds the electronic device, the user interface is displayed on the first display screen. At the sixth moment, the hinge angle between the first body and the second body is the first angle, and the electronic device is in a vertical state. The sixth moment is between the first moment and the second moment.

[0026] In this implementation, at the sixth moment, after the user unfolds the electronic device, the first display screen will display the user interface. At this time, the hinge angle between the first body and the second body is the first angle. It should be understood that at the sixth moment, the hinge angle of the electronic device is not fully unfolded to the second angle described at the second moment, but is maintained at a smaller angle to adapt to different usage scenarios or user comfort. It should be understood that the sixth moment occurs between the first moment and the second moment, and the user performs the unfolding operation at a certain time point after the screen is initially turned on and before the electronic device is fully unfolded.

[0027] According to the first aspect, or any implementation of the first aspect above, at the second moment, in response to the user unfolding the electronic device, displaying the user interface on the second display screen includes:

[0028] At the second moment, in response to the user unfolding the electronic device, based on the electronic device being in a vertical state and the duration between the second moment and the first moment being greater than a preset duration, the user interface is displayed on the second display screen.

[0029] In this implementation, at the second moment, the electronic device is in a vertical state, which means that at the second moment, the electronic device may be vertically unfolded or partially unfolded; the time length from the user starting to operate the device to light up the screen (first moment) to unfolding the device (second moment) exceeds a preset time length (for example, 10S or 15S, etc.). If both conditions are met, the electronic device will display the user interface on the second display screen. It should be understood that the above-mentioned preset time length can be a time threshold set by the device manufacturer according to user habits and device usage, which is used to determine whether the user wants to enter a new working mode or view more content. By detecting the user's operation and time interval, it is intelligently determined when to display the user interface on the second display screen, thereby providing a more personalized and user-friendly device usage experience.

[0030] According to the first aspect, or any implementation of the first aspect above, at the second moment, in response to the user unfolding the electronic device, displaying the user interface on the second display screen includes:

[0031] At the second moment, in response to the user unfolding the electronic device, acquiring voltage data detected by the Hall sensor;

[0032] determining, based on the voltage data, that the electronic device is deployed;

[0033] The user interface is displayed on the second display screen.

[0034] In this implementation, when it is not possible to intelligently determine when to display the user interface on the second display screen by detecting the user's operation and time interval, the Hall sensor in the electronic device can also be used to detect the voltage change caused by the change in the magnetic field when the user unfolds the electronic device. It should be understood that the Hall sensor is disposed on one side of the electronic device, and because it can sense the presence of a magnet or other magnetic component on the opposite side of the electronic device, it can be used to detect whether the electronic device is in an unfolded state or a folded state. The software architecture AP of the electronic device analyzes the voltage data provided by the Hall sensor to determine whether the electronic device has been unfolded, and once it is determined that the electronic device is in an unfolded state, the user interface is displayed on the second display screen.

[0035] According to the first aspect, or any implementation of the first aspect, at the fourth moment, after the user unfolds the electronic device, displaying the user interface on the first display screen includes:

[0036] At the fourth moment, after the user unfolds the electronic device, when it is determined that the electronic device is not in a vertical state and the first angle is less than a preset angle, the user interface is displayed on the first display screen.

[0037] In this implementation, not being in a vertical state or a non-vertical state can be understood as the electronic device not being in a completely vertical state. The above preset angle is set by the manufacturer according to the device design and usage scenario to determine whether the device is in a state suitable for displaying a user interface.

[0038] Since the hinge angle θ between the first body and the second body of the electronic device is [0°, 33°] during the process of the user unfolding the electronic device, the electronic device is considered to be in a folded state. The hinge angle θ between the first body and the second body of the electronic device is [33°, 93°], the electronic device is considered to be switched from a folded state to a stand state. The hinge angle θ between the first body and the second body of the electronic device is [93°, 180°], the electronic device is considered to be switched from a stand state to an unfolded state. Therefore, the above-mentioned preset angle can be 93°, and when the electronic device is not in a vertical state and the unfolding angle is less than 93°, the user interface is displayed on the first display screen. Furthermore, the display system of the electronic device can intelligently adjust the display content according to the physical state of the device to ensure that the user can obtain a suitable interface display in different usage modes.

[0039] According to the first aspect, or any implementation of the first aspect, at the fifth moment, in response to the user unfolding the electronic device, displaying the user interface on the second display screen includes:

[0040] At a fifth moment, in response to the user unfolding the electronic device, when it is determined that the electronic device is not in a vertical state and the second angle is greater than a preset angle, the user interface is displayed on the second display screen.

[0041] In this embodiment, the preset angle may be 93°, and when the electronic device is not in a vertical state and the unfolded angle is greater than 93°, the user interface is displayed on the second display screen. Furthermore, the display system of the electronic device can intelligently adjust the display content according to the physical state of the device, ensuring that the user can obtain a suitable interface display in different usage modes.

[0042] According to the first aspect, or any implementation of the first aspect, at the sixth moment, after the user unfolds the electronic device, displaying the user interface on the first display screen includes:

[0043] At the sixth moment, after the user unfolds the electronic device, it is determined that the electronic device is in a vertical state, and when the duration between the sixth moment and the first moment is less than a preset duration, the user interface is displayed on the first display screen.

[0044] In this implementation, at the sixth moment, after the user unfolds the electronic device, it is first determined whether the electronic device is in a vertical state, and the time length from the user turning on the screen to unfolding the device is calculated. If the electronic device is vertical and the operation time is shorter than the preset time length, the user interface is displayed on the first display screen.

[0045] According to the first aspect, or any implementation of the first aspect above, the electronic device includes an application processor AP and an enhanced digital signal processor ADSP, and the method further includes:

[0046] In response to the screen-on operation of the user, sending a monitoring request to the ADSP through the AP, wherein the monitoring request is used to request the ADSP to monitor the hinge angle between the first body and the second body, and the AP and the ADSP communicate based on an inter-core communication interface;

[0047] When the ADSP receives the monitoring request, the hinge angle between the first body and the second body is calculated based on the sensor data sent by the sensor of the electronic device.

[0048] According to the first aspect, or any implementation of the first aspect above, the ADSP includes a hinge angle algorithm module and at least one angle sensor driver;

[0049] The step of calculating the hinge angle between the first body and the second body based on sensor data sent by a sensor of the electronic device when the ADSP receives the monitoring request includes:

[0050] When the hinge angle algorithm module receives the monitoring request, the hinge angle algorithm module sends a sensor data reporting request to the at least one angle sensor driver;

[0051] When the at least one angle sensor driver receives the sensor data reporting request, reporting the sensor data to the hinge angle algorithm module at a fixed frequency;

[0052] The hinge angle algorithm module calculates a hinge angle between the first body and the second body based on the sensor data.

[0053] In this implementation, when the user performs a screen-lighting operation by clicking the screen of the electronic device or pressing any button of the electronic device, the application processor sends a monitoring request to the enhanced digital signal processor. This request is for the ADSP to monitor and calculate the hinge angle between the first body and the second body of the electronic device.

[0054] After the enhanced digital signal processor ADSP receives the monitoring request, it starts to process the sensor data from the electronic device obtained by at least one angle sensor driver. These sensors may include gyroscope sensors, accelerometers or other sensors that can detect physical changes. ADSP will use this data to calculate the hinge angle between the first body and the second body, and adjust the display screen or other functions used to display the interface on the electronic device accordingly, so that the foldable or deformable electronic device can more flexibly adapt to the user's interface display needs.

[0055] According to the first aspect, or any implementation of the first aspect above, the sensor data includes: an acceleration component in a direction toward the coordinate axis and an angular velocity component in a direction around the coordinate axis;

[0056] The hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, including:

[0057] The hinge angle algorithm module performs filtering processing on the acceleration component in the direction toward the coordinate axis according to the angular velocity component in the direction around the coordinate axis to obtain the hinge angle between the first fuselage and the second fuselage.

[0058] According to the first aspect, or any implementation of the first aspect above, the hinge angle algorithm module performs filtering processing on the acceleration component in the direction toward the coordinate axis according to the angular velocity component in the direction around the coordinate axis to obtain the hinge angle between the first fuselage and the second fuselage, including:

[0059] The hinge angle algorithm module adopts the Kalman filtering method to filter the acceleration component in the direction of the X-coordinate axis and the acceleration component in the direction of the Z-coordinate axis according to the angular velocity component around the Y-coordinate axis, so as to obtain the hinge angle between the first fuselage and the second fuselage.

[0060] In this implementation, first, the initial angle between the two bodies can be obtained by measuring the acceleration components of each display in the X-axis and Z-axis directions (respectively represented as gx1, gx2, gz1, and gz2). Then, the angular velocity component in the Y-axis direction is used to filter this initial angle to obtain a more accurate hinge angle.

[0061] According to the first aspect, or any implementation of the first aspect above, the sensor of the electronic device includes an acceleration sensor and a gyroscope sensor; and the method further includes:

[0062] The at least one angle sensor is driven to receive the original electrical signal reported by the acceleration sensor and the original electrical signal reported by the gyroscope sensor;

[0063] The original electrical signal reported by the acceleration sensor is processed by the at least one angle sensor to obtain the acceleration component in the direction of the coordinate axis;

[0064] The original electrical signal reported by the gyroscope sensor is processed by the at least one angle sensor drive to obtain the angular velocity component around the coordinate axis.

[0065] In this implementation, electronic devices use accelerometers and gyroscopes to monitor their physical state. These sensors provide raw electrical signals that reflect the movement of the device in space. Since raw electrical signals usually contain noise and possible interference, they need to be filtered and converted before they can be used for further calculation and analysis. In order to convert these raw signals into useful data, the angle sensor driver inside the electronic device performs the following steps:

[0066] In the specific implementation process, the angle sensor driver first receives the raw electrical signals from the accelerometer and gyroscope sensor. These signals are the direct electrical response of the sensor to the movement of the device. The angle sensor driver processes the raw electrical signals reported by the accelerometer to obtain the acceleration component of the device along the coordinate axis. Similarly, the angle sensor driver also processes the raw electrical signals reported by the gyroscope sensor to obtain the angular velocity component of the device around the coordinate axis, which reflects the rotation rate of each part of the electronic device around the coordinate axis.

[0067] According to the first aspect, or any implementation of the first aspect above, before the hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, the method further includes:

[0068] The hinge angle algorithm module calculates an estimated error value based on the acceleration component in the direction of the Y coordinate axis, and the estimated error value is used to represent the error value between the hinge angle calculated by the hinge angle algorithm module and the actual hinge angle;

[0069] When the estimated error value is greater than or equal to the error threshold, the hinge angle algorithm module performs vertical entry detection on the electronic device based on the acceleration component in the direction of the Y coordinate axis;

[0070] When the electronic device meets the vertical entry condition, performing a stationary detection on the electronic device to obtain a detection result;

[0071] Based on the detection result, determining an exit condition satisfied by the electronic device;

[0072] In a case where the electronic device satisfies the exit condition, determining that the electronic device exits the vertical state, and updating the estimated error value, wherein the updated estimated error value is less than the error threshold;

[0073] After obtaining the updated estimated error value, the step of calculating the hinge angle between the first body and the second body based on the sensor data through the hinge angle algorithm module is performed.

[0074] It should be understood that the vertical entry detection is to confirm whether the electronic device meets the vertical entry condition. In an optional example, the vertical entry detection can be to detect whether Gy falls within a threshold range: 8.7m / s 2 <Gy<10.9m / s 2 This threshold range is compared with 9.3m / s 2 <Gy<10.3m / s 2 , it is easier for the electronic device to meet the vertical state entry conditions. If so, the electronic device is regarded as being in the vertical state.

[0075] If the electronic device meets the vertical state entry condition, that is, the electronic device is in a vertical state, the hinge angle algorithm module will perform a static detection to determine whether the electronic device is in a static state. For example, the gravitational acceleration components Gx, Gy, and Gz measured on the X, Y, and Z axes of the electronic device can be combined with two static state thresholds to detect whether the electronic device is in a static state. When 8.7m / s is detected 2 <Gy<10.9m / s 2 And 8.7m / s 2 <Gy<10.9m / s 2 When the electronic device is in a stationary state, the stationary state includes absolute stationary state and relative stationary state (uniform motion). In addition, the electronic device is considered to be in a moving state.

[0076] It should be understood that after each time the electronic device turns on the screen, ADSP only performs a vertical state judgment once after the screen is turned on. When the electronic device meets the vertical state entry conditions, that is, when it is determined that the electronic device is in a vertical state, the vertical state flag is set to true; once the screen is turned on this time, the electronic device exits the vertical state, the vertical state flag becomes false, and no vertical state judgment is performed anymore, and it is considered that the electronic device has exited the vertical state until the electronic device turns off the screen and then turns on the screen again, at which time the vertical state flag is updated to true.

[0077] It should be noted that the static threshold value in the example of this application is based on the standard value of gravity acceleration (about 9.81m / s on the surface of the earth). 2). When the total acceleration measured by the accelerometer (i.e., the square root of the sum of the squares of the acceleration components on all axes) is close to this standard value, it can be considered that the electronic device is roughly at rest.

[0078] According to the first aspect, or any implementation of the first aspect above, the exit condition includes: a first exit condition and a second exit condition, and a constraint range of the first exit condition is smaller than a constraint range of the second exit condition;

[0079] The determining, based on the detection result, an exit condition satisfied by the electronic device includes:

[0080] When the detection result shows that the electronic device is in a stationary state, based on the acceleration component in the direction toward the Y coordinate axis being greater than a first threshold value, or the acceleration component in the direction toward the Y coordinate axis being less than a second threshold value, determining that the electronic device meets the first exit condition, the stationary state including: an absolute stationary state and a uniform motion state;

[0081] When the detection result shows that the electronic device is not in a stationary state, based on the acceleration component in the direction of the Y-coordinate axis being greater than a third threshold value, or the acceleration component in the direction of the Y-coordinate axis being less than a fourth threshold value, it is determined that the electronic device meets a second exit condition, the first threshold value is less than the third threshold value, the second threshold value is less than the first threshold value, and the fourth threshold value is less than the second threshold value.

[0082] It should be understood that the static state includes: an absolute static state and a uniform motion state. If the first threshold value is less than the third threshold value, the second threshold value is less than the first threshold value, and the fourth threshold value is less than the second threshold value, the electronic device is considered not to meet the second exit condition.

[0083] Compared with the first exit condition (narrow threshold) mentioned above, the second exit condition (wide threshold) is more difficult to exit. Optionally, as an illustrative example, the first exit condition may be: G y >The first threshold value 10.3m / s 2 or G y <Second threshold value 9.3m / s 2 , the second exit condition can be: G y >Third threshold value 10.9m / s 2 or G y <The fourth threshold value 8.7m / s 2 .

[0084] In the above implementation, the hinge angle algorithm module of the electronic device determines whether the electronic device meets specific exit conditions based on the sensor data of the acceleration sensor. These exit conditions are used to determine whether the electronic device can exit from the vertical state, that is, to switch from the vertical state to the non-vertical state.

[0085] If the electronic device is in a stationary state (including absolute stillness or relative stillness, i.e., uniform motion), the hinge angle algorithm module will check whether the acceleration component in the Y-axis direction is greater than the first threshold value or less than the second threshold value. If so, the device meets the first exit condition. If the electronic device is not in a stationary state, the hinge angle algorithm module will check whether the acceleration component in the Y-axis direction is greater than the third threshold value or less than the fourth threshold value. If so, it is considered that the electronic device meets the second exit condition. By using the hinge angle algorithm module to adjust the calculation threshold range of the electronic device exiting the vertical state according to the stationary or moving state of the electronic device, it is ensured that when the electronic device exits the vertical state, the vertical state is easier to identify and exit, which can accurately reflect the physical state of the electronic device, thereby facilitating rapid switching of the screen display.

[0086] According to the first aspect, or any implementation of the first aspect above, after the hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, the method further includes:

[0087] The hinge angle algorithm module reports the calculated hinge angle and the updated estimated error value to the AP;

[0088] The AP determines a folding state flag based on the hinge angle and the updated estimated error value;

[0089] If the AP determines that the electronic device is in the folded state based on the folded state flag, displaying the user interface on the first display screen;

[0090] If the AP determines that the electronic device is in the unfolded state based on the folding state flag, the user interface is displayed on the second display screen.

[0091] In this implementation, after the hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, the hinge angle algorithm module reports the calculated hinge angle and the updated estimated error value to the application processor AP. The AP determines a folding state flag based on the received hinge angle and the estimated error value, and the folding state flag is used to indicate whether the device is currently in a folded state or an unfolded state. If the AP determines that the electronic device is in a folded state, the first display screen will display the user interface; if the AP determines that the electronic device is in an unfolded state, the second display screen will display the user interface.

[0092] According to the first aspect, or any implementation of the first aspect above, the AP includes: a sensor hardware abstraction layer and a folding machine display management service layer;

[0093] The AP determines a folding state flag based on the hinge angle and the updated estimated error value, including:

[0094] If the sensor hardware abstraction layer determines that the updated estimated error value is less than the error threshold, the hinge angle is reported to the folding machine display management service layer on the AP;

[0095] The folding machine display management service layer determines the folding state flag of the electronic device based on the hinge angle.

[0096] In this implementation, the application processor AP includes a sensor hardware abstraction layer and a folding machine display management service layer to collaboratively determine the folding state of the electronic device. Specifically, the sensor hardware abstraction layer is responsible for handling low-level hardware interactions and data processing, while the folding machine display management service layer is responsible for making high-level decisions based on these data, such as the display state of the user interface. This layered architecture helps improve the efficiency and reliability of the system, while also making the system easier to maintain and upgrade.

[0097] According to the first aspect, or any implementation of the first aspect above, the method further includes:

[0098] If the sensor hardware abstraction layer determines that the updated estimated error value is greater than or equal to the error threshold, the hinge angle is not reported to the folding machine display management service layer.

[0099] According to the first aspect, or any implementation of the first aspect above, if the AP determines that the electronic device is in a folded state based on the folding state flag, displaying the user interface on the first display screen includes:

[0100] The folding machine display management service layer determines whether the folding state of the electronic device has changed based on the folding state flag;

[0101] In the case where the folding state of the electronic device changes, if the folding state flag indicates that the electronic device is in a folded state, the folding machine display management service layer displays the user interface on the first display screen.

[0102] According to the first aspect, or any implementation of the first aspect above, if the AP determines that the electronic device is in the unfolded state based on the folding state flag, displaying the user interface on the second display screen includes:

[0103] The folding machine display management service layer determines whether the folding state of the electronic device has changed based on the folding state flag;

[0104] In the case where the folding state of the electronic device changes, if the folding state flag indicates that the electronic device is in the unfolded state, the folding machine display management service layer displays the user interface on the second display screen.

[0105] In this implementation, the folding machine display management service layer is responsible for monitoring the folding state of the electronic device and updating the display interface according to the change of the folding state. The folding machine display management service layer will check the folding state flag to determine whether the folding state of the electronic device has changed. If the folding state of the electronic device has changed, and the folding state flag indicates that the device is in the folded state, the folding machine display management service layer will display the user interface on the first display screen, ensuring that when the user folds or unfolds the electronic device, the user interface can respond in time and present the user interface on the corresponding display screen. If the folding state of the electronic device has changed, and the folding state flag indicates that the device is in the unfolded state, the folding machine display management service layer will display the user interface on the second display screen, ensuring that when the user folds or unfolds the electronic device, the user interface can respond in time and present the user interface on the corresponding display screen.

[0106] According to the first aspect, or any implementation of the first aspect above, the method further includes:

[0107] When the electronic device does not meet the exit condition, starting a timer through the hinge angle algorithm module;

[0108] When the timing of the timer exceeds a predetermined time and the electronic device remains in a vertical state, voltage data is obtained from the Hall sensor driver through the hinge angle algorithm module, wherein the voltage data is collected by a Hall sensor connected to the Hall sensor driver on the electronic device, and the voltage data is used to determine whether the electronic device is folded or unfolded;

[0109] The hinge angle algorithm module reports the voltage data and the vertical state flag to the AP, wherein the vertical state flag is used to indicate that the electronic device is in a vertical state;

[0110] If the AP determines that the electronic device is in a folded state based on the voltage data, displaying the user interface on the first display screen;

[0111] If the AP determines that the electronic device is in the unfolded state based on the voltage data, the user interface is displayed on the second display screen.

[0112] In this implementation, when the electronic device is in a vertical state for a long time, the hinge angle algorithm module will adjust the screen switching strategy and switch the display screen based on whether the device is in a folded state or an unfolded state detected by the Hall effect sensor. This can avoid the problem of being unable to adaptively switch the screen due to a long vertical state, improve the user experience of foldable screen mobile phones in different usage scenarios, and make the switching of the display screen more in line with the user's actual usage.

[0113] According to the first aspect, or any implementation of the first aspect above, after the hinge angle algorithm module starts the timer, the method further includes:

[0114] When it is determined that the electronic device exits the vertical state, the hinge angle algorithm module stops the timing of the timer.

[0115] According to the first aspect, or any implementation of the first aspect above, after the hinge angle algorithm module starts the timer, the method further includes:

[0116] After the timing of the timer reaches the predetermined time length, the process returns to executing the process of determining the exit condition satisfied by the electronic device based on the detection result until the electronic device exits the vertical state or the timing of the timer exceeds the predetermined time length.

[0117] According to the first aspect, or any implementation of the first aspect above, the AP includes a folding machine display management service layer;

[0118] If the AP determines that the electronic device is in a folded state based on the voltage data, displaying the user interface on the first display screen includes:

[0119] The folding machine display management service layer determines that the electronic device is in a folded state based on the voltage data, and displays the user interface on the first display screen.

[0120] According to the first aspect, or any implementation of the first aspect above, the AP includes a folding machine display management service layer;

[0121] If the AP determines that the electronic device is in a folded state based on the voltage data, displaying the user interface on the first display screen includes:

[0122] The folding machine display management service layer on the AP determines that the electronic device is in the unfolded state based on the voltage data, and displays the user interface on the second display screen.

[0123] According to the first aspect, or any implementation of the first aspect above, the method further includes:

[0124] In a case where it is determined that the estimated error value is less than the error threshold, the step of calculating, by the hinge angle algorithm module, a hinge angle between the first body and the second body based on the sensor data is performed.

[0125] In a second aspect of the present application, an electronic device is provided, the electronic device comprising a hinge, a first body and a second body, the hinge being used to connect the first body and the second body;

[0126] An enhanced digital signal processor ADSP, configured to call any of the methods described above to determine a hinge angle between the first body and the second body;

[0127] An application processor AP communicates with the ADSP based on an inter-core communication interface, and is used to call any one of the methods described above, determine that the electronic device is in a folded state based on the hinge angle, and display the user interface on the first display screen; determine that the electronic device is in an unfolded state based on the hinge angle, and display the user interface on the second display screen.

[0128] The second aspect and any implementation of the second aspect correspond to the first aspect and any implementation of the first aspect respectively. The technical effects corresponding to the second aspect and any implementation of the second aspect can refer to the technical effects corresponding to the above-mentioned first aspect and any implementation of the first aspect, which will not be repeated here.

[0129] According to a third aspect, an electronic device is provided, comprising a module / unit for executing the first aspect or any one of the methods in the first aspect.

[0130] In a fourth aspect, an electronic device is provided, comprising one or more processors and a memory;

[0131] The memory is coupled to one or more processors, and the memory is used to store computer program code, wherein the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the first aspect or any one of the methods in the first aspect.

[0132] In a fifth aspect, a chip system is provided, which is applied to an electronic device, and the chip system includes one or more processors, and the processor is used to call computer instructions so that the electronic device executes the first aspect or any one of the methods in the first aspect.

[0133] In a sixth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the processor executes the first aspect or any one of the methods in the first aspect.

[0134] In a seventh aspect, a computer program product is provided, the computer program product comprising: a computer program code, when the computer program code is executed by an electronic device, the electronic device executes the first aspect or any one of the methods in the first aspect.

[0135] The present application provides an interface display method, which is applicable to a foldable electronic device with a hinge, such as a foldable smartphone or tablet computer. First moment: the user performs a screen-on operation, the electronic device lights up the screen in the folded state, and displays the user interface on the first display screen. Second moment: the user unfolds the electronic device, and the electronic device displays the user interface on the second display screen in the vertical state. At this time, the hinge angle between the first body and the second body is the first angle, and this moment occurs after the first moment. Third moment: the user folds the electronic device, and the electronic device still displays the user interface on the first display screen in the vertical state. The fourth moment occurring after the third moment: the user unfolds the electronic device again, and the user interface is displayed on the first display screen at this time, although the display area of ​​the second display screen is larger than the display area of ​​the first display screen. The above method enables the electronic device to intelligently switch the display screen according to its physical state (folded or unfolded) and the hinge angle in the vertical state, thereby providing a flexible and coherent user experience.

[0136] Through the above technical solution, since the electronic device includes the above interface display method, it at least has all the beneficial effects of the interface display method, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0137] Figure 1 A schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application;

[0138] Figure 2 A schematic block diagram of the software architecture and hardware architecture of an electronic device 100 provided in an embodiment of the present application;

[0139] FIG3( a ) is a schematic diagram of an electronic device 100 with an inward folding screen provided by an example of the present application in a folded state;

[0140] FIG3( b ) is a schematic diagram of an electronic device 100 with an inwardly folding screen provided in an example of the present application when it is in a stand state;

[0141] FIG3( c ) is a schematic diagram of an electronic device 100 with an inward folding screen provided by an example of the present application in an unfolded state;

[0142] FIG4( a ) is a schematic diagram of an electronic device 100 with an outward-folding folding screen provided in an example of the present application in a folded state;

[0143] FIG4( b ) is a schematic diagram of an electronic device 100 with an outward-folding folding screen provided in an example of the present application when it is in a stand state;

[0144] FIG4( c ) is a schematic diagram of an electronic device 100 with an outward-folding screen provided by an example of the present application in an unfolded state;

[0145] Figure 5 A schematic diagram of the unfolding process of an electronic device 100 with an outward-folding folding screen provided as an example of the present application;

[0146] Figure 6 A schematic diagram of a closing process of an electronic device 100 with an outward-folding folding screen provided as an example of the present application;

[0147] Figure 7 Another electronic device 100 with an outward folding screen provided as an example of the present application is a schematic diagram of a stand state;

[0148] Figure 8 Another electronic device 100 with an outward folding screen provided as an example of the present application is a schematic diagram of a stand state;

[0149] Fig. 9 It is a flowchart of an interface display method provided in an embodiment of the present application;

[0150] FIG10( a ) is a schematic diagram of an electronic device with an outward-folding folding screen provided by an example of the present application at a first moment;

[0151] FIG10( b ) is a schematic diagram of an electronic device with an outward-folding folding screen provided in an example of the present application at a second moment;

[0152] FIG10( c ) is a schematic diagram of an electronic device with an outward-folding folding screen provided in an example of the present application at a third moment;

[0153] FIG10( d ) is a schematic diagram of an electronic device with an outward-folding folding screen provided in an example of the present application at a third moment;

[0154] FIG11( a ) is a schematic diagram of an electronic device with an outward-folding folding screen provided by an example of the present application at a fifth moment;

[0155] FIG11( b ) is a schematic diagram of an electronic device with an outward-folding folding screen provided by an example of the present application at a sixth moment;

[0156] Fig.12 A schematic diagram of the interaction process between an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided as an example of the present application;

[0157] Fig.13 A schematic diagram of the interaction process between an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided as an example of the present application;

[0158] Fig.14 A schematic diagram of the interaction process between an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided as an example of the present application;

[0159] Fig.15 A schematic diagram of the interaction process between an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided as an example of the present application;

[0160] Fig.16 A schematic diagram of the interaction process between an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided as an example of the present application;

[0161] Fig.17 A schematic diagram of the interaction process between an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided as an example of the present application;

[0162] Fig.18 A flowchart of an optional interface display method provided for the example of this application;

[0163] Fig.19 It is a structural schematic diagram of an interface display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0164] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0165] It should be understood that the "multiple" mentioned in this application refers to two or more. In the description of this application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is just a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0166] In addition, in order to facilitate the clear description of the technical solution of the present application, the words "first", "second", etc. are used to distinguish the same items or similar items with basically the same functions and effects. The terms "first" and "second", etc. in the description and claims of the embodiments of the present application are used to distinguish different objects, rather than to describe the specific order of objects. For example, the first target object and the second target object, etc. are used to distinguish different target objects, rather than to describe the specific order of target objects.

[0167] In the embodiments of the present application, the words "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0168] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0169] First, some terms in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

[0170] Acceleration sensor (acceleration, ACC): is an electronic device that can measure acceleration force. Acceleration force is the force acting on an object when it is accelerating.

[0171] The gyroscope sensor (Gyro) is a simple and easy-to-use control system based on free space movement and gesture positioning. It determines the direction of a moving object based on the principle that the direction of the rotation axis is not affected by external forces. It was originally used in helicopter models and is now widely used in mobile portable devices such as mobile phones.

[0172] The application processor (AP) is the main processor in electronic devices (such as smartphones), responsible for executing the operating system, user interface, and application programs.

[0173] A digital signal processor (DSP) is a microprocessor specially designed for digital signal processing. It can process signals at high speed and high efficiency.

[0174] Advanced Digital Signal Processing (ADSP) can be understood as an enhanced digital signal processor DSP, or an advanced digital signal processing chip, which mainly processes digitized signals in a digital way.

[0175] Qualcomm Messaging Interface (QMI) is an architecture and protocol for communication between the hardware architecture and the application software architecture on mobile platforms. It provides a standardized multi-processor inter-process communication functional interface, enabling applications to communicate with the hardware architecture and implement various functions such as data transmission, network connection, phone calls and text messages.

[0176] The above is a brief introduction to the nouns involved in the embodiments of the present application, which will not be repeated below.

[0177] Before describing the technical solution of the embodiment of the present application, the electronic device in the embodiment of the present application is first described in conjunction with the accompanying drawings. Figure 1 , Figure 1 A schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present application.

[0178] Optionally, the electronic device 100 can be called a terminal or a terminal device. The specific product form of the electronic device 100 can be a smart terminal, such as a mobile phone, a tablet computer, a wearable device, an augmented reality / virtual reality device, a laptop computer, a vehicle-mounted device, a personal digital assistant (PDA), and other electronic devices with a folding screen function. Specifically, the functional modules involved in this application can be deployed on the DSP chip of the relevant device, and specifically can be the application program or software therein. The interface switching display function of an electronic device with a folding screen function can be realized through software installation or upgrade, as well as through hardware call coordination.

[0179] It should be understood that Figure 1 The electronic device 100 shown is only one example of an electronic device, and the electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have a different configuration of components. Figure 1 The various components shown in the EMBODIMENTS 2000 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0180] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an acceleration sensor, a temperature sensor, a motion sensor, an air pressure sensor, a magnetic sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0181] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor and / or a neural network processor (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0182] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0183] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory.

[0184] The USB interface 130 is an interface that complies with USB standard specifications, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.

[0185] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While the charging management module 140 is charging the battery 142, it can also power the electronic device through the power management module 141. The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and powers the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

[0186] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, the baseband processor, and the like.

[0187] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas.

[0188] The mobile communication module 150 may provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc.

[0189] The wireless communication module 160 can provide wireless communication solutions for application in the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi, Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0190] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with the network and other devices through wireless communication technology.

[0191] The electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor, etc. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0192] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0193] The electronic device 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor.

[0194] The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted to the camera photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.

[0195] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0196] Among them, the camera 193 can be located in the edge area of ​​the electronic device, can be an under-screen camera, or can be a liftable camera. The camera 193 can include a rear camera, and can also include a rear camera. The embodiment of the present application does not limit the specific position and form of the camera 193. The electronic device 100 can include cameras of one or more focal lengths. For example, cameras of different focal lengths can include a telephoto camera, a wide-angle camera, an ultra-wide-angle camera, or a panoramic camera.

[0197] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement a data storage function.

[0198] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121, for example, enabling the electronic device 100 to implement the frequency-limited operation method in the embodiment of the present application. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data (such as audio data, a phone book, etc.) created during the use of the electronic device 100, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0199] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170 and the application processor.

[0200] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0201] The touch sensor is also called a "touch panel". The touch sensor can be set on the display screen 194. The touch sensor and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor is used to detect a touch operation acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194.

[0202] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor can be arranged on the display screen 194. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor.

[0203] The gyro sensor may be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (ie, x, y, and z axes) may be determined by the gyro sensor.

[0204] The accelerometer can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the accelerometer can detect the magnitude and direction of gravity. The accelerometer can also be used to identify the posture of the electronic device, and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0205] The key 190 includes a power key (or power key), a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0206] Next, the software architecture and hardware architecture of the electronic device 100 are described. The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention takes the Android system of the layered architecture as an example to exemplify the software architecture of the electronic device 100.

[0207] See also Figure 2 , Figure 2 A schematic block diagram of the software architecture and hardware architecture of an electronic device 100 provided in an embodiment of the present application, referring to Figure 2 As shown, the above software architecture includes: an application processor (AP), the hardware architecture includes an enhanced digital signal processor ADSP, and the AP framework uses a layered architecture to divide the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the folding machine display management service layer, the application framework layer, and the hardware abstraction layer.

[0208] In this application example, the application framework layer in the AP can be Figure 2 The sensor framework (sensorFWK) shown in the figure, the hardware abstraction layer is specifically the sensor hardware abstraction layer (sensor HAL), and the sensor HAL may include: a hinge angle sensor hardware abstraction layer (hinge_angle.cpp) and a Hall sensor hardware abstraction layer (extend_hall.cpp).

[0209] The application layer can include a series of application packages, refer to Figure 2As shown, the application package may include applications such as gallery, creation assistant, quick application engine, light editing service, etc. The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer, including various components and services to support developers' Android development. The application framework layer includes some predefined functions. The application framework layer may include a window manager, content provider, notification manager, resource manager, search engine, learning memory library, and visual image module, etc.

[0210] Reference Figure 2 As shown in the figure, the hardware architecture ADSP includes: hinge angle algorithm module (hinge_angle aglo), sensor driver (hinge_angledriver), Hall sensor driver (extend_hall driver). ADSP can also be equipped with multiple external components or additional components, such as Hall sensor, accelerometer sensor ACC and gyroscope sensor GYRO, etc. These sensors are directly connected to the corresponding drivers in ADSP.

[0211] It should be understood that in the example of the present application, the driver on the ADSP is used to communicate directly with the hardware. For example, the driver on the ADSP may also include at least a display driver, a camera driver, and a sensor driver. The hardware on the ADSP may include devices such as a camera, a display, a microphone, a processor, and a memory.

[0212] Figure 2 The architecture diagram shown shows the communication mechanism between the software architecture AP and the hardware architecture ADSP. The communication between AP and ADSP is realized through the inter-core communication interface QMI. Based on the above architecture, it can be realized in the foldable screen device that the sensor driver (hinge_angledriver) is used to obtain the sensor data of the electronic device collected by the sensor, such as the acceleration component in the direction of the coordinate axis and the angular velocity component around the coordinate axis, and the hinge angle algorithm module (hinge_angle aglo) determines the hinge angle of the electronic device based on the above sensor data, that is, the folding angle, and then the AP side determines whether the electronic device is in a folded state or an unfolded state based on the hinge angle calculated by the ADSP side. Based on the hinge angle, it is determined that the electronic device is in a folded state, and the user interface is displayed on the first display screen; based on the hinge angle, it is determined that the electronic device is in an unfolded state, and the user interface is displayed on the second display screen.

[0213] It should be noted that the use of Figure 2In the architecture shown, even when the electronic device is off and the application processor AP enters a sleep state, since the touch IC and various sensors for detecting the status are running or mounted in the ADSP, it is still possible to calculate the hinge angles of the first body and the second body of the electronic device, and control the folded state or unfolded state of the electronic device according to the hinge angle, which helps to optimize the performance of the device and the user experience.

[0214] Understandably, Figure 2 The components included in the software architecture AP and the hardware architecture ADSP shown do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently.

[0215] The interface display method provided in the example of this application can be applied to electronic devices with foldable screens. Optionally, the electronic devices may include mobile phones, tablet computers, smart watches, laptop computers, virtual-reality fusion devices, super mobile personal computers, smart TVs, smart screens, high-definition TVs, smart speakers, smart projectors, etc.

[0216] It should be understood that, taking an electronic device with a foldable screen as an example, the electronic device includes a hinge, a first body and a second body, and the hinge is used to connect the first body and the second body; the hinge angle θ of the first body and the second body has a value range of [0°, 180°]. It should be understood that the hinge angle refers to the rotation angle between two objects, and is usually used to describe the folding angle between the two bodies of a foldable device (such as a foldable smartphone) or the screen driven by the two bodies.

[0217] Devices with folding structures are generally connected using hinges (rotating shafts). Schematically, the hinge structures used to connect the two bodies of an electronic device can be roughly classified into two types: one is an ordinary single rotating shaft, and the other is a complex hinge composed of multiple rotating shafts combined in different ways. In the example of this application, a complex hinge can be used to connect the first body and the second body of the electronic device.

[0218] It should be understood that the structure of a single shaft is relatively simple. In simple terms, one shaft is sleeved with another shaft to achieve position limiting and rotation. The flip phones in the era of feature phones basically have this single shaft structure. Now, including tablets, most notebooks on the market also use ordinary single shaft structures, and the flip range of such single shaft notebooks is generally within 180°. However, there is more than one structure and form of complex hinges. Different form changes can be achieved through various structural designs, different numbers of small shafts, and even different mechanical structures to meet the needs of different products.

[0219] Please refer to Figures 3(a), 3(b) and 3(c), which provide a plurality of product form schematic diagrams of electronic devices 100 with inward folding screens, wherein the inward folding screen is formed by folding inward along the central axis of the hinge to form a folding edge or a folding axis. On the electronic device 100 with the inward folding screen, the first display screen is a display screen arranged on the outside of the first body or the second body, and the second display screen is a display screen arranged on the inside of the first body and the second body. When the electronic device 100 with the inward folding screen is in a folded state, the first display screen and the second display screen are opposite to each other, and the second display screen is the display screen folded inward. The first body and the second body of the electronic device are folded along the central axis of the hinge to form a folding edge or a folding axis, and the second display screen can be folded into two parts (a left screen and a right screen), both of which are invisible to the user. The first display screen is arranged on the back of the second display screen, and the first display screen is visible to the user regardless of whether the inward folding screen is folded.

[0220] As shown in FIG3(a), the electronic device 100 with an inward folding screen is in a folded state (including fully closed or nearly closed). After the folding screen of the electronic device 100 is fully folded, the first display screen 1001 is visible to the user, and the second display screen 1002 is invisible to the user. When the electronic device 100 is unfolded by the user, the hinge angle θ between the first body 1003 and the second body 1004 is [0°, 33°], and the electronic device is considered to be in a folded state. When the electronic device is closed or folded by the user, the hinge angle θ between the first body and the second body of the electronic device is [0°, 27°], and the electronic device is considered to be switched from a stand state to a folded state.

[0221] As shown in FIG3(b), a schematic diagram of the electronic device with an inward folding screen in a stand state, in the example of the present application, when the electronic device 100 is unfolded by the user, the hinge angle θ between the first body and the second body of the electronic device 100 is [33°, 93°], and it is considered that the electronic device is switched from the folded state to the stand state. When the electronic device is closed or folded by the user, the hinge angle θ between the first body and the second body of the electronic device is [27°, 87°], and it is considered that the electronic device is switched from the unfolded state to the stand state.

[0222] As shown in FIG3(c), the electronic device with an inward folding screen is in an unfolded state. In the example of the present application, when the electronic device is unfolded by the user, the hinge angle θ between the first body and the second body of the electronic device is [93°, 180°], and the electronic device is considered to be switched from the stand state to the unfolded state. When the electronic device is closed or folded by the user, the hinge angle θ between the first body and the second body of the electronic device is [87°, 180°], and the electronic device is considered to be in the unfolded state.

[0223] Please refer to Figures 4(a), 4(b) and 4(c), which provide a plurality of product form schematic diagrams of electronic devices 100 with outward folding screens, where the outward folding screen is formed by folding the folding edge or folding axis outward along the central axis of the hinge to form a folding screen. The electronic device 100 with an outward folding screen as shown in Figure 4(a) is a form schematic diagram of the folded state. After the folding screen of the electronic device 100 is completely folded, the first display screen is visible to the user, and the user interface is displayed on the first display screen. The electronic device with an inward folding screen as shown in Figure 4(b) is a form schematic diagram of the stand state. The electronic device with an outward folding screen as shown in Figure 4(c) is a form schematic diagram of the unfolded state.

[0224] When the electronic device 100 with an outward folding screen is in a folded state, that is, the first body and the second body of the electronic device are folded along the central axis of the hinge to form a folding edge or a folding axis, the folding screen can be folded to form at least two display screens. On the electronic device 100 with an outward folding screen, the first display screen is a part of the second display screen. After the outward folding screen is folded, the first display screen and the second display screen are opposite to each other. Since the first display screen is a part of the second display screen, the first display screen and the second display screen are visible to the user in the folded state or the unfolded state. However, when the electronic device is in the folded state, the first display screen displays the user interface; when the electronic device is in the unfolded state, the second display screen displays the user interface.

[0225] It should be understood that the display screen provided with the main camera in the electronic device 100 is the main display screen, the second display screen is the main display screen, and the first display screen is the secondary display screen. Correspondingly, the hinge angle sensor (integrated with an acceleration sensor and a gyroscope sensor for calculating the hinge angle) provided on the second display screen is the main hinge angle sensor, and the sensor provided on the first display screen is the hinge angle sensor (integrated with an acceleration sensor and a gyroscope sensor for calculating the hinge angle) as the secondary hinge angle sensor. The distinction between the main and secondary in the above example is only used to more conveniently distinguish the first display screen from the second display screen, and the application does not specifically limit the specific functions and function implementations.

[0226] See also Figure 5 As shown, Figure 5A schematic diagram of the unfolding process of an electronic device 100 with an outward-folding folding screen is provided as an example of the present application. For an electronic device 100 with an inward-folding folding screen or an outward-folding folding screen, in the process of the electronic device being unfolded by the user, taking the hysteresis angle N° as 3° (it can also be 2°, 4°, 5°, etc. depending on the electronic device or the user's usage) as an example, the hinge angle θ between the first body and the second body is [0°, 33°], and the electronic device is considered to be in a folded state. If the hinge angle θ between the first body and the second body of the electronic device is [33°, 93°], the electronic device is considered to be switched from a folded state to a stand state. If the hinge angle θ between the first body and the second body of the electronic device is [93°, 180°], the electronic device is considered to be switched from a stand state to an unfolded state. It should be noted that during the process of the electronic device being folded to unfolded, the electronic device displays the user interface (i.e., full-screen display) on the second display screen in the stand state.

[0227] See also Figure 6 As shown, Figure 6 A schematic diagram of the closing process of an electronic device 100 with an outward-folding folding screen provided as an example of the present application, in the process of the electronic device being closed or folded by the user, taking the hysteresis angle N° as 3° (it can also be 2°, 4°, 5°, etc. depending on the electronic device or user usage) as an example, the hinge angle θ between the first body and the second body of the electronic device is [0°, 27°], then the electronic device is considered to be switched from the stand state to the folded state. The hinge angle θ between the first body and the second body of the electronic device is [27°, 87°], then the electronic device is considered to be switched from the unfolded state to the stand state. The hinge angle θ between the first body and the second body of the electronic device is [87°, 180°], then the electronic device is considered to be in the unfolded state. It should be noted that during the process of the electronic device being unfolded to folded, the electronic device displays the user interface (i.e., half-screen display) on the first display screen in the stand state.

[0228] It should be understood that the folding screen (inward folding screen and outward folding screen) in the above-mentioned embodiment of the present application is divided into at least two screens after being folded, which can be multiple independent screens, or a complete screen of an integrated structure, which is just folded into at least two parts. For example, the folding screen can be a flexible folding screen. The flexible folding screen includes a folding edge made of a flexible material. Part or all of the flexible folding screen is made of a flexible material. The at least two screens that the flexible folding screen is divided into after being folded are a complete screen of an integrated structure, which is just folded into at least two parts.

[0229] See also Figure 7 As shown, Figure 7Another example of an electronic device 100 with an outward folding screen provided in this application is a schematic diagram of the stand state, wherein the display screen of the electronic device 100 is divided into a first display screen 1001 and a second display screen 1002, and the first display screen 1001 and the second display screen 1002 are both provided with a hinge angle sensor, and specifically, the hinge angle sensor integrates an acceleration sensor and a gyroscope sensor. Figure 7 In the electronic device 100 shown, a hinge angle sensor A is provided on the first display screen 1001, and an acceleration sensor a and a gyroscope sensor a are integrated in the hinge angle sensor A. A hinge angle sensor B is provided on the second display screen 1002, and an acceleration sensor b and a gyroscope sensor b are integrated in the hinge angle sensor B.

[0230] The gyroscope sensor is used to determine the motion posture of the electronic device, and can be used to measure the angular velocity component of the display screen around the X-axis, the angular velocity component around the Y-axis, and the angular velocity component around the Z-axis. The acceleration sensor is used to measure the acceleration component of the display screen toward the X-axis, the acceleration component toward the Y-axis, and the acceleration component toward the Z-axis.

[0231] See also Figure 8 As shown, Figure 8 Another electronic device 100 with an outward folding screen provided for the example of the present application is a schematic diagram of the shape in the stand state, the hinge of the electronic device corresponds to the Y axis, and the electronic device can determine the hinge angle θ between the first fuselage and the second fuselage based on the acceleration component of each display screen in the X-axis direction and the acceleration component in the Z-axis direction (gx1, gx2, gz1, gz2) measured by the acceleration sensor and the gyroscope sensor, and filtering the initial angle based on the angular velocity component around the Y-axis direction. Among them, θ represents the hinge angle finally calculated, and θ1 and θ2 respectively represent the inclination angles of the first fuselage and the second fuselage relative to the horizontal plane.

[0232] For example, based on the acceleration component in the X-axis direction and the acceleration component in the Z-axis direction (gx1, gx2, gz1, gz2), the hinge angle θ can be calculated using the following calculation formula:

[0233] θ=θ1+θ2;

[0234] cosθ=cos(θ1+θ2)=(gz1*gz2+gx1*gx2) / (gz1 2 *gx1 2 )*(gz2 2 *gx2 2 ).

[0235] In the electronic device 100 with an outward folding screen, the switching of the display screen (i.e., switching from one display mode to another display mode) is mainly achieved by detecting the hinge angle between the first body and the second body (i.e., hinge angle, folding angle). Therefore, in the embodiment of the present application, after determining the hinge angle θ between the first body and the second body of the electronic device, the display screen of the folding screen mobile phone can be switched according to the hinge angle, for example, whether to display the user interface on the first display screen or on the second display screen.

[0236] When the user folds or unfolds the electronic device, the electronic device will determine which display screen should display the user interface based on the hinge angle, so that the electronic device can provide different user interfaces and functions to the user in different folding states. For example, taking the electronic device as a smartphone with an outward folding screen as an example, when the smartphone is fully unfolded, it can provide the user with a full view of a large screen; while when the smartphone is partially folded or fully folded, the interface may only be displayed on a small screen or half of the screen, so that the user can operate it with one hand, making the folding screen mobile phone more flexible and multifunctional.

[0237] However, it is worth noting that when the electronic device is in a vertical state (the hinge angle between the display plane of the electronic device and the horizontal plane is close to 90°, or it can also be understood that the hinge angle between the central axis or central rotation axis of the hinge of the electronic device and the horizontal plane is close to 90°, for example, a deviation of ±3° is allowed on the basis of 90°), the gravitational acceleration of the electronic device is concentrated in the Y-axis direction, while the gravitational acceleration components in the X-axis and Z-axis directions are very small, which will cause the effective calculation data of the folding hinge angle (Z-axis component and X-axis component of the gravitational acceleration) to be very small, thereby causing inaccurate calculation of the hinge angle between the first body and the second body, especially when the electronic device is shaking or there is electronic noise, this inaccuracy may cause erroneous switching operations of the display screen.

[0238] To solve this problem, current folding screen devices generally suppress posture reporting in the vertical state, that is, the device algorithm will temporarily stop reporting posture data when detecting the vertical state. This means that in the vertical state, no matter how the hinge angle changes, the underlying system of the device will not report the state change, thus avoiding the wrong screen switching.

[0239] However, this method is not the best solution for foldable screen devices because it may cause half-screen display problems in the unfolded state. If the half-screen display problem occurs, the problem will persist in the vertical state, thus affecting the user experience.

[0240] Therefore, for the design of foldable screen devices, a more sophisticated algorithm is needed to process the posture data of the electronic device in the vertical state, so as to ensure that the hinge angle of the first body and the second body of the electronic device can be accurately calculated even when the electronic device is in the vertical state, and ensure that the user can obtain accurate and reliable screen display even when the electronic device is in the vertical state, thereby providing a better user experience.

[0241] An embodiment of the present application provides an interface display method, which is applied to an electronic device. Fig. 9 is a flow chart of an interface display method provided in an embodiment of the present application, such as Fig. 9 As shown, an interface display method includes:

[0242] S910, at a first moment, in response to a screen-lighting operation by a user, the electronic device lights up the screen and displays a user interface on a first display screen. At the first moment, the electronic device is in a folded state.

[0243] S920, at a second moment, in response to the user unfolding the electronic device, displaying the user interface on the second display screen, at the second moment, the hinge angle between the first body and the second body is a first angle, the electronic device is in a vertical state, and the second moment is after the first moment;

[0244] S930, at a third moment, in response to the user folding the electronic device, displaying a user interface on the first display screen. At the third moment, the electronic device is in a vertical state.

[0245] S940, at the fourth moment, after the user unfolds the electronic device, the user interface is displayed on the first display screen. At the fourth moment, the electronic device is not in a vertical state, the hinge angle between the first body and the second body is a first angle, the display area of ​​the second display screen is larger than the display area of ​​the first display screen, and the fourth moment is after the third moment.

[0246] In the example of the present application, the vertical state means that the hinge angle between the display plane of the electronic device and the horizontal plane is close to 90°, or it can also be understood that the hinge angle between the central axis or central rotation axis of the hinge of the electronic device and the horizontal plane is close to 90°, for example, a deviation of ±3° is allowed on the basis of 90°.

[0247] Taking the electronic device in the example of the present application as a device with an inward folding screen as an example, the first display screen and the second display screen can be understood as two independent display screens. In this case, the display area of ​​the first display screen and the display area of ​​the second display screen can be the same or different.

[0248] Taking the electronic device in the example of this application as a device with an outward folding screen as an example, the first display screen can actually be a part of the second display screen. When the electronic device is folded, the user interface is displayed on the display area of ​​the first display screen, and when the electronic device is unfolded, the user interface is displayed on the display area of ​​the second display screen. Therefore, the display area of ​​the second display screen is larger than the display area of ​​the first display screen.

[0249] It should be noted that during actual use, the user can use the display screen with a main camera on the electronic device as the main display screen, and the display screen without a camera or with a slave camera as the slave display screen. For example, if the main camera is set on the first display screen, the first display screen is defaulted to be the main display screen, and the second display screen of the electronic device in the folded state is the slave display screen.

[0250] In addition, the main display screen and the secondary display screen can be adjusted according to the user's usage habits or personalized settings. For example, the main display screen can be a large screen after unfolding, that is, the second display screen, which is used for main operations and applications. The secondary display screen is a small screen on the outside in the folded state, that is, the first display screen, which is used to quickly view notifications, time, weather, etc.

[0251] It can be understood that the method of the present application can be implemented through the collaborative work of the software architecture AP and the hardware architecture ADSP in the electronic device to ensure that the user interface can be switched to an adapted display screen according to changes in the physical state of the electronic device.

[0252] For example, at the software level, the operating system on the AP needs to be able to detect the user's screen-on operation and trigger the screen-on event. At the hardware level, sensors on electronic devices are used to identify user operations, such as touching the screen or pressing a button, etc.

[0253] Please refer to FIG. 10( a ), which is a schematic diagram of an electronic device with an outward folding screen provided by the example of the present application at the first moment. At the first moment T1 , the user performs a screen-lighting operation on the electronic device 100 , and the electronic device 100 immediately lights up the screen. At this moment, the electronic device 100 is in a folded state, and a user interface is displayed on the first display screen 1001 , providing a compact information view.

[0254] Taking the electronic device 100 as an example of a smartphone with an outward folding screen, the first display screen in the folded state can be a part of the entire screen (second display screen) of the smartphone, which is used to quickly view notifications or perform simple operations. In addition, taking the above electronic device as an example of a smartphone with an inward folding screen, the first display screen in the folded state can be the outer screen of the smartphone, which is used to quickly view notifications or perform simple operations.

[0255] Please refer to FIG. 10(b), which is a schematic diagram of the form of an electronic device with an outward folding screen at the second moment provided by the example of the present application. At the second moment T2 after the first moment T1, in response to the user unfolding the electronic device 100, the second display screen 1002 takes over the display of the user interface to maintain the continuity of the user interface, while providing richer information in a larger display area. It should be understood that when the user unfolds the electronic device 100, it means switching the electronic device from a folded state or a stand state to an unfolded state. At the second moment, the hinge angle θ between the first body 1003 and the second body 1004 of the electronic device 100 is [93°, 180°].

[0256] Furthermore, at the second moment, the electronic device 100 is in a vertical state, which is similar to the standing state of a book. In the vertical state, the hinge angle between the display plane of the electronic device 100 and the horizontal plane is close to 90°, or the hinge angle between the central axis or central rotation axis of the hinge of the electronic device 100 and the horizontal plane is close to 90°.

[0257] Please refer to Figure 10(c), which is a schematic diagram of the shape of an electronic device with an outward folding screen at a third moment provided in an example of the present application. At the third moment T3 after the first moment T1 or the second moment T2, the user folds the electronic device 100, but the electronic device 100 remains in a vertical state, and the first display screen 1001 redisplays the user interface and adapts in real time to the new folding angle of the electronic device after the user's folding operation.

[0258] Please refer to Figure 10(d), which is a schematic diagram of the shape of an electronic device with an outward folding screen at a third moment provided in an example of the present application. At a fourth moment T4 after the third moment T3, the user unfolds the electronic device 100 which is still in a vertical state. In the unfolded state, the hinge angle between the first body 1003 and the second body 1004 of the electronic device 100 remains at the first angle α, and the first display screen 1001 continues to display the user interface, although the display area of ​​the second display screen is larger than the display area of ​​the first display screen.

[0259] By adopting the interface display method of the electronic device provided in the example of this application, the electronic device can intelligently respond to the user's operation and the physical state of the device in the vertical state, ensure the consistency and usability of the user interface, and make the switching of the display screen more in line with the user's actual usage. Regardless of whether the electronic device is in a vertical state or not, folded or unfolded, it can provide users with the best interface layout and function access in different usage scenarios, solving the problem of inconsistent interface display and usage status when users use folding screen devices.

[0260] It should be understood that the interface display method described in the examples of the present application can adapt to different types of electronic devices (for example, devices with inward-folding folding screens and outward-folding folding screens), as well as electronic devices in different states (folded state, unfolded state, vertical state, static state), so that the electronic device can maintain the continuity and consistency of the display interface in different physical states, and can also optimize the display content for the user according to the actual visible area of ​​the display screen.

[0261] As an optional example, at the second moment, the electronic device is in a vertical state, which means that at the second moment, the electronic device may be vertically unfolded or partially unfolded; the time length from the user starting to operate the device to light up the screen (first moment) to unfolding the device (second moment) exceeds a preset time length (for example, 10S or 15S, etc.). If both conditions are met, the electronic device will display the user interface on the second display screen. It should be understood that the above preset time length can be a time threshold set by the device manufacturer according to user habits and device usage, which is used to determine whether the user wants to enter a new working mode or view more content. Through the above example, the user's operation and time interval are detected to intelligently decide when to display the user interface on the second display screen, thereby providing a more personalized and user-friendly device usage experience.

[0262] As another optional example, when it is not possible to intelligently determine when to display the user interface on the second display screen by detecting the user's operation and time interval, the Hall sensor in the electronic device can be used to detect the voltage change caused by the change in the magnetic field when the user unfolds the electronic device. It should be understood that the Hall sensor is disposed on one side of the electronic device, and because it can sense the presence of a magnet or other magnetic component on the opposite side of the electronic device, it can be used to detect whether the electronic device is in an unfolded state or a folded state. The software system of the electronic device analyzes the voltage data provided by the Hall sensor to determine whether the device has been unfolded, and once it is determined that the device is in an unfolded state, the user interface is displayed on the second display screen.

[0263] Furthermore, even if it is impossible to intelligently decide when to display the user interface on the second display screen by detecting the user's operations and time intervals, the user can still see the content previously on the first display screen on the larger second display screen, providing the user with a better visual experience and more interaction space.

[0264] As another optional example, at the fourth moment, after the user unfolds the electronic device and determines that the electronic device is not in a vertical state and the first angle is less than a preset angle, the user interface is displayed on the first display screen.

[0265] In the example of the present application, "not being in a vertical state or a non-vertical state" can be understood as a state in which the electronic device is not completely vertical. The above-mentioned preset angle is set by the manufacturer according to the device design and usage scenario, and is used to determine whether the device is in a state suitable for displaying the user interface. Since the hinge angle θ between the first body and the second body is [0°, 33°] during the process of the electronic device being unfolded by the user, the electronic device is considered to be in a folded state. If the hinge angle θ between the first body and the second body of the electronic device is [33°, 93°], it is considered that the electronic device is switched from a folded state to a bracket state. If the hinge angle θ between the first body and the second body of the electronic device is [93°, 180°], it is considered that the electronic device is switched from a bracket state to an unfolded state. Therefore, the above-mentioned preset angle can be 93°, and when the electronic device is not in a vertical state and the unfolding angle is less than 93°, the user interface is displayed on the first display screen. Furthermore, the display system of the electronic device can intelligently adjust the display content according to the physical state of the device to ensure that the user can obtain a suitable interface display in different usage modes.

[0266] Please refer to Figure 11(a), which is a schematic diagram of the shape of an electronic device with an outward folding screen at the fifth moment provided by the example of this application. At the fifth moment T5 after the fourth moment T4, when the user unfolds the electronic device again, the hinge angle of the electronic device is adjusted to a second angle β that is larger than the first angle α. The second display screen will display the user interface, providing a different viewing angle and a larger display area than before. It can be seen that the display interface of the electronic device can be dynamically adjusted according to the folding and unfolding state of the device, providing users with a coherent and consistent user experience.

[0267] In one example, at the fifth moment, the display method of the electronic device further considers the specific unfolded state of the device and the user's operation. At the fifth moment, in response to the user unfolding the electronic device, when it is determined that the electronic device is not in a vertical state and the second angle β is greater than a preset angle, the user interface is displayed on the second display screen.

[0268] Based on the above description, it can be known that the first angle can be 30°, the second angle can be 60°, and so on. The preset angle can be but not limited to 70°, 80°, 90°, etc. It should be understood that the above angles can be determined according to actual conditions or user usage habits, and the examples in this application are not specifically limited.

[0269] When the electronic device is not in a vertical state and the unfolded angle is greater than a preset angle, the user interface is displayed on the second display screen. Furthermore, the display system of the electronic device can intelligently adjust the display content according to the physical state of the device, ensuring that the user can obtain an adapted display screen in different usage modes.

[0270] Please refer to FIG. 11(b), which is a schematic diagram of the form of an electronic device with an outward folding screen provided by the example of the present application at the sixth moment. At the sixth moment T6, after the user unfolds the electronic device, the user interface is displayed on the first display screen. At this time, during the process of the user operating the electronic device from the folded state to the unfolded state, the support state is passed, and the hinge angle between the first body and the second body is the first angle α, so the user interface is still displayed on the first display screen.

[0271] It should be understood that at the sixth moment, the hinge angle of the electronic device is not fully extended to the second angle β described at the second moment T2, but is maintained at a smaller angle α, which can adapt to different usage scenarios or user comfort. It should be understood that the sixth moment occurs between the first moment and the second moment, and the user performs the extension operation at a certain time point after initially operating the electronic device to light up the screen and before fully extending the electronic device.

[0272] Through the above examples, the electronic device can flexibly adapt to the needs of users in different usage modes, whether it is fully unfolded or partially unfolded. Users can choose the most suitable angle and state to use the device according to their personal usage habits and scenarios, while maintaining access to and interaction with the interface.

[0273] In one example, at the sixth moment T6, after the user unfolds the electronic device, it is first determined whether the electronic device is in a vertical state, and the time length from the user turning on the screen to unfolding the device is calculated. If the electronic device is vertical and the operation time is shorter than the preset time length, the user interface is displayed on the first display screen.

[0274] This design takes into account the situation that the user may only want to quickly check the information, rather than fully unfold the device for long-term use. Through the above processing method, the electronic device can provide a more convenient and intuitive user experience, while avoiding unnecessary energy consumption, because the second display will not be unfolded when the user only needs to quickly check, thereby enhancing the practicality and convenience of the device.

[0275] Combine the following Fig.12 This paper describes how electronic devices use their internal application processor AP and enhanced digital signal processor ADSP to achieve intelligent monitoring of device status and interface display processing.

[0276] In an optional implementation, the electronic device includes an application processor AP and an enhanced digital signal processor ADSP, see Fig.12 , Fig.12 A schematic diagram of an interaction process between an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided by an example of the present application, the method comprising:

[0277] S1210: In response to the user's screen-lighting operation, the AP sends a monitoring request to the ADSP.

[0278] The monitoring request is used to request the ADSP to monitor the hinge angle between the first body and the second body, and the AP and the ADSP communicate based on the inter-core communication interface. The inter-core communication interface allows the two processors to efficiently exchange data and instructions.

[0279] The above-mentioned step S1210 is executed during the execution of the above-mentioned step S920, that is, in response to the user's screen-turning operation, the AP sends a monitoring request to the ADSP. Similarly, during the execution of the above-mentioned step S1210, S910 can also be synchronously executed, that is, at the first moment, the electronic device turns on the screen and displays the user interface on the first display screen. At the first moment, the electronic device is in a folded state.

[0280] S1220: When the ADSP receives the monitoring request, the hinge angle between the first body and the second body is calculated based on the sensor data sent by the sensor of the electronic device.

[0281] During the execution of step S920, at a second moment, in response to the user unfolding the electronic device, while the user interface is displayed on the second display screen, step S1220 is executed to calculate that the hinge angle between the first body and the second body is a first angle.

[0282] In one example, since the change in the hinge angle can reflect whether the electronic device is folded or unfolded, it responds to the user's physical operation and ensures that the user interface can be properly adjusted according to the actual state of the device. The specific implementation process is as follows:

[0283] When the user performs a screen-lighting operation by clicking the screen of the electronic device or pressing any button of the electronic device, the application processor sends a monitoring request to the enhanced digital signal processor. This request is for the ADSP to monitor and calculate the hinge angle between the first body and the second body of the electronic device.

[0284] After the enhanced digital signal processor ADSP receives the monitoring request, it starts to process the sensor data from the electronic device obtained by at least one angle sensor driver. These sensors may include gyroscope sensors, accelerometers or other sensors that can detect physical changes. ADSP will use this data to calculate the hinge angle between the first body and the second body, and adjust the display screen or other functions used to display the interface on the electronic device accordingly, so that the foldable or deformable electronic device can more flexibly adapt to the user's interface display needs.

[0285] In an optional implementation, the enhanced digital signal processor ADSP is responsible for processing sensor data related to the hinge angle of the electronic device to obtain the hinge angle between the first body and the second body. The ADSP includes a hinge angle algorithm module and at least one angle sensor driver. Fig.13 , Fig.13 A schematic diagram of the interaction process between an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided by the example of the present application. The method also includes:

[0286] S12201: When the hinge angle algorithm module receives a monitoring request, it sends a sensor data reporting request to at least one angle sensor driver.

[0287] S12202: When at least one angle sensor driver receives a sensor data reporting request, the sensor data is reported to the hinge angle algorithm module at a fixed frequency.

[0288] S12203, a hinge angle algorithm module calculates a hinge angle between the first body and the second body based on the sensor data.

[0289] It can be understood that at the above steps T2, T4, T5, and T6, the hinge angle algorithm module can calculate the hinge angle between the first body and the second body based on the sensor data based on the above steps S12201 to S12203.

[0290] It should be understood that in the example of the present application, at least one Hall sensor driver and at least one angle sensor driver are provided in the ADSP. When there is one angle sensor driver, it is used to process the sensor data uploaded by the acceleration sensor and the sensor data uploaded by the gyroscope sensor. When there are two angle sensor drivers, the acceleration sensor driver can be used to process the sensor data uploaded by the acceleration sensor, and the gyroscope sensor driver can be used to process the sensor data uploaded by the gyroscope sensor.

[0291] When the user activates the screen-on operation, the software architecture AP on the electronic device sends a monitoring request to the hinge angle algorithm module in the hardware architecture ADSP. After receiving the monitoring request, the hinge angle algorithm module will issue an instruction to at least one angle sensor driver in the ADSP, requesting the angle sensor driver to start reporting sensor data. After at least one angle sensor driver receives the data reporting request, the collected sensor data will be reported to the hinge angle algorithm module at a predetermined fixed frequency, so that the hinge angle algorithm module uses these sensor data to calculate the hinge angle between the first body and the second body. This process allows the electronic device to use ADSP to monitor its physical state in real time, and adjust or switch the display screen to display the user interface or other functions according to the hinge angle through AP, providing users with a smoother and more intuitive user experience.

[0292] In an optional implementation, the sensor data includes: an acceleration component in the direction of the coordinate axis and an angular velocity component in the direction around the coordinate axis; a hinge angle algorithm module calculates an initial angle between the first body and the second body based on the acceleration component in the direction of the coordinate axis; and filters the initial angle based on the angular velocity component in the direction around the coordinate axis to obtain the hinge angle between the first body and the second body.

[0293] In the above optional implementation, the hinge angle algorithm module first uses the acceleration component measured by the sensor to calculate the initial angle between the first body and the second body. Specifically, the initial angle is estimated based on the acceleration change of the electronic device in space, and the relative position between the first body and the second body is preliminarily determined. Since the angular velocity component reflects the rotation rate of each part of the device around the coordinate axis, these data can help the algorithm module more accurately understand the dynamic changes of the device. Next, the hinge angle algorithm module uses the angular velocity component to filter this initial angle to reduce measurement noise and other possible interference, thereby obtaining a more accurate and stable hinge angle measurement value.

[0294] It should be understood that filtering is signal processing that can help extract useful signals while suppressing noise. In this case, the filter may be designed as a low-pass filter that allows low-frequency signals to pass while blocking high-frequency noise. In this way, when the two body parts of the electronic device move relative to each other, the hinge angle algorithm module can accurately measure the angle change between them.

[0295] In a specific implementation, the hinge angle algorithm module calculates the initial angle between the first body and the second body according to the acceleration component in the direction of the X-axis and the acceleration component in the direction of the Z-axis; the hinge angle algorithm module uses the Kalman filter method to filter the initial angle according to the angular velocity component around the Y-axis to obtain the hinge angle between the first body and the second body.

[0296] In the above example, first, by measuring the acceleration components of each display in the X-axis and Z-axis directions (represented as gx1, gx2, gz1, gz2 respectively), the initial angle between the two fuselages can be obtained. Then, the angular velocity component in the Y-axis direction is used to filter this initial angle to obtain a more accurate hinge angle.

[0297] For example, the hinge angle algorithm module can calculate the hinge angle θ based on the acceleration component in the X-axis direction and the acceleration component in the Z-axis direction (gx1, gx2, gz1, gz2) using the following calculation formula:

[0298] θ=θ1+θ2;

[0299] cosθ=cos(θ1+θ2)=(gz1*gz2+gx1*gx2) / (gz1 2 *gx1 2 )*(gz2 2 *gx2 2 ).

[0300] In this formula, θ represents the final hinge angle, and θ1 and θ2 represent the inclination angles of the first fuselage and the second fuselage relative to the horizontal plane. By taking the square root of the product and the sum of the squares of the acceleration components, the cosine values ​​of the two angles can be calculated using the properties of trigonometric functions to obtain the initial angle. The hinge angle algorithm module uses the Kalman filter method to process the angular velocity component, that is, the initial angle calculated by the acceleration component is filtered based on the angular velocity component to obtain the final hinge angle.

[0301] It should be understood that the Kalman filter method is an optimization algorithm that estimates the state of a dynamic system in the presence of noise. The Kalman filter continuously corrects the estimate of the system state through prediction and update steps, thereby optimizing the calculation of the hinge angle. Even in the presence of noise in the measurement of acceleration and angular velocity, it can help the algorithm module accurately estimate the hinge angle, providing a dynamic and adaptive way to process sensor data, so that electronic devices can respond more accurately to user operations and changes in the physical state of the device.

[0302] In one example, the sensor of the electronic device includes an acceleration sensor and a gyroscope sensor; in the embodiment of the present application, the original electrical signal reported by the acceleration sensor and the original electrical signal reported by the gyroscope sensor are received specifically through at least one angle sensor drive; the original electrical signal reported by the acceleration sensor is processed through at least one angle sensor drive to obtain an acceleration component in the direction of the coordinate axis; the original electrical signal reported by the gyroscope sensor is processed through at least one angle sensor drive to obtain an angular velocity component in the direction around the coordinate axis.

[0303] It should be understood that electronic devices use accelerometers and gyroscopes to monitor their physical state. These sensors provide raw electrical signals that reflect the movement of the device in space. Since raw electrical signals usually contain noise and possible interference, they need to be filtered and converted before they can be used for further calculation and analysis. In order to convert these raw signals into useful data, the angle sensor driver inside the electronic device performs the following steps:

[0304] In the specific implementation process, the angle sensor driver first receives the raw electrical signals from the accelerometer and gyroscope sensor. These signals are the direct electrical response of the sensor to the movement of the device. The angle sensor driver processes the raw electrical signals reported by the accelerometer to obtain the acceleration component of the device along the coordinate axis. Similarly, the angle sensor driver also processes the raw electrical signals reported by the gyroscope sensor to obtain the angular velocity component of the device around the coordinate axis, which reflects the rotation rate of each part of the electronic device around the coordinate axis.

[0305] See also Fig.14 , Fig.14 A schematic diagram of the interaction process of an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided in an example of the present application. In one example, before the hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, the method further includes:

[0306] S1201, the hinge angle algorithm module calculates an estimated error value based on the acceleration component in the direction of the Y coordinate axis, and the estimated error value is used to characterize the error value between the hinge angle calculated by the hinge angle algorithm module and the actual hinge angle.

[0307] S1202: When the estimated error value is greater than or equal to the error threshold, the hinge angle algorithm module performs vertical entry detection on the electronic device based on the acceleration component in the direction of the Y coordinate axis.

[0308] Through the above step S1202, the electronic device is detected to be in a vertical state, and in step S920, it is determined that the electronic device is in a vertical state. It can be understood that in step S930, at the third moment, the electronic device is still in a vertical state.

[0309] S1203: When the electronic device meets the vertical entry condition, a stationary detection is performed on the electronic device to obtain a detection result.

[0310] S1204: Determine the exit condition satisfied by the electronic device based on the detection result.

[0311] S1205: When the electronic device meets the exit condition, determine that the electronic device exits the vertical state, and update the estimated error value, wherein the updated estimated error value is less than the error threshold.

[0312] After obtaining the updated estimated error value, the above step S12203 is executed, and the hinge angle between the first body and the second body is calculated based on the sensor data by the hinge angle algorithm module.

[0313] Before calculating the hinge angle between the first body and the second body, the hinge angle algorithm module first uses the acceleration component in the Y-axis direction to calculate an estimated error value. This error value represents the difference between the hinge angle calculated by the algorithm and the actual hinge angle. If it is determined that the estimated error value is less than the error threshold, the hinge angle between the first body and the second body is calculated based on the sensor data by the hinge angle algorithm module. If this estimated error value is greater than or equal to a preset error threshold, for example, 0.4, the hinge angle algorithm module will further detect whether the electronic device is in a vertical state.

[0314] It should be understood that the vertical entry detection is to confirm whether the electronic device meets the vertical entry condition. In an optional example, the vertical entry detection can be to detect whether Gy falls within a threshold range: 8.7m / s 2 <Gy<10.9m / s 2 This threshold range is compared with 9.3m / s 2 <Gy<10.3m / s 2 , it is easier for the electronic device to meet the vertical state entry conditions. If so, the electronic device is regarded as being in the vertical state.

[0315] It should still be understood that after each time the electronic device turns on the screen, ADSP only performs a vertical state judgment once after the screen is turned on. When the electronic device meets the vertical state entry conditions, that is, when it is determined that the electronic device is in a vertical state, the vertical state flag is set to true; once the screen is turned on this time, the electronic device exits the vertical state, the vertical state flag becomes false, and no vertical state judgment is performed anymore, and it is considered that the electronic device has exited the vertical state until the electronic device turns off the screen and then turns on the screen again, at which time the vertical state flag is updated to true.

[0316] If the electronic device meets the above vertical state entry conditions, the hinge angle algorithm module will perform a stationary detection to determine whether the electronic device is in a stationary state. For example, the gravitational acceleration components Gx, Gy, and Gz measured on the X, Y, and Z axes of the electronic device can be combined with two threshold values ​​to detect whether the electronic device is in a stationary state.

[0317] In one example, it can be but not limited to when Gx is detected 2 +Gy2+Gz2<10.1 2 And Gx 2 +Gy2+Gz2>9.5 2 When the electronic device is in a stationary state, the stationary state includes absolute stationary state and relative stationary state (uniform motion). In addition, the electronic device is considered to be in a moving state.

[0318] It should be noted that the static threshold value in the example of this application is based on the standard value of gravity acceleration (about 9.81m / s on the surface of the earth). 2 ). When the total acceleration measured by the accelerometer (i.e., the square root of the sum of the squares of the acceleration components on all axes) is close to this standard value, it can be considered that the electronic device is roughly at rest.

[0319] Afterwards, the exit condition satisfied by the electronic device is determined according to whether the electronic device is in a stationary state or a moving state. If the electronic device meets the exit condition, the hinge angle algorithm module will update the estimated error value to ensure that the updated value is less than the error threshold. That is, the hinge angle algorithm module believes that the electronic device is no longer in a vertical state, or the state of the electronic device is stable enough to proceed to the next step of hinge angle calculation.

[0320] After updating the estimated error value, the hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, which can ensure that the measurement of the hinge angle is as accurate as possible, so that the user interface of the electronic device can be appropriately adjusted according to the actual physical state of the device.

[0321] In an optional implementation, the exit condition includes: a first exit condition and a second exit condition, and a constraint range of the first exit condition is smaller than a constraint range of the second exit condition.

[0322] When the detection result shows that the electronic device is in a stationary state, the electronic device is determined to meet the first exit condition based on the acceleration component in the direction of the Y-coordinate axis being greater than the first threshold value, or the acceleration component in the direction of the Y-coordinate axis being less than the second threshold value; otherwise, it is considered that the electronic device does not meet the first exit condition.

[0323] When the detection result shows that the electronic device is not in a stationary state, it is determined that the electronic device meets the second exit condition based on the acceleration component in the direction of the Y-coordinate axis being greater than the third threshold value, or the acceleration component in the direction of the Y-coordinate axis being less than the fourth threshold value.

[0324] It should be understood that the static state includes: an absolute static state and a uniform motion state. If the first threshold value is less than the third threshold value, the second threshold value is less than the first threshold value, and the fourth threshold value is less than the second threshold value, the electronic device is considered not to meet the second exit condition.

[0325] Compared with the first exit condition (narrow threshold) mentioned above, the second exit condition (wide threshold) is more difficult to exit. Optionally, in one example, the first exit condition is G y >The first threshold value 10.3m / s 2 or G y <Second threshold value 9.3m / s 2 , the second exit condition is G y >Third threshold value 10.9m / s 2 or G y <The fourth threshold value 8.7m / s 2 .

[0326] In the above implementation, the hinge angle algorithm module of the electronic device determines whether the electronic device meets specific exit conditions based on the data of the acceleration sensor. These exit conditions are used to determine whether the device can exit from the vertical state, that is, convert from the vertical state to the non-vertical state.

[0327] If the electronic device is in a stationary state (including absolute stillness or relative stillness, i.e., uniform motion), the hinge angle algorithm module will check whether the acceleration component in the Y-axis direction is greater than the first threshold value or less than the second threshold value. If so, the device meets the first exit condition. If the electronic device is not in a stationary state, the hinge angle algorithm module will check whether the acceleration component in the Y-axis direction is greater than the third threshold value or less than the fourth threshold value. If so, it is considered that the electronic device meets the second exit condition. By using the hinge angle algorithm module to adjust the calculation threshold range of the electronic device exiting the vertical state according to the stationary or moving state of the electronic device, it is ensured that when the electronic device exits the vertical state, the vertical state is easier to identify and exit, which can accurately reflect the physical state of the electronic device, thereby facilitating rapid switching of the screen display.

[0328] The embodiment of the present application provides a wide threshold and narrow threshold adaptive switching mechanism, which can improve the flexibility and accuracy of judgment. When an electronic device such as a folding screen mobile phone is determined to be in a stationary state, a stationary detection is performed in combination with the data obtained by the accelerometer. When the electronic device is in a relatively stationary state, the hinge angle algorithm module adopts or switches to a narrow threshold recognition (easy to exit the vertical state), that is, it determines whether the electronic device meets the first exit condition, which makes the vertical state easier to be recognized and exited, thereby facilitating the rapid switching of the screen display. On the contrary, even in the case of a narrow threshold recognition of whether the electronic device exits the vertical state, if the electronic device is still in the vertical state for a long time, the hinge angle algorithm module will adjust the screen switching strategy, and use the device detected by the Hall effect sensor (hall sensor) to switch the display screen (the subsequent embodiment will be explained), which can avoid the problem of the inability to adaptively switch the display screen due to the device being in a vertical state for a long time, improve the user experience of the folding screen device in different usage scenarios, and make the switching of the display screen more in line with the actual usage of the user.

[0329] Taking the foldable screen mobile phone as an example, a magnet can be set on the first body of the foldable screen mobile phone, and a Hall sensor can be set on the second body, and the magnet and the Hall sensor can be combined to detect the change of the magnetic field. When the electronic device is folded or unfolded, the strength and direction of the magnetic field will change, so that it can be determined whether the foldable screen mobile phone is in a folded state or an unfolded state. By providing a display switching method that comprehensively utilizes an accelerometer and a Hall sensor to optimize the screen switching accuracy of the foldable screen mobile phone, the display switching response rate of the foldable screen mobile phone in different postures can be improved, thereby improving the user experience.

[0330] See also Fig.15 , Fig.15 A schematic diagram of the interaction process of an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided as an example of the present application. As an optional implementation, after the hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, the method further includes:

[0331] S1230: The hinge angle algorithm module reports the calculated hinge angle and the updated estimated error value to the AP.

[0332] S1240, the AP determines a folding state flag based on the hinge angle and the updated estimated error value.

[0333] S1250: If the AP determines that the electronic device is in the folded state based on the folding state flag, a user interface is displayed on the first display screen.

[0334] S1260: If the AP determines that the electronic device is in the unfolded state based on the folding state flag, a user interface is displayed on the second display screen.

[0335] Through the above-mentioned method steps S1230 to S1260, the example of the present application can determine the first moment T1, the second moment T2, the third moment T3, the fourth moment T4, the fifth moment T5, and the sixth moment T6 to determine whether the electronic device is in a folded state or an unfolded state, and when the electronic device is in a folded state or an unfolded state, during the process of the user unfolding the electronic device, the first display screen or the second display screen is specifically used to display the interface.

[0336] In the example of the present application, after the hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, the hinge angle algorithm module reports the calculated hinge angle and the updated estimated error value to the application processor AP. The AP determines a folding state flag based on the received hinge angle and the estimated error value, and the folding state flag is used to indicate whether the device is currently in a folded state or an unfolded state. If the AP determines that the electronic device is in a folded state, the first display screen will display the user interface; if the AP determines that the electronic device is in an unfolded state, the second display screen will display the user interface.

[0337] When the electronic device is in a vertical state, the electronic device adjusts the display of the user interface according to its physical state (folded or unfolded), thereby providing a more intuitive and adaptable user experience. For example, when the electronic device is folded, only a smaller display or external display may be available, and when the electronic device is unfolded, a larger internal display may be used. In this way, the electronic device can ensure that the user always sees relevant information and interfaces on the most appropriate screen, regardless of whether the electronic device is folded or unfolded.

[0338] See also Fig.16 , Fig.16 A schematic diagram of the interaction flow of an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided as an example of this application. The application processor AP includes a sensor hardware abstraction layer and a folding machine display management service layer to collaboratively determine the folding state of the electronic device. Specifically, the sensor hardware abstraction layer is responsible for handling low-level hardware interactions and data processing, while the folding machine display management service layer is responsible for making high-level decisions based on these data, such as the display state of the user interface. This layered architecture helps improve the efficiency and reliability of the system, and also makes the system easier to maintain and upgrade.

[0339] In one implementation, see Fig.16 , the AP determines the folding state flag based on the hinge angle and the updated estimated error value, including:

[0340] S12401, if the sensor hardware abstraction layer determines that the updated estimated error value is less than the error threshold, the hinge angle is reported to the folding machine display management service layer on the AP;

[0341] S12402, the folding machine display management service layer determines the folding state flag of the electronic device based on the hinge angle.

[0342] In addition, if the sensor hardware abstraction layer determines that the updated estimated error value is greater than or equal to the error threshold, the hinge angle is not reported to the folding machine display management service layer.

[0343] If the sensor hardware abstraction layer determines that the updated estimated error value is less than the error threshold, the hinge angle will be reported to the folding machine display management service layer in the AP. The folding machine display management service layer then determines the folding state flag of the electronic device based on the received hinge angle, ensuring that the electronic device can adjust the display of the user interface according to its physical state (folded or unfolded).

[0344] If the sensor hardware abstraction layer determines that the updated estimated error value is greater than or equal to the error threshold, the hinge angle will not be reported to the folding device display management service layer. This means that only when the estimated error value is within an acceptable range will the hinge angle data be used for further processing and display state decisions, which can prevent inaccurate state judgments caused by excessive errors and ensure that the display screen that displays the user interface is dynamically adjusted according to the folding state of the folding screen device.

[0345] In one implementation, the folding machine display management service layer is responsible for monitoring the folding state of the electronic device and updating the display interface according to the change of the folding state. The folding machine display management service layer checks the folding state flag to determine whether the folding state of the electronic device has changed. If the folding state of the electronic device has changed, and the folding state flag indicates that the device is in the folded state, the folding machine display management service layer will display the user interface on the first display screen, ensuring that when the user folds or unfolds the electronic device, the user interface can respond in time and present the user interface on the corresponding display screen.

[0346] In one implementation, if the folding state of the electronic device changes, and the folding state flag indicates that the device is in the unfolded state, the folding machine display management service layer will display the user interface on the second display screen, ensuring that when the user folds or unfolds the electronic device, the user interface can respond in time and present the user interface on the corresponding display screen.

[0347] Exemplarily, in an optional embodiment, the Hall sensor is generally used to detect changes in the magnetic field, such as proximity switches, position detection, etc.

[0348] In an alternative implementation, see Fig.17 , Fig.17 The present application example provides a schematic diagram of the interaction process between an application processor AP and an enhanced digital signal processor ADSP in an electronic device. The above method also includes:

[0349] S1601: When the electronic device does not meet the exit condition, start the timer through the hinge angle algorithm module.

[0350] S1602, when the timer exceeds a predetermined time and the electronic device remains in a vertical state, obtaining voltage data from the Hall sensor driver through a hinge angle algorithm module, wherein the voltage data is collected by a Hall sensor connected to the Hall sensor driver on the electronic device, and the voltage data is used to determine whether the electronic device is folded or unfolded;

[0351] S1603: The hinge angle algorithm module reports the voltage data and the vertical state flag to the AP, wherein the vertical state flag is used to indicate that the electronic device is in the vertical state.

[0352] S1604, if the AP determines based on the voltage data that the electronic device is in a folded state, displaying a user interface on the first display screen;

[0353] S1605: If the AP determines based on the voltage data that the electronic device is in the unfolded state, a user interface is displayed on the second display screen.

[0354] Through the above steps S1601 to 1605, when the timer exceeds the predetermined time and the electronic device remains in the vertical state, the hinge angle algorithm module is used to obtain voltage data from the Hall sensor drive, so as to achieve at the second moment T2, in response to the user unfolding the electronic device, obtaining the voltage data detected by the Hall sensor; thereafter, the AP side determines that the electronic device is unfolded based on the voltage data; and displays the user interface on the second display screen.

[0355] It should be understood that the vertical state flag means that after each time the electronic device turns on the screen, ADSP only performs a vertical state judgment once after the screen is turned on, and the flag is true at this time; once the screen is turned on this time, the electronic device exits the vertical state, the vertical state flag becomes false, and no vertical state judgment is performed anymore, and it is considered that the electronic device has exited the vertical state until the electronic device turns off the screen and then turns the screen on again, at which time the vertical state flag is updated to true.

[0356] In an optional implementation, if the electronic device does not meet the exit condition, the hinge angle algorithm module will start a timer. If the timer exceeds the predetermined time and the electronic device remains in a vertical state, the hinge angle algorithm module will obtain voltage data from the Hall sensor driver; these voltage data are collected by the Hall sensor on the device and are used to determine whether the device is in a folded or unfolded state; the hinge angle algorithm module will report the voltage data and the vertical state flag to the application processor AP, and the vertical state flag is used to indicate that the electronic device is currently in a vertical state.

[0357] If the AP determines that the device is in a folded state based on the voltage data, the user interface is displayed on the first display screen. If the AP determines that the device is in an unfolded state based on the voltage data, the user interface is displayed on the second display screen. Hall sensors are generally used to detect changes in magnetic fields, such as proximity switches, position detection, etc.

[0358] After the hinge angle algorithm module starts the timer, if it is determined that the electronic device exits the vertical state, the hinge angle algorithm module stops the timer. After the timer reaches a predetermined time (for example, 10S, 15S, etc.), it returns to execute based on the detection result to determine the exit condition satisfied by the electronic device until the electronic device exits the vertical state or the timer exceeds the predetermined time.

[0359] In an optional implementation, the application processor (AP) includes a folding machine display management service layer, which can determine the state of the electronic device based on the voltage data: if the voltage data indicates that the device is in a folded state, the folding machine display management service layer will display the user interface on the first display screen. On the contrary, if the voltage data indicates that the device is in an unfolded state, the user interface is displayed on the second display screen. Through the above method, an electronic device with two or more display screens and usage modes can intelligently switch the display screen according to its physical state (folded or unfolded), thereby improving the user experience.

[0360] The following is combined with Fig.18 , specifically explains how to determine the display screen that displays the user interface when the electronic device meets the exit conditions and does not meet the exit conditions. Fig.18 , Fig.18 A schematic diagram of the interaction flow between an application processor AP and an enhanced digital signal processor ADSP in an electronic device provided as an example of the present application.

[0361] S1801: The hinge angle algorithm module calculates an estimated error value based on the acceleration component in the direction of the Y coordinate axis.

[0362] S1802: When the estimated error value is greater than or equal to the error threshold, the hinge angle algorithm module performs vertical entry detection on the electronic device based on the acceleration component in the direction of the Y coordinate axis.

[0363] S1803: When the electronic device meets the vertical entry condition, a stationary detection is performed on the electronic device to obtain a detection result.

[0364] S1804a: When the detection result shows that the electronic device is in a stationary state, determine whether the electronic device satisfies a first exit condition.

[0365] S1805a: When the detection result shows that the electronic device is not in a stationary state, determine that the electronic device satisfies a second exit condition.

[0366] S1806: When the electronic device meets the exit condition, determine that the electronic device exits the vertical state, and update the estimated error value.

[0367] S1807: The hinge angle algorithm module calculates a hinge angle between the first body and the second body based on the sensor data.

[0368] S1808, the hinge angle algorithm module reports the calculated hinge angle and the updated estimated error value to the AP.

[0369] S1809, the AP determines the folding state flag based on the hinge angle and the updated estimated error value.

[0370] S1810, if the AP determines that the electronic device is in a folded state based on the folding state flag, the user interface is displayed on the first display screen; if the AP determines that the electronic device is in an unfolded state based on the folding state flag, the user interface is displayed on the second display screen.

[0371] S1804b: When the detection result shows that the electronic device is in a stationary state, determine that the electronic device does not satisfy the first exit condition.

[0372] S1805b: When the detection result shows that the electronic device is not in a stationary state, determine that the electronic device does not satisfy a second exit condition.

[0373] S1811: When the electronic device does not meet the exit condition, start the timer through the hinge angle algorithm module.

[0374] S1812, when the timer exceeds a predetermined time and the electronic device remains in a vertical state, voltage data is obtained from the Hall sensor driver through the hinge angle algorithm module.

[0375] S1813: The hinge angle algorithm module reports the voltage data and the vertical state flag to the AP.

[0376] S1814, if the AP determines based on the voltage data that the electronic device is in a folded state, then the user interface is displayed on the first display screen; if the AP determines based on the voltage data that the electronic device is in an unfolded state, then the user interface is displayed on the second display screen.

[0377] Through the above example, when the electronic device meets the exit condition and exits the vertical state, the hinge angle algorithm module is used to calculate the hinge angle between the first body and the second body based on the sensor data, and then the folding state flag is determined in the AP based on the hinge angle and the updated estimated error value. If the electronic device is determined to be in the folded state based on the folding state flag, the user interface is displayed on the first display screen; if the electronic device is determined to be in the unfolded state based on the folding state flag, the user interface is displayed on the second display screen. And, when the electronic device does not meet the exit condition, the timer is started by the hinge angle algorithm module. When the timer exceeds the predetermined time and the electronic device remains in the vertical state, the voltage data is obtained from the Hall sensor drive by the hinge angle algorithm module. Then, the AP determines that the electronic device is in the folded state based on the voltage data, and then the user interface is displayed on the first display screen; the AP determines that the electronic device is in the unfolded state based on the voltage data, and then the user interface is displayed on the second display screen. In this way, the problem that the display screen cannot be switched adaptively due to the device being in the vertical state for a long time can be avoided, and the user experience of the folding screen device in different usage scenarios is improved, so that the switching of the display screen is more in line with the actual usage of the user.

[0378] According to an embodiment of the present application, based on the above-mentioned interface display method embodiment, an electronic device is also provided, the electronic device comprising a hinge, a first body and a second body, the hinge being used to link the first body and the second body; an enhanced digital signal processor ADSP being used to call an interface display method such as and determine a hinge angle between the first body and the second body; an application processor AP communicating with the ADSP based on an inter-core communication interface, being used to call an interface display method such as any one of the items, determining that the electronic device is in a folded state based on the hinge angle, and displaying a user interface on a first display screen; determining that the electronic device is in an unfolded state based on the hinge angle, and displaying a user interface on a second display screen.

[0379] Combined with the above Figure 2From the schematic block diagram of an electronic device 100 shown, it can be seen that the software architecture of the electronic device includes: an application processor (AP), the hardware architecture includes an enhanced digital signal processor ADSP, the application framework layer in the AP can be a sensor framework layer (sensor FWK), the hardware abstraction layer is specifically a sensor hardware abstraction layer (sensor HAL), and the sensor HAL can include: a hinge angle sensor hardware abstraction layer (hinge_angle.cpp) and a Hall sensor hardware abstraction layer (extend_hall.cpp).

[0380] The hardware architecture ADSP includes: hinge angle algorithm module (hinge_angle aglo), angle sensor driver (hinge_angledriver), Hall sensor driver (extend_hall driver). ADSP can also be equipped with multiple external components or additional components, such as Hall sensor, accelerometer sensor ACC and gyroscope sensor GYRO, etc. These sensors are directly connected to the corresponding drivers in ADSP.

[0381] It should be understood that in the example of the present application, the driver on the ADSP is used to communicate directly with the hardware. For example, the driver on the ADSP may also include at least a display driver, a camera driver, and a sensor driver. The hardware on the ADSP may include devices such as a camera, a display, a microphone, a processor, and a memory.

[0382] Since the communication between AP and ADSP is achieved through the inter-core communication interface QMI, based on the above architecture, an interface display method such as any one of the above is called. In the foldable screen device, on the ADSP side, a sensor driver (hinge_angledriver) is used to obtain sensor data of the electronic device collected by the sensor, such as the acceleration component in the direction of the coordinate axis and the angular velocity component around the coordinate axis, and the hinge angle algorithm module (hinge_angle aglo) determines the hinge angle of the electronic device, that is, the folding angle, based on the above sensor data, and then the AP side determines whether the electronic device is in a folded state or an unfolded state based on the hinge angle calculated by the ADSP side.

[0383] Furthermore, the electronic device can be determined to be in a folded state based on the hinge angle, and the user interface can be displayed on the first display screen; the electronic device can be determined to be in an unfolded state based on the hinge angle, and the user interface can be displayed on the second display screen. Even in a vertical state, the electronic device can still intelligently switch the display screen according to the change of its physical form (folded or unfolded), thereby providing a flexible user experience.

[0384] Fig.19This is a schematic diagram of the structure of an interface display device provided in an embodiment of the present application. The device can be implemented by software, hardware or a combination of both to become part or all of a computer device, and is applied to an electronic device. The electronic device includes a hinge, a first body and a second body, and the hinge is used to connect the first body and the second body; the computer device can be any electronic device in the examples of the present application. Fig.19 , the interface display device comprises:

[0385] The first display unit 1901 is used for, at a first moment, in response to a screen-lighting operation by a user, lighting up the screen of the electronic device and displaying a user interface on a first display screen. At the first moment, the electronic device is in a folded state;

[0386] The second display unit 1902 is configured to display a user interface on a second display screen in response to the user unfolding the electronic device at a second moment, wherein the hinge angle between the first body and the second body is a first angle, the electronic device is in a vertical state, and the second moment is after the first moment;

[0387] The third display unit 1903 is used for displaying the user interface on the first display screen at a third moment in response to the user folding the electronic device. At the third moment, the electronic device is in a vertical state.

[0388] The fourth display unit 1904 is used to display the user interface on the first display screen at a fourth moment after the user unfolds the electronic device. At the fourth moment, the hinge angle between the first body and the second body is the first angle, the display area of ​​the second display screen is larger than the display area of ​​the first display screen, and the fourth moment is after the third moment.

[0389] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0390] At a fifth moment, in response to the user unfolding the electronic device, the user interface is displayed on the second display screen. At the fifth moment, the hinge angle between the first body and the second body is a second angle, which is greater than the first angle. The fifth moment is after the first moment or the third moment.

[0391] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0392] At the sixth moment, after the user unfolds the electronic device, the user interface is displayed on the first display screen. At the sixth moment, the hinge angle between the first body and the second body is the first angle, the electronic device is in a vertical state, and the sixth moment is between the first moment and the second moment.

[0393] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the second display unit is further used for:

[0394] At the second moment, in response to the user unfolding the electronic device, based on the electronic device being in a vertical state and the duration between the second moment and the first moment being greater than a preset duration, a user interface is displayed on the second display screen.

[0395] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the second display unit is further used for:

[0396] At a second moment, in response to the user unfolding the electronic device, voltage data detected by the Hall sensor is acquired;

[0397] determining electronic device deployment based on the voltage data;

[0398] The user interface is displayed on the second display screen.

[0399] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the fourth display unit is further used for:

[0400] At the fourth moment, after the user unfolds the electronic device and determines that the electronic device is not in a vertical state and the first angle is less than a preset angle, the user interface is displayed on the first display screen.

[0401] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the fifth display unit is further used for:

[0402] At a fifth moment, in response to the user unfolding the electronic device, when it is determined that the electronic device is not in a vertical state and the second angle is greater than a preset angle, a user interface is displayed on the second display screen.

[0403] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the sixth display unit is further used for:

[0404] At the sixth moment, after the user unfolds the electronic device and it is determined that the electronic device is in a vertical state, and when the duration between the sixth moment and the first moment is less than a preset duration, the user interface is displayed on the first display screen.

[0405] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the electronic device includes an application processor AP and an enhanced digital signal processor ADSP, and the above device is also used for:

[0406] In response to the user's screen-on operation, a monitoring request is sent to the ADSP through the AP, where the monitoring request is used to request the ADSP to monitor the hinge angle between the first body and the second body, and the AP and the ADSP communicate based on the inter-core communication interface;

[0407] When the ADSP receives the monitoring request, the hinge angle between the first body and the second body is calculated based on the sensor data sent by the sensor of the electronic device.

[0408] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the ADSP includes a hinge angle algorithm module and at least one angle sensor driver; the above device is also used for:

[0409] When the hinge angle algorithm module receives the monitoring request, it sends a sensor data reporting request to at least one angle sensor driver;

[0410] When at least one angle sensor driver receives a sensor data reporting request, the sensor data is reported to the hinge angle algorithm module at a fixed frequency;

[0411] The hinge angle algorithm module calculates a hinge angle between the first body and the second body based on the sensor data.

[0412] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the sensor data includes: an acceleration component in a direction toward the coordinate axis and an angular velocity component in a direction around the coordinate axis; the above-mentioned device is also used for:

[0413] The hinge angle algorithm module performs filtering processing on the acceleration component in the direction of the coordinate axis according to the angular velocity component in the direction around the coordinate axis to obtain the hinge angle between the first fuselage and the second fuselage.

[0414] As an example of the present application, according to the first aspect, or any implementation method of the first aspect above, the above-mentioned device is also used for: a hinge angle algorithm module, which adopts a Kalman filter method to filter the acceleration component in the direction of the X-coordinate axis and the acceleration component in the direction of the Z-coordinate axis according to the angular velocity component in the direction around the Y-coordinate axis, so as to obtain the hinge angle between the first fuselage and the second fuselage.

[0415] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the sensor of the electronic device includes an acceleration sensor and a gyroscope sensor; the above device is also used for:

[0416] The original electrical signal reported by the acceleration sensor and the original electrical signal reported by the gyroscope sensor are received by driving at least one angle sensor;

[0417] The original electrical signal reported by the acceleration sensor is processed by at least one angle sensor to obtain the acceleration component in the direction of the coordinate axis;

[0418] Driven by at least one angle sensor, the original electrical signal reported by the gyroscope sensor is processed to obtain the angular velocity component around the coordinate axis.

[0419] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0420] The hinge angle algorithm module calculates an estimated error value based on the acceleration component in the direction of the Y coordinate axis, and the estimated error value is used to characterize the error value between the hinge angle calculated by the hinge angle algorithm module and the actual hinge angle;

[0421] When the estimated error value is greater than or equal to the error threshold, the hinge angle algorithm module performs vertical entry detection on the electronic device based on the acceleration component in the direction of the Y coordinate axis;

[0422] When the electronic device meets the vertical entry condition, a static detection is performed on the electronic device to obtain a detection result;

[0423] Based on the detection result, determining an exit condition satisfied by the electronic device;

[0424] When the electronic device meets the exit condition, determine that the electronic device exits the vertical state, and update the estimated error value, wherein the updated estimated error value is less than the error threshold;

[0425] After obtaining the updated estimated error value, the hinge angle between the first body and the second body is calculated based on the sensor data by the hinge angle algorithm module.

[0426] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the exit condition includes: a first exit condition and a second exit condition, and the constraint range of the first exit condition is smaller than the constraint range of the second exit condition; the above-mentioned device is also used for:

[0427] Based on the detection results, determine the exit conditions that the electronic device meets, including:

[0428] When the detection result shows that the electronic device is in a stationary state, based on the acceleration component in the direction of the Y coordinate axis being greater than a first threshold value, or the acceleration component in the direction of the Y coordinate axis being less than a second threshold value, it is determined that the electronic device meets a first exit condition, and the stationary state includes: an absolute stationary state and a uniform motion state;

[0429] When the detection result shows that the electronic device is not in a stationary state, based on the acceleration component in the direction of the Y-coordinate axis being greater than the third threshold value, or the acceleration component in the direction of the Y-coordinate axis being less than the fourth threshold value, it is determined that the electronic device meets the second exit condition, the first threshold value is less than the third threshold value, the second threshold value is less than the first threshold value, and the fourth threshold value is less than the second threshold value.

[0430] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0431] The hinge angle algorithm module reports the calculated hinge angle and updated estimated error value to the AP;

[0432] AP determines the folding state flag based on the hinge angle and the updated estimated error value;

[0433] If the AP determines that the electronic device is in the folded state based on the folded state flag, displaying the user interface on the first display screen;

[0434] If the AP determines that the electronic device is in the unfolded state based on the folding state flag, the user interface is displayed on the second display screen.

[0435] As an example of the present application, according to the first aspect, or any implementation of the first aspect above,

[0436] The AP includes: a sensor hardware abstraction layer and a folding machine display management service layer; the device is also used for:

[0437] If the sensor hardware abstraction layer determines that the updated estimated error value is less than the error threshold, the hinge angle is reported to the folding machine display management service layer on the AP;

[0438] The folding machine display management service layer determines the folding state flag of the electronic device based on the hinge angle.

[0439] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0440] If the sensor hardware abstraction layer determines that the updated estimated error value is greater than or equal to the error threshold, the hinge angle is not reported to the folding machine display management service layer.

[0441] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0442] The folding machine display management service layer determines whether the folding state of the electronic device has changed based on the folding state flag bit;

[0443] When the folding state of the electronic device changes, if the folding state flag indicates that the electronic device is in the folded state, the folding machine display management service layer displays the user interface on the first display screen.

[0444] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0445] The folding machine display management service layer determines whether the folding state of the electronic device has changed based on the folding state flag bit;

[0446] When the folding state of the electronic device changes, if the folding state flag indicates that the electronic device is in the unfolded state, the folding machine display management service layer displays the user interface on the second display screen.

[0447] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0448] When the electronic device does not meet the exit condition, the timer is started through the hinge angle algorithm module;

[0449] When the timer exceeds a predetermined time and the electronic device remains in a vertical state, voltage data is obtained from the Hall sensor driver through the hinge angle algorithm module, wherein the voltage data is collected by a Hall sensor connected to the Hall sensor driver on the electronic device, and the voltage data is used to determine whether the electronic device is folded or unfolded;

[0450] The hinge angle algorithm module reports the voltage data and the vertical state flag to the AP, wherein the vertical state flag is used to indicate that the electronic device is in the vertical state;

[0451] If the AP determines based on the voltage data that the electronic device is in a folded state, displaying a user interface on the first display screen;

[0452] If the AP determines that the electronic device is in the unfolded state based on the voltage data, the user interface is displayed on the second display screen.

[0453] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0454] When it is determined that the electronic device exits the vertical state, the hinge angle algorithm module stops the timing of the timer.

[0455] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0456] After the timer reaches a predetermined time, the process returns to the execution based on the detection result to determine the exit condition satisfied by the electronic device until the electronic device exits the vertical state or the timer exceeds a predetermined time.

[0457] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the AP includes a folding machine display management service layer; the device is also used for:

[0458] The folding machine display management service layer determines that the electronic device is in a folded state based on the voltage data and displays a user interface on the first display screen.

[0459] According to the first aspect, or any implementation of the first aspect above, the AP includes a folding machine display management service layer;

[0460] If the AP determines based on the voltage data that the electronic device is in the folded state, then displaying a user interface on the first display screen includes:

[0461] The folding machine display management service layer on the AP determines that the electronic device is in the unfolded state based on the voltage data and displays the user interface on the second display screen.

[0462] As an example of the present application, according to the first aspect, or any implementation of the first aspect above, the apparatus is further used for:

[0463] When it is determined that the estimated error value is less than the error threshold, the hinge angle between the first body and the second body is calculated based on the sensor data by the hinge angle algorithm module.

[0464] It should be noted that: the interface display device provided in the above embodiment only uses the division of the above-mentioned functional modules as an example when the folding screen device switches the display screen. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0465] The functional units and modules in the above embodiments may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit, and the above integrated units may be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present application.

[0466] The interface display device and the interface display method embodiments provided in the above embodiments belong to the same concept. The specific working process of the units and modules in the above embodiments and the technical effects brought about can be found in the method embodiment part and will not be repeated here.

[0467] An embodiment of the present application further provides an electronic device, the electronic device comprising one or more processors and a memory;

[0468] The memory is coupled to one or more processors, and the memory is used to store computer program codes. The computer program codes include computer instructions. One or more processors call the computer instructions to enable the electronic device to execute the interface display method shown above.

[0469] The electronic device may be a mobile phone, a smart screen, a tablet computer, a wearable electronic device, an in-vehicle electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a projector, or a communication device such as a server, a storage device, a base station, or a smart car, etc. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0470] An embodiment of the present application also provides a computer-readable storage medium, in which computer instructions are stored; when the computer-readable storage medium is executed on an electronic device, the electronic device executes the interface display method shown above.

[0471] The aforementioned computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the aforementioned computer instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center via wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The aforementioned computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes one or more available media integrated therein. The aforementioned available media may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium, or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0472] The embodiment of the present application also provides a computer program product including computer instructions, which, when executed on an electronic device, enables the electronic device to execute the interface display method shown above.

[0473] The computer storage medium and computer program product provided in the above-mentioned embodiments of the present application are used to execute the method provided above. Therefore, the beneficial effects that can be achieved can refer to the corresponding beneficial effects of the method provided above, and will not be repeated here.

[0474] In the above embodiments, it can also be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The above-mentioned computer program product includes one or more computer instructions. When the above-mentioned computer instructions are loaded and executed on a computer, the above-mentioned process or function according to the embodiment of the present application is generated in whole or in part. The above-mentioned computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The above-mentioned computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the above-mentioned computer instructions can be transmitted from a website site, computer, server or data center by wired (such as: coaxial cable, optical fiber, data subscriber line (Digital Subscriber Line, DSL)) or wireless (such as: infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The above-mentioned computer-readable storage medium can be any available medium that a computer can access, or a data storage device such as a server, data center, etc. that contains one or more available media integrated. The available media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, digital versatile discs (DVD)), or semiconductor media (eg, solid state disks (SSD)).

[0475] The above are optional embodiments provided for the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the technical scope disclosed in the present application shall be included in the protection scope of the present application.

[0476] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. An interface display method, characterized in that: Applied to an electronic device, the electronic device comprises a hinge, a first body and a second body, the hinge is used to connect the first body and the second body; the method comprises: At a first moment, in response to a screen-lighting operation by a user, the electronic device lights up the screen and displays a user interface on a first display screen. At the first moment, the electronic device is in a folded state; At a second moment, in response to the user unfolding the electronic device, the user interface is displayed on the second display screen, at the second moment, the hinge angle between the first body and the second body is a first angle, the electronic device is in a vertical state, and the second moment is after the first moment; At a third moment, in response to the user folding the electronic device, the user interface is displayed on the first display screen, and at the third moment, the electronic device is in a vertical state; At a fourth moment, after the user unfolds the electronic device, the user interface is displayed on the first display screen. At the fourth moment, the electronic device is not in a vertical state, the hinge angle between the first body and the second body is a first angle, the display area of ​​the second display screen is larger than the display area of ​​the first display screen, and the fourth moment is after the third moment.

2. The method according to claim 1, characterized in that The method further comprises: At a fifth moment, in response to the user unfolding the electronic device, the user interface is displayed on the second display screen. At the fifth moment, the electronic device is not in a vertical state, the hinge angle between the first body and the second body is a second angle, the second angle is greater than the first angle, and the fifth moment is after the first moment or the third moment.

3. The method according to claim 1, characterized in that The method further comprises: At the sixth moment, after the user unfolds the electronic device, the user interface is displayed on the first display screen. At the sixth moment, the hinge angle between the first body and the second body is the first angle, and the electronic device is in a vertical state. The sixth moment is between the first moment and the second moment.

4. The method according to claim 1, characterized in that At the second moment, in response to the user unfolding the electronic device, displaying the user interface on the second display screen includes: At the second moment, in response to the user unfolding the electronic device, when it is determined that the electronic device is in a vertical state and the time length between the second moment and the first moment is greater than a preset time length, the user interface is displayed on the second display screen.

5. The method according to claim 1, characterized in that At the second moment, in response to the user unfolding the electronic device, displaying the user interface on the second display screen includes: At the second moment, in response to the user unfolding the electronic device, acquiring voltage data detected by the Hall sensor; determining, based on the voltage data, that the electronic device is deployed; The user interface is displayed on the second display screen.

6. The method according to claim 1, characterized in that At the fourth moment, after the user unfolds the electronic device, displaying the user interface on the first display screen includes: At the fourth moment, after the user unfolds the electronic device, when it is determined that the electronic device is not in a vertical state and the first angle is less than a preset angle, the user interface is displayed on the first display screen.

7. The method according to claim 2, characterized in that At the fifth moment, in response to the user unfolding the electronic device, displaying the user interface on the second display screen includes: At the fifth moment, in response to the user unfolding the electronic device, when it is determined that the electronic device is not in a vertical state and the second angle is greater than a preset angle, the user interface is displayed on the second display screen.

8. The method according to claim 3, characterized in that At the sixth moment, after the user unfolds the electronic device, displaying the user interface on the first display screen includes: At the sixth moment, after the user unfolds the electronic device, it is determined that the electronic device is in a vertical state, and when the duration between the sixth moment and the first moment is less than a preset duration, the user interface is displayed on the first display screen.

9. The method according to any one of claims 1 to 8, characterized in that The electronic device includes an application processor AP and an enhanced digital signal processor ADSP, and the method further includes: In response to the screen-on operation of the user, sending a monitoring request to the ADSP through the AP, wherein the monitoring request is used to request the ADSP to monitor the hinge angle between the first body and the second body, and the AP and the ADSP communicate based on an inter-core communication interface; When the ADSP receives the monitoring request, the hinge angle between the first body and the second body is calculated based on the sensor data sent by the sensor of the electronic device.

10. The method according to claim 9, characterized in that The ADSP includes a hinge angle algorithm module and at least one angle sensor driver; The step of calculating the hinge angle between the first body and the second body based on sensor data sent by a sensor of the electronic device when the ADSP receives the monitoring request includes: When the hinge angle algorithm module receives the monitoring request, the hinge angle algorithm module sends a sensor data reporting request to the at least one angle sensor driver; When the at least one angle sensor driver receives the sensor data reporting request, reporting the sensor data to the hinge angle algorithm module at a fixed frequency; The hinge angle algorithm module calculates a hinge angle between the first body and the second body based on the sensor data.

11. The method according to claim 10, characterized in that The sensor data includes: an acceleration component in the direction of the coordinate axis and an angular velocity component in the direction around the coordinate axis; The hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, including: The hinge angle algorithm module performs filtering processing on the acceleration component in the direction toward the coordinate axis according to the angular velocity component in the direction around the coordinate axis to obtain the hinge angle between the first fuselage and the second fuselage.

12. The method according to claim 11, characterized in that The hinge angle algorithm module performs filtering processing on the acceleration component in the direction toward the coordinate axis according to the angular velocity component in the direction around the coordinate axis to obtain the hinge angle between the first fuselage and the second fuselage, including: The hinge angle algorithm module adopts the Kalman filtering method to filter the acceleration component in the direction of the X-coordinate axis and the acceleration component in the direction of the Z-coordinate axis according to the angular velocity component around the Y-coordinate axis, so as to obtain the hinge angle between the first fuselage and the second fuselage.

13. The method according to claim 11, characterized in that The sensor of the electronic device includes an acceleration sensor and a gyroscope sensor; the method further includes: The at least one angle sensor is driven to receive the original electrical signal reported by the acceleration sensor and the original electrical signal reported by the gyroscope sensor; The original electrical signal reported by the acceleration sensor is processed by the at least one angle sensor to obtain the acceleration component in the direction of the coordinate axis; The original electrical signal reported by the gyroscope sensor is processed by the at least one angle sensor drive to obtain the angular velocity component around the coordinate axis.

14. The method according to claim 11, characterized in that Before the hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, the method further includes: The hinge angle algorithm module calculates an estimated error value based on the acceleration component in the direction of the Y coordinate axis, and the estimated error value is used to represent the error value between the hinge angle calculated by the hinge angle algorithm module and the actual hinge angle; When the estimated error value is greater than or equal to the error threshold, the hinge angle algorithm module performs vertical entry detection on the electronic device based on the acceleration component in the direction of the Y coordinate axis; When the electronic device meets the vertical entry condition, performing a stationary detection on the electronic device to obtain a detection result; Based on the detection result, determining an exit condition satisfied by the electronic device; In a case where the electronic device satisfies the exit condition, determining that the electronic device exits the vertical state, and updating the estimated error value, wherein the updated estimated error value is less than the error threshold; After obtaining the updated estimated error value, the step of calculating the hinge angle between the first body and the second body based on the sensor data through the hinge angle algorithm module is performed.

15. The method according to claim 14, characterized in that The exit condition includes: a first exit condition and a second exit condition, wherein the constraint range of the first exit condition is smaller than the constraint range of the second exit condition; The determining, based on the detection result, an exit condition satisfied by the electronic device includes: When the detection result shows that the electronic device is in a stationary state, based on the acceleration component in the direction toward the Y coordinate axis being greater than a first threshold value, or the acceleration component in the direction toward the Y coordinate axis being less than a second threshold value, determining that the electronic device meets the first exit condition, the stationary state including: an absolute stationary state and a uniform motion state; When the detection result shows that the electronic device is not in a stationary state, determining that the electronic device meets a second exit condition based on that the acceleration component in the direction toward the Y coordinate axis is greater than a third threshold value, or the acceleration component in the direction toward the Y coordinate axis is less than a fourth threshold value; The first threshold value is smaller than the third threshold value, the second threshold value is smaller than the first threshold value, and the fourth threshold value is smaller than the second threshold value.

16. The method according to claim 15, characterized in that After the hinge angle algorithm module calculates the hinge angle between the first body and the second body based on the sensor data, the method further includes: The hinge angle algorithm module reports the calculated hinge angle and the updated estimated error value to the AP; The AP determines a folding state flag based on the hinge angle and the updated estimated error value; If the AP determines that the electronic device is in the folded state based on the folded state flag, displaying the user interface on the first display screen; If the AP determines that the electronic device is in the unfolded state based on the folding state flag, the user interface is displayed on the second display screen.

17. The method according to claim 16, characterized in that The AP includes: a sensor hardware abstraction layer and a folding machine display management service layer; The AP determines a folding state flag based on the hinge angle and the updated estimated error value, including: If the sensor hardware abstraction layer determines that the updated estimated error value is less than the error threshold, the hinge angle is reported to the folding machine display management service layer on the AP; The folding machine display management service layer determines the folding state flag of the electronic device based on the hinge angle.

18. The method according to claim 17, characterized in that The method further comprises: If the sensor hardware abstraction layer determines that the updated estimated error value is greater than or equal to the error threshold, the hinge angle is not reported to the folding machine display management service layer.

19. The method according to claim 17, characterized in that If the AP determines that the electronic device is in the folded state based on the folded state flag, displaying the user interface on the first display screen includes: The folding machine display management service layer determines whether the folding state of the electronic device has changed based on the folding state flag; In the case where the folding state of the electronic device changes, if the folding state flag indicates that the electronic device is in a folded state, the folding machine display management service layer displays the user interface on the first display screen.

20. The method of claim 17, wherein: If the AP determines that the electronic device is in the unfolded state based on the folding state flag, displaying the user interface on the second display screen includes: The folding machine display management service layer determines whether the folding state of the electronic device has changed based on the folding state flag; In the case where the folding state of the electronic device changes, if the folding state flag indicates that the electronic device is in the unfolded state, the folding machine display management service layer displays the user interface on the second display screen.

21. The method of claim 14, wherein: The method further comprises: When the electronic device does not meet the exit condition, starting a timer through the hinge angle algorithm module; When the timing of the timer exceeds a predetermined time and the electronic device remains in a vertical state, voltage data is obtained from the Hall sensor driver through the hinge angle algorithm module; wherein the voltage data is collected by a Hall sensor connected to the Hall sensor driver on the electronic device, and the voltage data is used to determine whether the electronic device is folded or unfolded; The hinge angle algorithm module reports the voltage data and the vertical state flag to the AP, wherein the vertical state flag is used to indicate that the electronic device is in a vertical state; If the AP determines that the electronic device is in a folded state based on the voltage data, displaying the user interface on the first display screen; If the AP determines that the electronic device is in the unfolded state based on the voltage data, the user interface is displayed on the second display screen.

22. The method according to claim 21, characterized in that After the hinge angle algorithm module starts the timer, the method further includes: When it is determined that the electronic device exits the vertical state, the hinge angle algorithm module stops the timing of the timer.

23. The method of claim 21, wherein: After the hinge angle algorithm module starts the timer, the method further includes: After the timing of the timer reaches the predetermined time length, the process returns to executing the process of determining the exit condition satisfied by the electronic device based on the detection result until the electronic device exits the vertical state or the timing of the timer exceeds the predetermined time length.

24. The method of claim 21, wherein: The AP includes a folding machine display management service layer; If the AP determines that the electronic device is in a folded state based on the voltage data, displaying the user interface on the first display screen includes: The folding machine display management service layer determines that the electronic device is in a folded state based on the voltage data, and displays the user interface on the first display screen.

25. The method of claim 21, wherein: The AP includes a folding machine display management service layer; If the AP determines that the electronic device is in a folded state based on the voltage data, displaying the user interface on the first display screen includes: The folding machine display management service layer on the AP determines that the electronic device is in the unfolded state based on the voltage data, and displays the user interface on the second display screen.

26. The method of claim 14, wherein: The method further comprises: In a case where it is determined that the estimated error value is less than the error threshold, the step of calculating, by the hinge angle algorithm module, a hinge angle between the first body and the second body based on the sensor data is performed.

27. An electronic device, characterized in that: The electronic device comprises a hinge, a first body and a second body, wherein the hinge is used to connect the first body and the second body; An enhanced digital signal processor ADSP, configured to call the method according to any one of claims 1 to 26 to determine a hinge angle between the first body and the second body; an application processor AP, communicating with the ADSP based on an inter-core communication interface, and configured to call the method according to any one of claims 1 to 26, determine that the electronic device is in a folded state based on the hinge angle, and display the user interface on the first display screen; The electronic device is determined to be in an unfolded state based on the hinge angle, and the user interface is displayed on the second display screen.

28. An electronic device, characterized in that: The electronic device includes: one or more processors, and a memory; The memory is coupled to the one or more processors, and the memory is used to store computer program codes, wherein the computer program codes include computer instructions, and the one or more processors call the computer instructions to enable the electronic device to perform the method as claimed in any one of claims 1 to 26.

29. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises instructions, which, when executed on an electronic device, cause the electronic device to perform the method as claimed in any one of claims 1 to 26.

Citation Information

Patent Citations

  • Display method of foldable electronic equipment and electronic equipment

    CN110620833A

  • Display method of folding screen and related device

    CN116257200A

  • Method for determining included angle of folding screen and related equipment thereof

    CN116366750A

  • Hinge angle detection method and related equipment

    CN116781809A

  • Collaborative display method and device and medium

    CN117111796A