Screen display method and related equipment

Abstract

The invention relates to a screen display method and related equipment. The method is applied to the terminal equipment. And under the condition that the inner screen is converted from the folded state to the unfolded state, the terminal equipment determines a first change value of a flip angle of the first screen and a second change value of a flip angle of the second screen, determines a screen display direction based on the first change value and the second change value, and displays screen content on the inner screen according to the screen display direction. According to the method and the device, the screen display direction of the to-be-displayed screen content can be determined according to the first change value of the flip angle of the first screen and the second change value of the flip angle of the second screen; therefore, the problem that the display direction of the screen content on the inner screen is easy to rotate under the condition that the inner screen of the terminal equipment is unfolded for displaying because the inner screen of the existing terminal equipment cannot recognize the posture (such as transverse unfolding or vertical unfolding) of the user for unfolding the inner screen according to the posture of the first screen and the posture of the second screen is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminals, and in particular to a screen display method and related equipment. BACKGROUND

[0002] With the continuous development of electronic devices and display screens, electronic devices with foldable display screens are increasingly applied in people's daily life and work. The foldable display screen can fully display various types of information (such as pictures, videos, games, etc.) in the interface, and also ensures that the size of the electronic device will not be too large to be inconvenient to carry. Taking a mobile phone as an example, at present, a mobile phone with a foldable screen includes an outer screen and an inner screen. The inner screen is a foldable screen inward. When the inner screen display screen content is unfolded, the display direction of the screen content on the inner screen is prone to rotation, causing inconvenience to users. SUMMARY

[0003] In view of the above, it is necessary to provide a screen display method, a terminal device, a storage medium and a computer program product to solve the technical problem of rotation of the display direction when the inner screen displays screen content.

[0004] In a first aspect, the embodiments of the present application provide a screen display method applied to a terminal device, the terminal device including an inner screen, the inner screen being a foldable screen and including a first screen and a second screen. The method includes: determining a first change value of a rotation angle of the first screen and a second change value of a rotation angle of the second screen in a case where the inner screen is changed from a folded state to an unfolded state; determining a screen display direction based on the first change value and the second change value; and displaying screen content on the inner screen according to the screen display direction. The above technical solution of the present application can determine the first change value of the rotation angle of the first screen and the second change value of the rotation angle of the second screen, and determine the screen display direction of the screen content to be displayed according to the first change value and the second change value, thereby solving the problem that in the case where there is only one acceleration sensor on the inner screen of the existing terminal device, the terminal device cannot obtain the posture of the first screen and the posture of the second screen, and cannot recognize the posture (such as horizontal or vertical) of the user unfolding the inner screen according to the posture of the first screen and the posture of the second screen, and further causing the display direction of the screen content on the inner screen to be prone to rotation in the case where the terminal device displays after unfolding the inner screen.

[0005] In some embodiments of the present application, in the case that the inner screen is transformed from the folded state to the unfolded state, determining the first change value of the rotation angle of the first screen and the second change value of the rotation angle of the second screen comprises: obtaining the first rotation angle of the first screen and the first rotation angle of the second screen in the case that the inner screen is in the folded state; obtaining the second rotation angle of the first screen and the second rotation angle of the second screen in the case that the inner screen is in the unfolded state; determining the absolute value of the rotation angle difference value of the first screen as the first change value based on the first rotation angle and the second rotation angle of the first screen; and determining the absolute value of the rotation angle difference value of the second screen as the second change value based on the first rotation angle and the second rotation angle of the second screen. The above technical solution can accurately determine the change of the rotation angle of the first screen based on the first rotation angle and the second rotation angle of the first screen, and accurately determine the change of the rotation angle of the second screen based on the first rotation angle and the second rotation angle of the second screen in the case that the inner screen is transformed from the folded state to the unfolded state.

[0006] In some embodiments of the present application, determining the screen display direction based on the first change value and the second change value comprises: taking the absolute value of the difference between the first change value and the second change value to obtain a target difference value; if the target difference value is within a preset angle range, determining the screen display direction as a vertical display direction; and if the target difference value is not within the preset angle range, determining the screen display direction as a horizontal display direction. The above technical solution can accurately determine the screen display direction based on the target difference value between the first change value of the rotation angle of the first screen and the second change value of the rotation angle of the second screen, and the preset angle range.

[0007] In some embodiments of the present application, the method further comprises: determining the hinge angle between the first screen and the second screen according to the obtained first magnetic sensor data and second magnetic sensor data, and determining that the inner screen is transformed from the folded state to the unfolded state if the hinge angle is greater than or equal to a preset angle. The above technical solution can accurately determine the state of the inner screen according to the obtained hinge angle between the first screen and the second screen.

[0008] In some embodiments of the present application, displaying the screen content on the inner screen according to the screen display direction comprises: displaying the screen content on the inner screen according to the vertical display direction if it is determined that the screen display direction is a vertical display direction; and displaying the screen content on the inner screen according to the horizontal display direction if it is determined that the screen display direction is a horizontal display direction. The above technical solution can accurately determine the screen display direction of the inner screen according to the unfolded posture of the first screen and the second screen, and solve the problem that the display direction of the screen content on the inner screen is prone to rotation.

[0009] In some embodiments of this application, displaying screen content on the inner screen according to the screen display orientation includes: when displaying screen content on the inner screen according to the vertical display orientation, detecting the pitch angle and flip angle of the inner screen; if the pitch angle is less than a first preset angle and the flip angle is greater than a second preset angle, changing the display of screen content from the vertical display orientation to the horizontal display orientation. The above technical solution, when displaying screen content on the inner screen according to the vertical display orientation, can accurately determine the current posture of the terminal device based on the pitch angle and flip angle of the inner screen, and display screen content according to the display orientation corresponding to the current posture of the terminal device, thereby improving the user experience.

[0010] In some embodiments of this application, displaying screen content on the inner screen according to the screen display orientation includes: when displaying screen content on the inner screen according to the horizontal display orientation, detecting the pitch angle and flip angle of the inner screen; if the pitch angle is less than a third preset angle and the flip angle is greater than a fourth preset angle, changing the display of screen content from the horizontal display orientation to the vertical display orientation. The above technical solution, when displaying screen content on the inner screen according to the horizontal display orientation, can accurately determine the current posture of the terminal device based on the pitch angle and flip angle of the inner screen, and display screen content according to the display orientation corresponding to the current posture of the terminal device, thereby improving the user experience.

[0011] In some embodiments of this application, the pitch angle of the inner screen is the same as that of the first screen or the second screen, and the flip angle of the inner screen is the same as that of the first screen or the second screen.

[0012] In some embodiments of this application, the method further includes: if the external screen of the terminal device displays interface content, the displayed content is used as the screen content; if the external screen is in a screen-off state, the lock screen interface is used as the screen content.

[0013] Secondly, embodiments of this application provide a terminal device, which includes a memory and a processor: the memory is used to store program instructions; the processor is used to read and execute the program instructions stored in the memory, and when the program instructions are executed by the processor, the terminal device performs the above-described screen display method.

[0014] Thirdly, some embodiments of this application provide a chip including a processor and a memory; wherein the processor is connected to the memory; the memory is used to store program instructions; and the processor is used to read the program instructions stored in the memory to implement the above-described screen display method.

[0015] Fourthly, some embodiments of this application provide a computer storage medium storing program instructions that, when executed on a terminal device, cause the terminal device to perform the aforementioned screen display method.

[0016] Fifthly, some embodiments of this application provide a computer program product, including computer program instructions, which, when executed by a processor, implement the screen display method described above.

[0017] Furthermore, the technical effects brought about by the second to fifth aspects can be found in the descriptions of the methods in the above-mentioned method section, and will not be repeated here. Attached Figure Description

[0018] Figures 1(a)-1(c) This is a schematic diagram of a mobile phone provided in an embodiment of this application.

[0019] Figure 2 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application.

[0020] Figure 3 A software structure block diagram of a terminal device provided in an embodiment of this application.

[0021] Figure 4 The software and hardware workflow for displaying screen content on an inner screen is provided in one embodiment of this application.

[0022] Figure 5 A flowchart of a screen display method provided in an embodiment of this application.

[0023] Figure 6 This is a schematic diagram of the attitude angle of a terminal device provided in an embodiment of this application.

[0024] Figure 7 This is a schematic diagram of the inner screen of a terminal device provided in an embodiment of this application changing from a folded state to an unfolded state.

[0025] Figure 8(a) is a schematic diagram of the inner screen of a vertically unfolding mobile phone provided in an embodiment of this application.

[0026] Figure 8(b) is a schematic diagram of the inner screen of a horizontally unfolded mobile phone provided in an embodiment of this application.

[0027] Figure 9 A flowchart of a screen display method provided in another embodiment of this application.

[0028] Figure 10 A flowchart of a screen display method provided in another embodiment of this application. Detailed Implementation

[0029] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of some embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in some embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0030] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. The terminology used in this application's specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. It should be understood that, unless otherwise stated, " / " in this application means "or". For example, A / B can mean A or B. In some embodiments of this application, "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. "At least one" refers to one or more. "More than one" refers to two or more. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, and a, b, and c (seven cases).

[0031] With the continuous development of electronic devices and displays, electronic devices with foldable displays are increasingly being used in people's daily lives and work. Foldable displays can fully display various types of information on the interface (such as pictures, videos, games, etc.) while ensuring that the size of the electronic device is not too large to be inconvenient to carry.

[0032] For clarity, we will use a foldable phone as an example. The foldable screen in the phone will be considered as the inner screen. For example, please refer to... Figures 1(a)-1(c)Figure 1(a) is a schematic diagram of a mobile phone provided in an embodiment of this application. The inner screen is a foldable screen, and the phone in Figure 1(a) is in the unfolded state. The inner screen may include a first screen, a second screen, and a hinge. The first and second screens are connected by the hinge. The first and second screens can rotate around the hinge. The first and second screens can be folded and unfolded via the hinge. The unfolded inner screen can be folded inward along the hinge in the direction shown in Figure 1(b), forming a half-folded or half-unfolded state as shown in Figure 1(b). Further folding can form the state shown in Figure 1(c), and it can be further folded until the inner screen is completely folded, putting the phone in a folded state. After the inner screen is completely folded, the first and second screens are in opposite directions and are not visible to the user.

[0033] In some embodiments of this application, the inward-folding mobile phone also includes a display screen, which can be referred to as an outer screen, on the back of the inner screen. The outer screen can be located on the back of the inner screen. For example, as shown in Figure 1(c), the outer screen can be located on the back of the first screen. The outer screen shown in Figure 1(c) is only one example of an outer screen; the position (e.g., it could also be the back of a second screen), screen size (e.g., full screen, half screen, etc.), and screen shape can be set according to actual needs, such as a rectangle, square, trapezoid, ellipse, etc. Figures 1(a)-1(c) This involves folding the inner screen of the phone vertically, that is, folding it along the horizontal folding edge of the inner screen to form two screens (i.e., the first screen and the second screen). In some other embodiments of this application, the inner screen of the phone can also be folded horizontally, that is, folding it along the vertical folding edge of the inner screen to form two screens (i.e., the first screen and the second screen).

[0034] Mobile phones can be folded into various forms: folded, unfolded, and semi-folded (or semi-unfolded). In the embodiments of this application, when the phone is in the folded state, the inner screen is completely folded, and the first and second screens are attached together (in contact or not in contact). The first and second screens are not visible to the user; that is, the inner screen is invisible to the user, while the outer screen is visible. In the embodiments of this application, when the phone is in the unfolded state, the first and second screens are essentially on the same plane and are visible to the user. The outer screen and inner screen are positioned on opposite sides of the phone. For example, the inner screen faces the user, and the outer screen faces away from the user. Alternatively, in other usage scenarios, the inner screen may face away from the user, and the outer screen may face the user.

[0035] However, when converting a phone from a folded to an unfolded state and displaying content on the inner screen, the display orientation of the content on the inner screen can easily rotate, causing inconvenience for the user. For example, when converting a phone from a folded to an unfolded state, because the phone cannot recognize whether the inner screen is unfolded horizontally or vertically, the display orientation of the video content on the inner screen may not match the screen's orientation. This causes the video content on the inner screen to rotate to match the screen's orientation, resulting in inconvenience for the user and affecting the user experience.

[0036] In view of the above-mentioned problems, this application provides a screen display method to solve the technical problem of the display direction rotating when the inner screen displays screen content.

[0037] The screen display method described herein is applied to various terminal devices. In this embodiment, a mobile phone is used as an example for illustration. In other embodiments, the terminal device may also be a tablet computer, e-reader, remote control, personal computer (PC), laptop computer, personal digital assistant (PDA), in-vehicle device, smart TV, wearable device, television set, or other electronic products with a display interface, as well as smartwatches, smart bracelets, and other smart display wearable products. This embodiment does not impose any special limitations on the form of the aforementioned terminal device.

[0038] refer to Figure 2 The diagram shown is a structural schematic of a terminal device provided in an embodiment of this application. In this embodiment, the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0039] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0040] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0041] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0042] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0043] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0044] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the terminal device 100.

[0045] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.

[0046] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0047] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.

[0048] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the shooting function of the terminal device 100. The processor 110 and the display screen 194 communicate via the DSI interface to enable the display function of the terminal device 100.

[0049] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0050] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge terminal device 100, and can also be used for data transfer between terminal device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other terminal devices 100, such as AR devices.

[0051] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may also adopt different interface connection methods or a combination of multiple interface connection methods as described in the above embodiments.

[0052] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the terminal device 100. While charging the battery 142, the charging management module 140 can also supply power to the terminal device 100 via the power management module 141.

[0053] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0054] The wireless communication function of the terminal device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0055] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0056] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the terminal device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0057] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0058] The wireless communication module 160 can provide solutions for wireless communication applications on the terminal device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0059] In some embodiments, antenna 1 of terminal device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling terminal device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0060] Terminal device 100 implements display functions through a GPU, display screen 194, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0061] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0062] Terminal device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0063] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0064] Camera 193 is used to capture still images or videos and can be understood as an image sensor. An object passes through the lens to generate an optical image projected onto a photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to an ISP (Internet Service Provider) for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP (Digital Signal Processor) for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the terminal device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0065] A digital signal processor (DSP) is used to process digital signals. Besides digital image signals, it can also process other digital signals. For example, when terminal device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0066] Video codecs are used to compress or decompress digital video. Terminal device 100 may support one or more video codecs. Thus, terminal device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0067] NPU stands for Neural Network (NN) Computing Processor. By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in terminal devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0068] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM).

[0069] Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), and double data rate synchronous dynamic random access memory (DDR SDRAM, such as fifth-generation DDR SDRAM, which is generally called DDR5 SDRAM). Non-volatile memory can include disk storage devices and flash memory.

[0070] Flash memory can be classified according to its operating principle, including NOR FLASH, NAND FLASH, 3D NAND FLASH, etc.; according to the level of the storage cell, including single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc.; and according to the storage specification, including universal flash storage (UFS) and embedded multimedia card (eMMC), etc.

[0071] The random access memory can be directly read and written by the processor 110. It can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data.

[0072] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110.

[0073] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of the terminal device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, music, video, and other files can be stored in the external non-volatile memory.

[0074] Internal memory 121 or external memory interface 120 is used to store one or more computer programs. The one or more computer programs are configured to be executed by processor 110. The one or more computer programs include multiple instructions, which, when executed by processor 110, can implement the screen display method on terminal device 100 in the above embodiments to realize the screen display function of terminal device 100.

[0075] Terminal device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0076] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0077] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The terminal device 100 can listen to music or make hands-free calls through the speaker 170A.

[0078] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the terminal device 100 answers a phone call or voice message, the receiver 170B can be brought close to the listener's ear to hear the voice.

[0079] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals and can be understood as a type of sound sensor. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Terminal device 100 may be equipped with at least one microphone 170C. In some embodiments, terminal device 100 may be equipped with two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, terminal device 100 may be equipped with three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0080] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0081] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Terminal device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, terminal device 100 detects the intensity of the touch operation based on pressure sensor 180A. Terminal device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example: when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0082] The gyroscope sensor 180B can be used to determine the motion attitude of the terminal device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the terminal device 100 around three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the terminal device 100's shake, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the terminal device 100 through reverse movement, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0083] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the terminal device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0084] The magnetic sensor 180D includes a Hall sensor. The terminal device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the terminal device 100 is a flip phone, the terminal device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0085] The 180E accelerometer can detect the magnitude of acceleration of the terminal device 100 in various directions (generally three axes). When the terminal device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of the terminal device 100, and can be applied to applications such as landscape / portrait switching and pedometers.

[0086] A distance sensor 180F is used to measure distance. The terminal device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, the terminal device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0087] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The terminal device 100 emits infrared light outward through the LED. The terminal device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 100. When insufficient reflected light is detected, the terminal device 100 can determine that there is no object near the terminal device 100. The terminal device 100 may use the proximity sensor 180G to detect when a user holds the terminal device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and screen locking.

[0088] The ambient light sensor 180L is used to sense the ambient light intensity. The terminal device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light intensity. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the terminal device 100 is in a pocket to prevent accidental touches.

[0089] The fingerprint sensor 180H is used to collect fingerprints. The terminal device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0090] Temperature sensor 180J is used to detect temperature. In some embodiments, terminal device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, terminal device 100 reduces the performance of the processor located near temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is below another threshold, terminal device 100 heats battery 142 to prevent abnormal shutdown of terminal device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, terminal device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0091] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of terminal device 100, in a different position than display screen 194.

[0092] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.

[0093] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Terminal device 100 can receive button input and generate key signal inputs related to user settings and function control of terminal device 100.

[0094] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0095] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0096] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the terminal device 100. The terminal device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the terminal device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

[0097] The software system of terminal device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to exemplify the software structure of terminal device 100.

[0098] refer to Figure 3 The diagram shown is a software structure block diagram of a terminal device provided in an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. Taking the Android system as an example, in some embodiments, the Android system is divided into four layers, from top to bottom: the application layer (APP), the application framework layer (Framework), the hardware abstraction layer (HAL), and the kernel layer (Kernel).

[0099] The application layer may include a series of application packages. In this embodiment, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0100] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications within the application layer. The application framework layer includes some predefined functions. In this embodiment, such as... Figure 3As shown, the application framework layer can include sensor services. The application framework layer can provide relevant APIs for applications in the application layer and provide sensor services to the applications, such as providing the sensor data and display data required by the applications. Optionally, as... Figure 3 As shown, the application framework layer may also include: window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0101] The Hardware Abstraction Layer (HAL), also known as the Android Runtime, is responsible for the scheduling and management of the Android system; it includes the core libraries and the virtual machine. The core libraries consist of two parts: one part contains the functionalities that the Java language needs to call, and the other part contains the core Android libraries.

[0102] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0103] The system library can include multiple functional modules. For example: Sensor Abstraction Layer (Sensor HAL), graphics engine, and graphics hardware composer.

[0104] The sensor abstraction layer is used to report sensor data to the sensor service in the application framework layer.

[0105] A graphics engine is a drawing engine that creates graphics, such as Surface Flinger and Skia GraphicsLibrary.

[0106] The graphics hardware compositor is a driver abstraction layer of a dedicated chip for layer compositing. For example, in the embodiments of this application, the graphics hardware compositor is used to connect the graphics engine and the display driver. That is, the graphics hardware compositor is a communication bridge between the graphics engine and the display driver, so that the layers drawn by the graphics engine can be transmitted to the display driver for display.

[0107] Optionally, the system library may also include a surface manager, media libraries, and 3D graphics processing libraries (e.g., OpenGL ES).

[0108] The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The 3D graphics processing library is used for 3D graphics drawing, image rendering, compositing, and layer processing.

[0109] The kernel layer is the layer between hardware and software. In this embodiment, the kernel layer includes at least a display driver and a sensor driver. Optionally, the kernel layer may also include a camera driver, an audio driver, etc.

[0110] The kernel layer driver module is used to obtain data reported by one or more sensors in the hardware layer, process it, and report the processing results to the hardware abstraction layer.

[0111] In this embodiment, the hardware layer may include hardware modules such as a sensor module and a display screen. In this embodiment, the sensor module includes at least a touch sensor, an accelerometer, and a magnetic sensor. The touch sensor and the display screen together form a touchscreen. The accelerometer and magnetic sensor are used to acquire attitude data of the terminal device. In this embodiment, the first screen and the second screen are each equipped with at least one accelerometer and at least one magnetic sensor.

[0112] It should be noted that, although the embodiments of this application are based on Android... TM This explanation uses the system as an example, but its basic principles also apply to systems based on Harmony OS. TM iOS TM or Windows TM Terminal devices with operating systems such as [list of operating systems].

[0113] The following is combined Figure 4 This example illustrates the software and hardware workflow of a terminal device displaying screen content on its internal screen.

[0114] Taking a mobile phone as an example, when the foldable screen is unfolded, the accelerometer and magnetometer on the first and second screens detect the phone's attitude data and report it to the sensor driver. The attitude data can include at least the attitude data of the first and second screens; for example, it can include angle data, acceleration data, gyroscope data, etc. Then, the attitude data is transmitted to the sensor service via the sensor driver → sensor abstraction layer → sensor service path. The sensor service sends the attitude data of the first and second screens to the application layer. The application in the application layer determines the screen display orientation based on the attitude data of the first and second screens and displays the screen content on the inner screen according to the orientation. This effectively avoids the problem of screen content rotation on the inner screen when the screen is unfolded, such as the content rotating from a horizontal to a vertical orientation, causing inconvenience and affecting the user experience.

[0115] refer toFigure 5 The diagram shown is a flowchart of a screen display method provided in an embodiment of this application. Figure 5 The example method includes one or more steps, but does not constitute a limitation of this application. Furthermore, the order of the steps in the method is merely illustrative and may be changed. Additional steps may be added or steps may be removed without departing from the disclosure of this application. The method includes the following steps.

[0116] Step S501: When the inner screen is in a folded state, obtain the first flip angle of the first screen and the second screen.

[0117] In some embodiments of this application, the sensor service acquires first magnetic sensor data and second magnetic sensor data, wherein the first magnetic sensor data is uploaded to the sensor service by the magnetic sensor corresponding to the first screen, and the second magnetic sensor data is uploaded to the sensor service by the magnetic sensor corresponding to the second screen. The sensor service determines the hinge angle between the first screen and the second screen based on the first magnetic sensor data and the second magnetic sensor data. A hinge is a mechanical structure in a foldable phone used to connect and support two screens (e.g., the first screen and the second screen). The hinge allows the phone to unfold and fold smoothly in different folding states, maintaining the durability and normal function of the screen. If the hinge angle is less than a preset angle, it is determined that the inner screen is in a folded state. When the inner screen is in a folded state, the sensor service acquires acceleration data of the first screen and acceleration data of the second screen, determines a first flip angle of the first screen based on the acceleration data of the first screen, and determines a first flip angle of the second screen based on the acceleration data of the second screen, wherein the acceleration data of the first screen is uploaded to the first screen by the acceleration sensor of the first screen, and the acceleration data of the second screen is uploaded to the sensor service by the acceleration sensor of the second screen.

[0118] In some embodiments of this application, attitude angles (Euler angles) can be used to characterize the attitude of the first screen and the second screen. The attitude angles can be determined based on the relationship between the coordinate system of the inner screen and the geographic coordinate system. (See reference...) Figure 6 As shown, when the inner screen is folded, a Cartesian coordinate system (X, Y, Z) is constructed with the center of the plane containing the outer screen as the center O. Euler angles are the angles of rotation of the phone around the three axes of the coordinate system (X, Y, Z). The rotation axis of the inner screen can be the rotation axis connecting the first and second screens. The Y-axis is parallel to the rotation axis. The angle of rotation of the inner screen around the X-axis is the pitch angle, the angle of rotation around the Y-axis is the roll angle, and the angle of rotation around the Z-axis is the yaw angle. Euler angles consist of the pitch angle, roll angle, and yaw angle. Euler angles can be calculated from the acceleration components of the accelerometers on the X, Y, and Z axes of the accelerometers in the first and second screens. (This is from an embodiment of the present application.) Figure 6Taking a left-right folding phone as an example, this paper explains how to obtain the first flip angle of the first screen and the second screen when the inner screen is in a folded state. In other embodiments, it also includes obtaining the first flip angle of the first screen and the second screen when the inner screen is in a folded state in a right-up folding phone scenario. This application does not limit this.

[0119] When the inner screen is in a folded state, the angle by which the first screen rotates around the Y-axis is the first flip angle of the first screen, and the angle by which the second screen rotates around the Y-axis is the first flip angle of the second screen.

[0120] In some embodiments of this application, in the folded state, the inner screen is not visible to the user, and the mobile phone displays screen content through the outer screen.

[0121] Step S502: Detect whether the inner screen has changed from a folded state to an unfolded state.

[0122] In some embodiments of this application, the sensor service determines the hinge angle between the first screen and the second screen based on the acquired first magnetic sensor data and second magnetic sensor data. If the hinge angle is greater than or equal to a preset angle, it is determined that the inner screen has changed from a folded state to an unfolded state. If the inner screen changes from a folded state to an unfolded state, step S503 is executed; if the inner screen does not change from a folded state to an unfolded state, step S502 is executed again to repeatedly detect whether the inner screen has changed from a folded state to an unfolded state.

[0123] In other embodiments, if the inner screen does not change from the folded state to the unfolded state, other situations can be considered to determine whether it is necessary to continuously detect whether the inner screen changes from the folded state to the unfolded state. For example, if the phone is in a powered-off or sleep state, no detection is required. If a user operation is detected that changes the phone's state, the detection in step S502 can be continued.

[0124] Step S503: When the inner screen is in the unfolded state, obtain the second flip angle of the first screen and the second screen.

[0125] In some embodiments of this application, when it is determined that the inner screen is in an unfolded state, the sensor service obtains the acceleration data of the first screen and the acceleration data of the second screen when the inner screen is in an unfolded state, determines the second flip angle of the first screen based on the acceleration data of the first screen, and determines the second flip angle of the second screen based on the acceleration data of the second screen.

[0126] refer to Figure 7 As shown, when the inner screen changes from the folded state to the unfolded state, the angle by which the first screen rotates around the Y-axis is the second flip angle of the first screen, and the angle by which the second screen rotates around the Y-axis is the second flip angle of the second screen.

[0127] Step S504: Determine the screen display orientation based on the first and second flip angles of the first screen and the first and second flip angles of the second screen.

[0128] In some embodiments of this application, the sensor service reports the first and second flip angles of the first screen and the second screen to the application. The application determines the absolute value of the flip angle difference between the first and second screens (hereinafter referred to as the "first absolute value") and the absolute value of the flip angle difference between the second and second screens (hereinafter referred to as the "second absolute value"). The absolute value of the difference between the first and second absolute values ​​is taken to obtain the target difference. If the target difference is within a preset angle range, the screen display direction is determined to be a vertical display direction; if the target difference is not within the preset angle range, the screen display direction is determined to be a horizontal display direction. In some embodiments of this application, the preset angle range can be 0°-15°.

[0129] Referring to Figure 8(a), which is a schematic diagram of the inner screen of a vertically unfolded mobile phone according to an embodiment of this application, the inner screen unfolds in a left-right direction. In the folded state, the first screen and the second screen do not rotate relative to the Y-axis, and the first flip angle of the first screen and the first flip angle of the second screen are about 0°. When the inner screen is unfolded to change to the unfolded state, the second flip angle of the first screen and the second screen are about 90°. Therefore, the absolute value of the difference in the flip angle of the first screen is approximately the same as the absolute value of the difference in the flip angle of the second screen. The target difference is within a preset range of 0°-15°. Therefore, when the target difference is within the preset angle range, the screen display direction can be determined to be the vertical display direction.

[0130] Referring to Figure 8(b), which is a schematic diagram of the inner screen of a horizontally unfolded mobile phone according to an embodiment of this application. In the folded state, the first screen and the second screen do not rotate relative to the Y-axis, and the first flip angle of the first screen and the first flip angle of the second screen are approximately 0°. When the inner screen is unfolded to change to the unfolded state, the second flip angle of the first screen is approximately 90°, and the flip angle of the second screen is approximately 0°. Therefore, the absolute value of the difference in the flip angles of the first screen and the second screen is significantly different, and the target difference exceeds the preset angle range of 0°-15°. Thus, when the target difference is not within the preset angle range, the screen display direction can be determined to be the horizontal display direction. The above embodiment uses a preset angle range of 0°-15° as an example. In other embodiments, the preset angle range can also be different, and this application does not limit this.

[0131] Step S505: Display screen content on the inner screen according to the screen display orientation.

[0132] In one embodiment of this application, when the inner screen changes from a folded state to an unfolded state, the mobile phone changes from displaying screen content on the outer screen to displaying screen content on the inner screen.

[0133] In one embodiment of this application, if the screen display orientation is determined to be portrait, the application displays its screen content on the inner screen according to the portrait display orientation reported by the sensor service; if the screen display orientation is determined to be landscape, the application displays its screen content on the inner screen according to the landscape display orientation reported by the sensor service. The screen content can be the application's user interface or the application's content display interface. For example, if the application is a video playback application, the screen content can be a video being played.

[0134] In one embodiment of this application, the application can be a system application or a third-party application. In some embodiments of this application, the system application can display its interface, such as a desktop or lock screen interface, based on the screen display orientation reported by the sensor service. In some embodiments of this application, the third-party application can display its interface based on the screen display orientation reported by the sensor service. For example, a music application can display a music playback interface based on the screen display orientation reported by the sensor service, and a video application can display a video playback interface based on the screen display orientation reported by the sensor service.

[0135] In one embodiment of this application, the application also provides a settings interface for the user to select whether to display screen content according to the screen display orientation uploaded by the sensor service. An example is given below. The settings interface includes an "Allow rotation" option. If the application detects that the user has touched the "Allow rotation" option in the settings interface, it displays the screen content according to the screen display orientation uploaded by the sensor service, such as displaying the application's interface content on the inner screen according to the vertical display orientation uploaded by the sensor service.

[0136] This application embodiment can obtain the first flip angle of the first screen and the first flip angle of the second screen in the folded state, and obtain the second flip angle of the first screen and the second flip angle of the second screen in the unfolded state. Based on the first flip angle and the second flip angle of the first screen and the second flip angle of the second screen, the screen display direction is determined, and the screen content is displayed on the inner screen according to the screen display direction. This solves the problem that in the case of existing terminal devices with only one accelerometer on the inner screen, the terminal device cannot obtain the posture of the first screen and the posture of the second screen, and cannot determine the posture of the user unfolding the inner screen (such as horizontal unfolding or vertical unfolding) based on the posture of the first screen and the posture of the second screen. As a result, when the terminal device unfolds the inner screen to display screen content, the display direction of the screen content on the inner screen is prone to rotation.

[0137] refer to Figure 9 The diagram shown is a flowchart of a screen display method provided in another embodiment of this application.Figure 9 The example method includes one or more steps, but does not constitute a limitation of this application. Furthermore, the order of the steps in the method is merely illustrative and may be changed. Additional steps may be added or steps may be removed without departing from the disclosure of this application. The method includes the following steps.

[0138] Step S901: When the inner screen is in a folded state, obtain the first flip angle of the first screen and the second screen.

[0139] Step S902: Detect whether the inner screen has changed from the folded state to the unfolded state. If the inner screen has changed from the folded state to the unfolded state, proceed to step S903. If the inner screen has not changed from the folded state to the unfolded state, continue to proceed to step S902 to repeatedly detect whether the inner screen has changed from the folded state to the unfolded state.

[0140] Step S903: When the inner screen is in the unfolded state, obtain the second flip angle of the first screen and the second screen.

[0141] Step S904: Determine a first change value based on the first flip angle and the second flip angle of the first screen, and determine a second change value based on the first flip angle and the second flip angle of the second screen, and determine the screen display direction.

[0142] In some embodiments of this application, the mobile phone determines the absolute value of the difference between the first screen's flip angle and the second screen's flip angle as a first change value, and determines the absolute value of the difference between the second screen's flip angle and the second screen's flip angle as a second change value. The absolute value of the difference between the first change value and the second change value is taken to obtain a target difference value. If the target difference value is within a preset angle range, the screen display direction is determined to be a vertical display direction. If the target difference value is not within a preset angle range, the screen display direction is determined to be a horizontal display direction.

[0143] For specific embodiments of steps S901-S904 in this application, please refer to the relevant examples. Figure 5 The implementation details of steps S501-S504 will not be repeated here.

[0144] Step S905: Determine the target difference based on the first change value and the second change value, and determine whether the target difference is within the preset angle range. If the target difference is within the preset angle range, proceed to step S906; if the target difference is not within the preset angle range, proceed to step S909.

[0145] Step S906: Determine the screen display orientation as portrait orientation, and display the screen content according to the portrait orientation.

[0146] Step S907: Detect the first pitch angle and the first flip angle of the inner screen, and determine whether the first pitch angle of the inner screen is less than a first preset angle and whether the first flip angle of the inner screen is greater than a second preset angle. If the first pitch angle of the inner screen is less than the first preset angle and the first flip angle of the inner screen is greater than the second preset angle, proceed to step S908. If either the first pitch angle of the inner screen is greater than or equal to the first preset angle or the first flip angle of the inner screen is less than or equal to the second preset angle, continue to proceed to step S907 to determine the attitude of the inner screen.

[0147] In this embodiment, when the inner screen is unfolded, the sensor service receives acceleration data reported by the accelerometers of the first or second screen, and determines the first pitch angle and the first flip angle of the inner screen based on the received data. The following explanation uses the acceleration data reported by the accelerometer of the first screen as an example. The sensor service receives the acceleration data reported by the accelerometer of the first screen, determines the angle by which the first screen rotates around the X-axis as the first pitch angle of the inner screen, and determines the angle by which the first screen rotates around the Y-axis as the first flip angle of the inner screen. In one embodiment of this application, the first preset angle is 30°, and the second preset angle is 45°.

[0148] Step S908: Display screen content according to the horizontal display orientation.

[0149] In some embodiments of this application, when the inner screen is unfolded, if the sensor service determines that the first pitch angle of the inner screen is less than a first preset angle and the first flip angle of the inner screen is greater than a second preset angle, then it determines that the screen display direction changes from a vertical display direction to a horizontal display direction, and sends the horizontal display direction to the application. The application displays screen content according to the horizontal display direction, thereby adjusting the screen display direction of the inner screen based on the posture of the inner screen.

[0150] Step S909: Determine the screen display orientation as horizontal, and display the screen content according to the horizontal display orientation.

[0151] Step S910: Detect the second pitch angle and second flip angle of the inner screen, and determine whether the second pitch angle of the inner screen is less than a third preset angle and whether the second flip angle of the inner screen is greater than a fourth preset angle. If the second pitch angle of the inner screen is less than the third preset angle and the second flip angle of the inner screen is greater than the fourth preset angle, proceed to step S911. If either the second pitch angle of the inner screen is greater than or equal to the third preset angle or the second flip angle of the inner screen is less than or equal to the fourth preset angle, continue to proceed to step S910 to determine the attitude of the inner screen.

[0152] In this embodiment, when the inner screen is unfolded, the sensor service receives acceleration data reported by the accelerometers of the first or second screen, and determines the second pitch angle and the second flip angle of the inner screen based on the received data. In one embodiment of this application, the third preset angle is 30°, and the fourth preset angle is 45°.

[0153] Step S911: Display the screen content according to the vertical display direction.

[0154] In some embodiments of this application, when the inner screen is unfolded, if the sensor service determines that the second pitch angle of the inner screen is less than the third preset angle and the second flip angle of the inner screen is greater than the fourth preset angle, then the screen display direction is determined to change from a horizontal display direction to a vertical display direction, and the vertical display direction is sent to the application. The application displays the screen content according to the vertical display direction, thereby adjusting the screen display direction of the inner screen according to the posture of the inner screen.

[0155] refer to Figure 10 The diagram shown is a flowchart of a screen display method provided in another embodiment of this application. Figure 5 The example method includes one or more steps, but does not constitute a limitation of this application. Furthermore, the order of the steps in the method is merely illustrative and may be changed. Additional steps may be added or steps may be removed without departing from the disclosure of this application. The method includes the following steps.

[0156] Step S1001: When the inner screen is in a folded state, obtain the first flip angle of the first screen and the second screen.

[0157] In this embodiment of the application, the specific implementation details of step S1001 can be found by referring to... Figure 5 The implementation details of step S501 are shown below.

[0158] Step S1002: Determine whether the external screen displays any interface content. If the external screen displays interface content, proceed to step S1003; if the external screen does not display any content (e.g., the external screen is in a screen-off state), proceed to step S1004.

[0159] Step S1003: Use the interface content displayed on the external screen as the screen content.

[0160] In some embodiments of this application, the display service uses the interface content displayed on the external screen as the screen content. For example, if the interface content displayed on the external screen is video content, the video content is used as the screen content.

[0161] Step S1004: Use the lock screen as the screen content.

[0162] In one embodiment of this application, when the outer screen is in a screen-off state, the display service uses the lock screen interface as the screen content.

[0163] Step S1005: Detect whether the inner screen has changed from the folded state to the unfolded state. If the inner screen has changed from the folded state to the unfolded state, proceed to step S1006. If the inner screen has not changed from the folded state to the unfolded state, continue to proceed to step S1005 to repeatedly detect whether the inner screen has changed from the folded state to the unfolded state.

[0164] The specific implementation details of step S1005 in the embodiments of this application can be found by referring to... Figure 5 The step S502 shown.

[0165] In some embodiments of this application, the mobile phone's display service determines whether it has obtained the screen content of the outer screen reported by the display driver. If the display service has obtained the screen content of the outer screen reported by the display driver, it determines that the outer screen displays screen content; if the display service has not obtained the screen content of the outer screen reported by the display driver, it determines that the outer screen does not display screen content.

[0166] Step S1006: When the inner screen is in the unfolded state, obtain the second flip angle of the first screen and the second screen.

[0167] Step S1007: Determine the screen display direction based on the first and second flip angles of the first screen and the first and second flip angles of the second screen.

[0168] In some embodiments of this application, the specific implementation of step S1006 can refer to the implementation of step S503, and the specific implementation of step S1007 can refer to the implementation of step S504.

[0169] Step S1008: Display screen content on the inner screen according to the screen display orientation.

[0170] In one embodiment of this application, when the inner screen changes from a folded state to an unfolded state, the mobile phone changes from displaying screen content based on the outer screen to displaying screen content based on the inner screen. The application receives the screen display direction sent by the sensor service and the screen content sent by the display service, and displays the screen content on the inner screen according to the screen display direction.

[0171] This application embodiment can obtain the first flip angle of the first screen and the first flip angle of the second screen in the folded state, and the second flip angle of the first screen and the second flip angle of the second screen in the unfolded state. Based on the first and second flip angles of the first and second screens, the screen display direction is determined, and the screen content is displayed on the inner screen according to the screen display direction. This solves the problem that the display direction of the screen content on the inner screen is prone to rotation when the screen content is displayed on the unfolded inner screen. At the same time, when the inner screen changes from the folded state to the unfolded state, the mobile phone changes from displaying screen content on the outer screen to displaying screen content on the inner screen, thereby achieving continuous display from the outer screen to the inner screen and improving the user experience.

[0172] This embodiment also provides a computer storage medium storing computer instructions. When the computer instructions are executed on the terminal device 100, the terminal device 100 performs the aforementioned related method steps to implement the screen display method in the above embodiment.

[0173] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned related steps to implement the screen display method in the above embodiment.

[0174] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the screen display method in the above method embodiments.

[0175] In this embodiment, the terminal device 100, computer storage medium, computer program product or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0176] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0177] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0178] The unit described as a separate component may or may not be physically separate. The component shown as a unit can be one physical unit or multiple physical units, that is, it can be located in one place or distributed in multiple different places. Some or all of the units can be selected to achieve the purpose of the solution in this embodiment according to actual needs.

[0179] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0180] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially or in other words, the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0181] The above embodiments are only used to illustrate the technical solutions of this application and are not intended to limit it. Although this application has been described in detail with reference to the above preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions to the technical solutions of this application should not depart from the spirit and scope of the technical solutions of this application.

Claims

1. A screen display method applied to a terminal device, characterized by, The terminal device comprises an inner screen, the inner screen is a folding screen and comprises a first screen and a second screen, and the method comprises: In the case that the inner screen is transformed from a folding state to an unfolding state, a first change value of a turning angle of the first screen and a second change value of a turning angle of the second screen are determined; Based on the first change value and the second change value, a screen display direction is determined; Screen content is displayed on the inner screen according to the screen display direction.

2. The screen display method of claim 1, wherein, The determination of the first change value of the turning angle of the first screen and the second change value of the turning angle of the second screen in the case that the inner screen is transformed from the folding state to the unfolding state comprises: In the case that the inner screen is in the folding state, a first turning angle of the first screen and a first turning angle of the second screen are acquired; In the case that the inner screen is in the unfolding state, a second turning angle of the first screen and a second turning angle of the second screen in the case that the inner screen is in the unfolding state are acquired; Based on the first turning angle and the second turning angle of the first screen, an absolute value of a turning angle difference value of the first screen is determined as the first change value; Based on the first turning angle and the second turning angle of the second screen, an absolute value of a turning angle difference value of the second screen is determined as the second change value.

3. The screen display method according to claim 1 or 2, wherein The determination of the screen display direction based on the first change value and the second change value comprises: An absolute value of a difference value between the first change value and the second change value is obtained as a target difference value; If the target difference value is within a preset angle range, the screen display direction is determined as a portrait display direction; If the target difference value is not within the preset angle range, the screen display direction is determined as a landscape display direction.

4. The screen display method of claim 1, wherein, The method further comprises: Based on the acquired first magnetic sensor data and second magnetic sensor data, a hinge angle between the first screen and the second screen is determined, and if the hinge angle is greater than or equal to a preset angle, it is determined that the inner screen is transformed from the folding state to the unfolding state.

5. The screen display method of claim 1, wherein, The display of the screen content on the inner screen according to the screen display direction comprises: If it is determined that the screen display direction is a portrait display direction, the screen content is displayed on the inner screen according to the portrait display direction; If it is determined that the screen display direction is a landscape display direction, the screen content is displayed on the inner screen according to the landscape display direction.

6. The screen display method of claim 1, wherein, The display of the screen content on the inner screen according to the screen display direction comprises: In the case that the screen content is displayed on the inner screen according to the portrait display direction, a pitch angle and a turning angle of the inner screen are detected; If the pitch angle is less than a first preset angle and the turning angle is greater than a second preset angle, the display of the screen content according to the portrait display direction is transformed into the display of the screen content according to a landscape display direction.

7. The screen display method of claim 1, wherein, The display of the screen content on the inner screen according to the screen display direction comprises: In the case that the screen content is displayed on the inner screen according to the landscape display direction, a pitch angle and a turning angle of the inner screen are detected; If the pitch angle is less than a third preset angle and the roll angle is greater than a fourth preset angle, the screen content is displayed according to a portrait display direction.

8. The screen display method according to claim 6 or 7, wherein, The pitch angle of the inner screen is the pitch angle of the first screen or the second screen, and the roll angle of the inner screen is the roll angle of the first screen or the second screen.

9. The screen display method of claim 1, wherein, The method further comprises: If the outer screen of the terminal device displays interface content, the display content is taken as the screen content. If the outer screen is in an off-screen state, a lock screen interface is taken as the screen content.

10. A terminal device, comprising: The terminal device comprises a memory and a processor: The memory is configured to store program instructions. The processor is configured to read and execute the program instructions stored in the memory, and when the program instructions are executed by the processor, the terminal device executes the screen display method in any one of claims 1 to 9.

11. A computer storage medium, characterized in that The computer storage medium stores program instructions, and when the program instructions are executed on the terminal device, the terminal device executes the screen display method in any one of claims 1 to 9.

12. A computer program product comprising computer program instructions, characterised in that, The computer program instructions are executed by the processor to implement the screen display method in any one of claims 1 to 9.

Images