An interface display method, a terminal device, and a storage medium

Abstract

The application provides an interface display method, a terminal device and a storage medium, relates to the technical field of multi-screen terminal, and can replace data collected by a main acceleration sensor arranged on a body where a main screen is located by data collected by a secondary acceleration sensor arranged on a body where a secondary screen is located when the interface of the application is displayed on the secondary screen of the terminal device and the automatic rotation function is started, so that the transmission path of the data collected by the main sensor is not changed, the data identifier of the main sensor carries the secondary sensor data and is transmitted to the application, and the application can determine the display direction of the content in the interface displayed on the secondary screen based on the secondary sensor data carried by the data identifier of the main sensor received. In this way, when a third-party application adapted to the multi-screen terminal is developed, the original display logic on the single-screen terminal does not need to be changed, and the correct automatic rotation function can also be realized.

Description

Technical Field

[0001] This application relates to the field of multi-screen terminal technology, and in particular to an interface display method, terminal device and storage medium. Background Technology

[0002] As mobile phones become increasingly popular, people's demand for large-screen phones is also growing stronger. As screens get bigger, the surface area of ​​mobile phones also gets bigger, making them inconvenient to carry. Therefore, foldable screen phones, which balance portability and screen requirements, are becoming more and more popular.

[0003] However, when using a foldable phone, the content displayed on the main screen can achieve the correct display orientation based on the rotation of the main screen. For example, icons are displayed vertically upright from the user's perspective. However, the content displayed on the secondary screen often has an incorrect display orientation based on the rotation of the secondary screen. For example, icons are displayed vertically upside down from the user's perspective. Summary of the Invention

[0004] This application provides an interface display method, terminal device, and storage medium, which enables the content displayed on the interface of the terminal device to rotate correctly as the display screen rotates.

[0005] To achieve the above objectives, this application adopts the following technical solution:

[0006] In a first aspect, embodiments of this application provide an interface display method applied to a terminal device. The terminal device includes a first sensor, a second sensor, and a display screen, the display screen including a first screen and a second screen. When the terminal device is unfolded, the first sensor is located below the first screen, the second sensor is located below the second screen, and the display orientations of the first screen and the second screen are the same. When the terminal device is folded, the display orientations of the first screen and the second screen are opposite. The method includes:

[0007] The terminal device displays the first interface of the first application on the first screen;

[0008] During the process of displaying the first interface on the first screen, the terminal device acquires data collected by the first sensor through the first application;

[0009] During the process of rotating the first screen counterclockwise by 90°, the terminal device rotates the first icon in the first interface clockwise by 90° relative to the first screen based on the data collected by the first sensor.

[0010] The terminal device receives the first operation to switch to the second screen to display the first application;

[0011] In response to the first operation, the terminal device displays a second interface of the first application on the second screen. The second interface is the interface after the first interface is adapted to the second screen. The second interface includes the first icon.

[0012] During the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application;

[0013] During the process of rotating the second screen counterclockwise by 90°, the terminal device rotates the first icon in the second interface clockwise by 90° relative to the second screen based on the data collected by the second sensor.

[0014] In this application, the limitation of rotating the first screen counterclockwise by 90° does not mean that the multi-screen terminal will only display the interface of the first application horizontally on the first screen based on the data collected by the accelerometer when rotating counterclockwise by 90°. Furthermore, 90° is merely an example; in practical applications, this 90° only represents one example within the rotation range. For example, it could be any angle between 80° and 100°, such as 80°, 85°, 88°, 92°, 95°, etc. Of course, this 90° can also be understood as the angle corresponding to the first screen switching from portrait to landscape display, or vice versa.

[0015] Similarly, the limitation of rotating the second screen 90° counterclockwise is as described above.

[0016] Of course, counterclockwise is just an example. In practical applications, it can also be clockwise rotation. For example, a 90° counterclockwise rotation is equivalent to a 270° clockwise rotation, and a 90° clockwise rotation is equivalent to a 270° counterclockwise rotation.

[0017] The icon rotates in the opposite direction to the screen, and the icon rotates at an angle close to the screen's rotation angle, but the icon's rotation angle relative to the screen is 90°, 180°, 270°, or 360°.

[0018] When multiple angles can be presented between two screens (or two areas of a display), when the interface content is displayed on the first screen, the display direction of the content on the interface is determined by a sensor located below the first screen; when the first screen rotates, the content displayed on the interface on the first screen rotates in the opposite direction, so that the content on the interface can always be displayed vertically from the user's perspective; when the interface content is displayed on the second screen, the display direction of the content on the interface is determined by a sensor located below the second screen; when the second screen rotates, the content displayed on the interface on the second screen rotates in the opposite direction, so that the content on the interface can always be displayed vertically from the user's perspective.

[0019] As one implementation of the first aspect of this application, during the process of displaying the first interface on the first screen, the terminal device acquires data collected by the first sensor through the first application, including:

[0020] The terminal device acquires data collected by the second sensor, and the data collected by the second sensor is called the second data.

[0021] The terminal device acquires data collected by the first sensor, and the data collected by the first sensor is the first data.

[0022] If the first interface of the first application is displayed on the first screen, the terminal device obtains the data collected by the first sensor through the first application;

[0023] During the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including:

[0024] The terminal device acquires data collected by the second sensor, and the data collected by the second sensor is called the second data.

[0025] If the second interface of the first application is displayed on the second screen, the terminal device stores the data collected by the second sensor.

[0026] The terminal device acquires data collected by the first sensor, and the data collected by the first sensor is the first data.

[0027] If the second interface of the first application is displayed on the second screen, the terminal device will replace the data collected by the first sensor with the data collected by the second sensor stored in the terminal device, and obtain the data after the first sensor is replaced. The data after the first sensor is replaced is the second data collected by the second sensor.

[0028] The terminal device obtains data after the first sensor has been replaced through the first application.

[0029] In this application, since the terminal device can only register one sensor, the first sensor at the bottom of the first screen is used as the registered sensor. When the first screen is displayed, the data collected by the registered first sensor is obtained. When the second screen is displayed, the data collected by the second sensor is replaced with the data collected by the first sensor. In this way, the data obtained is the data after the first sensor is replaced, but it is actually the data collected by the second sensor.

[0030] As another implementation of the first aspect of this application, the terminal device includes: a first processor and a second processor, wherein a first application runs on the first processor;

[0031] After the terminal device displays the first interface of the first application on the first screen, the method further includes:

[0032] The first processor sends first information to the second processor, and the first information is displayed on the first screen.

[0033] After receiving the first information, the second processor sets the display status flag to the first flag, which is used to indicate that it is displayed on the first screen.

[0034] During the display of the first interface on the first screen, the terminal device acquires data collected by the first sensor through the first application, including:

[0035] The second processor acquires the data collected by the second sensor, and the data collected by the second sensor is the second data.

[0036] The second processor acquires the data collected by the first sensor, and the data collected by the first sensor is the first data.

[0037] When the display status flag in the second processor is set to the first flag, the second processor sends the data collected by the first sensor to the first application in the first processor.

[0038] The first application in the first processor acquires data collected by the first sensor.

[0039] In this application, the first processor is an application processor, and the second processor processes the data collected by the sensor. The first processor monitors whether the data is displayed on the first screen or the second screen and sends the monitored display status to the second processor. The second processor sets a display status flag based on the received display status and determines whether to perform a replacement operation between the data collected by the second sensor and the data collected by the first sensor based on the display status flag. This display status flag method allows the display status to be changed when switching display states. Before the display status changes, the second processor can determine whether to perform a replacement operation based on the displayed status each time it receives data collected by the sensor.

[0040] As another implementation of the first aspect of this application, after the terminal device displays the second interface of the first application on the second screen, the method further includes:

[0041] The first processor sends a second message to the second processor, and the second message is displayed on the second screen.

[0042] After receiving the second information, the second processor sets the display status flag to the second flag, which is used to indicate that the information is displayed on the second screen.

[0043] During the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including:

[0044] The second processor acquires the data collected by the second sensor, and the data collected by the second sensor is the second data.

[0045] When the display status flag in the second processor is set to the second flag, the second processor stores the data collected by the second sensor.

[0046] The second processor acquires the data collected by the first sensor, and the data collected by the first sensor is the first data.

[0047] When the display status flag in the second processor is set to the second flag, the second processor replaces the data collected by the first sensor with the data collected by the second sensor stored in the second processor. The data collected by the second sensor after the first sensor is replaced becomes the second data collected by the second sensor.

[0048] The second processor sends the data of the first sensor after it has been replaced to the first application of the first processor;

[0049] The first application in the first processor acquires data after the first sensor has been replaced.

[0050] In this application, when the display status flag is the second flag, it can be determined that the display is on the secondary screen, and the replacement operation of the data collected by the second sensor with the data collected by the second sensor can be performed.

[0051] As another implementation of the first aspect of this application, when the terminal device is folded, the data of the first sensor in the first direction and the data of the second sensor in the first direction are the same in value but opposite in direction, the data of the first sensor in the second direction and the data of the second sensor in the second direction are the same in value but opposite in direction, and the data of the first sensor in the third direction and the data of the second sensor in the third direction are the same in value and in the same direction.

[0052] During the display of the first interface on the first screen, the terminal device acquires data collected by the first sensor through the first application, including:

[0053] The terminal device acquires data collected by the second sensor, and the data collected by the second sensor is called the second data.

[0054] The terminal device acquires data collected by the first sensor, and the data collected by the first sensor is the first data.

[0055] If the first interface of the first application is displayed on the first screen, the terminal device obtains the data collected by the first sensor through the first application;

[0056] During the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including:

[0057] The terminal device acquires data collected by the second sensor, and the data collected by the second sensor is called the second data.

[0058] The terminal device acquires data collected by the first sensor, and the data collected by the first sensor is the first data.

[0059] If the second interface of the first application is displayed on the second screen, the terminal device will flip the data in the first direction and the data in the second direction from the data collected by the first sensor.

[0060] The terminal device acquires data collected by the first sensor after the orientation is flipped through the first application.

[0061] In this application, the first direction and the second direction can be the directions represented by the x-axis and z-axis in the above embodiments, and the third direction can be the direction represented by the y-axis in the above embodiments. Since in the folded state, the data on the x-axis and z-axis of the data collected by the two acceleration sensors are flipped between positive and negative, while the data on the y-axis is the same, the replacement operation of the data of the first sensor by the data of the second sensor can be achieved by setting the direction flipping operation on the x-axis and z-axis.

[0062] Since the data collected by the first sensor and the second sensor are correlated when the first screen and the second screen are folded, for example, the data values ​​are the same but opposite in some directions, the data collected by the second sensor can be generated from the data collected by the first sensor by flipping the orientation.

[0063] As another implementation of the first aspect of this application, the terminal device includes: a first processor and a second processor, wherein a first application runs on the first processor; after the terminal device displays a second interface of the first application on a second screen, the method further includes:

[0064] The first processor sends a second message to the second processor, and the second message is displayed on the second screen.

[0065] After receiving the second information, the second processor sets the display status flag to the second flag, which is used to indicate that the information is displayed on the second screen.

[0066] During the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including:

[0067] The second processor acquires the data collected by the second sensor, and the data collected by the second sensor is the second data.

[0068] The second processor acquires the data collected by the first sensor, and the data collected by the first sensor is the first data.

[0069] When the display status flag in the second processor is set to the second flag, the second processor flips the data in the first direction and the data in the second direction from the data collected by the first sensor.

[0070] The second processor sends the data collected by the first sensor after the direction is flipped to the first application of the first processor;

[0071] The first application in the first processor acquires data collected by the first sensor after the orientation is flipped.

[0072] When generating data from the second sensor by flipping the direction of data collected by the first sensor, the direction flipping operation can also be determined based on the display status flag.

[0073] As another implementation of the first aspect of this application, the first interface of the first application includes a first screen switching button, and the first operation is an operation performed on the first screen switching button.

[0074] Alternatively, the first operation is a gesture operation performed on the first screen;

[0075] Alternatively, the system menu bar may include a second screen switching button, and the first operation is the operation performed on the second screen switching button.

[0076] In this application, a variety of methods are provided in a multi-screen terminal to allow the application interface to switch between the first screen and the second screen.

[0077] As another implementation of the first aspect of this application, the method further includes:

[0078] After the first application is launched, the terminal device acquires the first data collected by the first sensor at a first time period, and the terminal device acquires the second data collected by the second sensor at a first time period.

[0079] Alternatively, after receiving the second operation, the terminal device acquires the first data collected by the first sensor at a first time period, and the terminal device acquires the second data collected by the second sensor at a first time period. The second operation is an operation performed on the auto-rotate button in the system menu bar.

[0080] In this application, the automatic rotation function can be enabled through the system menu bar, or it can be enabled by the application itself that may have landscape mode. After the automatic rotation function is enabled, the first sensor and the second sensor can collect data based on the same event cycle.

[0081] As another implementation of the first aspect of this application, after the terminal device displays a second interface of the first application on a second screen in response to the first operation, the method further includes:

[0082] The terminal device receives a third operation;

[0083] In response to the third operation, the terminal device turns off its display screen;

[0084] The terminal device receives the fourth operation;

[0085] In response to the fourth operation, the terminal device lights up its display screen and displays the second interface of the first application on the second screen;

[0086] During the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application;

[0087] During the process of rotating the second screen counterclockwise by 90°, the terminal device rotates the first icon in the second interface clockwise by 90° relative to the second screen based on the data collected by the second sensor.

[0088] In this application, the third and fourth operations can be operations performed by a user briefly pressing a physical button on the terminal device, which is used to turn the screen off and on. For example, when the terminal device is displaying on the secondary screen, a user briefly presses the physical button, turning off both the main and secondary screens. When the terminal device is in a screen-off state, a user briefly presses the physical button; if the application interface was displayed on the secondary screen before the screen was turned off, then in response to the brief press of the physical button, the terminal device turns on the secondary screen and continues to display the application interface displayed before the screen was turned off. If the application interface is displayed on the second screen, and the screen is turned on again after being turned off, the second screen should still be lit, and the application interface should continue to be displayed on the second screen. Simultaneously, it is also necessary to determine the display method of the content in the interface based on data collected by the second sensor.

[0089] As another implementation of the first aspect of this application, the terminal device includes a first processor and a second processor, and the first application runs on the first processor;

[0090] After the terminal device displays a second interface of the first application on a second screen in response to the first operation, the method further includes:

[0091] The first processor sets the display state to the first state, which means it is displayed on the second screen.

[0092] After setting the display state to the first state, the first processor sends an enable command and second information to the second processor. The second information is used to indicate that it is displayed on the second screen.

[0093] After receiving the second information, the second processor sets the display status flag to the second flag;

[0094] After receiving the start command, the second processor starts the replacement operation, which is to replace the data collected by the first sensor with the data collected by the second sensor when the display status flag is the second flag.

[0095] In this application, a display state can be set in both a first and a second processor. The display state in the second processor updates accordingly with the display state in the first processor. When the display state in the first processor switches from the first screen to the second screen, it updates to the first state; similarly, the display state in the second processor updates to the first state.

[0096] As another implementation of the first aspect of this application, after the terminal device turns off the display screen, the method further includes:

[0097] The first processor maintains the display state as the first state;

[0098] The first processor sends a shutdown command to the second processor;

[0099] After receiving the shutdown command, the second processor disables the replacement operation;

[0100] After the terminal device responds to the fourth operation and displays the second interface of the first application on the second screen, the method further includes:

[0101] The first processor's query display status is "first status";

[0102] Based on the first state obtained from the query, the first processor sends an enable command to the second processor;

[0103] After receiving the enable command, the second processor initiates the replacement operation;

[0104] During the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including:

[0105] After the replacement operation is initiated, if the display status flag is set to the second flag, the second processor will replace the data collected by the first sensor with the data collected by the second sensor.

[0106] The second processor sends the data of the first sensor after it has been replaced to the first processor.

[0107] In this application, when the second screen display state is updated to be off, the display state in the first processor may not need to be updated. Similarly, the display state in the second processor does not need to be updated. However, in order to prevent the second processor from continuing to perform the replacement operation of the data collected by the second sensor on the data collected by the first sensor, the first processor can send a shutdown command to the second processor to disable the replacement operation. That is, even if the display state flag bit in the second processor is the second flag, the replacement function is disabled, and the replacement operation will no longer be performed.

[0108] As another implementation of the first aspect of this application, after the terminal device turns off the display screen, the method further includes:

[0109] The first processor sets the display state to the second state, which means that the display is on the first screen.

[0110] The first processor sends a shutdown command and the first message to the second processor;

[0111] After receiving the shutdown command, the second processor disables the replacement operation;

[0112] After receiving the first information, the second processor sets the display status flag to the first flag;

[0113] After the terminal device responds to the fourth operation and displays the second interface of the first application on the second screen, the method further includes:

[0114] The first processor is set to display status as the first state;

[0115] After setting the display status to the first state, the first processor sends an enable command and second information to the second processor.

[0116] After receiving the second information, the second processor sets the display status flag to the second flag;

[0117] After receiving the enable command, the second processor initiates the replacement operation.

[0118] In this application, the display state in the first processor can also be set to update in real time. For example, when the second screen's display state is updated to off, the display state in the first processor is updated to the first screen display. Similarly, the display state in the second processor also needs to be updated, with the display state flag in the second processor being updated to the first flag. In this case, the replacement operation of the data collected by the second sensor with the data collected by the first sensor can be avoided. Of course, in practical applications, the first processor sends a shutdown command to the second processor when the second screen is not displaying. This dual approach ensures that the aforementioned replacement operation is not performed when the screen is off.

[0119] As another implementation of the first aspect of this application, during the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including:

[0120] After the replacement operation is initiated, if the status flag is set to the second flag, the second processor will replace the data collected by the first sensor with the data collected by the second sensor.

[0121] The second processor sends the data of the first sensor after it has been replaced to the first processor. The data of the first sensor after it has been replaced is the data collected by the second sensor.

[0122] The first processor acquires data from the replaced first sensor through the first application.

[0123] In this application, the second processor only performs the replacement operation of the data collected by the second sensor with the data collected by the first sensor when the replacement operation is enabled and the display status flag is set to the second flag. This allows the display orientation of the content displayed on the second screen to be determined using the data collected by the second sensor below the second screen when the second screen is displayed. Secondly, a terminal device is provided, including a processor that runs a computer program stored in a memory to implement the method of any one of the first aspects of this application.

[0124] Thirdly, a chip system is provided, including a processor coupled to a memory, wherein the processor executes a computer program stored in the memory to implement the method of any one of the first aspects of this application.

[0125] Fourthly, a computer-readable storage medium is provided, which stores a computer program that, when executed by one or more processors, implements the method of any one of the first aspects of this application.

[0126] Fifthly, embodiments of this application provide a computer program product that, when run on a device, causes the device to execute the method of any one of the first aspects of this application.

[0127] It is understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0128] Figure 1 This is a schematic diagram of the hardware structure of a terminal device provided in an embodiment of this application;

[0129] Figure 2 This is a schematic diagram of the front structure of a terminal device provided in an embodiment of this application;

[0130] Figure 3This is a schematic diagram of the rear structure of a terminal device provided in an embodiment of this application;

[0131] Figure 4 This is a folding schematic diagram of a terminal device provided in an embodiment of this application;

[0132] Figure 5 A schematic diagram of a main screen display camera application provided in an embodiment of this application;

[0133] Figure 6 A schematic diagram of the interface of a camera application that rotates 90° counterclockwise on the main screen, provided for an embodiment of this application;

[0134] Figure 7 A schematic diagram of the interface of a secondary screen display camera application provided in an embodiment of this application;

[0135] Figure 8 A schematic diagram of an interface where the secondary screen is rotated 90° counterclockwise, provided for an embodiment of this application;

[0136] Figure 9 This application provides a schematic diagram of the structure of a main sensor and a secondary sensor within a terminal device.

[0137] Figure 10 A schematic diagram illustrating the direction of data collected by the main sensor and the secondary sensor in a folded state, provided in an embodiment of this application;

[0138] Figure 11 This is a schematic diagram of the structure of another terminal device provided in an embodiment of this application;

[0139] Figure 12 This application provides a technical architecture diagram of a terminal device interface display method according to an embodiment of the present application.

[0140] Figure 13 A timing diagram illustrating a terminal device interface display method provided in an embodiment of this application;

[0141] Figure 14 A schematic diagram illustrating the correct interface displayed on the secondary screen after it is rotated 90° counterclockwise, as provided in an embodiment of this application.

[0142] Figure 15 A timing diagram of another interface display method for a terminal device provided in an embodiment of this application;

[0143] Figure 16 A timing diagram of another terminal device interface display method provided in an embodiment of this application. Detailed Implementation

[0144] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limiting purposes, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details.

[0145] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0146] It should also be understood that in the embodiments of this application, "one or more" refers to one, two, or more; "and / or" describes the relationship between the associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following associated objects have an "or" relationship.

[0147] Furthermore, in the description of this application and the appended claims, the terms "first," "second," "third," "fourth," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0148] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0149] This application provides an interface display method that can be applied to terminal devices. The terminal device can be a tablet computer, mobile phone, wearable device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), etc. These terminal devices can have at least two screens in any form, and therefore can also be referred to as multi-screen terminals. This application does not limit the specific type of multi-screen terminal.

[0150] Figure 1 A schematic diagram of a terminal device is shown. The multi-screen terminal 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a touch sensor 180K, an ambient light sensor 180L, at least two accelerometer sensors, etc.

[0151] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the multi-screen terminal 100. In other embodiments of this application, the multi-screen terminal 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0152] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), sensor coprocessor (SCP), baseband processor, and / or neural network processing unit (NPU), etc. The different processing units may be independent devices or integrated into one or more processors.

[0153] The controller can serve as the central nervous system and command center of the multi-screen terminal 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control the fetching and execution of instructions.

[0154] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0155] USB interface 130 is an interface that conforms to the USB standard specification, specifically it can be a Mini USB interface, Micro USB interface, USB Type C interface, etc. USB interface 130 can be used to connect a charger to charge the multi-screen terminal 100, and it can also be used for data transfer between the multi-screen terminal 100 and peripheral devices.

[0156] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the multi-screen terminal 100. In other embodiments of this application, the multi-screen terminal 100 may also adopt different interface connection methods or a combination of multiple interface connection methods as described in the above embodiments.

[0157] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the multi-screen terminal 100. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0158] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of multi-screen terminal 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and at least one application program required for a function (such as sound playback function, image playback function, etc.).

[0159] In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0160] The charging management module 140 is used to receive charging input from the charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130.

[0161] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.

[0162] In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may also be located in the same device.

[0163] The wireless communication function of the multi-screen terminal 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0164] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the multi-screen terminal 100 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0165] The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on the multi-screen terminal 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1.

[0166] The wireless communication module 160 can provide solutions for wireless communication applications on the multi-screen terminal 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0167] In some embodiments, the antenna 1 of the multi-screen terminal 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the multi-screen terminal 100 can communicate with the network and other devices through wireless communication technology.

[0168] The multi-screen terminal 100 can implement audio functions, such as music playback and recording, through an audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0169] The audio module 170 is used to convert digital audio signals into analog audio signals for output, and also to convert analog audio inputs into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0170] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The multi-screen terminal 100 can listen to music or make hands-free calls through the speaker 170A.

[0171] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the multi-screen terminal 100 answers a phone call or voice message, the receiver 170B can be brought close to the listener's ear to receive the voice message.

[0172] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Multi-screen terminal 100 can be equipped with at least one microphone 170C. In some embodiments, multi-screen terminal 100 can be equipped with two microphones 170C, which, in addition to monitoring voice messages, can also perform noise reduction. In other embodiments, multi-screen terminal 100 can also be equipped with three, four, or more microphones 170C, enabling sound signal acquisition, noise reduction, sound source identification, and directional recording functions. Headphone jack 170D is used to connect wired headphones. Headphone jack 170D can be a USB interface 130, or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, or a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0173] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Multi-screen terminal 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, multi-screen terminal 100 detects the touch operation intensity based on pressure sensor 180A. Multi-screen terminal 100 can also calculate the touch position based on the detection signal from pressure sensor 180A.

[0174] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of multi-screen terminal 100, in a different position than display screen 194.

[0175] The ambient light sensor 180L is used to sense ambient light intensity. The multi-screen terminal 100 can adaptively adjust the brightness of its display screen 194 based on the sensed ambient light intensity. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the multi-screen terminal 100 is in a pocket to prevent accidental touches.

[0176] The 180B accelerometer sensor is used to sense acceleration force. Acceleration force is the force acting on the multi-screen terminal's body during acceleration, such as gravity. Each screen of the multi-screen terminal can be equipped with an accelerometer sensor. That is, there can be 2 to N accelerometer sensors within the multi-screen terminal.

[0177] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. The multi-screen terminal 100 can receive button input and generate key signal inputs related to user settings and function control of the multi-screen terminal 100.

[0178] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback.

[0179] The multi-screen terminal 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0180] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a minimized display, a microLED, a micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the multi-screen terminal 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0181] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the multi-screen terminal 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0182] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the multi-screen terminal 100. The multi-screen terminal 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The multi-screen terminal 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the multi-screen terminal 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the multi-screen terminal 100 and cannot be separated from it.

[0183] This application does not specifically limit the structure of the execution subject of an interface display method. As long as the code recording an interface display method according to this application is executed, communication can be performed according to the interface display method provided in this application. For example, the execution subject of an interface display method provided in this application can be a functional module in a terminal device capable of calling and executing a program, or a communication device applied in a terminal device, such as a chip.

[0184] As mobile phones become increasingly popular, people's demand for large-screen phones is also growing stronger. However, as the screen size increases, the surface area of ​​the phone also becomes larger, making it inconvenient to carry. Therefore, foldable screen phones, which balance portability and screen requirements, are becoming increasingly popular.

[0185] Reference Figure 2 This is a schematic diagram of the front structure of a foldable screen mobile phone provided in an embodiment of this application.

[0186] The foldable phone in this embodiment includes a first body and a second body, which are connected and can be folded along the connection point. As shown in the figure, there is a virtual folding axis between the first body and the second body, which can be understood as the line where the plane of the first body and the plane of the second body intersect when they are not on the same plane. The width of the first body of the foldable phone is greater than the width of the second body. Screens are provided on the first body and the second body. When the first body and the second body are in an unfolded state, the screens on the first body and the second body are in an unfolded state; when the first body and the second body are in a folded state, the screens on the first body and the second body are in a folded state. The portion of the screen located in the area of ​​the first body is the first display area, and the portion of the screen located in the area of ​​the second body is the second display area. With the folding or unfolding action between the first body and the second body, the first display area and the second display area of ​​the screen also fold or unfold accordingly. For ease of subsequent description, the first display area of ​​the display screen is referred to as the first screen, and the second display area of ​​the display screen is referred to as the second screen. In addition, a front-facing camera is provided on the side of the first body that is located on the first screen.

[0187] Reference Figure 3 ,for Figure 2 The diagram shows the rear structure of a foldable phone; a rear camera-related component is located on the side of the first body facing away from the first screen. Although not shown in the diagram, it can be understood that the rear camera-related component may include one or more of the following: flash, wide-angle camera, standard camera, and depth-sensing camera, etc.

[0188] Figure 2 and Figure 3 The folding angle between the first and second bodies of the foldable phone shown can be from 0° to 180°. Of course, in actual applications, the folding angle may have slight differences from the set folding angle; for example, the folding angle may be greater than 180°.

[0189] Reference Figure 4This diagram illustrates a foldable phone with its first and second bodies folded at a 0° angle. Both the first screen on the first body and the second screen on the second body face outwards, meaning their display orientation is towards the outside of the entire body. Furthermore, the first and second screens are back-to-back, meaning their display orientations are opposite. When the second screen faces the user, because the width of the second body is less than the width of the first body, the user can see the second screen and the areas of the first body not covered or obstructed by the second body (e.g., rear camera components). Similarly, when the first screen faces the user, because the width of the first body is greater than the width of the second body, the first screen is visible from the user's perspective. This application does not further illustrate this with illustrations. It can be understood that the display orientation of the screen refers to the orientation of the content displayed on the screen.

[0190] based on Figure 4 The defined folding angle is understandable. Figure 2 and Figure 3 In the foldable phone shown, the folding angle between the first body and the second body is 180°. At this time, the first screen on the first body and the second screen on the second body face the same side of the entire body, that is, the display direction of the first screen and the second screen is the same.

[0191] Of course, if the structure is set up reasonably and the flexibility of the folding screen meets the requirements, the folding angle between the first body and the second body can be greater than 180°.

[0192] When the folding angle between the first body and the second body is 360°, the first screen on the first body and the second screen on the second body face the inside of the entire body, and the first screen and the second screen are facing each other. This application will not provide further examples through illustrations.

[0193] As mentioned earlier, the first screen and the second screen can be two areas of the same complete screen. The first screen is one area of ​​the complete screen, and the second screen is the other area. These two areas of the complete screen are respectively located on the first and second bodies. When the first and second bodies are folded or unfolded, the two areas of the complete screen also fold or unfold accordingly. Therefore, this screen arrangement requires the complete screen to have good flexibility, allowing it to withstand numerous folding and unfolding cycles at the junction of the first and second screens. Because the content is displayed on the entire complete screen, the display effect is better from the user's perspective, resulting in a superior user experience.

[0194] In this embodiment, the first screen and the second screen can also be two independent screens, respectively disposed on the first body and the second body. Since the first screen and the second screen are two independent screens, they do not need to be flexible screens, resulting in relatively lower costs. However, when displaying content through the first screen and the second screen, the display effect is poor due to the splicing marks in the middle.

[0195] Figure 2 The foldable phone shown has a first screen and a second screen, so users can switch the content displayed on the foldable phone between the first screen and the second screen.

[0196] As an example of a scenario, refer to Figure 5 When a user uses the foldable phone and takes a selfie facing the first screen, the foldable phone uses the front-facing camera, and the first screen displays the camera app interface (this camera app can be used as an example of the first application). Figure 5 The interface shown can be considered as an example of a first interface. This camera application interface displays a selfie taken by the user using the front-facing camera. Furthermore, from the user's perspective, the icons in the camera application interface displayed on this first screen are vertically oriented. Here, "upright" and "inverted" are opposite directions; "upright" can be a pre-set display direction for the icon, and "inverted" is the direction the icon is in after rotating 180°. Taking the display of text or numbers in the icon as an example, an upright display of the icon represents the normal display of the text or number, while an inverted display represents the direction the text or number is in after rotating 180°.

[0197] When a user rotates the foldable phone approximately 90° so that the first screen of the foldable phone is in landscape mode, some icons and selfie images on the interface displayed on the first screen of the foldable phone will rotate 90° relative to the first screen itself.

[0198] Reference Figure 6 As shown, the user rotates counterclockwise. Figure 5 The diagram illustrates the interface displayed on the first screen of a foldable phone after it has been rotated approximately 90 degrees. In this diagram, the virtual buttons are rotated 90 degrees clockwise relative to the first screen itself. For example, the "AI button," "flash button," "focus indicator," and "camera switch button" are all rotated clockwise relative to the first screen. The selfie screen is also rotated 90 degrees clockwise relative to the first screen. After these icons and the selfie screen are rotated 90 degrees clockwise, from the user's perspective, they are displayed vertically. The "AI button," "flash button," "focus indicator," or "camera switch button" in the above example can all serve as examples of the first icon.

[0199] Because the first screen is rotated approximately 90° counterclockwise, the virtual buttons and selfie screen are rotated 90° clockwise relative to the foldable phone itself. Therefore, from the user's perspective, these virtual buttons and selfie screen do not switch from a "vertical" display state to a "horizontal" display state along with the first screen. This provides users with a better visual experience.

[0200] In practical applications, all displayed content in the interface can be rotated accordingly, or only some displayed content can be rotated accordingly. This application embodiment does not limit which content is set to rotate accordingly.

[0201] Additionally, because some virtual button icons have a special symmetrical structure, from the user's perspective, the displayed direction is the same after rotation and before rotation. Therefore, some virtual buttons may actually rotate, but from the user's perspective, it may not appear as if they have rotated.

[0202] Figure 5 and Figure 6 The automatic rotation function shown is implemented based on a sensor built into the foldable phone, which is an accelerometer. The direction of the acceleration detected by the accelerometer determines the display direction of the content on the interface.

[0203] In practical use, whether Figure 5 The vertical shot shown is still Figure 6 The horizontal shot shown uses the front-facing camera for selfies, and front-facing cameras on phones typically don't produce the same image quality as rear cameras (e.g., lower pixel count). Therefore, the user can switch the camera app from the first screen to the second screen on the foldable phone by flipping the phone so that both the second screen and the rear camera face the user. In practice, a screen switching button (referred to as the first screen switching button) can be displayed on the camera app interface. Clicking this button switches the camera app from the first screen to the second screen. Alternatively, a screen switching button (referred to as the second screen switching button) can be placed in the system menu bar (e.g., triggered by swiping down from the top of the screen). Clicking this button also switches the camera app from the first screen to the second screen. Of course, a preset gesture can also trigger the camera app to switch from the first screen to the second screen; this can be referred to as the first operation.

[0204] Reference Figure 7 This is a selfie effect image when the user uses the camera application interface displayed on the second screen.

[0205] The same interface of the same application can be completely identical or different when displayed on the first screen and the second screen. As an example of difference, the content of the displayed interface can be adaptively adjusted based on the aspect ratio of the first and second screens. For example, when the width of the second screen is smaller than the width of the first screen, some virtual buttons in the width direction can be hidden, and the user can trigger the multi-screen terminal to display the hidden virtual buttons on that interface through a swipe gesture. Figure 7 The interface shown can serve as an example of a second interface, which hides the "large aperture button" and "more button" relative to the first interface.

[0206] When users take selfies using the camera app interface displayed on the second screen, they can also take photos horizontally. For example, they can rotate the foldable phone about 90° so that the second screen of the foldable phone is in landscape mode. In this case, some icons and selfie images displayed on the second screen of the foldable phone will also rotate 90° relative to the second screen.

[0207] Reference Figure 8 As shown, the user rotates counterclockwise. Figure 7 The diagram illustrates the interface displayed on the second screen of a foldable phone after the second screen has been rotated approximately 90 degrees. In this diagram, some virtual buttons are also rotated 90 degrees counter-clockwise relative to the second screen. For example, the "AI button," "focus indicator," and "camera switching button" are displayed vertically upside down relative to the counter-clockwise rotation of the second screen. The selfie screen is also rotated 90 degrees counter-clockwise relative to the second screen and displayed vertically upside down. From the user's perspective, when using the second screen in landscape mode, these virtual icons and the selfie screen appear to be rotated in the wrong direction.

[0208] Analysis revealed that while accelerometers can be placed on both the first and second bodies of a foldable phone, and the orientation of the content displayed on the first screen of the first body's camera application interface is determined based on data collected by the accelerometer on the first body, and the orientation of the content displayed on the second screen of the second body's camera application interface is determined based on data collected by the accelerometer on the second body, the operating system can only register one accelerometer. Therefore, upper-layer applications can only receive data reported by the accelerometer on one body (e.g., the first body). Figure 8In the scenario shown, the display orientation determined by the data collected by the accelerometer on the first unit and the data collected by the accelerometer on the second unit are completely opposite. According to the operating system's process: when the camera application interface is displayed on the second screen, the display orientation is determined based on the data uploaded by the accelerometer on the first unit. Therefore, this causes the icons and other content in the interface displayed on the second screen of the second unit to be flipped. For a clearer understanding of the reason for this flipping, please refer to [link / reference needed]. Figure 9 and Figure 10 Description of the scenario shown.

[0209] Reference Figure 9 This is a schematic diagram showing the positional relationship between the accelerometer and the body when the folding angle between the first body and the second body in the foldable screen mobile phone provided in this application embodiment is 180°.

[0210] For ease of description, the first screen mounted on the first body can be referred to as the main screen, the accelerometer mounted on the first body can be referred to as the main sensor or the first sensor, the second screen mounted on the second body can be referred to as the secondary screen, and the accelerometer mounted on the second body can be referred to as the secondary sensor or the second sensor. The main sensor is the accelerometer registered in the operating system.

[0211] The main sensor can detect data in three directions: the x-axis, y-axis, and z-axis. Both the x-axis and y-axis of the main sensor are parallel to the plane containing the first body. As an example of the specific directions of the x-axis and y-axis, the x-axis is parallel to the shorter side of the first body and points to the right; the y-axis is parallel to the longer side of the first body and points upwards; and the z-axis is perpendicular to the plane containing the first body and faces towards the screen. The directional terms "right" and "up" are used in conjunction with... Figure 9 The structural diagram shown serves as a basic orientation representation.

[0212] The secondary sensor can also detect data in three directions: data along its x-axis, y-axis, and z-axis. The x-axis and y-axis of the secondary sensor are parallel to the plane of the second body. As an example of the specific directions of the x-axis and y-axis, the x-axis is parallel to the shorter side of the second body and points to the right; the y-axis is parallel to the longer side of the second body and points upwards; and the z-axis is perpendicular to the plane of the second body and faces towards the screen. The directional terms "right" and "up" are used in conjunction with... Figure 9 The structural diagram shown serves as a basic orientation representation.

[0213] Any two of the three axes of the main sensor are perpendicular to each other; the three axes of the main sensor may also not be perpendicular. Figure 9 The directions shown in the illustrated embodiment, for example, the positions of the x-axis, y-axis, and z-axis of the main sensor can be arbitrarily interchanged, or the directions of any one or more axes of the main sensor and Figure 9 The directions shown are the opposite directions, or any directions provided that one axis is perpendicular to the plane containing the first body, and the other two axes are perpendicular to and parallel to the two planes containing the first body. Similarly, the three axes of the sub-sensor also follow the above description of directions. Typically, when the folding angle between the first and second bodies is 180°, the directions of the three axes of the main sensor are consistent with the directions of the three axes of the sub-sensor.

[0214] The accelerometer measures the acceleration components on the three axes mentioned above. When the multi-screen terminal is stationary, it measures the gravitational acceleration components on the three axes.

[0215] Continue with Figure 9 Taking the directions of the three axes of the main sensor and the three axes of the sub-sensor as examples, when the folding angle between the first and second bodies is 180 degrees, the positive direction of the x-axis on the main sensor and the positive direction of the x-axis on the sub-sensor are consistent, for example, they can be in the same direction; the positive direction of the z-axis on the main sensor and the positive direction of the z-axis on the sub-sensor are consistent, for example, they can be in the same direction; when the folding angle between the first and second bodies is any other angle between 0 and 180 degrees, the positive direction of the x-axis on the main sensor and the positive direction of the x-axis on the sub-sensor are inconsistent, for example, they are in opposite directions when the folding angle is 0 degrees; the positive direction of the z-axis on the main sensor and the positive direction of the z-axis on the sub-sensor are inconsistent, for example, they are in opposite directions when the folding angle is 0 degrees; regardless of the folding angle between the first and second bodies, the positive direction of the y-axis on the main sensor and the positive direction of the y-axis on the sub-sensor are consistent, for example, they can be in the same direction.

[0216] Reference Figure 10 This is a schematic diagram showing the positional relationship between the accelerometer and the body when the folding angle between the first body and the second body in the foldable screen phone provided in this application embodiment is 0°.

[0217] When the folding angle between the first and second bodies in a foldable phone is 0°, the positive direction of the y-axis on the main sensor and the positive direction of the y-axis on the secondary sensor are consistent, for example, they can be in the same direction; the positive direction of the x-axis on the main sensor and the positive direction of the x-axis on the secondary sensor are inconsistent, for example, they are in opposite directions; the positive direction of the z-axis on the main sensor and the positive direction of the z-axis on the secondary sensor are inconsistent, for example, they are in opposite directions.

[0218] When the foldable phone is in portrait mode for selfies, the data along the y-axis plays a major role in determining the display orientation of the content on the second screen. The positive y-axis on the main sensor and the positive y-axis on the secondary sensor are in the same direction, so it does not affect the display orientation of the content on the second screen when it is in portrait mode.

[0219] When a foldable phone is in landscape mode for selfies, the data along the x-axis plays a major role in determining the display orientation of the content on the second screen. The positive x-axis on the main sensor and the positive x-axis on the secondary sensor are in opposite directions. Therefore, if the upper-layer application still uses the data reported by the main sensor, it will affect the display orientation of the content on the second screen when the phone is in landscape mode.

[0220] In view of this, embodiments of this application provide an interface display method for a multi-screen terminal, which can realize: when displaying the interface on the screen of the body where the secondary sensor is located, the display direction is determined based on the data collected by the secondary sensor; when displaying the interface on the screen of the body where the primary sensor is located, the display direction is determined based on the data collected by the primary sensor.

[0221] Furthermore, as can be understood from the above description, the interface display method for multi-screen terminals provided in this application embodiment is not only applicable to the foldable screen phone provided in the above embodiment, but also applicable to the following types of multi-screen terminals: comprising at least two bodies equipped with screens, wherein the at least two bodies equipped with screens can be arranged in a non-parallel state between the planes on which the at least two bodies equipped with screens are located by changing their relative poses, and each of the at least two bodies equipped with screens is equipped with an accelerometer. When applying the interface display method for multi-screen terminals provided in this application embodiment to this type of terminal, when displaying an application interface on the screen of any of the at least two bodies equipped with screens, the display direction of the content in the interface can be determined based on data provided by the accelerometer inside the body on which the screen is located.

[0222] As another example of a terminal that can implement the interface display method of the multi-screen terminal provided in the embodiments of this application, refer to Figure 11 The diagram shows the structure of a foldable screen phone.

[0223] Figure 11In the foldable phone shown, when the phone is folded, the first screen on the first body and the second screen on the second body face each other. A third screen is also located on the second body, and the third screen and the second screen face away from each other. When the application interface is displayed on the first screen, the display direction of the content is determined by an accelerometer on the first body where the first screen is located. When the application interface is displayed on the second or third screen, the display direction of the content is determined by accelerometers on the second body where the second and third screens are located, respectively.

[0224] The following will be based on Figure 9 and Figure 10 Taking the foldable screen phone shown as an example, this application describes in detail the specific implementation of the interface display method for a multi-screen terminal provided in the embodiments.

[0225] Figure 12 This is a technical architecture diagram of the interface display method for a multi-screen terminal provided in this application embodiment. The left side of the diagram represents the Application Processor (AP), and the right side represents the ADSP (Analog Devices Signal Processor) chip. The AP chip is the application processor in the multi-screen terminal; the operating system, user interface, and applications all execute on the AP chip, which can be referred to as the first processor. The ADSP chip is a chip dedicated to digital signal processing and can be referred to as the second processor. On the main chip side, this application embodiment mainly involves the application layer, application framework layer, and hardware abstraction layer.

[0226] Application A is located in the application layer. Application A can be some applications that come with the multi-screen terminal itself, or applications that the user installs on the multi-screen terminal. As an example, application A can be a camera application.

[0227] The display service resides in the application framework layer and serves as a system application or service. It can monitor the display status of multiple screen terminals in real time, such as the main screen display and the secondary screen display.

[0228] The overall device status management service is located in the application framework layer. This service is used to manage and maintain the display status of multi-screen terminals, including the main screen display and the secondary screen display. In practical applications, it may also include screen on or off.

[0229] The status monitoring unit, the main sensor abstraction module, and the data switching switch are located in the sensorhal, which is located in the hardware abstraction layer.

[0230] The system state management service located in the application framework layer and the sensorhal located in the hardware abstraction layer exchange information via the HIDL interface. The interface used to implement information exchange between the application framework layer and the hardware abstraction layer includes the operating system's HIDL interface A, and also includes another HIDL interface B provided in this application embodiment, which can be a custom interface.

[0231] The main sensor abstraction module is used to receive acceleration data sent by the main sensor module from the ADSP side.

[0232] The status monitoring unit is used to monitor the display status transmitted by the application framework layer.

[0233] The data switching switch is used to send an enable command to the data synchronization unit to the ADSP when switching to the secondary screen display, and to send a disable command to the data synchronization unit to the ADSP when exiting the secondary screen display (e.g., when the main screen is displayed and the screen is off).

[0234] Switching to the secondary screen display can be: the previous display state is the main screen display, and the current display state is the secondary screen display; or the previous information is the screen off, and the current information is the screen on and the display state is the secondary screen display. Exiting the secondary screen display can be: the previous display state is the secondary screen display, and the current display state is the main screen display; or the previous display state is the secondary screen display, and the current information is the screen off.

[0235] In implementing the interface display method provided in the embodiments of this application, the sensorhidl process in sensorhal implements the functions listed above for each module by calling the main sensor abstraction module, the status monitoring unit, and the data switching switch.

[0236] On one side of the ADSP chip, there are a main sensor module, a secondary sensor module, and a data synchronization unit.

[0237] The main sensor module can receive acceleration data reported by the main sensor;

[0238] The secondary sensor module can receive acceleration data reported by the secondary sensor;

[0239] The data synchronization unit is used to replace the data reported by the main sensor with the data reported by the secondary sensor when the secondary screen is displayed, when the secondary screen is turned on. When the secondary screen is turned off, the replacement of the data reported by the main sensor with the data reported by the secondary sensor is no longer performed.

[0240] The ADSP uses two threads to implement the functions of each module.

[0241] As an example, the sensorpd-1 thread can call the main sensor module to receive acceleration data reported by the main sensor, and the sensorpd-2 thread can call the secondary sensor module to receive acceleration data reported by the secondary sensor; the sensorpd-1 thread can also call the data synchronization unit to replace the data described above.

[0242] The dotted lines in the diagram represent the process of transmitting the display status of the multi-screen terminal. The overall system status management service can receive the display status of the foreground application A from application A, or it can obtain the display status from the system's display service. The overall system status management service can transmit the display status to the status monitoring unit in the sensorhal through the HIDL interface B. The status monitoring unit can turn on the data switching switch, thereby triggering the data switching switch to send the current display status to the data synchronization unit on the ADSP side. The data synchronization unit can record the latest display status.

[0243] In the diagram, the solid lines represent the data transfer process from the sensor to application A. The main sensor reports the data it collects to the main sensor module in the ADSP; the secondary sensor reports the data it collects to the secondary sensor module in the ADSP. When the display is in secondary screen mode, the data synchronization unit replaces the data reported by the main sensor with the data reported by the secondary sensor. Then, the ADSP chip sends the secondary sensor data (the original main sensor data has been replaced by the secondary sensor data, and the data identifier is the registered main sensor identifier) ​​to the main sensor abstraction module in the sensorhal on the AP chip side. The main sensor abstraction module in the sensorhal sends the received secondary sensor data (carrying the main sensor identifier) ​​to the overall system state management service through HIDL interface A. The overall system state management service then sends the received secondary sensor data (carrying the main sensor identifier) ​​to application A, enabling application A to determine the display orientation of the content on the interface based on the received secondary sensor data with the sensor identifier.

[0244] This architecture diagram illustrates that, without altering the transmission process of the main sensor data, when the secondary screen is displayed, application A can receive secondary sensor data, allowing the content on application A's interface to rotate automatically and correctly. Furthermore, for any third-party application, during development, there's no need to consider the underlying internal implementation; it only needs to listen to the data of a sensor identifier according to the original logic. This allows it to adjust the display orientation of the content on the main screen based on the main sensor data within the main screen's internal system, and adjust the display orientation of the content on the secondary screen based on the secondary sensor data within the secondary screen's internal system.

[0245] To better understand the interface display methods for multi-screen terminals corresponding to this architecture diagram, refer to... Figure 13 This is a timing diagram of the interface display method for multi-screen terminals based on this architecture diagram.

[0246] S101, the display service sends the display status of the display screen to the overall system status management service.

[0247] In this embodiment, the display service (displaymanagerservice), as a background service program of the system, can monitor the display status of the screen and, when a change in the display status is detected, send the changed display status to the overall system state management service (e.g., devicestateproviderimpl). This embodiment takes the detection of a secondary screen display as an example.

[0248] As an example, when any application switches from the main screen display to the secondary screen display, the display service detects the change in display status and can send the display status "secondary screen display" to the device state management service; when any application switches from the secondary screen display to the main screen display, the display service detects the change in display status and can send the display status "main screen display" to the device state management service; in this way, the device state management service can record the latest display status of the screen.

[0249] Of course, when the display service detects that the screen is on or off, it can also send the corresponding display status to the overall device status management service.

[0250] As an example of switching between the main screen and the secondary screen for application A, the switching between the main screen and the secondary screen can be achieved through virtual buttons (e.g., screen switching buttons) on the interface displayed when application A is running in the foreground. Alternatively, the switching between the main screen and the secondary screen can be achieved through gesture operations.

[0251] Of course, the interface of application A can also be switched between the main screen and the secondary screen using buttons provided by the system (such as the screen switching button in the drop-down menu).

[0252] When the display service detects that a foreground application is switching between the main screen and the secondary screen, it can send the latest display status of the foreground application to the overall device status management service.

[0253] In the above embodiments, the display state includes main screen display and secondary screen display. If the multi-screen terminal includes more screens, different names or identifiers can be set for each screen to determine the current display state of the multi-screen terminal.

[0254] S102, After receiving the display status sent by the display service, the whole machine status management service stores the display status.

[0255] In this embodiment, the overall device state management service can store the latest display state of the currently running application A in the foreground. In this embodiment, the display state displayed on the secondary screen can be recorded as the first state, and the display state displayed on the main screen can be recorded as the second state.

[0256] S103, the overall system status management service sends the display status to sensorhidl.

[0257] The overall system status management service can send display status to the sensorhidl process based on the HIDL interface B.

[0258] In practice, the HIDL interface B can be a custom interface with any name.

[0259] S104, after receiving the display status, the sensorhidl process sends the display status to the sensorpd-1 thread on the ADSP side.

[0260] The Sensorhidl process, as a process on the AP chip side, can send display status information to the sensorpd-1 thread on the ADSP side via inter-core communication. In specific implementations, the information sent by the AP chip to the ADSP chip that is displayed on the secondary screen is denoted as the second information, and the information sent by the AP chip to the ADSP chip that is displayed on the main screen is denoted as the first information.

[0261] S105, after the sensorpd-1 thread on the ADSP side receives the display status, it sets the display status flag to: secondary screen display flag based on the received display status.

[0262] The display status flag is maintained in sensorpd-1 in ADSP. This display status flag can be represented by "g_subscreen_display_state", and different characters can be used to represent different display states.

[0263] As an example, the main screen display can be represented by the character "1". That is, g_subscreen_display_state = 1 indicates that the application A running in the foreground is displayed on the main screen of the multi-screen terminal. This character can also be recorded as the first flag. The secondary screen display can be represented by the character "100". That is, g_subscreen_display_state = 100 indicates that the application A running in the foreground is displayed on the secondary screen of the multi-screen terminal. This character can also be recorded as the second flag. The above characters are only used as examples and do not impose any limitations on this application.

[0264] In this embodiment, the multi-screen terminal can enable an automatic rotation function for multiple applications installed on the multi-screen terminal; alternatively, it can disable the automatic rotation function, so that the content displayed on the interface of the multiple applications running in the foreground no longer rotates relative to the screen rotation. For example, an automatic rotation button can be set in the system menu bar of the multi-screen terminal, and users can click the automatic rotation button to enable or disable the automatic rotation function. When the automatic rotation button in the system menu bar is enabled, the content on the interface of multiple applications running on the multi-screen terminal can be automatically rotated.

[0265] Additionally, when application A is a camera application, regardless of whether the automatic rotation function is enabled on the multi-screen terminal, application A can enable the automatic rotation function applicable to application A itself after startup.

[0266] As an example, when the auto-rotate button in the system menu bar is off, the interface of another application B in the multi-screen terminal cannot automatically rotate its content. However, after application A is opened, the auto-rotate function applicable to application A can be enabled. Application A can then obtain data collected by the accelerometer corresponding to the screen displaying application A's interface. Based on the obtained data, application A can determine the display orientation of the content in application A's interface.

[0267] Reference Figure 13 Steps S201 to S210 are timing diagrams for when the automatic rotation function is enabled as application A is started.

[0268] S201, Application A sends a message to the sensorhidl process indicating that the automatic rotation service has been enabled.

[0269] In this embodiment, application A can be configured to automatically enable the auto-rotation service when running in the foreground. For example, if application A is a camera application, when application A is launched and running in the foreground or switched from the background to the foreground, it will send an activation message for the auto-rotation service to the sensorhidl process. In this embodiment, launching application A serves as the trigger condition for sending the activation message to the sensorhidl process. This activation message indicates that application A has enabled the auto-rotation service and requires the accelerometer to report the collected data. Whether the auto-rotation service is switched off after application A is closed or switched to the background depends on whether the system-level auto-rotation function of the foldable phone is enabled. For example, if the multi-screen terminal system does not enable the auto-rotation service, then the auto-rotation service of the multi-screen terminal will also be off after application A is closed or switched to the background. If the multi-screen terminal system enables the auto-rotation service, then the auto-rotation service of the multi-screen terminal will remain on after application A is closed or switched to the background. Enabling the system-level auto-rotation service can be triggered by operating the auto-rotation button in the system menu bar. This operation can be referred to as the second operation.

[0270] In addition, the activation information of this automatic rotation service indicates that application A has enabled the automatic rotation service, therefore, the accelerometer needs to report data.

[0271] In a specific implementation, application A can call the enablesensor() interface to the sensorservice in the application framework layer. When calling this interface, sampling parameters (such as sampling frequency or sampling period) are sent at the same time. The sensorservice in the application framework layer sends an enable command to sensorhal. This enable command can be used to indicate the start information of the auto-rotation service.

[0272] As another embodiment of this application, application A can be configured not to have the ability to enable the automatic rotation service when running in the foreground. Instead, its automatic rotation function depends on whether it is enabled at the system level of the multi-screen terminal. For example, if application A is a video playback application, and the automatic rotation service of the multi-screen terminal itself is enabled, application A will not send information to sensorhidl to enable or disable the automatic rotation service when switching to the foreground or after starting. However, the content displayed in the interface of application A when running in the foreground can change orientation as the screen of the multi-screen terminal rotates. If the automatic rotation service of the multi-screen terminal itself is disabled, the content displayed in the interface of application A when running in the foreground will not change orientation as the screen of the multi-screen terminal rotates. In this case, the information to enable or disable the automatic rotation service is not sent by application A to sensorhidl, but by another window management service in the system responsible for enabling or disabling the automatic rotation service. As an example, when a user clicks the "Auto Rotate" virtual button in the drop-down menu, it can trigger the window management service to send information to sensorhidl to enable or disable the auto rotation function. Consequently, the content on the interface of the application running in the foreground on the multi-screen terminal will automatically rotate.

[0273] Furthermore, since the triggering conditions of step S101 (e.g., any application switches to the secondary screen display) and the triggering conditions of step S201 (e.g., when application A is opened) do not have a logical order, in practical applications, it does not mean that step S101 necessarily precedes step S201.

[0274] S202, after receiving the automatic rotation service activation information, sensorhidl sends an acceleration sensor data acquisition request to sensorpd-1 on the ADSP side via inter-core communication.

[0275] S203, after receiving the acquisition request, sensorpd-1 on the ADSP side sends an acquisition command to the main sensor, which carries the sampling parameters.

[0276] In the specific implementation, the sensorpd-1 on the ADSP side calls write_mask() in the set_accel_mode() function to write the sampling parameters to the register of the main sensor via I2C, so as to trigger the main sensor to start sampling according to the sampling parameters. The sampling parameters can be the sampling rate or sampling period of the main sensor. For example, both sensors collect data at the first time period.

[0277] S204, sensorpd-1 on the ADSP side sends a sampling command to sensorpd-2 on the ADSP side.

[0278] This sampling command can carry the sampling parameters of the main sensor.

[0279] S205, the sensorpd-2 on the ADSP side sends a sampling command to the secondary sensor, which carries the same sampling parameters as the primary sensor.

[0280] The process by which sensorpd-2 on the ADSP side sends sampling commands to the secondary sensor can be referenced in the process by which sensorpd-1 on the ADSP side sends acquisition commands to the primary sensor. Since the data acquired by the secondary sensor needs to replace the data acquired by the primary sensor when the secondary screen is used for display, the primary and secondary sensors can be configured to use the same sampling parameters.

[0281] After S203, the main sensor reports the main sensor data collected by the main sensor based on the sampling parameters to sensorpd-1 on the ADSP side; after S205, the secondary sensor reports the secondary sensor data collected by the secondary sensor based on the sampling parameters to sensorpd-1 on the ADSP side.

[0282] Although the sampling parameters of the main sensor and the secondary sensor are the same, in practical applications, the reporting times of the main sensor and the secondary sensor are not necessarily completely consistent.

[0283] S206, the main sensor reports main sensor data to sensorpd-1 on the ADSP side.

[0284] S207, the secondary sensor reports secondary sensor data to sensorpd-2 on the ADSP side.

[0285] S208, on the ADSP side, sensor pd-2 sends secondary sensor data to sensor pd-1.

[0286] In practical applications, data reported by both the main sensor and the secondary sensor are stored in different storage spaces. When new data is stored in a storage space, an update message is sent to the corresponding thread, allowing the thread to retrieve the stored sensor data. Therefore, after step S207, sensor pd-2 stores the received secondary sensor data in storage space B. When new data is stored in storage space B, it sends an update message to sensor pd-1. If sensor pd-1 determines that the display state is secondary screen display, it retrieves the secondary sensor data from storage space B. For ease of description, this can be understood as sensor pd-2 sending secondary sensor data to sensor pd-1.

[0287] S209, when the ADSP receives sensor data reported by the secondary sensor and the current display status flag is set to secondary screen display, it stores the secondary sensor data; when it receives sensor data reported by the primary sensor and the current display status flag is set to secondary screen display, it replaces the primary sensor data with the stored secondary sensor data.

[0288] In practical implementation, a storage variable temp can be set. When the secondary screen is displayed and the received sensor data is secondary sensor data, the secondary sensor data is stored in this storage variable. When the secondary screen is displayed and the received sensor data is primary sensor data, the latest secondary sensor data stored in the storage variable replaces the currently received primary sensor data. In this way, the secondary sensor data can be transmitted to application A without changing the operating system's process of reporting sensor data from the primary sensor.

[0289] Specific examples are as follows:

[0290] if(state->rigid_body_type==1&&g_subscreen_display_state==100){

[0291] temp.x = opdata_cal.x;

[0292] temp.y = opdata_cal.y;

[0293] temp.z = opdata_cal.z;

[0294] }

[0295] if(state->rigid_body_type==0&&g_subscreen_display_state==100){

[0296] opdata_cal.x = temp.x;

[0297] opdata_cal.y = temp.y;

[0298] opdata_cal.z = temp.z;

[0299] }

[0300] Among them, rigid_body_type indicates whether the currently received sensor data is primary sensor data or secondary sensor data, with "0" indicating primary sensor data and "1" indicating secondary sensor data.

[0301] g_subscreen_display_state indicates the current display state; "100" indicates that the subscreen is being displayed.

[0302] temp.x represents the storage variable on the x-axis;

[0303] temp.y represents the storage variable on the y-axis;

[0304] temp.z represents the storage variable on the z-axis.

[0305] opdata_cal.x represents the data identifier on the x-axis in the data reported by the main sensor.

[0306] opdata_cal.y represents the data identifier on the y-axis in the data reported by the main sensor.

[0307] opdata_cal.z represents the data identifier on the z-axis in the data reported by the main sensor.

[0308] Although the operating system process can only register one primary sensor and obtain its data identifiers (opdata_cal.x, opdata_cal.y, opdata_cal.z), it is possible to continue transmitting the primary sensor's data (carrying the primary sensor identifier) ​​to application A when the primary screen is displayed. Similarly, when the secondary screen is displayed, the secondary sensor's data (carrying the same primary sensor identifier) ​​can be transmitted to application A in the same manner.

[0309] In practice, the storage variable contains the latest secondary sensor data. After obtaining the primary sensor data, the latest secondary sensor data in the storage variable is used to replace the latest primary sensor data. Even if the data collected by the primary sensor and the data collected by the secondary sensor are reported at slightly different times, the difference will not exceed one sampling period. Typically, the sampling period of the sensor is very short, while the flipping action of the user when using a foldable phone may take longer than the sampling period. Therefore, from the user's perspective, there will not be a significant delay.

[0310] Since the folding angle between the first screen and the second screen is the same regardless of the degree, the value on the y-axis of the main sensor and the value on the y-axis of the sub-sensor are the same. Therefore, in the above embodiment, there is no need for the process of storing the data on the y-axis of the sub-sensor and replacing the data on the y-axis of the main sensor. Thus, when reporting data, the reported data are: the data on the x-axis and z-axis of the sub-sensor and the data on the y-axis of the main sensor.

[0311] In practical applications, when users switch between the main screen and the secondary screen of a foldable phone, in most scenarios, both the main screen and the secondary screen are in a fully folded state. Figure 10 As shown in the diagram, the values ​​of the main sensor on the main body where the main screen is located and the secondary sensor on the secondary body where the secondary screen is located are exactly the same in the y-direction, opposite in the x-direction, and opposite in the z-direction. Therefore, it can be set that if the currently received data is from the main sensor and the current display status flag is for the secondary screen, then the x and z values ​​of the main sensor data will be flipped or rotated (180°).

[0312] Specific examples are as follows:

[0313] if(state->rigid_body_type==0&&g_subscreen_display_state==100){

[0314] opdata_cal.x=-opdata_cal.x;

[0315] opdata_cal.z=-opdata_cal.z;

[0316] }

[0317] Among them, rigid_body_type indicates whether the currently received sensor data is primary sensor data or secondary sensor data, with "0" indicating primary sensor data and "1" indicating secondary sensor data.

[0318] g_subscreen_display_state indicates the current display state; "100" indicates that the subscreen is being displayed.

[0319] opdata_cal.x represents the data identifier on the x-axis in the data reported by the main sensor.

[0320] opdata_cal.z represents the data identifier on the z-axis in the data reported by the main sensor.

[0321] The values ​​of the x-axis and z-axis data of the main sensor are kept constant, and a "-" sign is added before them to obtain the x-axis and z-axis data of the secondary sensor. The y-axis data of the main sensor remains unchanged to obtain the y-axis data of the secondary sensor. Accordingly, if the currently received main sensor data is displayed on the main screen and the current display status flag is set to main screen display, then the main sensor data (carrying the main sensor identifier) ​​is directly transmitted to application A.

[0322] This allows the same data identifier to be used to transmit data from the three axes collected by the main sensor when displayed on the main screen, and to transmit data from the three axes collected by the secondary sensor when displayed on the secondary screen.

[0323] Of course, this implementation method does not require the participation of secondary sensor data reported by the secondary sensor. That is, the secondary sensor may not need to be set in the multi-screen terminal, or if the secondary sensor is set, it is not necessary for the secondary sensor to collect data, or if the secondary sensor is set, the data collected by the secondary sensor does not need to undergo other conversion processing.

[0324] In practical applications, the specific method adopted can be selected according to the specific structure of the multi-screen terminal and the target user group. This application does not limit the specific implementation method.

[0325] S210, on the ADSP side, sensor pd-1 sends secondary sensor data to sensorhidl, and the identifier carried in this secondary sensor data is the registered primary sensor identifier.

[0326] S211, sensorhidl reports the received secondary sensor data (carrying the data identifier of the primary sensor) to application A.

[0327] S212, After receiving the data from the secondary sensor, application A determines the display direction of the content on the interface based on the received sensor data.

[0328] As an example of determining the display direction of icons on the interface based on sensor data, in this embodiment of the application, the data collected by the accelerometer is divided into components in three directions, each component being the acceleration component in that direction. When the multi-screen terminal is stationary, the components in the three directions are the components of gravitational acceleration in the three directions.

[0329] by Figure 9 The example shown illustrates the setup of an accelerometer sensor in a foldable phone. Since the z-axis represents the acceleration component perpendicular to the display screen, the display orientation can be determined based on the acceleration components along the x and y axes when determining the orientation of content on the interface. Figure 9 In the diagram, if the x-axis points to the right, then the opposite direction of the x-axis is to the left; if the y-axis points to the top, then the opposite direction of the y-axis is to the bottom.

[0330] If the acceleration component on the x-axis is greater than the acceleration component on the y-axis, and the acceleration component on the x-axis is positive, then the icon is displayed with the bottom of the icon pointing towards the x-axis: right, and the top of the icon pointing in the opposite direction of the x-axis: left. If the acceleration component on the x-axis is greater than the acceleration component on the y-axis, and the acceleration component on the x-axis is negative, then the icon is displayed with the bottom of the icon pointing in the opposite direction of the x-axis: left, and the top of the icon pointing in the positive direction of the x-axis: right. If the acceleration component on the x-axis is less than the acceleration component on the y-axis, and the acceleration component on the y-axis is positive, then the icon is displayed with the bottom of the icon pointing towards the y-axis: top, and the top of the icon pointing in the opposite direction of the y-axis: bottom. If the acceleration component on the x-axis is less than the acceleration component on the y-axis, and the acceleration component on the y-axis is negative, then the icon is displayed with the bottom of the icon pointing in the opposite direction of the y-axis: bottom, and the top of the icon pointing in the positive direction of the y-axis: top.

[0331] Of course, when users hold a multi-screen terminal, the acceleration components of the sensors in different directions may change abruptly. To avoid abrupt changes in the display orientation of icons and other displayed content, other restrictions can be set. For example, restrictions can be imposed from two angles: duration and / or the difference in acceleration components. When the difference between the acceleration components on the x-axis and y-axis is greater than or equal to a first threshold, and the duration is greater than a second threshold, the display switches to the direction corresponding to the larger acceleration component (the bottom of the icon faces that direction); otherwise, the display orientation of the previous moment is maintained. For example, when the difference between the acceleration components on the x-axis and y-axis is less than the first threshold, the display orientation of the previous moment is maintained.

[0332] Based on the secondary screen display flag in step S105, the data synchronization logic in S209, and the determination of the display direction of the interface content based on the secondary sensor data in step S212 in this example, it can be understood that when application A is running in the foreground and is displayed on the secondary screen, application A receives secondary sensor data and can determine the display direction of the content of the interface displayed on the secondary screen based on the secondary sensor data, thereby reducing... Figure 8 The icons that appear are flipped.

[0333] Correspondingly, in Figure 7 In the described scenario, regardless of whether the data collected by the main sensor or the secondary sensor is greater on the y-axis than on the x-axis, and the y-axis acceleration component is negative, it can be understood that when displaying the application interface in portrait mode on a secondary screen, the acceleration component on the y-axis is greater than on the x-axis, and the y-axis acceleration component is negative. Therefore, based on the above description, it can be understood that when displaying the application interface in portrait mode on a secondary screen, regardless of whether the data is collected by the main sensor or the secondary sensor, Figure 7 In the interface shown, the bottom of the icons faces the opposite direction of the y-axis (bottom), and the top of the icons faces the positive direction of the y-axis (top). Similarly, the preview image in this interface is displayed in the same direction as the icons.

[0334] If the user rotates counterclockwise Figure 7 When the foldable phone is rotated approximately 90 degrees, the display orientation of the content on the secondary screen can be determined in the following way:

[0335] A diagram illustrating the state of a foldable phone is shown below. Figure 8 and Figure 14 As shown.

[0336] by Figure 9 Taking the orientation of the sensor shown as an example, if the icon display orientation is determined based on the data collected by the main sensor, then the acceleration component on the x-axis of the main sensor is greater than the acceleration component on the y-axis, and the acceleration component on the x-axis is negative. Therefore, the bottom of the icon faces the opposite direction of the x-axis: to the left. That is, the bottom of the icon displayed on the second screen is located on one side of the folding axis, and the top of the icon is located on the side of the second screen opposite to the folding axis. Figure 8 The interface state shown is incorrect. Therefore, when the application interface is displayed on the secondary screen in landscape mode, if the display method of the content in the interface is determined based on the data collected by the main sensor below the main screen, an incorrect display will occur, resulting in a poor user experience.

[0337] by Figure 9 Taking the direction of the sensor shown as an example, if the icon display direction is determined based on the data collected by the secondary sensor, then the acceleration component on the x-axis of the secondary sensor is greater than the acceleration component on the y-axis, and the acceleration component on the x-axis is positive. Therefore, the bottom of the icon displayed on the second screen faces the side opposite to the folding axis, and the top of the icon faces the side opposite to the folding axis. Figure 14 The interface state is shown. Therefore, when the application interface is displayed on the secondary screen in landscape mode, if the display method of the content in the interface is determined based on the data collected by the secondary sensor below the secondary screen, the icons and preview screens in the interface can be displayed in a way consistent with the user's perspective.

[0338] Figure 14 In this design, the virtual buttons are rotated 90° clockwise relative to the second screen of the foldable phone. For example, the "AI button," "focus indicator," and "camera switching button" are all rotated 90° clockwise relative to the second screen of the foldable phone itself. The selfie screen is also rotated 90° clockwise relative to the second screen of the foldable phone itself. From the user's perspective, these virtual icons and the selfie screen are displayed vertically, which is more in line with the user's viewing orientation. Therefore, by adopting the interface display method of the multi-screen terminal provided in this application embodiment, some content displayed on the second screen can be correctly rotated when using the second screen in landscape mode.

[0339] In the examples above, the screen is rotated 90° counterclockwise as an example. In practical applications, the screen can be rotated clockwise or at other angles to achieve the correct rotation of the interface content in accordance with the display method of the terminal interface provided in the above embodiments.

[0340] In the above example, the x-axis, y-axis, and z-axis are for illustrative purposes only. The y-axis of the main sensor can be understood as an axis parallel to the folding axis between the main screen and the secondary screen; the z-axis of the main sensor can be understood as an axis perpendicular to the main screen; and the x-axis of the main sensor can be understood as an axis perpendicular to the plane containing the y-axis and z-axis of the main sensor. The y-axis of the secondary sensor can be understood as an axis parallel to the folding axis between the main screen and the secondary screen, and in the same direction as the y-axis of the main sensor; the z-axis of the main sensor can be an axis perpendicular to the main screen. When the screen containing the main sensor and the screen corresponding to the secondary sensor are unfolded into the same plane, the z-axis of the main sensor and the z-axis of the secondary sensor are in the same direction; the x-axis of the main sensor is an axis perpendicular to the plane containing the y-axis and z-axis of the secondary sensor. When the screen containing the main sensor and the screen corresponding to the secondary sensor are unfolded into the same plane, the z-axis of the main sensor and the x-axis of the secondary sensor are in the same direction.

[0341] As mentioned above, the overall system status management service can store the latest display state of the application running in the foreground. Therefore, the embodiments of this application can achieve the correct display of the content in the interface of the application displayed in the foreground after the screen-off event and the screen-on event, based on the display state of the foreground application maintained by the overall system status management service.

[0342] Figure 15 This is a timing diagram illustrating another application scenario of the interface display method for a multi-screen terminal provided in this application embodiment; this application scenario can be... Figure 13 The scenario is a continuation based on the timing diagram shown.

[0343] The illustration only shows... Figure 13 Some steps in the text, steps not shown, can be followed according to Figure 13 The description in the text, Figure 13 In the scenario shown, the multi-screen terminal displays application A on the secondary screen.

[0344] S301: After the display service detects that the screen is off, it sends screen off information to the overall system status management service.

[0345] In this embodiment, the multi-screen terminal can be triggered to enter a screen-off state via a physical button or other triggering process. After the multi-screen terminal enters the screen-off state, the screen-off information of the multi-screen terminal can be sent from the system's display service to the overall device status management service. The user's operation of clicking the physical button to trigger the multi-screen terminal to turn off the screen can be recorded as the third operation.

[0346] S302, after receiving the screen-off information, the overall system status management service maintains the display status as secondary screen display (this status is recorded as the first state).

[0347] In this embodiment, from the user's perspective, if application A was displayed on the secondary screen before the screen was turned off, and application A was not killed when the screen-on command was received, the user would expect that upon turning on the screen, the last interface of application A before the screen was turned off would continue to be displayed on the secondary screen, and that the content in the last interface of application A would be correctly oriented. Therefore, even when the screen is off, the display state in the overall device state management service can be maintained as secondary screen display.

[0348] S303, the system status management service sends a screen-off message to the sensorhidl process.

[0349] S304, the sensorhidl process sends a shutdown command to sensorpd-1 on the ADSP side.

[0350] Since the data collected by the accelerometer in the multi-screen terminal can be applied not only to the scenario of this application embodiment, but also to other scenario detection of the multi-screen terminal in the screen-off state, such as detecting when the phone is picked up by the user in the screen-off state, or detecting when the phone is flipped in the screen-off state, the main sensor and the secondary sensor can continue to collect data in the screen-off state of the multi-screen terminal. However, for the embodiments of this application, it is not necessary to use the data collected by the main sensor and the secondary sensor to determine the display direction. Therefore, in specific implementation, after the whole device state management service sends a shutdown command to sensorhidl, sensorhidl calls the state listening unit to send screen-off information. The state listening unit triggers the data switching switch based on the screen-off information and sends a shutdown command to the data synchronization unit.

[0351] S305, after receiving the shutdown command, sensorpd-1 on the ADSP side stops the replacement of main sensor data with secondary sensor data, and simultaneously stops the process of reporting sensor data to application A in this embodiment of the application, i.e., stops... Figure 13 The timing diagram shows step S209 and subsequent processes. However, the main sensor data and the sub-sensor data may be transmitted to other applications in other ways, and this application embodiment does not limit this.

[0352] S401: After the display service detects that the screen is on, it sends screen-on information to the overall system status management.

[0353] Multi-screen terminals can trigger the screen-on process via physical button operations (or gestures). After the screen-on process begins, if application A was displayed on the secondary screen before the previous screen-off, and application A was not killed when the screen-on information is received (application A may be killed in the screen-off state due to memory reclamation mechanisms), then the process of launching application A on the secondary screen will be executed. The operation that triggers the multi-screen terminal to transition from screen-off to screen-on is recorded as the fourth operation.

[0354] During the execution of the above process, the screen-on information of the multi-screen terminal can be sent from the system's display service to the overall system status management service.

[0355] S402, the status of the whole machine status management service query is displayed on the secondary screen.

[0356] In this embodiment of the application, the display state in the whole machine status management service continues to maintain the latest display state before the screen-off event after the screen-off event and the screen-on event: secondary screen display. Therefore, the query result is secondary screen display.

[0357] S403, the overall system status management service sends a screen-on message to sensorhidl.

[0358] After receiving the screen-on information, sensorhidl sends an enable command to sensorpd-1 on the ADSP side.

[0359] In a specific implementation, sensorhidl can call the status monitoring unit and the data switching switch to execute the following process: the status monitoring unit can receive the screen lighting information, and the status monitoring unit triggers the data switching switch to send an enable command to sensorpd-1 on the ADSP side based on the received screen lighting information.

[0360] After receiving the data synchronization start command, sensorpd-1 on the ADSP side starts the replacement process of the main sensor data with the secondary sensor data.

[0361] S406, when the sensorpd-1 on the ADSP side receives sensor data reported by the secondary sensor and the current display status flag is set to secondary screen display, it stores the secondary sensor data; when it receives sensor data reported by the primary sensor and the current display status flag is set to secondary screen display, it replaces the primary sensor data with the stored secondary sensor data.

[0362] S407, the sensorpd-1 on the ADSP side reports the secondary sensor data (carrying the primary sensor data identifier) ​​to sensorhidl.

[0363] The subsequent execution process can be referred to Figure 13 The steps following step S210 in the timing sequence shown.

[0364] Since the startup process of application A also takes time, application A has already received the secondary sensor data (carrying the primary sensor identifier) ​​before the first interface of application A is drawn. Therefore, the content of application A's interface displayed on the secondary screen of the multi-screen terminal has the correct display orientation. Of course, in actual applications, even if application A receives the secondary sensor data (carrying the primary sensor identifier) ​​after the first interface of application A has been drawn and displayed, application A's interface can still quickly and correctly display the data after receiving the sensor data.

[0365] Therefore, by maintaining the latest display state before the screen goes out during the screen-off period through the whole device state management service, the multi-screen terminal can continue to directly execute the process of determining the display direction of the content in the interface of the secondary screen when displaying application A after the screen is turned on, so that the content in the interface of application A can be displayed correctly as quickly as possible.

[0366] In some application scenarios, applications may malfunction, such as an application freezing on the secondary screen, preventing it from reporting its display status, or the primary screen misreporting the display status as a secondary screen display. These issues can cause errors in the display status of the overall device status management service and potentially lead to confusion in the primary and secondary sensor data in the data synchronization unit. Therefore, this application also provides a self-recovery scheme for abnormal scenarios, which automatically restores the device to a normal state after a series of screen-off and screen-on events.

[0367] Figure 16 This is a timing diagram of another application scenario of the interface display method for a multi-screen terminal provided in the embodiments of this application.

[0368] The timing diagram and Figure 15 The difference in the timing shown is:

[0369] When the screen-off process is executed on a multi-screen terminal, after the whole device status management service receives the screen-off information in step S301, it executes step S501 and subsequent steps.

[0370] S501, the overall system status management service settings display status is the main screen display (this status is recorded as the second status).

[0371] S502, the overall system status management service sends screen-off and main screen display information to sensorhidl when the display status is either screen off or main screen display.

[0372] After receiving the information about screen off and main screen display, S503's sensorhal sends a shutdown command to sensorpd-1 on the ADSP side. This command can carry the information about the main screen display.

[0373] After receiving the information displayed on the main screen by calling the status monitoring unit, Sensorhidl sends a shutdown command (carrying the main screen display information) to sensorpd-1 by calling the data switching switch.

[0374] After receiving the shutdown command, the sensorpd-1 on the S504 ADSP side sets the display status to the main screen display flag.

[0375] After step S504, the main sensor data and sub-sensor data on the ADSP side have been restored to the main sensor reporting process, and the confusion between the main sensor and sub-sensor that existed before has been eliminated.

[0376] Since the display status flag has already been set to the main screen display flag, the process of replacing the main sensor data with the secondary sensor data no longer needs to be executed.

[0377] When the screen-on process is executed on a multi-screen terminal, after the whole machine status management service receives the screen-on information in step S401, it executes step S601 and subsequent steps.

[0378] S601, the system status management service no longer queries its own stored display status.

[0379] S602, the overall system status management service received a display status message from the display service indicating that the secondary screen is being displayed.

[0380] If application A continues to be displayed on the secondary screen after the screen is turned on, the display service can also send the display status to the overall device status management service: secondary screen display.

[0381] S603, the overall system status management service sends screen-on information and the display status of the secondary screen to sensorhidl.

[0382] S604, sensorhidl sends an enable command to sensorpd-1 on the ADSP side, which carries secondary screen display information.

[0383] After receiving the information from the secondary screen display by calling the status monitoring unit, Sensorhidl determines that it is switching to the secondary screen display state and calls the data switching switch to send an enable command (carrying the secondary screen display information) to sensorpd-1 on the ADSP side.

[0384] After receiving the command to enable the secondary display, the sensorpd-1 on the S605 ADSP side sets the secondary display flag.

[0385] S606, the sensorpd-1 on the ADSP side enables the replacement of primary sensor data with secondary sensor data.

[0386] Of course, in practical applications, the process of replacing the main sensor data with the secondary sensor data can be skipped. Instead, the process of replacing the main sensor data with the secondary sensor data can be used when the display status flag is the secondary screen display flag.

[0387] S406, when the sensorpd-1 on the ADSP side receives sensor data reported by the secondary sensor and the current display status flag is set to secondary screen display, it stores the secondary sensor data; when it receives sensor data reported by the primary sensor and the current display status flag is set to secondary screen display, it replaces the primary sensor data with the stored secondary sensor data.

[0388] S407, the sensorpd-1 on the ADSP side reports the secondary sensor data (the main sensor data identifier) ​​to sensorhidl.

[0389] The subsequent execution process can be referred to Figure 13 The steps following step S210 in the timing sequence shown.

[0390] In this embodiment of the application, after the multi-screen terminal re-enters the screen-on process, it follows... Figure 13 The timing diagram shows the process of launching application A and displaying it on the secondary screen. Application A sends the display status to the overall device status management service. The overall device status management service executes subsequent processes based on the latest received display status. Therefore, even if application A continues to be displayed on the secondary screen after the screen is turned on, application A can continue to determine the display direction of the content in the interface based on the secondary sensor data (carrying the main sensor identifier).

[0391] The interface display method for a multi-screen terminal provided in this application embodiment can restore the secondary screen display state to the primary screen display state through a screen-off event, thereby enabling the ADSP to return to the process of transmitting data from the primary sensor to the upper-layer application; when the screen is turned on again, if application A has not been killed and is still displayed on the secondary screen, the trigger condition that application A is running in the foreground and displayed on the secondary screen during the screen-on event triggers application A to send the secondary screen display state to the overall device state management service. The overall device state management service will store the secondary screen display state and continue the subsequent process to update the display state flag in the ADSP to the secondary screen display flag, thereby restoring the process of transmitting secondary sensor data when the secondary screen is displayed.

[0392] The above embodiments all use the selfie interface of application A (a camera application) as an example to describe the interface display method of the multi-screen terminal provided in this application. In practical applications, the interface of the multi-screen terminal displaying photos already taken by application A on the secondary screen (i.e., the photo preview interface) is also applicable to the interface display method of the multi-screen terminal provided in this application. Of course, the interface display method of the multi-screen terminal provided in this application can also be applied when the multi-screen terminal itself has its automatic rotation service enabled and displays other applications on the secondary screen.

[0393] The primary and secondary accelerometers provided in this application are merely examples of primary and secondary sensors. In practical applications, the primary ambient light sensor located on one side of the primary screen and the secondary ambient light sensor located on the secondary screen are also applicable to the operations performed by the data synchronization unit in the interface display method of the multi-screen terminal provided in this application. The only difference is that the upper-layer application adjusts the brightness of the display screen based on the sensor data it receives. Of course, other similar sensors located on different screens of the multi-screen terminal are also applicable to the operations performed by the data synchronization unit provided in this application.

[0394] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0395] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, can implement the steps in the above-described method embodiments.

[0396] This application also provides a computer program product that, when run on a multi-screen terminal, enables the multi-screen terminal to implement the steps described in the above-described method embodiments.

[0397] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying the computer program code to the first device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0398] This application also provides a chip system, which includes a processor coupled to a memory. The processor executes a computer program stored in the memory to implement the steps of any method embodiment of this application. The chip system can be a single chip or a chip module composed of multiple chips.

[0399] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0400] Those skilled in the art will recognize that the units and method steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0401] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A method for displaying an interface, characterized in that, The invention is applied to a terminal device, which includes a first sensor, a second sensor, and a display screen, the display screen including a first screen and a second screen; when the terminal device is unfolded, the first sensor is located below the first screen, the second sensor is located below the second screen, and the first screen and the second screen have the same display orientation; When the terminal device is folded, the display orientations of the first screen and the second screen are opposite. The method includes: The terminal device displays a first interface of the first application on the first screen; During the process of displaying the first interface on the first screen, the terminal device acquires data collected by the first sensor through the first application; During the process of rotating the first screen counterclockwise by 90°, the terminal device rotates the first icon in the first interface clockwise by 90° relative to the first screen based on the data collected by the first sensor. The terminal device receives a first operation to switch to the second screen to display the first application; In response to the first operation, the terminal device displays a second interface of the first application on the second screen. The second interface is the interface after the first interface is adapted to the second screen, and the second interface includes the first icon. During the process of displaying the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application; During the process of rotating the second screen counterclockwise by 90°, the terminal device rotates the first icon in the second interface clockwise by 90° relative to the second screen based on the data collected by the second sensor.

2. The method as described in claim 1, characterized in that, During the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including: The terminal device acquires the data collected by the second sensor, and the data collected by the second sensor is the second data. If the second interface of the first application is displayed on the second screen, the terminal device stores the data collected by the second sensor; The terminal device acquires the data collected by the first sensor, and the data collected by the first sensor is the first data. If the second interface of the first application is displayed on the second screen, the terminal device replaces the data collected by the first sensor with the data collected by the second sensor stored in the terminal device to obtain the data after the first sensor is replaced. The data after the first sensor is replaced is the second data collected by the second sensor. The terminal device obtains data after the first sensor has been replaced through the first application.

3. The method as described in claim 1, characterized in that, The terminal device includes a first processor and a second processor, the first application runs on the first processor, and after the terminal device displays a second interface of the first application on the second screen, the method further includes: The first processor sends second information to the second processor, the second information indicating that it will be displayed on the second screen; After receiving the second information, the second processor sets the display status flag to a second flag, which is used to indicate that the information is displayed on the second screen. During the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including: The second processor acquires the data collected by the second sensor, and the data collected by the second sensor is the second data; When the display status flag bit in the second processor is the second flag, the second processor stores the data collected by the second sensor; The second processor acquires the data collected by the first sensor, and the data collected by the first sensor is the first data; When the display status flag in the second processor is the second flag, the second processor replaces the data collected by the first sensor with the data collected by the second sensor stored in the second processor. The data of the first sensor after being replaced is the second data collected by the second sensor. The second processor sends the data of the first sensor being replaced to the first application of the first processor; The first application in the first processor acquires data after the first sensor has been replaced.

4. The method as described in claim 1, characterized in that, When the terminal device is folded, the data values ​​of the first sensor in the first direction and the data values ​​of the second sensor in the first direction are the same but opposite in direction; the data values ​​of the first sensor in the second direction and the data values ​​of the second sensor in the second direction are the same but opposite in direction; and the data values ​​of the first sensor in the third direction and the data values ​​of the second sensor in the third direction are the same and in the same direction. During the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including: The terminal device acquires the data collected by the second sensor, and the data collected by the second sensor is the second data. The terminal device acquires the data collected by the first sensor, and the data collected by the first sensor is the first data. If the second interface of the first application is displayed on the second screen, the terminal device will flip the data in the first direction and the data in the second direction from the data collected by the first sensor. The terminal device obtains the data collected by the first sensor after the orientation is flipped through the first application.

5. The method as described in claim 1, characterized in that, The terminal device includes: a first processor and a second processor, wherein the first application runs on the first processor; after the terminal device displays a second interface of the first application on the second screen, the method further includes: The first processor sends second information to the second processor, the second information indicating that it will be displayed on the second screen; After receiving the second information, the second processor sets the display status flag to a second flag, which is used to indicate that the information is displayed on the second screen. During the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including: The second processor acquires the data collected by the second sensor, and the data collected by the second sensor is the second data; The second processor acquires the data collected by the first sensor, and the data collected by the first sensor is the first data; When the display status flag in the second processor is the second flag, the second processor flips the data in the first direction and the data in the second direction in the data collected by the first sensor. The second processor sends the data collected by the first sensor after the direction is flipped to the first application of the first processor; The first application in the first processor acquires data collected by the first sensor after the orientation is flipped.

6. The method according to any one of claims 1 to 5, characterized in that, The first interface of the first application includes a first screen switching button, and the first operation is an operation performed on the first screen switching button; Alternatively, the first operation may be a gesture operation performed on the first screen; Alternatively, the system menu bar may include a second screen switching button, and the first operation is an operation performed on the second screen switching button.

7. The method according to any one of claims 1 to 5, characterized in that, The method further includes: After the first application is launched, the terminal device acquires the first data collected by the first sensor at a first time period, and the terminal device acquires the second data collected by the second sensor at the first time period. Alternatively, upon receiving the second operation, the terminal device acquires the first data collected by the first sensor over a first time period, and the terminal device acquires the second data collected by the second sensor over the first time period, wherein the second operation is an operation performed on the auto-rotate button in the system menu bar.

8. The method according to any one of claims 1 to 7, characterized in that, After the terminal device displays the second interface of the first application on the second screen in response to the first operation, the method further includes: The terminal device receives a third operation; In response to the third operation, the terminal device turns off the display screen; The terminal device receives the fourth operation; In response to the fourth operation, the terminal device lights up the display screen and displays the second interface of the first application on the second screen; During the process of displaying the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application; During the process of rotating the second screen counterclockwise by 90°, the terminal device rotates the first icon in the second interface clockwise by 90° relative to the second screen based on the data collected by the second sensor.

9. The method as described in claim 8, characterized in that, The terminal device includes a first processor and a second processor, and the first application runs on the first processor; After the terminal device displays the second interface of the first application on the second screen in response to the first operation, the method further includes: The first processor sets the display state to a first state, which indicates that the display is on the second screen; After setting the display state to the first state, the first processor sends an enable command and second information to the second processor, the second information being used to indicate display on the second screen; After receiving the second information, the second processor sets the display status flag to the second flag; After receiving the start command, the second processor initiates a replacement operation, which is a replacement operation whereby the data collected by the second sensor replaces the data collected by the first sensor when the display status flag is the second flag.

10. The method as described in claim 9, characterized in that, After the terminal device turns off the display screen, the method further includes: The first processor maintains the display state as the first state; The first processor sends a shutdown command to the second processor; After receiving the shutdown command, the second processor disables the replacement operation; After the terminal device displays the second interface of the first application on the second screen in response to the fourth operation, the method further includes: The first processor queries the display status and finds it to be the first status; Based on the first state obtained from the query, the first processor sends an enable command to the second processor; After receiving the enable command, the second processor initiates the replacement operation; During the display of the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including: After the replacement operation is initiated, if the display status flag is the second flag, the second processor will replace the data collected by the first sensor with the data collected by the second sensor. The second processor sends the data of the first sensor after it has been replaced to the first processor.

11. The method as described in claim 9, characterized in that, After the terminal device turns off the display screen, the method further includes: The first processor sets the display state to a second state, which indicates that the display is on the first screen; The first processor sends a shutdown command and first information to the second processor; After receiving the shutdown command, the second processor disables the replacement operation; After receiving the first information, the second processor sets the display status flag to the first flag; After the terminal device displays the second interface of the first application on the second screen in response to the fourth operation, the method further includes: The first processor sets the display state to the first state; After setting the display state to the first state, the first processor sends an enable command and second information to the second processor; After receiving the second information, the second processor sets the display status flag to the second flag; After receiving the start command, the second processor initiates the replacement operation.

12. The method according to any one of claims 9 to 11, characterized in that, During the process of displaying the second interface on the second screen, the terminal device acquires data collected by the second sensor through the first application, including: After the replacement operation is initiated, if the display status flag is the second flag, the second processor will replace the data collected by the first sensor with the data collected by the second sensor. The second processor sends the data after the first sensor has been replaced to the first processor. The data after the first sensor has been replaced is the data collected by the second sensor. The first processor obtains the data after the first sensor has been replaced through the first application.

13. A terminal device, characterized in that, The terminal device includes a processor for running a computer program stored in a memory, such that the terminal device implements the method as described in any one of claims 1 to 12.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by one or more processors, implements the method as described in any one of claims 1 to 12.

Images