Interface display method, terminal equipment and storage medium

Abstract

The invention provides an interface display method, terminal equipment and a storage medium, and relates to the technical field of multi-screen terminals. According to the method, an interface of an application can be displayed on a secondary screen of the terminal equipment, and an automatic rotation function is started; the data collected by the auxiliary acceleration sensor arranged on the machine body where the auxiliary screen is located is used for replacing the data collected by the main acceleration sensor arranged on the machine body where the main screen is located, so that the transmission path of the data collected by the main sensor is not changed, and the data identification of the main sensor carries the auxiliary sensor data to be transmitted to the application. The application can determine the display direction of the content in the interface displayed on the secondary screen based on the secondary sensor data carried by the received data identifier of the primary sensor; when the third-party application adaptive to the multi-screen terminal is developed in the mode, the correct automatic rotation function can be realized without changing the original display logic on the single-screen terminal.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of multi-screen terminal technology, and in particular to an interface display method, a terminal device, and a storage medium. Background Art

[0002] As mobile phones become more and more popular as mobile terminals, people's demand for large-screen mobile phones is becoming stronger and stronger; as the screen size increases, the flat area of ​​the mobile phone is also getting larger, making it inconvenient to carry; therefore, foldable-screen mobile phones that take into account both portability and screen requirements are becoming more and more popular.

[0003] However, when using a foldable screen mobile phone, the interface content displayed on the main screen can achieve the correct display direction based on the rotation of the main screen, for example, the icons are displayed vertically and forwardly from the user's perspective; the interface displayed on the secondary screen often has the wrong display direction based on the rotation of the secondary screen, for example, the icons are displayed vertically and inverted from the user's perspective. Summary of the invention

[0004] The embodiments of the present application provide an interface display method, a terminal device, and a storage medium, which can realize correct rotation of content in the interface displayed on a display screen of a terminal device as the display screen rotates when the interface is displayed on the display screen.

[0005] In order to achieve the above objectives, this application adopts the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides an interface display method, which is applied to a terminal device, wherein the terminal device includes a first sensor, a second sensor, and a display screen, wherein the display screen includes a first screen and a second screen; when the terminal device is unfolded, the first sensor is located below the first screen, the second sensor is located below the second screen, and the display directions of the first screen and the second screen are the same; when the terminal device is folded, the display directions of the first screen and the second screen are opposite to each other, and the method includes:

[0007] The terminal device displays a first interface of a first application on a first screen;

[0008] During the process of displaying the first interface on the first screen, the terminal device obtains data collected by the first sensor through the first application;

[0009] During the process of rotating the first screen counterclockwise by 90°, the terminal device rotates the first icon in the first interface clockwise by 90° relative to the first screen based on the data collected by the first sensor;

[0010] The terminal device receives a first operation of switching to displaying a first application on a second screen;

[0011] In response to the first operation, the terminal device displays a second interface of the first application on the second screen, where the second interface is an interface after the first interface is adapted to the second screen, and the second interface includes the first icon;

[0012] During the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application;

[0013] During the process of the second screen rotating counterclockwise by 90°, the terminal device rotates the first icon in the second interface clockwise by 90° relative to the second screen based on the data collected by the second sensor.

[0014] In this application, the limitation that the first screen rotates 90° counterclockwise does not mean that only when it rotates 90° counterclockwise, the multi-screen terminal will display the interface of the first application horizontally on the first screen based on the data collected by the acceleration sensor. In addition, 90° is only an example. In actual applications, the 90° only represents an example within the rotation range. For example, it can also be any angle between 80° and 100°, as examples: 80°, 85°, 88°, 92°, 95°, etc. Of course, the 90° can also be understood as the angle corresponding to the first screen switching from vertical display to horizontal display, or from horizontal display to vertical display.

[0015] Similarly, the limitation of the second screen rotating 90° counterclockwise refers to the above description.

[0016] Of course, counterclockwise rotation is only an example, and in actual applications, it may also be clockwise rotation. For example, 90° counterclockwise rotation is equivalent to 270° clockwise rotation, and 90° clockwise rotation is equivalent to 270° counterclockwise rotation.

[0017] The rotation direction of the icon is opposite to that of the screen, and the rotation angle of the icon is close to that of the screen, but the rotation angle of the icon relative to the screen is 90°, 180°, 270°, and 360°.

[0018] When multiple angles can be presented between two screens (or two areas of the display screen), when the interface content is displayed on the first screen, the display direction of the content on the interface can be determined by a sensor below the first screen; when the first screen is rotated, the content in the interface displayed on the first screen is rotated in the opposite direction, and from the user's perspective, the content on the interface can always remain displayed vertically and positively; when the interface content is displayed on the second screen, the display direction of the content on the interface can be determined by a sensor below the second screen; when the second screen is rotated, the content in the interface displayed on the second screen is rotated in the opposite direction, and from the user's perspective, the content on the interface can always remain displayed vertically and positively.

[0019] As an implementation of the first aspect of the present application, in a process of displaying the first interface on the first screen, the terminal device obtains data collected by the first sensor through the first application, including:

[0020] The terminal device acquires data collected by the second sensor, where the data collected by the second sensor is the second data;

[0021] The terminal device acquires data collected by the first sensor, where the data collected by the first sensor is the first data;

[0022] If the first interface of the first application is displayed on the first screen, the terminal device obtains the data collected by the first sensor through the first application;

[0023] In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including:

[0024] The terminal device acquires data collected by the second sensor, where the data collected by the second sensor is the second data;

[0025] If the second interface of the first application is displayed on the second screen, the terminal device stores the data collected by the second sensor;

[0026] The terminal device acquires data collected by the first sensor, where the data collected by the first sensor is the first data;

[0027] If the second interface of the first application is displayed on the second screen, the terminal device replaces the data collected by the first sensor with the data collected by the stored second sensor to obtain the data after the first sensor is replaced, and the data after the first sensor is replaced is the second data collected by the second sensor;

[0028] The terminal device obtains the data after the first sensor is replaced through the first application.

[0029] In this application, since the terminal device can only register one sensor, the first sensor below the first screen is used as the registered sensor. When the first screen displays the interface, the data collected by the registered first sensor is obtained; when the second screen displays the interface, the data collected by the second sensor replaces the data collected by the first sensor. In this way, the data obtained is the data after the first sensor is replaced, but it is actually the data collected by the second sensor.

[0030] As another implementation of the first aspect of the present application, a terminal device includes: a first processor and a second processor, and the first application runs in the first processor;

[0031] After the terminal device displays the first interface of the first application on the first screen, the method further includes:

[0032] The first processor sends first information to the second processor, and the first information is displayed on the first screen;

[0033] After receiving the first information, the second processor sets the display state flag to a first flag, where the first flag is used to indicate display on the first screen;

[0034] In the process of displaying the first interface on the first screen, the terminal device obtains data collected by the first sensor through the first application, including:

[0035] The second processor acquires data collected by the second sensor, where the data collected by the second sensor is the second data;

[0036] The second processor acquires data collected by the first sensor, where the data collected by the first sensor is the first data;

[0037] When the display status flag in the second processor is the first flag, the second processor sends the data collected by the first sensor to the first application in the first processor;

[0038] The first application in the first processor obtains data collected by the first sensor.

[0039] In the present application, the first processor is an application processor, and the second processor processes the data collected by the sensor. The first processor is used to monitor whether the display is on the first screen or the second screen, and sends the monitored display state to the second processor; the second processor is used to set the display state flag according to the received display state, and determine whether to perform the replacement operation of the data collected by the second sensor with the data collected by the first sensor according to the display state flag. Through this display state flag method, the display state can be changed when the display state is switched. Before the display state changes, the second processor can determine whether to perform the replacement processing operation based on the display state every time it receives the data collected by the sensor.

[0040] As another implementation of the first aspect of the present application, after the terminal device displays the second interface of the first application on the second screen, the method further includes:

[0041] The first processor sends second information to the second processor, and the second information is displayed on the second screen;

[0042] After receiving the second information, the second processor sets the display state flag to a second flag, where the second flag is used to indicate display on the second screen;

[0043] In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including:

[0044] The second processor acquires data collected by the second sensor, where the data collected by the second sensor is the second data;

[0045] When the display status flag in the second processor is the second flag, the second processor stores the data collected by the second sensor;

[0046] The second processor acquires data collected by the first sensor, where the data collected by the first sensor is the first data;

[0047] When the display status flag in the second processor is the second flag, the second processor replaces the data collected by the first sensor with the stored data collected by the second sensor, and the data after the first sensor is replaced is the second data collected by the second sensor;

[0048] The second processor sends the data after the first sensor is replaced to the first application of the first processor;

[0049] The first application in the first processor obtains data after the first sensor is replaced.

[0050] In the present application, when the display status flag is the second flag, it can be determined that the display is on the secondary screen, and the data collected by the first sensor can be replaced by the data collected by the second sensor.

[0051] As another implementation of the first aspect of the present application, when the terminal device is folded, the data of the first direction of the first sensor and the data of the first direction of the second sensor have the same value and are in opposite directions, the data of the second direction of the first sensor and the data of the second direction of the second sensor have the same value and are in opposite directions, and the data of the third direction of the first sensor and the data of the third direction of the second sensor have the same value and are in the same direction;

[0052] In the process of displaying the first interface on the first screen, the terminal device obtains data collected by the first sensor through the first application, including:

[0053] The terminal device acquires data collected by the second sensor, where the data collected by the second sensor is the second data;

[0054] The terminal device acquires data collected by the first sensor, where the data collected by the first sensor is the first data;

[0055] If the first interface of the first application is displayed on the first screen, the terminal device obtains the data collected by the first sensor through the first application;

[0056] In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including:

[0057] The terminal device acquires data collected by the second sensor, where the data collected by the second sensor is the second data;

[0058] The terminal device acquires data collected by the first sensor, where the data collected by the first sensor is the first data;

[0059] If the second interface of the first application is displayed on the second screen, the terminal device flips the data in the first direction and the data in the second direction in the data collected by the first sensor;

[0060] The terminal device obtains the data collected by the first sensor after the direction is flipped through the first application.

[0061] In the present application, the first direction and the second direction may be the directions indicated by the x-axis and the z-axis in the above embodiment, and the third direction may be the direction indicated by the y-axis in the above embodiment. Since in the folded state, the data on the x-axis and the z-axis in the data collected by the two acceleration sensors are both flipped in positive and negative directions, and the data on the y-axis is the same, it is possible to set the data of the second sensor to replace the data of the first sensor by the direction flipping operation on the x-axis and the z-axis.

[0062] When the first screen and the second screen are in a folded state, the data collected by the first sensor and the data collected by the second sensor are correlated. For example, the data values ​​in some directions are the same but in opposite directions. Therefore, the data collected by the first sensor can be generated from the data collected by the second sensor by flipping the directions.

[0063] As another implementation of the first aspect of the present application, the terminal device includes: a first processor and a second processor, and the first application runs in the first processor; after the terminal device displays a second interface of the first application on a second screen, the method further includes:

[0064] The first processor sends second information to the second processor, and the second information is displayed on the second screen;

[0065] After receiving the second information, the second processor sets the display state flag to a second flag, where the second flag is used to indicate display on the second screen;

[0066] In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including:

[0067] The second processor acquires data collected by the second sensor, where the data collected by the second sensor is the second data;

[0068] The second processor acquires data collected by the first sensor, where the data collected by the first sensor is the first data;

[0069] When the display status flag in the second processor is the second flag, the second processor flips the direction of the data in the first direction and the data in the second direction in the data collected by the first sensor;

[0070] The second processor sends the data collected by the first sensor after the direction is flipped to the first application of the first processor;

[0071] The first application in the first processor obtains data collected by the first sensor after the direction is flipped.

[0072] When the data collected by the second sensor is generated by flipping the direction of the data collected by the first sensor, it can also be determined whether to perform the direction flipping operation based on the display state flag.

[0073] As another implementation of the first aspect of the present application, the first interface of the first application includes a first screen switching button, and the first operation is an operation acting on the first screen switching button;

[0074] Or, the first operation is a gesture operation acting on the first screen;

[0075] Or, the system menu bar includes a second screen switching button, and the first operation is an operation acting on the second screen switching button.

[0076] In the present application, in a multi-screen terminal, various methods are provided to enable the interface of an application to switch between a first screen and a second screen.

[0077] As another implementation of the first aspect of the present application, the method further includes:

[0078] After the first application is started, the terminal device obtains first data collected by the first sensor in a first time period, and the terminal device obtains second data collected by the second sensor in the first time period;

[0079] Alternatively, after receiving the second operation, the terminal device obtains first data collected by the first sensor in a first time period, and the terminal device obtains second data collected by the second sensor in the first time period, and the second operation is an operation on the automatic rotation button in the system menu bar.

[0080] In the present application, the automatic rotation function can be enabled through the system menu bar, or by starting the application itself that may have a horizontal screen scene. After the automatic rotation function is enabled, the first sensor and the second sensor can collect data based on the same event cycle.

[0081] As another implementation of the first aspect of the present application, after the terminal device displays the second interface of the first application on the second screen in response to the first operation, the method further includes:

[0082] The terminal device receives a third operation;

[0083] In response to the third operation, the terminal device turns off the display screen;

[0084] The terminal device receives a fourth operation;

[0085] In response to the fourth operation, the terminal device lights up the display screen and displays the second interface of the first application on the second screen;

[0086] During the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application;

[0087] During the process of the second screen rotating counterclockwise by 90°, the terminal device rotates the first icon in the second interface clockwise by 90° relative to the second screen based on the data collected by the second sensor.

[0088] In the present application, the third operation and the fourth operation may be an operation in which the user short presses a physical button on the terminal device, and the physical button is used to turn off and light up the screen. As an example, when the terminal device is in the state of displaying on the secondary screen, the user short presses the physical button, and the terminal device turns off the main screen and the secondary screen; when the terminal device is in the screen-off state, the user short presses the physical button, and if the application interface was displayed on the secondary screen before the last screen was turned off, then in response to the short press of the physical button, the terminal device lights up the secondary screen, and continues to display the application interface displayed before the last screen was turned off on the secondary screen. If the interface of the application is displayed on the second screen, when the screen is turned off and then turned on, the second screen is still lit, and the interface of the application continues to be displayed on the second screen. At the same time, it is also necessary to determine the display mode of the content in the interface based on the data collected by the second sensor.

[0089] As another implementation of the first aspect of the present application, the terminal device includes a first processor and a second processor, and the first application runs in the first processor;

[0090] After the terminal device displays the second interface of the first application on the second screen in response to the first operation, the method further includes:

[0091] The first processor sets the display state to a first state, wherein the first state indicates display on the second screen;

[0092] After setting the display state to the first state, the first processor sends an opening instruction and second information to the second processor, where the second information is used to indicate display on the second screen;

[0093] After receiving the second information, the second processor sets the display status flag to the second flag;

[0094] After receiving the start instruction, the second processor starts the replacement operation, where the replacement operation is an operation of replacing the data collected by the first sensor with the data collected by the second sensor when the display status flag is the second flag.

[0095] In the present application, the display state can be set in the first processor, and the display state can also be set in the second processor, and the display state in the second processor is updated along with the display state in the first processor. The display state in the first processor is updated to the first state when the first screen is switched to the second screen display, and similarly, the display state in the second processor is updated to the first state.

[0096] As another implementation of the first aspect of the present application, after the terminal device turns off the display screen, the method further includes:

[0097] The first processor maintains the display state as a first state;

[0098] The first processor sends a shutdown instruction to the second processor;

[0099] After receiving the closing instruction, the second processor closes the replacement operation;

[0100] After the terminal device displays the second interface of the first application on the second screen in response to the fourth operation, the method further includes:

[0101] The first processor query displays a state that is a first state;

[0102] The first processor sends an opening instruction to the second processor based on the queried first state;

[0103] After receiving the start instruction, the second processor starts the replacement operation;

[0104] In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including:

[0105] After the replacement operation is started, the second processor replaces the data collected by the first sensor with the data collected by the second sensor if the display status flag is the second flag;

[0106] The second processor sends the data after the first sensor is replaced to the first processor.

[0107] In the present application, when the display status of the second screen is updated to off, the display status in the first processor may no longer be updated. Similarly, the display status in the second processor does not need to be updated. However, in order to prevent the second processor from continuing to replace the data collected by the first sensor with the data collected by the second sensor, the first processor may send a close instruction to the second processor to close the replacement operation. That is, even if the display status identification bit in the second processor is the second flag, the replacement function is closed and the replacement operation is no longer performed.

[0108] As another implementation of the first aspect of the present application, after the terminal device turns off the display screen, the method further includes:

[0109] The first processor sets the display state to a second state, where the second state indicates displaying on the first screen;

[0110] The first processor sends a closing instruction and first information to the second processor;

[0111] After receiving the closing instruction, the second processor closes the replacement operation;

[0112] After receiving the first information, the second processor sets the display status flag to the first flag;

[0113] After the terminal device displays the second interface of the first application on the second screen in response to the fourth operation, the method further includes:

[0114] The first processor sets the display state to a first state;

[0115] After setting the display state to the first state, the first processor sends an opening instruction and a second message to the second processor;

[0116] After receiving the second information, the second processor sets the display status flag to the second flag;

[0117] After receiving the start instruction, the second processor starts the replacement operation.

[0118] In the present application, the display status in the first processor can also be set to be updated in real time. For example, when the display status of the second screen is updated to off, the display status in the first processor is updated to the first screen display. Similarly, the display status in the second processor also needs to be updated, and the display status flag in the second processor is updated to the first flag. In this case, it is possible to avoid continuing to execute the replacement operation of the data collected by the second sensor for the data collected by the first sensor. Of course, in actual applications, the first processor sends a shutdown instruction to the second processor when the second screen is not displayed. This ensures that the above-mentioned replacement operation is no longer performed in the off screen state in a dual manner.

[0119] As another implementation of the first aspect of the present application, in the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including:

[0120] After the second processor starts the replacement operation, if the display status flag is the second flag, the data collected by the second sensor replaces the data collected by the first sensor;

[0121] The second processor sends the data after the first sensor is replaced to the first processor, and the data after the first sensor is replaced is the data collected by the second sensor.

[0122] The first processor obtains data after the first sensor is replaced through the first application.

[0123] In the present application, the second processor performs the replacement operation of the data collected by the second sensor for the data collected by the first sensor only when the replacement operation is turned on and the display status flag is the second flag, so that when the second screen is displayed, the display direction of the content in the interface displayed on the second screen is determined by the data collected by the second sensor below the second screen. In a second aspect, a terminal device is provided, including a processor, the processor is used to run a computer program stored in a memory to implement any method of the first aspect of the present application.

[0124] In a third aspect, a chip system is provided, including a processor, wherein the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement any method of the first aspect of the present application.

[0125] In a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by one or more processors, the method of any one of the first aspects of the present application is implemented.

[0126] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a device, enables the device to execute any one of the methods in the first aspect of the present application.

[0127] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0128] Figure 1 A schematic diagram of the hardware structure of a terminal device provided in an embodiment of the present application;

[0129] Figure 2 A schematic diagram of the front structure of a terminal device provided in an embodiment of the present application;

[0130] Figure 3A schematic diagram of the back structure of a terminal device provided in an embodiment of the present application;

[0131] Figure 4 A schematic diagram of a folding terminal device provided in an embodiment of the present application;

[0132] Figure 5 A schematic diagram of an interface of a main screen displaying a camera application provided in an embodiment of the present application;

[0133] Figure 6 A schematic diagram of an interface of a camera application with the main screen rotated 90° counterclockwise provided in an embodiment of the present application;

[0134] Figure 7 A schematic diagram of an interface of a secondary screen displaying a camera application provided in an embodiment of the present application;

[0135] Figure 8 A schematic diagram of an interface in which a secondary screen is rotated 90° counterclockwise provided in an embodiment of the present application;

[0136] Fig. 9 A schematic diagram of the structure of a main sensor and a secondary sensor in a terminal device provided in an embodiment of the present application;

[0137] Fig.10 A schematic diagram of the direction of data collected by a main sensor and a secondary sensor in a folded state provided in an embodiment of the present application;

[0138] Fig.11 A schematic diagram of the structure of another terminal device provided in an embodiment of the present application;

[0139] Fig.12 A technical architecture diagram of an interface display method for a terminal device provided in an embodiment of the present application;

[0140] Fig.13 A timing diagram of an interface display method of a terminal device provided in an embodiment of the present application;

[0141] Fig.14 A schematic diagram of a correct interface displayed on a secondary screen after the secondary screen is rotated 90° counterclockwise provided in an embodiment of the present application;

[0142] Fig.15 A timing diagram of another interface display method of a terminal device provided in an embodiment of the present application;

[0143] Fig.16 A timing diagram of another interface display method for a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0144] In the following description, specific details such as specific system structures and technologies are provided for illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details.

[0145] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0146] It should also be understood that in the embodiments of the present application, "one or more" refers to one, two or more than two; "and / or" describes the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B may represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B may be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0147] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", "fourth", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0148] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0149] An interface display method provided in an embodiment of the present application can be applicable to a terminal device. The terminal device can be a tablet computer, a mobile phone, a wearable device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. The terminal device can have at least two screens in any form, so it can also be recorded as a multi-screen terminal. The embodiment of the present application does not limit the specific type of the multi-screen terminal.

[0150] Figure 1 The structure diagram of a terminal device is shown. The multi-screen terminal 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a touch sensor 180K, an ambient light sensor 180L, at least two acceleration sensors, etc.

[0151] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the multi-screen terminal 100. In other embodiments of the present application, the multi-screen terminal 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0152] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a sensor coprocessor (SCP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0153] The controller may be the nerve center and command center of the multi-screen terminal 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0154] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0155] The USB interface 130 is an interface that complies with USB standard specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the multi-screen terminal 100, and may also be used to transmit data between the multi-screen terminal 100 and peripheral devices.

[0156] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the multi-screen terminal 100. In other embodiments of the present application, the multi-screen terminal 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0157] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the multi-screen terminal 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external memory card.

[0158] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the multi-screen terminal 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system and an application required for at least one function (such as a sound playback function, an image playback function, etc.).

[0159] In addition, the internal memory 121 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0160] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from the wired charger through the USB interface 130 .

[0161] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

[0162] In some other embodiments, the power management module 141 may also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 may also be disposed in the same device.

[0163] The wireless communication function of the multi-screen terminal 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0164] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the multi-screen terminal 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0165] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the multi-screen terminal 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.

[0166] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the multi-screen terminal 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and filters it, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0167] In some embodiments, antenna 1 of the multi-screen terminal 100 is coupled to the mobile communication module 150, and antenna 2 is coupled to the wireless communication module 160, so that the multi-screen terminal 100 can communicate with the network and other devices through wireless communication technology.

[0168] The multi-screen terminal 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor.

[0169] The audio module 170 is used to convert digital audio signals into analog audio signals for output, and is also used to convert analog audio inputs into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0170] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The multi-screen terminal 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0171] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the multi-screen terminal 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the ear.

[0172] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C with his mouth to input the sound signal into the microphone 170C. The multi-screen terminal 100 can be provided with at least one microphone 170C. In other embodiments, the multi-screen terminal 100 can be provided with two microphones 170C, which can not only monitor voice information but also realize noise reduction function. In other embodiments, the multi-screen terminal 100 can also be provided with three, four or more microphones 170C to realize the collection of sound signals, noise reduction, identification of sound sources, realization of directional recording functions, etc. The headphone jack 170D is used to connect wired headphones. The headphone jack 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0173] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The multi-screen terminal 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the multi-screen terminal 100 detects the intensity of the touch operation based on the pressure sensor 180A. The multi-screen terminal 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A.

[0174] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the multi-screen terminal 100, which is different from the position of the display screen 194.

[0175] The ambient light sensor 180L is used to sense the ambient light brightness. The multi-screen terminal 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the multi-screen terminal 100 is in a pocket to prevent accidental touch.

[0176] The acceleration sensor 180B is used to sense the acceleration force. The acceleration force is the force acting on the body of the multi-screen terminal during the acceleration process, for example, gravity. An acceleration sensor can be set on the body where each screen of the multi-screen terminal is located. That is, the number of acceleration sensors in the multi-screen terminal can be 2 to N.

[0177] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The multi-screen terminal 100 may receive key input and generate key signal input related to user settings and function control of the multi-screen terminal 100.

[0178] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.

[0179] The multi-screen terminal 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0180] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the multi-screen terminal 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0181] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the multi-screen terminal 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0182] The SIM card interface 195 is used to connect the SIM card. The SIM card can be connected to and separated from the multi-screen terminal 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The multi-screen terminal 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The multi-screen terminal 100 interacts with the network through the SIM card to realize functions such as calls and data communications. In some embodiments, the multi-screen terminal 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the multi-screen terminal 100 and cannot be separated from the multi-screen terminal 100.

[0183] The embodiment of the present application does not particularly limit the specific structure of the execution subject of an interface display method, as long as the code of an interface display method of the embodiment of the present application can be run to communicate according to an interface display method provided by the embodiment of the present application. For example, the execution subject of an interface display method provided by the embodiment of the present application can be a functional module in a terminal device that can call and execute a program, or a communication device applied to a terminal device, such as a chip.

[0184] As mobile phones become more and more popular as mobile terminals, people's demand for large-screen mobile phones is becoming stronger and stronger; however, as the screen size increases, the flat area of ​​the mobile phone is also getting larger, making it inconvenient to carry; therefore, foldable-screen mobile phones that take into account both portability and screen requirements are becoming more and more popular.

[0185] Reference Figure 2 , which is a schematic diagram of the front structure of a folding screen mobile phone provided in an embodiment of the present application.

[0186] The folding screen mobile phone in the embodiment of the present application includes a first body and a second body, the first body and the second body are connected, and can be folded along the connection part between the first body and the second body. As shown in the figure, there is a virtual folding axis between the first body and the second body, and the virtual folding axis can be understood as the line that intersects when the plane where the first body is located and the plane where the second body is located are not in the same plane. The width of the first body of the folding screen mobile phone is greater than the width of the second body. Screens are arranged on the first body and the second body. When the first body and the second body are in an unfolded state, the screens on the first body and the second body are in an unfolded state; when the first body and the second body are in a folded state, the screens on the first body and the second body are in a folded state, wherein the part of the screen located in the first body area is the first display area, and the part of the screen located in the second body area is the second display area. With the folding action or unfolding action between the first body and the second body, the first display area and the second display area of ​​the screen are also folded or unfolded. For the convenience of subsequent description, the first display area of ​​the display screen is recorded as the first screen, and the second display area of ​​the display screen is recorded as the second screen. In addition, a front camera is arranged on a surface of the first body located at the first screen.

[0187] Reference Figure 3 ,for Figure 2 The back structure diagram of the folding screen mobile phone shown in the figure; the rear camera related components are arranged on the side of the first body facing away from the first screen. Although not shown in the figure, it can be understood that the rear camera related components may include one or more of the following: a flash, a wide-angle camera, a standard camera, and a depth of field camera.

[0188] Figure 2 and Figure 3 The folding angle between the first body and the second body in the folding screen mobile phone shown can be 0° to 180°. Of course, in actual applications, the folding angle may be slightly different from the set folding angle, for example, the folding angle may be greater than 180°.

[0189] Reference Figure 4, is a schematic diagram of a folding screen mobile phone when the folding angle between the first body and the second body is 0°, the first screen on the first body and the second screen on the second body are both facing the outside of the entire body, that is, the display direction is facing the outside of the entire body; and the first screen and the second screen are in a back-to-back state, that is, the display direction of the first screen and the display direction of the second screen are opposite; when the second screen faces the user, since the width of the second body where the second screen is located is smaller than the width of the first body, the user's perspective can see the second screen and the area of ​​the first body that is not covered and blocked by the second body (for example, components related to the rear camera). Similarly, when the first screen faces the user, since the width of the first body where the first screen is located is larger than the width of the second body, the first screen can be seen from the user's perspective, and this application will no longer use diagrams as examples. It can be understood that the display direction of the screen is the direction in which the content displayed on the screen is facing.

[0190] based on Figure 4 The defined folding angle can be understood. Figure 2 and Figure 3 The folding angle between the first body and the second body in the folding screen mobile phone shown is 180°. At this time, the first screen on the first body and the second screen on the second body face the same side of the entire body, that is, the display directions of the first screen and the second screen are the same.

[0191] Of course, if the structure is reasonably set up and the flexibility of the folding screen meets the requirements, the folding angle between the first body and the second body can also be greater than 180°.

[0192] When the folding angle between the first body and the second body is 360°, the first screen on the first body and the second screen on the second body are respectively facing the inner side of the entire body, and the first screen and the second screen are in a facing state. This application will not be exemplified by diagrams.

[0193] As mentioned above, the first screen and the second screen can be two areas of the same complete screen, the first screen is one area of ​​the complete screen, and the second screen is another area of ​​the complete screen, and the two areas of the complete screen are respectively arranged on the first body and the second body. When folding or unfolding between the first body and the second body, the two areas of the complete screen are also folded or unfolded accordingly, so this screen setting method requires that the complete screen has good flexibility, and the junction between the first screen and the second screen can experience more folding and unfolding. Since the content is displayed through the entire complete screen, from the user's perspective, the display effect is better and the user experience is better.

[0194] The first screen and the second screen in the embodiment of the present application may also be two independent screens, which are respectively arranged on the first body and the second body. Since the first screen and the second screen are two independent screens, the first screen and the second screen may not be flexible screens, and the cost is relatively low. However, when displaying content through the first screen and the second screen, the display effect is poor due to the splicing marks in the middle.

[0195] Figure 2 The foldable screen mobile phone shown has a first screen and a second screen, so the user can switch the content displayed on the foldable screen mobile phone between the first screen and the second screen.

[0196] As an example of a scenario, see Figure 5 When the user uses the foldable screen mobile phone and takes a selfie facing the first screen, the foldable screen mobile phone calls the front camera, and the first screen displays the camera application interface (the camera application can be used as an example of the first application, Figure 5 The interface shown can be used as an example of the first interface), and the camera application interface displays the user's selfie captured by the front camera. In addition, from the user's perspective, the icons in the camera application interface displayed on the first screen are displayed vertically in the forward direction. Among them, the forward direction and the reverse direction are opposite directions to each other. The forward direction can be the preset display direction of the icon, and the reverse direction is the direction of the icon after rotating 180°. Taking the text or number displayed in the icon as an example, the forward display of the icon is the normal display of the text or number, and the reverse display of the icon is the direction of the text or number after rotating 180°.

[0197] When the user rotates the foldable screen phone about 90° so that the first screen in the foldable screen phone is in landscape mode, some icons in the interface displayed on the first screen of the foldable screen phone and the selfie screen are rotated 90° relative to the first screen itself.

[0198] Reference Figure 6 As shown, the user rotates counterclockwise Figure 5 The schematic diagram of the interface displayed on the first screen of the foldable screen mobile phone is shown after the foldable screen mobile phone is rotated about 90°. In this diagram, the virtual buttons are rotated 90° clockwise relative to the first screen itself. For example, the "AI button", "flash button", "focal length mark" and "camera switch button" are all rotated clockwise relative to the first screen. The selfie screen is also rotated 90° clockwise relative to the first screen itself. After the above icons and selfie screen are rotated 90° clockwise, from the user's perspective, the above icons and selfie screen are displayed vertically and positively. The "AI button", "flash button", "focal length mark" or "camera switch button" in the above examples can all be used as examples of first icons.

[0199] Since the first screen is rotated counterclockwise by about 90°, the virtual buttons and the selfie screen are rotated clockwise by 90° relative to the foldable screen phone itself. Therefore, from the user's perspective, these virtual buttons and the selfie screen are not switched from the "vertical" display state to the "horizontal" display state along with the first screen. In this way, the user can obtain a better visual effect of the interface.

[0200] In actual applications, all displayed content in the interface may be set to rotate accordingly, or part of the displayed content may be set to rotate accordingly. The embodiment of the present application does not limit which specific content is set to rotate accordingly.

[0201] In addition, since the icons of some virtual buttons have a special symmetrical structure, from the user's perspective, the display direction is the same before and after rotation. Therefore, some virtual buttons may actually rotate, but from the user's perspective, it does not appear that they have rotated.

[0202] Figure 5 and Figure 6 The automatic rotation function shown is implemented based on a sensor built into the body of the folding screen mobile phone, which is an acceleration sensor. The display direction of the content in the interface is determined based on the direction of acceleration detected by the acceleration sensor.

[0203] In actual use, whether Figure 5 The vertical shot shown is still Figure 6 As shown in the horizontal shot, since the selfie in this scene calls the front camera, and the front camera of the mobile phone is usually not as good as the rear camera in shooting effect, for example, the front camera is not as high as the rear camera in pixel, etc.; therefore, the user can switch the camera application interface currently displayed on the first screen of the folding screen mobile phone to the second screen display, and at the same time, the user flips the mobile phone so that the second screen and the rear camera face the user. In the specific implementation, a screen switching button (which can be recorded as the first screen switching button) can be displayed on the camera application interface, and the user clicks the screen switching button to switch the camera application from the first screen display to the second screen display. In addition, a screen switching button (which can be recorded as the second screen switching button) can also be set in the system menu bar (for example, the system menu bar can be triggered by sliding down from the top of the display screen), and the user clicks the screen switching button to switch the camera application from the first screen display to the second screen display. Of course, the camera application can also be triggered to switch from the first screen display to the second screen display through a preset gesture operation, and the above operation can be recorded as the first operation.

[0204] Reference Figure 7 , which is a picture of the selfie effect when the user uses the second screen to display the camera application interface.

[0205] The same interface of the same application can be exactly the same when displayed on the first screen and when displayed on the second screen, or there can be differences. As an example of a difference, the content in the displayed interface can be adaptively adjusted based on the aspect ratio of the first screen and the second screen. For example, when the width of the second screen is smaller than the width of the first screen, some virtual buttons in the width direction are hidden, and the user can trigger the multi-screen terminal to display the hidden virtual buttons on the interface through a sliding gesture. Figure 7 The interface shown can be used as an example of a second interface, which hides the “large aperture button” and the “more button” relative to the first interface.

[0206] When users use the second screen to display the camera application interface to take selfies, they can also take horizontal photos. For example, they can also rotate the foldable phone about 90° so that the second screen in the foldable phone is in a horizontal state. In this case, some icons in the interface displayed on the second screen of the foldable phone and the selfie screen are also rotated 90° relative to the second screen.

[0207] Reference Figure 8 As shown, the user rotates counterclockwise Figure 7 Schematic diagram of the interface displayed on the second screen of the foldable screen mobile phone after the second screen is rotated about 90°. In this diagram, some virtual buttons are also rotated 90° counterclockwise relative to the second screen of the foldable screen mobile phone. For example, the "AI button", "focal length mark" and "camera switch button" are all displayed vertically inverted relative to the counterclockwise rotation of the second screen of the foldable screen mobile phone. The selfie screen is also rotated 90° counterclockwise relative to the second screen of the foldable screen mobile phone itself and displayed vertically inverted. From the user's perspective, when using the second screen in landscape mode, these virtual icons and selfie screens are rotated in the wrong direction.

[0208] After analysis, although acceleration sensors can be set on both the first body and the second body of the folding screen mobile phone, the direction of the content in the camera application interface displayed on the first screen of the first body is determined based on the data collected by the acceleration sensor on the first body, and the direction of the content in the camera application interface displayed on the second screen of the second body is determined based on the data collected by the acceleration sensor on the second body. However, since the operating system can only register one acceleration sensor, the upper-layer application can only receive data reported by the acceleration sensor set on one body (for example, the first body). Figure 8In the scenario shown, the display direction determined by the data collected by the acceleration sensor on the first body and the display direction determined by the data collected by the acceleration sensor on the second body are completely opposite. According to the process of the operating system: when the camera application interface is displayed on the second screen, the display direction is determined based on the data uploaded by the acceleration sensor on the first body. Therefore, the icons and other contents in the interface displayed on the second screen of the second body are flipped. To better understand the above flipping reasons, please refer to Fig. 9 and Fig.10 Description of the scenario shown.

[0209] Reference Fig. 9 , which is a schematic diagram of the positional relationship between the acceleration sensor and the body when the folding angle between the first body and the second body in the folding screen mobile phone provided in an embodiment of the present application is 180°.

[0210] For the convenience of description, the first screen set on the first body can be recorded as the main screen, the acceleration sensor set on the first body can be recorded as the main sensor or the first sensor, the second screen set on the second body can be recorded as the sub-screen, and the acceleration sensor set on the second body can be recorded as the sub-sensor or the second sensor. The main sensor is the acceleration sensor registered in the operating system.

[0211] The main sensor can detect data in three directions: data on the x-axis of the main sensor, data on the y-axis of the main sensor, and data on the z-axis of the main sensor, wherein the x-axis of the main sensor and the y-axis of the main sensor are both parallel to the plane where the first body is located. As an example of the specific directions of the x-axis of the main sensor and the y-axis of the main sensor, the x-axis of the main sensor is parallel to the shorter side of the first body and faces right; the y-axis of the main sensor is parallel to the longer side of the first body and faces upward; the z-axis of the main sensor is perpendicular to the plane where the first body is located and faces one side of the screen. Fig. 9 The structural diagram shown serves as a basic orientation representation.

[0212] The secondary sensor can also detect data in three directions: data on the secondary sensor's x-axis, data on the secondary sensor's y-axis, and data on the secondary sensor's z-axis, wherein the secondary sensor's x-axis and the secondary sensor's y-axis are both parallel to the plane where the second body is located. As an example of the specific directions of the secondary sensor's x-axis and the secondary sensor's y-axis, the secondary sensor's x-axis is parallel to the second body's shorter side and to the right; the secondary sensor's y-axis is parallel to the second body's longer side and upward; the secondary sensor's z-axis is perpendicular to the plane where the second body is located and toward one side of the screen. The directional words "right" and "up" are both in the form of Fig. 9 The structural diagram shown serves as a basic orientation representation.

[0213] Any two of the three axes of the main sensor are perpendicular to each other. The three axes of the main sensor may not be Fig. 9 In the illustrated embodiment, the directions shown, for example, the x-axis of the main sensor, the y-axis of the main sensor, and the z-axis of the main sensor can be arbitrarily exchanged, or the directions of any one or more axes of the main sensor and Fig. 9 The directions shown are opposite directions, or any directions when it is determined that one of the axes is perpendicular to the plane where the first body is located, and the other two axes are perpendicular and parallel to the two planes where the first body is located. Similarly, the three axes of the secondary sensor also follow the above description of directions. Generally, when the folding angle between the first body and the second body is 180°, the directions of the three axes of the main sensor and the three axes of the secondary sensor are consistent.

[0214] The acceleration sensor measures the acceleration components on the above three axes. When the multi-screen terminal is in a stationary state, the acceleration components of gravity on the three axes are measured.

[0215] Continue with Fig. 9 Taking the directions of the three axes of the main sensor and the directions of the three axes of the sub-sensor as examples, when the folding angle between the first body and the second body is 180 degrees, the positive direction of the x-axis on the main sensor is consistent with the positive direction of the x-axis on the sub-sensor, for example, they can be in the same direction; the positive direction of the z-axis on the main sensor is consistent with the positive direction of the z-axis on the sub-sensor, for example, they can be in the same direction; when the folding angle between the first body and the second body is other angles between 0 and 180 degrees, the positive direction of the x-axis on the main sensor is inconsistent with the positive direction of the x-axis on the sub-sensor, for example, they are in the opposite direction when the folding angle is 0°; the positive direction of the z-axis on the main sensor is inconsistent with the positive direction of the z-axis on the sub-sensor, for example, they are in the opposite direction when the folding angle is 0°; no matter how many degrees the folding angle between the first body and the second body is, the positive direction of the y-axis on the main sensor is consistent with the positive direction of the y-axis on the sub-sensor, for example, they can be in the same direction.

[0216] Reference Fig.10 , which is a schematic diagram of the positional relationship between the acceleration sensor and the body when the folding angle between the first body and the second body in the folding screen mobile phone provided in an embodiment of the present application is 0°.

[0217] When the folding angle between the first body and the second body in the folding screen mobile phone is 0°, the positive direction of the y-axis on the main sensor is consistent with the positive direction of the y-axis on the secondary sensor, for example, they can be in the same direction; the positive direction of the x-axis on the main sensor is inconsistent with the positive direction of the x-axis on the secondary sensor, for example, they are in opposite directions; the positive direction of the z-axis on the main sensor is inconsistent with the positive direction of the z-axis on the secondary sensor, for example, they are in opposite directions.

[0218] When the foldable phone is in portrait orientation for taking selfies, the data in the y-axis direction mainly affects the display direction of the content on the interface displayed on the second screen. The positive direction of the y-axis on the main sensor and the positive direction of the y-axis on the secondary sensor are the same, so it does not affect the display direction of the content on the interface displayed on the second screen when the phone is in portrait orientation.

[0219] When the foldable screen phone is in landscape orientation for taking selfies, the data in the x-axis direction mainly affects the display direction of the content on the interface displayed on the second screen. The positive direction of the x-axis on the main sensor and the positive direction of the x-axis on the secondary sensor are in opposite directions. Therefore, if the upper-level application still uses the data reported by the main sensor, it will affect the display direction of the content on the second screen when the screen is in landscape orientation.

[0220] In view of this, an embodiment of the present application provides an interface display method for a multi-screen terminal, which can achieve: when the interface is displayed on the screen of the body where the secondary sensor is located, the display direction is determined based on the data collected by the secondary sensor; when the interface is displayed on the screen of the body where the main sensor is located, the display direction is determined based on the data collected by the main sensor.

[0221] In addition, it can be understood from the above description that the interface display method of the multi-screen terminal provided by the embodiment of the present application can be applied not only to the folding screen mobile phone provided by the above embodiment, but also to the following types of multi-screen terminals: comprising at least two bodies provided with screens, the at least two bodies provided with screens can change their relative postures so that the planes where the at least two bodies provided with screens are located are in a non-parallel state, and the at least two bodies provided with screens are respectively provided with acceleration sensors. When the interface display method of the multi-screen terminal provided by the embodiment of the present application is applied to this type of terminal, it can be set that when the application interface is displayed on the screen of any of the at least two bodies provided with screens, the display direction of the content in the interface is determined based on the data provided by the acceleration sensor inside the body where the screen is located.

[0222] As another example of a terminal that can implement the interface display method of the multi-screen terminal provided in the embodiment of the present application, refer to Fig.11 The structural schematic diagram of the folding screen mobile phone is shown.

[0223] Fig.11In the folding screen mobile phone shown, when the folding screen mobile phone is in the folded state, the first screen on the first body and the second screen on the second body are in a facing state, and a third screen is also provided on the second body, and the third screen and the second screen are in a back-to-back state. When the application interface is displayed on the first screen, the display direction of the content on the interface is determined based on the acceleration sensor on the first body where the first screen is located, and when the application interface is displayed on the second screen or the third screen, the display direction of the content on the interface is determined based on the acceleration sensor on the second body where the second screen and the third screen are located.

[0224] The following will Fig. 9 and Fig.10 Taking the folding screen mobile phone shown as an example, the specific implementation method of the interface display method of the multi-screen terminal provided in the embodiment of the present application is described in detail.

[0225] Fig.12 A technical architecture diagram of the interface display method for a multi-screen terminal provided in an embodiment of the present application. The left side of the technical architecture diagram is the application chip (Application Processor, AP) side, and the right side is the ADSP chip (Analog Devices Signal Processor) side. The AP chip is the application processor in the multi-screen terminal. The operating system, user interface and application program are all executed on the AP chip, and the processor can be recorded as the first processor. The ADSP chip is a chip dedicated to digital signal processing and can be recorded as the second processor. On the main chip side, the embodiment of the present application mainly involves the application layer, the application framework layer and the hardware abstraction layer.

[0226] Among them, application A is located in the application layer. Application A can be some applications that come with the multi-screen terminal itself, or it can be an application installed by the user in the multi-screen terminal, etc. As an example, application A can be a camera application.

[0227] The display service is located in the application framework layer. It is a system application or system service. It can monitor the display status of the display screen of the multi-screen terminal in real time, such as the main screen display, the secondary screen display, etc.

[0228] The whole machine status management service is located in the application framework layer. The whole machine status management service is used to manage and maintain the display status of the multi-screen terminal. The display status includes the main screen display and the secondary screen display. Of course, in actual applications, it can also include turning the screen on or off.

[0229] The status monitoring unit, the main sensor abstraction module and the data switching switch are located in the sensorhal, which is located in the hardware abstraction layer.

[0230] Information transmission is achieved between the whole machine state management service located in the application framework layer and the sensorhal located in the hardware abstraction layer through the HIDL interface. The interface used to achieve information transmission between the application framework layer and the hardware abstraction layer includes the HIDL interface A of the operating system and another HIDL interface B provided in the embodiment of the present application, which HIDL interface B can be a custom interface.

[0231] The main sensor abstraction module is used to receive acceleration data sent by the main sensor module transmitted from the ADSP side.

[0232] The status monitoring unit is used to monitor the display status transmitted by the application framework layer.

[0233] The data switching switch is used to send a start instruction of the data synchronization unit to ADSP when switching to the secondary screen display, and to send a close instruction of the data synchronization unit to ADSP when exiting the secondary screen display (for example, when the main screen display enters the off-screen state).

[0234] Among them, switching to the secondary screen display can be: the previous display state is the main screen display, and the current display state is the secondary screen display; it can also be that the previous information is off-screen information, the current information is on-screen information and the display state is secondary screen display; exiting the secondary screen display can be: the previous display state is secondary screen display, and the current display state is main screen display; or the previous display state is secondary screen display, and the current is off-screen information.

[0235] When specifically implementing the interface display method provided in the embodiment of the present application, the sensorhidl process in sensorhal implements the above-listed functions of each module by calling the main sensor abstract module, the status monitoring unit and the data switching switch.

[0236] On the ADSP chip side, there are a main sensor module, a sub-sensor module, and a data synchronization unit.

[0237] The main sensor module can receive acceleration data reported by the main sensor;

[0238] The secondary sensor module can receive acceleration data reported by the secondary sensor;

[0239] The data synchronization unit is used to replace the data reported by the main sensor with the data reported by the auxiliary sensor when the auxiliary screen is displayed when it is turned on, and no longer replace the data reported by the main sensor with the data reported by the auxiliary sensor when it is turned off.

[0240] The ADSP side implements the functions of each module through two threads.

[0241] As an example, the sensorpd-1 thread may call the main sensor module to receive acceleration data reported by the main sensor, and the sensorpd-2 thread may call the secondary sensor module to receive acceleration data reported by the secondary sensor; the sensorpd-1 thread may also call the data synchronization unit to implement the data replacement described above.

[0242] Among them, the dotted line in the diagram represents the transmission process of the display status of the multi-screen terminal. The whole machine status management service can receive the display status of application A running in the foreground from application A, and can also obtain the display status from the system's display service. The whole machine status management service can transmit the display status to the status monitoring unit in sensorhal through the HIDL interface B; the status monitoring unit can turn on the data switching switch, thereby triggering the data switching switch to send the current display status to the data synchronization unit on the ADSP side, and the data synchronization unit can record the latest display status.

[0243] The solid line in the diagram is the process of transmitting sensor data to application A. The main sensor data collected by the main sensor is reported to the main sensor module in ADSP; the secondary sensor data collected by the secondary sensor is reported to the secondary sensor module in ADSP. When the display state is secondary screen display, the data synchronization unit replaces the data reported by the secondary sensor with the data reported by the main sensor, and then the ADSP chip side sends the secondary sensor data to the main sensor abstract module in sensorhal on the AP chip side (the original main sensor data has been replaced by the secondary sensor data, and the data identifier is the registered main sensor identifier). The main sensor abstract module in sensorhal sends the received secondary sensor data (carrying the main sensor identifier) ​​to the whole machine state management service through HIDL interface A, and the whole machine state management service sends the received secondary sensor data (carrying the main sensor identifier) ​​to application A, so that application A determines the display direction of the content in the interface based on the secondary sensor data of the received sensor identifier.

[0244] It can be understood from this architecture diagram that, without changing the transmission process of the main sensor data, the sensor data received by application A can be made to be the secondary sensor data when the secondary screen is displayed, so that the display direction of the content in the interface of application A can be automatically rotated normally; and, for any third-party application, during the development process, there is no need to consider the underlying internal implementation. You only need to listen to the data of a sensor identifier according to the original logic, so that when the main screen is displayed, the display direction of the content in the interface can be adjusted based on the main sensor data in the body where the main screen is located, and when the secondary screen is displayed, the display direction of the content in the interface can be adjusted based on the secondary sensor data in the body where the secondary screen is located.

[0245] In order to more clearly understand the interface display method of the multi-screen terminal corresponding to the architecture diagram. Fig.13 , which is a timing diagram of the interface display method of the multi-screen terminal based on the architecture diagram.

[0246] S101, the display service sends the display status of the display screen to the whole machine status management service.

[0247] In the embodiment of the present application, the display service (displaymanagerservice) as the background service program of the system can monitor the display state of the display screen, and when detecting that the display state changes, send the changed display state to the whole machine state management service (for example, devicestateproviderimpl). The embodiment of the present application takes the detection of the secondary screen display as an example.

[0248] As an example, when any application switches from the main screen display to the secondary screen display, the display service detects that the display status has switched from the main screen display to the secondary screen display, and can send the display status: secondary screen display to the whole machine status management service; when any application switches from the secondary screen display to the main screen display, the display service detects that the display status has switched from the main screen display to the secondary screen display, and can send the display status: main screen display to the whole machine status management service; in this way, the whole machine status management service can record the latest display status of the display screen.

[0249] Of course, when the display service detects that the screen is on or off, it can also send the corresponding display status to the whole machine status management service.

[0250] As an example of switching display of application A between the main screen and the secondary screen, the switching display between the main screen and the secondary screen can be implemented by a virtual button (for example, a screen switching button) on the interface displayed when application A is running in the foreground, and the switching display between the main screen and the secondary screen can also be implemented through gesture operations.

[0251] Of course, the interface of application A can also be switched between the main screen and the secondary screen through buttons provided by the system (for example, a screen switching button in a drop-down menu).

[0252] When the display service detects that an application running in the foreground switches display between the main screen and the secondary screen, the latest display status of the application running in the foreground can be sent to the whole device status management service.

[0253] In the above embodiment, the display status includes the main screen display and the secondary screen display. If the multi-screen terminal includes more screens, different names or identifiers can be set for the multiple screens respectively, and the current display status of the multi-screen terminal can be determined by different names or identifiers.

[0254] S102: After receiving the display status sent by the display service, the whole machine status management service stores the display status.

[0255] In the embodiment of the present application, the whole machine state management service can store the latest display state of the currently foreground running application A. In the embodiment of the present application, the display state displayed on the secondary screen can be recorded as the first state, and the display state displayed on the main screen can be recorded as the second state.

[0256] S103, the whole device status management service sends the display status to sensorhidl.

[0257] The whole machine status management service can send the display status to the sensorhidl process based on the HIDL interface B.

[0258] In a specific implementation, the HIDL interface B may be a user-defined interface with any name.

[0259] S104, after receiving the display status, the sensorhidl process sends the display status to the sensorpd-1 thread on the ADSP side.

[0260] As a process on the AP chip side, the sensorhidl process can send the display status to the sensorpd-1 thread on the ADSP side through inter-core communication. In the specific implementation, the information sent by the AP chip to the ADSP chip and displayed on the secondary screen is recorded as the second information, and the information sent by the AP chip to the ADSP chip and displayed on the main screen is recorded as the first information.

[0261] S105, after receiving the display status, the sensorpd-1 thread on the ADSP side sets the display status flag to: secondary screen display flag based on the received display status.

[0262] The sensorpd-1 in the ADSP maintains the display status flag, which can be represented by "g_subscreen_display_state" and different characters can be used to represent different display states.

[0263] As an example, the main screen display can be represented by the character "1". That is, g_subscreen_display_state = 1 means that the application A running in the foreground is displayed on the main screen of the multi-screen terminal, and this character can also be recorded as the first mark; the sub-screen display can be represented by the character "100". That is, g_subscreen_display_state = 100 means that the application A running in the foreground is displayed on the sub-screen of the multi-screen terminal, and this character can also be recorded as the second mark; the above characters are only used for examples and do not impose any restrictions on this application.

[0264] In the embodiment of the present application, the multi-screen terminal can enable the automatic rotation function applicable to multiple applications installed in the multi-screen terminal; or the automatic rotation function can be disabled, so that the content in the interface displayed by the multiple applications installed in the multi-screen terminal when running in the foreground no longer rotates relative to the rotation of the screen. For example, an automatic rotation button is set in the system menu bar of the multi-screen terminal, and the user can click the automatic rotation button to enable or disable the automatic rotation function. After the automatic rotation button of the system menu bar is enabled, multiple applications running in the multi-screen terminal can realize automatic rotation of the content on the interface.

[0265] In addition, when application A is a camera application, regardless of whether the multi-screen terminal turns on the automatic rotation function, application A can turn on the automatic rotation function applicable to application A itself after it is started.

[0266] As an example, when the automatic rotation button in the system menu bar is turned off, the interface of another application B in the multi-screen terminal cannot achieve automatic rotation of its content. However, after application A is turned on, the automatic rotation function applicable to application A can be turned on. Application A can then obtain data collected by the acceleration sensor corresponding to the screen displaying the interface of application A, and application A can determine the display direction of the content in the interface of application A based on the obtained data.

[0267] Reference Fig.13 Steps S201 to S210 in FIG. 1 are a timing diagram for turning on the automatic rotation function as application A is started.

[0268] S201, application A sends information indicating that the automatic rotation service has been enabled to the sensorhidl process.

[0269] In an embodiment of the present application, it is possible to set application A to automatically start the automatic rotation service when it is running in the foreground. For example, when application A is a camera application, application A is started and runs in the foreground or switches from the background to the foreground, and the information that the automatic rotation service has been turned on will be sent to the sensorhidl process. In the embodiment of the present application, starting application A is used as a trigger condition for sending the information that the automatic rotation service has been turned on to the sensorhidl process. The turned-on information indicates that application A has turned on the automatic rotation service and requires the acceleration sensor to report the collected data. After application A is closed or switched to the background, whether the automatic rotation service is switched to the closed state is related to whether the automatic rotation function of the folding screen mobile phone system level is turned on. For example, if the multi-screen terminal system does not turn on the automatic rotation service, the automatic rotation service of the multi-screen terminal is also turned off after application A is closed or switched to the background. If the multi-screen terminal system turns on the automatic rotation service, the automatic rotation service of the multi-screen terminal remains turned on after application A is closed or switched to the background. The opening of the system-level automatic rotation service can be triggered by an operation on the automatic rotation button in the system menu bar. This operation can be recorded as a second operation.

[0270] In addition, the activation information of the automatic rotation service indicates that application A has activated the automatic rotation service, and therefore, the acceleration sensor is required to report data.

[0271] In the specific implementation, application A can call the enablesensor() interface to the sensorservice in the application framework layer, and send down sampling parameters (for example, sampling frequency or sampling period, etc.) when calling the interface. The sensorservice in the application framework layer sends an enable instruction to sensorhal, and the enable instruction can be used to indicate the startup information of the automatic rotation service.

[0272] As another embodiment of the present application, it is also possible to set application A not to have the ability to enable the automatic rotation service when it is running in the foreground, but to determine whether the automatic rotation function at the system level of the multi-screen terminal is enabled. For example, when application A is a video playback application, after the automatic rotation service of the multi-screen terminal itself is enabled, application A will not send the enable or disable information of the automatic rotation service to sensorhidl when it is switched to the foreground or started, but the content in the interface displayed when application A is running in the foreground can change direction as the screen in the multi-screen terminal rotates. After the automatic rotation service of the multi-screen terminal itself is turned off, the content in the interface displayed when application A is running in the foreground will not change direction as the screen of the multi-screen terminal rotates. In this case, the enable information of the automatic rotation service is not sent by application A to sensorhidl, but another window management service in the system responsible for enabling or disabling the automatic rotation service sends the enable information or disable message of the automatic rotation service to sensorhidl. As an example, when a user clicks the "auto-rotate" virtual button in the drop-down menu, the window management service can be triggered to send information about turning on or off the auto-rotate function to sensorhidl. Accordingly, the content on the interface of the application running in the foreground of the multi-screen terminal is automatically rotated.

[0273] In addition, since there is no logical order between the triggering conditions of step S101 (for example, any application switches to the secondary screen display) and the triggering conditions of step S201 (for example, when application A is turned on), in actual application, it does not mean that step S101 must come before step S201.

[0274] S202, after receiving the start information of the automatic rotation service, sensorhid1 sends a request for obtaining acceleration sensor data to sensorpd-1 on the ADSP side through inter-core communication.

[0275] S203, after receiving the acquisition request, sensorpd-1 on the ADSP side sends a sampling instruction to the main sensor, where the sampling instruction carries sampling parameters.

[0276] In the specific implementation, sensorpd-1 on the ADSP side calls write_mask() in the set_accel_mode() function, and writes sampling parameters to the register of the main sensor through I2C to trigger the main sensor to start sampling according to the sampling parameters. The sampling parameters can be the sampling rate or sampling period of the main sensor. For example, both sensors collect data in the first time period.

[0277] S204, sensorpd-1 on the ADSP side sends a sampling instruction to sensorpd-2 on the ADSP side.

[0278] The sampling instruction may carry sampling parameters of the main sensor.

[0279] S205, sensorpd-2 on the ADSP side sends a sampling instruction to the slave sensor, and the instruction carries the same sampling parameters as those of the main sensor.

[0280] The process of sensorpd-2 on the ADSP side sending sampling instructions to the secondary sensor can refer to the process of sensorpd-1 on the ADSP side sending acquisition instructions to the main sensor. Since the data collected by the secondary sensor needs to be replaced by the data collected by the primary sensor when the secondary screen is displayed, the primary sensor and the secondary sensor can be set to use the same sampling parameters.

[0281] After S203, the main sensor reports the main sensor data collected by the main sensor based on the sampling parameters to sensorpd-1 on the ADSP side; after S205, the secondary sensor reports the secondary sensor data collected by the secondary sensor based on the sampling parameters to sensorpd-1 on the ADSP side.

[0282] Although the sampling parameters of the main sensor and the secondary sensor are the same, in actual applications, the reporting times of the main sensor and the secondary sensor are not necessarily completely consistent.

[0283] S206, the main sensor reports the main sensor data to sensorpd-1 on the ADSP side.

[0284] S207, the secondary sensor reports the secondary sensor data to sensorpd-2 on the ADSP side.

[0285] S208, sensor pd-2 on the ADSP side sends the secondary sensor data to sensor pd-1.

[0286] In actual applications, both the data reported by the main sensor and the data reported by the secondary sensor are stored in different storage spaces. After the storage space has new data stored, data update information will be sent to the corresponding thread, and the corresponding thread can obtain the stored sensor data from the storage space. Therefore, after step S207, sensor pd-2 stores the received secondary sensor data in storage space B. After new data is stored in storage space B, it will send data update information to sensor pd-1. When sensor pd-1 determines that the display state is secondary screen display, it will obtain the secondary sensor data from storage space B. For the convenience of description, it is understood here that sensor pd-2 sends the secondary sensor data to sensor pd-1.

[0287] S209, when ADSP receives sensor data reported by the secondary sensor and the current display status flag is for secondary screen display, it stores the secondary sensor data; when ADSP receives sensor data reported by the main sensor and the current display status flag is for secondary screen display, it replaces the main sensor data with the stored secondary sensor data.

[0288] In the specific implementation, a storage variable temp can be set. When the secondary screen is displayed and the received sensor data is secondary sensor data, the secondary sensor data is stored in the storage variable; when the secondary screen is displayed and the received sensor data is primary sensor data, the latest secondary sensor data stored in the storage variable replaces the currently received primary sensor data. In this way, the secondary sensor data can be transmitted to application A without changing the process of the main sensor reporting sensor data of the operating system.

[0289] The following are some examples:

[0290] if(state->rigid_body_type==1&&g_subscreen_display_state==100){

[0291] temp.x = opdata_cal.x;

[0292] temp.y = opdata_cal.y;

[0293] temp.z = opdata_cal.z;

[0294] }

[0295] if(state->rigid_body_type==0&&g_subscreen_display_state==100){

[0296] opdata_cal.x = temp.x;

[0297] opdata_cal.y = temp.y;

[0298] opdata_cal.z = temp.z;

[0299] }

[0300] Here, rigid_body_type indicates whether the currently received sensor data is main sensor data or sub-sensor data, "0" indicates main sensor data, and "1" indicates sub-sensor data.

[0301] g_subscreen_display_state indicates the current display status, and "100" indicates sub-screen display.

[0302] temp.x represents the storage variable on the x-axis;

[0303] temp.y represents the storage variable on the y-axis;

[0304] temp.z represents the storage variable on the z-axis.

[0305] opdata_cal.x indicates the data identifier on the x-axis in the data reported by the main sensor.

[0306] opdata_cal.y indicates the data identifier on the y-axis in the data reported by the main sensor.

[0307] opdata_cal.z indicates the data identifier on the z-axis in the data reported by the main sensor.

[0308] Although only one main sensor can be registered in the operating system process and the data identifier of the main sensor is obtained: opdata_cal.x, opdata_cal.y, opdata_cal.z, the data of the main sensor (carrying the main sensor identifier) ​​can continue to be transmitted to application A when the main screen is displayed, and the data of the secondary sensor (carrying the same main sensor identifier) ​​can be transmitted to application A in the above manner when the secondary screen is displayed.

[0309] In the specific implementation, the storage variable stores the latest secondary sensor data. After obtaining the main sensor data, the latest secondary sensor data in the storage variable will replace the latest main sensor data. Even if the reporting time of the data collected by the main sensor and the secondary sensor is not completely consistent, the difference will not be greater than one sampling period. Usually, the sampling period of the sensor is very short, and when the user flips the folding screen mobile phone, the flipping action time itself may be greater than the sampling period. Therefore, there will be no large delay from the user's perspective.

[0310] Since the value on the y-axis of the main sensor and the value on the y-axis of the sub-sensor are the same regardless of the folding angle between the first screen and the second screen, in the above embodiment, there may be no process of storing the y-axis data of the sub-sensor and replacing the y-axis data of the main sensor. Therefore, when reporting data, the reported data are: the data on the x-axis and the z-axis of the sub-sensor and the y-axis data of the main sensor.

[0311] In actual applications, when a user uses a folding screen mobile phone to switch between the main screen and the secondary screen to display the application interface, in most application scenarios, the body where the main screen is located and the body where the secondary screen is located are in a completely folded state, that is, Fig.10 Therefore, the values ​​of the main sensor on the body where the main screen is located and the secondary sensor on the body where the secondary screen is located are exactly the same in the y direction, but the values ​​in the x direction are opposite, and the values ​​in the z direction are opposite. Therefore, if the currently received data is the data of the main sensor, and the current display status flag is for secondary screen display, the x value and z value of the main sensor data can be flipped or rotated (rotated 180°).

[0312] The following are some examples:

[0313] if(state->rigid_body_type==0&&g_subscreen_display_state==100){

[0314] opdata_cal.x=-opdata_cal.x;

[0315] opdata_cal.z=-opdata_cal.z;

[0316] }

[0317] Here, rigid_body_type indicates whether the currently received sensor data is main sensor data or sub-sensor data, "0" indicates main sensor data, and "1" indicates sub-sensor data.

[0318] g_subscreen_display_state indicates the current display status, and "100" indicates sub-screen display.

[0319] opdata_cal.x indicates the data identifier on the x-axis in the data reported by the main sensor.

[0320] opdata_cal.z indicates the data identifier on the z-axis in the data reported by the main sensor.

[0321] Set the x-axis data and z-axis data of the main sensor to remain unchanged, and add a "-" sign in front to get the x-axis data and z-axis data of the secondary sensor. The y-axis data of the main sensor remains unchanged and is the y-axis data of the secondary sensor. Correspondingly, if the main sensor data is currently received and the current display status flag is displayed on the main screen, the main sensor data (with the main sensor identifier) ​​is directly passed to application A.

[0322] In this way, the same data identifier can be used to transmit the data on the three axes collected by the main sensor when displayed on the main screen, and to transmit the data on the three axes collected by the secondary sensor when displayed on the secondary screen.

[0323] Of course, this implementation method does not require the participation of the sub-sensor data reported by the sub-sensor, that is, the sub-sensor may no longer be set in the multi-screen terminal, or when the sub-sensor is set, the sub-sensor is not required to collect data, or when the sub-sensor is set, the data collected by the sub-sensor does not need to undergo other conversion processing.

[0324] In actual applications, the specific method can be selected according to the specific structure of the multi-screen terminal and the target user group. The embodiments of the present application do not limit the specific implementation method.

[0325] S210, sensor pd-1 on the ADSP side sends the secondary sensor data to sensorhidl, where the identifier carried by the secondary sensor data is the registered primary sensor identifier.

[0326] S211, sensorhid1 reports the received secondary sensor data (carrying the data identifier of the primary sensor) to application A.

[0327] S212: After receiving the secondary sensor data, application A determines the display direction of the content in the interface based on the received sensor data.

[0328] As an example of determining the display direction of an icon in an interface based on sensor data, in an embodiment of the present application, the data collected by the acceleration sensor is divided into components in three directions, and the component in each direction is the acceleration component in that direction. When the multi-screen terminal is in a stationary state, the components in the three directions are the components of gravity acceleration in the three directions.

[0329] by Fig. 9 The configuration of the acceleration sensor in a folding screen mobile phone shown in the figure is taken as an example. Since the z-axis is the acceleration component perpendicular to the display screen, when determining the display direction of the content in the interface, the display direction can be determined according to the acceleration components on the x-axis and y-axis. Fig. 9 In the figure, if the direction of the x-axis is the right side, the opposite direction of the x-axis is the left side, and if the direction of the y-axis is the upper side, the opposite direction of the y-axis is the lower side.

[0330] If the acceleration component on the x-axis is greater than the acceleration component on the y-axis, and the acceleration component on the x-axis is positive, the display direction of the icon is such that the bottom end of the icon faces the direction of the x-axis: the right, and the top end of the icon faces the opposite direction of the x-axis: the left; if the acceleration component on the x-axis is greater than the acceleration component on the y-axis, and the acceleration component on the x-axis is negative, the display direction of the icon is such that the bottom end of the icon faces the opposite direction of the x-axis: the left, and the top end faces the positive direction of the x-axis: the right; if the acceleration component on the x-axis is less than the acceleration component on the y-axis, and the acceleration component on the y-axis is positive, the display direction of the icon is such that the bottom end of the icon faces the direction of the y-axis: the top, and the top end of the icon faces the opposite direction of the y-axis: the bottom; if the acceleration component on the x-axis is less than the acceleration component on the y-axis, and the acceleration component on the y-axis is negative, the display direction of the icon is such that the bottom end of the icon faces the opposite direction of the y-axis: the bottom, and the top end of the icon faces the positive direction of the y-axis: the top.

[0331] Of course, when the user holds a multi-screen terminal, the acceleration components of the sensors in various directions in the multi-screen terminal may jump. In order to avoid the jump of the display direction of the displayed content such as icons, other restrictions can be set. For example, it can be limited from two angles of duration and / or acceleration component difference. When the difference between the acceleration component on the x-axis and the acceleration component on the y-axis is greater than or equal to the first threshold and the duration is greater than the second threshold, switch to the direction corresponding to the larger acceleration component (the bottom of the icon is facing this direction), otherwise keep the display direction of the previous moment. For example, when the difference between the acceleration component on the x-axis and the acceleration component on the y-axis is less than the first threshold, keep the display direction of the previous moment.

[0332] Based on the secondary screen display flag in step S105, the data synchronization logic in S209, and the determination of the display direction of the interface content according to the secondary sensor data in S212 in this example, it can be understood that when application A is running in the foreground, if it is displayed on the secondary screen, application A receives the secondary sensor data, and can determine the display direction of the content of the interface displayed on the secondary screen based on the secondary sensor data, thereby reducing Figure 8 The icon that appears flips.

[0333] Accordingly, in Figure 7 In the scenario described above, whether in the data collected by the main sensor or the data collected by the secondary sensor, the acceleration component on the y-axis is greater than the acceleration component on the x-axis, and the acceleration component on the y-axis is negative. Therefore, based on the above description, it can be understood that when the application interface is displayed in a vertical screen mode through the secondary screen, whether the data collected by the main sensor or the data collected by the secondary sensor is used, Figure 7 The bottom of the icon in the interface shown faces the opposite direction of the y-axis: the lower side, and the top of the icon faces the positive direction of the y-axis: the upper side. Similarly, the display direction of the preview image in the interface is the same as the display direction of the icon.

[0334] If the user rotates counterclockwise Figure 7 When the foldable screen mobile phone is rotated about 90 degrees, the display direction of the content in the interface displayed on the secondary screen of the foldable screen can be determined in the following ways:

[0335] The schematic diagram of the status of the folding screen mobile phone is as follows Figure 8 and Fig.14 shown.

[0336] by Fig. 9 Taking the direction of the sensor shown in the figure as an example, if the icon display direction is determined based on the data collected by the main sensor, the acceleration component on the x-axis of the main sensor is greater than the acceleration component on the y-axis, and the acceleration component on the x-axis is negative, so the bottom of the icon faces the opposite direction of the x-axis: the left side, that is, the bottom of the icon displayed on the second screen is on the side of the folding axis, and the top of the icon is on the side of the second screen opposite to the folding axis, that is Figure 8 Therefore, when the application interface is displayed on the secondary screen and the screen is in landscape mode, if the display mode of the content in the interface is determined based on the data collected by the main sensor below the main screen, an incorrect display will occur, resulting in a poor user experience.

[0337] by Fig. 9 Taking the direction of the sensor shown in the figure as an example, if the icon display direction is determined based on the data collected by the secondary sensor, the acceleration component on the x-axis of the secondary sensor is greater than the acceleration component on the y-axis, and the acceleration component on the x-axis is positive, so the bottom of the icon displayed on the second screen faces the side opposite to the folding axis, and the top of the icon faces the side of the folding axis, that is, Fig.14 Therefore, when the interface of the application is displayed on the secondary screen and in the horizontal screen state, if the display mode of the content in the interface is determined based on the data collected by the secondary sensor below the secondary screen, the icons and preview screens in the interface can be displayed in a manner consistent with the user's perspective.

[0338] Fig.14 In the embodiment, the virtual buttons are rotated 90° clockwise relative to the second screen of the foldable screen mobile phone. For example, the "AI button", "focal length mark" and "camera switch button" are all rotated 90° clockwise relative to the second screen of the foldable screen mobile phone itself. The selfie screen is also rotated 90° clockwise relative to the second screen of the foldable screen mobile phone itself. From the user's perspective, the display direction of these virtual icons and selfie screens is vertical and forward, which is more in line with the user's viewing direction. Therefore, by adopting the interface display method of the multi-screen terminal provided in the embodiment of the present application, some content displayed on the second screen can be correctly rotated when the second screen is used in landscape mode.

[0339] In the above examples, the counterclockwise rotation of the screen by 90° is used as an example. In actual applications, the correct rotation of the interface content can be achieved by rotating the screen clockwise or at other angles according to the display method of the terminal interface provided in the above embodiments.

[0340] In the above examples, the x-axis, y-axis and z-axis are used for examples only. The y-axis in the main sensor can be understood as an axis parallel to the folding axis between the main screen and the secondary screen, the z-axis of the main sensor can be understood as an axis perpendicular to the main screen, and the x-axis of the main sensor can be understood as an axis perpendicular to the plane where the y-axis and z-axis of the main sensor are located. The y-axis in the secondary sensor can be understood as an axis parallel to the folding axis between the main screen and the secondary screen, and in the same direction as the y-axis in the main sensor; the z-axis of the main sensor can be an axis perpendicular to the main screen, and when the screen where the main sensor is located and the screen corresponding to the secondary sensor are unfolded into the same plane, the z-axis of the main sensor and the z-axis of the secondary sensor are in the same direction; the x-axis of the main sensor is an axis perpendicular to the plane where the y-axis and z-axis of the secondary sensor are located, and when the screen where the main sensor is located and the screen corresponding to the secondary sensor are unfolded into the same plane, the z-axis of the main sensor and the x-axis of the secondary sensor are in the same direction.

[0341] As mentioned above, the whole machine status management service can store the latest display status of the application running in the foreground. Therefore, the embodiment of the present application can achieve the correct display direction of the content in the interface of the application displayed in the foreground after the screen off event and the screen on event based on the display status of the foreground application maintained by the whole machine status management service.

[0342] Fig.15 A timing diagram of another application scenario of the interface display method of the multi-screen terminal provided in the embodiment of the present application; the application scenario can be Fig.13 Continuation scenario based on the timing diagram shown.

[0343] This diagram only shows Fig.13 Some steps in the above, steps not shown can be followed Fig.13 Description in Fig.13 In the scenario shown, the multi-screen terminal displays application A on the secondary screen.

[0344] S301, after the display service detects that the screen is turned off, it sends screen off information to the whole machine status management service.

[0345] In the embodiment of the present application, the multi-screen terminal can trigger the multi-screen terminal to enter the screen-off state through a physical button or other triggering process. After the multi-screen terminal enters the screen-off state, the screen-off information of the multi-screen terminal can be sent by the display service of the system to the whole machine state management service. The operation of the user clicking the physical button to trigger the multi-screen terminal to turn off the screen can be recorded as the third operation.

[0346] S302, after receiving the screen-off information, the whole machine status management service maintains the display status as the secondary screen display (this status is recorded as the first status).

[0347] In the embodiment of the present application, from the user's experience perspective, if application A is displayed on the secondary screen before the last screen is turned off and application A is not killed when the screen is turned on command is received, the user will hope that the last interface of application A before the screen is turned off will continue to be displayed on the secondary screen at the moment of turning on the screen, and at the same time, the content direction of the last interface of application A displayed is correct. Therefore, in the case of screen turning off, the display state in the whole machine state management service can also be maintained as secondary screen display.

[0348] S303: The whole device status management service sends a screen-off message to the sensorhidl process.

[0349] S304, the sensorhidl process sends a shutdown command to sensorpd-1 on the ADSP side.

[0350] Since the data collected by the acceleration sensor in the multi-screen terminal can be applied not only to the scenarios of the embodiments of the present application, but also to other scenario detections when the multi-screen terminal is in the screen-off state, for example, detection of a mobile phone being picked up by a user in the screen-off state, flip detection in the screen-off state, etc., the main sensor and the sub-sensor can continue to collect data when the multi-screen terminal is in the screen-off state. However, for the embodiments of the present application, it is not necessary to use the data collected by the main sensor and the sub-sensor to determine the display direction. Therefore, in the specific implementation, after the whole machine status management service sends a shutdown command to sensorhidl, sensorhidl calls the status monitoring unit to send the screen-off information. The status monitoring unit triggers the data switching switch based on the screen-off information to send a shutdown command to the data synchronization unit.

[0351] S305, after receiving the shutdown command, sensorpd-1 on the ADSP side stops the replacement of the primary sensor data with the secondary sensor data, and stops the process of reporting the sensor data to application A in the embodiment of the present application, i.e., stops Fig.13 Step S209 and subsequent processes in the timing diagram are shown. However, the main sensor data and the auxiliary sensor data may be transmitted to other applications in other ways, and the embodiment of the present application does not limit this.

[0352] S401, after the display service detects that the screen is on, it sends screen-on information to the whole machine status management.

[0353] The multi-screen terminal can trigger the multi-screen terminal to start the screen-on process through operations on physical buttons (or gestures). After the multi-screen terminal starts the screen-on process, if application A is displayed on the secondary screen before the last screen is turned off and application A is not killed when the screen-on information is received (due to the memory recycling mechanism, application A may be killed in the screen-off state), the process of starting application A on the secondary screen is executed. The operation of triggering the multi-screen terminal to enter the screen-on state from the screen-off state is recorded as the fourth operation.

[0354] During the execution of the above process, the screen light information of the multi-screen terminal can be sent by the system's display service to the whole machine status management service.

[0355] S402, the whole machine status management service query display status is the secondary screen display.

[0356] In the embodiment of the present application, the display status in the whole machine status management service continues to maintain the latest display status before the screen off event after the screen off event and the screen on event: secondary screen display, so the query result is secondary screen display.

[0357] S403, the whole device status management service sends screen light information to sensorhidl.

[0358] S404: After receiving the screen-on information, sensorhidl sends an on command to sensorpd-1 on the ADSP side.

[0359] In the specific implementation, sensorhidl can call the status monitoring unit and the data switching switch to execute the following process: the status monitoring unit can receive the screen-on information, and the status monitoring unit triggers the data switching switch to send an on instruction to sensorpd-1 on the ADSP side based on the received screen-on information.

[0360] S405, after receiving the data synchronization start instruction, sensorpd-1 on the ADSP side starts the process of replacing the main sensor data with the secondary sensor data.

[0361] S406, when sensorpd-1 on the ADSP side receives sensor data reported by the secondary sensor and the current display status flag is for secondary screen display, it stores the secondary sensor data; when sensor data reported by the main sensor is received and the current display status flag is for secondary screen display, it replaces the main sensor data with the stored secondary sensor data.

[0362] S407, sensorpd-1 on the ADSP side reports the secondary sensor data (carrying the primary sensor data identifier) ​​to sensorhidl.

[0363] The subsequent execution process can refer to Fig.13 The steps after step S210 in the timing sequence shown.

[0364] Since the startup process of application A also takes time, application A has received the secondary sensor data (carrying the main sensor identifier) ​​before the first interface of application A is drawn. Therefore, the content of the interface of application A displayed on the secondary screen of the multi-screen terminal has the correct display direction. Of course, in actual applications, even if application A receives the secondary sensor data (carrying the main sensor identifier) ​​after the first interface of application A is drawn and displayed, the interface of application A can also be quickly and correctly displayed after receiving the sensor data.

[0365] Therefore, by using the whole-device status management service to maintain the latest display status before the screen is turned off, the multi-screen terminal can continue to directly execute the process of determining the display direction of the content in the interface when the secondary screen is displayed in the scenario where application A is displayed on the secondary screen after the screen is turned on, so that the content in the interface of application A can be displayed correctly as quickly as possible.

[0366] In some application scenarios, since the application may have abnormalities, for example, the application displayed on the secondary screen is stuck, resulting in the inability to report the display status of the application displayed on the secondary screen, or the main screen mistakenly reports the display status as the secondary screen display, etc., the display status in the whole machine status management service will be erroneous and the primary and secondary sensor data in the data synchronization unit may be confused. Therefore, the embodiment of the present application also provides a self-recovery solution for abnormal scenarios, so that it can automatically recover to a normal state after a series of screen-off events and screen-on events.

[0367] Fig.16 A timing diagram of another application scenario of the interface display method for a multi-screen terminal provided in an embodiment of the present application.

[0368] The timing diagram and Fig.15 The differences in the timings shown are:

[0369] When the multi-screen terminal executes the screen-off process, after the whole device status management service receives the screen-off information in step S301, S501 and subsequent steps are executed.

[0370] S501, the whole machine status management service sets the display status to main screen display (this status is recorded as the second status).

[0371] S502, when the display status is screen off or main screen display, the whole device status management service sends screen off or main screen display information to sensorhidl.

[0372] S503, after receiving the information of screen off and main screen display, sensorhal sends a shutdown command to sensorpd-1 on the ADSP side, and the command can carry the information of main screen display.

[0373] After receiving the information displayed on the main screen by calling the status monitoring unit, Sensorhidl sends a shutdown command (carrying the main screen display information) to sensorpd-1 by calling the data switching switch.

[0374] S504, after receiving the shutdown instruction, sensorpd-1 on the ADSP side sets the display state to the main screen display flag.

[0375] After step S504, the main sensor data and the sub-sensor data on the ADSP side have been restored to the main sensor reporting process. Even if there was confusion between the main sensor and the sub-sensor before, this confusion has been eliminated.

[0376] Since the display status flag has been set to the main screen display flag, the process of closing the replacement of the main sensor data with the auxiliary sensor data may no longer be executed.

[0377] When the multi-screen terminal executes the screen light-up process, after the whole device status management service receives the screen light-up information in step S401, S601 and subsequent steps are executed.

[0378] S601: The whole device status management service no longer queries the display status stored in itself.

[0379] S602: The whole device status management service receives the display status sent by the display service: secondary screen display.

[0380] When application A continues to be displayed on the secondary screen after the screen is turned on, the display service can also send a display status to the whole device status management service: secondary screen display.

[0381] S603, the whole device status management service sends the screen light information and the display status of the secondary screen to sensorhidl.

[0382] S604, sensorhid1 sends an opening instruction to sensorpd-1 on the ADSP side, and the opening instruction carries the secondary screen display information.

[0383] After receiving the information displayed on the secondary screen by calling the status monitoring unit, Sensorhidl determines that it is switched to the secondary screen display state, and calls the data switching switch to send an opening instruction (carrying the secondary screen display information) to sensorpd-1 on the ADSP side.

[0384] S605, after receiving the start instruction carrying the secondary screen display, sensorpd-1 on the ADSP side sets the secondary screen display flag.

[0385] S606, sensorpd-1 on the ADSP side starts the process of replacing the primary sensor data with the secondary sensor data.

[0386] Of course, in actual applications, it is also possible not to start the replacement process of the main sensor data with the secondary sensor data, but to use the secondary sensor data to replace the main sensor data when the display status flag is the secondary screen display flag.

[0387] S406, when sensorpd-1 on the ADSP side receives sensor data reported by the secondary sensor and the current display status flag is for secondary screen display, it stores the secondary sensor data; when sensor data reported by the main sensor is received and the current display status flag is for secondary screen display, it replaces the main sensor data with the stored secondary sensor data.

[0388] S407, sensorpd-1 on the ADSP side reports the secondary sensor data (primary sensor data identifier) ​​to sensorhidl.

[0389] The subsequent execution process can refer to Fig.13 The steps after step S210 in the timing sequence shown.

[0390] In the embodiment of the present application, after the multi-screen terminal re-enters the screen light process, Fig.13 In the timing diagram shown, the process of starting application A and displaying application A on the secondary screen is that application A sends the display status to the whole machine status management service, and the whole machine status management service executes the subsequent processes based on the most recently received display status. Therefore, when application A continues to be displayed on the secondary screen after the screen is turned on, application A can also continue to determine the display direction of the content in the interface based on the secondary sensor data (carrying the main sensor identifier).

[0391] The interface display method of the multi-screen terminal provided in the embodiment of the present application can restore the status of the secondary screen display to the main screen display status through a screen-off event, so that the ADSP side also returns to the process of transmitting the main sensor data to the upper-level application; when the screen is turned on again, if application A has not been killed and is still displayed on the secondary screen, the trigger condition that application A is running in the foreground and displayed on the secondary screen during the screen-on event triggers application A to send the secondary screen display status to the whole machine status management service. The whole machine status management service will store the secondary screen display status and continue the subsequent process to update the display status identifier in the ADSP to the secondary screen display flag, thereby restoring the process of transmitting the secondary sensor data when the secondary screen is displayed.

[0392] The above embodiments all take application A as the selfie interface of the camera application as an example to describe the interface display method of the multi-screen terminal provided by the embodiment of the present application. In actual applications, when the multi-screen terminal displays the interface of the photos that have been taken by application A on the secondary screen (i.e., the preview interface of the photos), the interface display method of the multi-screen terminal provided by the embodiment of the present application is also applicable. Of course, after the multi-screen terminal itself turns on the automatic rotation service, when other applications are displayed on the secondary screen, the interface display method of the multi-screen terminal provided by the embodiment of the present application can also be applied.

[0393] The main acceleration sensor and the auxiliary acceleration sensor provided in the embodiment of the present application are also only examples of the main sensor and the auxiliary sensor. In actual applications, the main ambient light sensor located on the side of the main screen and the auxiliary ambient light sensor located on the side of the auxiliary screen are also applicable to the operations performed by the data synchronization unit in the interface display method of the multi-screen terminal provided in the embodiment of the present application, except that the upper-layer application adjusts the brightness of the display screen according to the obtained sensor data after obtaining the data. Of course, other sensors of the same category located in different screens of the multi-screen terminal are also applicable to the operations performed by the data synchronization unit provided in the example of the present application.

[0394] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0395] The embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0396] The embodiment of the present application also provides a computer program product. When the computer program product runs on a multi-screen terminal, the multi-screen terminal can implement the steps in the above-mentioned various method embodiments.

[0397] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying the computer program code to the first device, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0398] The embodiment of the present application also provides a chip system, the chip system includes a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement the steps of any method embodiment of the present application. The chip system can be a single chip or a chip module composed of multiple chips.

[0399] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0400] Those of ordinary skill in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0401] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. An interface display method, characterized in that: Applied to a terminal device, the terminal device comprises a first sensor, a second sensor and a display screen, the display screen comprises a first screen and a second screen; when the terminal device is unfolded, the first sensor is located below the first screen, the second sensor is located below the second screen, and the first screen and the second screen have the same display direction; When the terminal device is folded, the display directions of the first screen and the second screen are opposite to each other, and the method includes: The terminal device displays a first interface of a first application on the first screen; During the process of displaying the first interface on the first screen, the terminal device obtains data collected by the first sensor through the first application; During the process of rotating the first screen counterclockwise by 90°, the terminal device rotates the first icon in the first interface clockwise by 90° relative to the first screen based on the data collected by the first sensor; The terminal device receives a first operation of switching to display the first application on the second screen; In response to the first operation, the terminal device displays a second interface of the first application on the second screen, where the second interface is an interface of the first interface adapted to the second screen, and the second interface includes the first icon; During the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application; During the process of the second screen rotating counterclockwise by 90°, the terminal device rotates the first icon in the second interface clockwise by 90° relative to the second screen based on the data collected by the second sensor.

2. The method according to claim 1, characterized in that In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including: The terminal device acquires data collected by the second sensor, where the data collected by the second sensor is second data; If the second interface of the first application is displayed on the second screen, the terminal device stores the data collected by the second sensor; The terminal device acquires data collected by the first sensor, where the data collected by the first sensor is first data; If the second interface of the first application is displayed on the second screen, the terminal device replaces the data collected by the first sensor with the stored data collected by the second sensor to obtain the data after the first sensor is replaced, and the data after the first sensor is replaced is the second data collected by the second sensor; The terminal device obtains data after the first sensor is replaced through the first application.

3. The method according to claim 1, characterized in that The terminal device includes a first processor and a second processor, the first application runs on the first processor, and after the terminal device displays a second interface of the first application on the second screen, the method further includes: The first processor sends second information to the second processor, and the second information is displayed on the second screen; After receiving the second information, the second processor sets the display status flag to a second flag, where the second flag is used to indicate display on the second screen; In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including: The second processor acquires data collected by the second sensor, where the data collected by the second sensor is second data; When the display status flag in the second processor is the second flag, the second processor stores the data collected by the second sensor; The second processor acquires data collected by the first sensor, where the data collected by the first sensor is first data; When the display status flag in the second processor is the second flag, the second processor replaces the data collected by the first sensor with the stored data collected by the second sensor, and the data after the first sensor is replaced is the second data collected by the second sensor; The second processor sends the data after the first sensor is replaced to the first application of the first processor; The first application in the first processor obtains data after the first sensor is replaced.

4. The method according to claim 1, characterized in that When the terminal device is folded, the data of the first direction of the first sensor and the data of the first direction of the second sensor have the same value and are in opposite directions, the data of the second direction of the first sensor and the data of the second direction of the second sensor have the same value and are in opposite directions, and the data of the third direction of the first sensor and the data of the third direction of the second sensor have the same value and are in the same direction; In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including: The terminal device acquires data collected by the second sensor, where the data collected by the second sensor is second data; The terminal device acquires data collected by the first sensor, where the data collected by the first sensor is first data; If the second interface of the first application is displayed on the second screen, the terminal device flips the data in the first direction and the data in the second direction in the data collected by the first sensor; The terminal device obtains the data collected by the first sensor after the direction is flipped through the first application.

5. The method according to claim 1, characterized in that The terminal device includes: a first processor and a second processor, and the first application runs in the first processor; after the terminal device displays a second interface of the first application on the second screen, the method further includes: The first processor sends second information to the second processor, and the second information is displayed on the second screen; After receiving the second information, the second processor sets the display status flag to a second flag, where the second flag is used to indicate display on the second screen; In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including: The second processor acquires data collected by the second sensor, where the data collected by the second sensor is second data; The second processor acquires data collected by the first sensor, where the data collected by the first sensor is first data; When the display status flag in the second processor is the second flag, the second processor flips the directions of the data in the first direction and the data in the second direction in the data collected by the first sensor; The second processor sends the data collected by the first sensor after the direction is flipped to the first application of the first processor; The first application in the first processor obtains data collected by the first sensor after the direction is flipped.

6. The method according to any one of claims 1 to 5, characterized in that: The first interface of the first application includes a first screen switching button, and the first operation is an operation performed on the first screen switching button; Or, the first operation is a gesture operation acting on the first screen; Or, the system menu bar includes a second screen switching button, and the first operation is an operation acting on the second screen switching button.

7. The method according to any one of claims 1 to 5, characterized in that The method further comprises: After the first application is started, the terminal device obtains first data collected by the first sensor in a first time period, and the terminal device obtains second data collected by the second sensor in the first time period; Alternatively, after receiving the second operation, the terminal device obtains first data collected by the first sensor in a first time period, and the terminal device obtains second data collected by the second sensor in the first time period, and the second operation is an operation acting on the automatic rotation button in the system menu bar.

8. The method according to any one of claims 1 to 7, characterized in that After the terminal device displays the second interface of the first application on the second screen in response to the first operation, the method further includes: The terminal device receives a third operation; In response to the third operation, the terminal device turns off the display screen; The terminal device receives a fourth operation; In response to the fourth operation, the terminal device lights up the display screen and displays the second interface of the first application on the second screen; During the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application; During the process of the second screen rotating counterclockwise by 90°, the terminal device rotates the first icon in the second interface clockwise by 90° relative to the second screen based on the data collected by the second sensor.

9. The method according to claim 8, characterized in that The terminal device includes a first processor and a second processor, and the first application runs in the first processor; After the terminal device displays the second interface of the first application on the second screen in response to the first operation, the method further includes: The first processor sets the display state to a first state, wherein the first state is displayed on the second screen; After setting the display state to the first state, the first processor sends an opening instruction and second information to the second processor, where the second information is used to indicate display on the second screen; After receiving the second information, the second processor sets the display status flag to a second flag; After receiving the start instruction, the second processor starts a replacement operation, wherein the replacement operation is an operation of replacing the data collected by the first sensor with the data collected by the second sensor when the display status flag is the second flag.

10. The method according to claim 9, characterized in that After the terminal device turns off the display screen, the method further includes: The first processor maintains the display state as the first state; The first processor sends a shutdown instruction to the second processor; After receiving the closing instruction, the second processor closes the replacement operation; After the terminal device displays the second interface of the first application on the second screen in response to the fourth operation, the method further includes: The first processor queries that the display state is the first state; The first processor sends an enable instruction to the second processor based on the first state obtained by query; After receiving the start instruction, the second processor starts the replacement operation; In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including: After the replacement operation is started, if the display status flag is the second flag, the second processor replaces the data collected by the first sensor with the data collected by the second sensor; The second processor sends the data after the first sensor is replaced to the first processor.

11. The method according to claim 9, characterized in that After the terminal device turns off the display screen, the method further includes: The first processor sets the display state to a second state, where the second state indicates display on the first screen; The first processor sends a closing instruction and first information to the second processor; After receiving the closing instruction, the second processor closes the replacement operation; After receiving the first information, the second processor sets the display status flag to a first flag; After the terminal device displays the second interface of the first application on the second screen in response to the fourth operation, the method further includes: The first processor sets the display state to the first state; After setting the display state to the first state, the first processor sends an opening instruction and second information to the second processor; After receiving the second information, the second processor sets the display status flag to a second flag; After receiving the start instruction, the second processor starts the replacement operation.

12. The method according to any one of claims 9 to 11, characterized in that In the process of displaying the second interface on the second screen, the terminal device obtains data collected by the second sensor through the first application, including: After the replacement operation is started, if the display status flag is the second flag, the second processor replaces the data collected by the first sensor with the data collected by the second sensor; The second processor sends the data after the first sensor is replaced to the first processor, where the data after the first sensor is replaced is the data collected by the second sensor; The first processor obtains data after the first sensor is replaced through the first application.

13. A terminal device, characterized in that: The terminal device comprises a processor, and the processor is used to run a computer program stored in a memory, so that the terminal device implements the method according to any one of claims 1 to 12.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by one or more processors, the method according to any one of claims 1 to 12 is implemented.

Images