Interface display method and device

By creating a virtual screen in the folding screen device, synchronous refresh of display area B and display area C is solved, the problem of delay in interface update in the folded state is improved, and the user experience is improved, ensuring that the application interface can respond to user operations in a timely manner in the folded state is completed. .

CN119271099AActive Publication Date: 2025-01-07HONOR DEVICE CO LTD
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
CN202410543541.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-04-28
Publication Date
2025-01-07
Estimated Expiration
2044-04-28

AI Technical Summary

Technical Problem

In the folding state of the folding screen phone, the display area B and the display area C cannot be refreshed simultaneously, resulting in limited user experience and inability to respond to user triggering operations, resulting in delayed or invalid application interface updates.

Method used

By creating a virtual screen, setting up synchronous refresh of display area B and display area C, synchronous display between the first display area and the second display area is realized, the application interface is updated in response to user operations, and the content is displayed in the virtual screen to ensure the display Area C is synchronized with the contents of display area B.

Benefits of technology

The application interface of the folded screen device is synchronously updated in the folded state, which improves the user experience, ensures that the display area C can reflect the operation results of the display area B in real time, and avoids the problems of interface update delay and unresponsive user operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119271099A_ABST
    Figure CN119271099A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides an interface display method and device, and relates to the technical field of terminals. The method comprises the steps that in response to a first operation, a second floating window corresponding to a second application is displayed in a first display area, a display area of a virtual screen is set as a second display area, and a first application interface is displayed in the second display area through the virtual screen; in response to the second operation, displaying a first floating window in the first display area; and in response to the third operation, displaying the second application interface in the second display area. Thus, the folding screen device can not only display the content in the window of the first display area to the second display area cooperatively, but also respond to the trigger operation executed by the user for the second display area, and the application interface in the floating window and the application interface in the second display area can be updated synchronously.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an interface display method and device. Background Art

[0002] With the popularization and development of the Internet, people's functional requirements for electronic devices have become more and more diversified. For example, in order to increase users' demand for multiple services, foldable screen mobile phones have gradually come into the user's field of vision, and users can use multiple display screens in foldable screen mobile phones to perform multiple services. For example, take the foldable screen mobile phone as an external folding mobile phone as an example for schematic illustration. When the foldable screen mobile phone is in the unfolded state, the user can use display screen A for interface display; when the foldable screen mobile phone is in the folded state, the user can use display area B and / or display area C to display content. Among them, display area B and display area C are both composed of a part of the display area in display screen A.

[0003] However, there are certain limitations to the usage of the above-mentioned foldable screen mobile phones. Summary of the invention

[0004] An embodiment of the present application provides a display method and device, which are applied to the field of terminal technology, so that a folding screen device can mirror the application interface displayed in the window of display area B to display area C, and the application interface in display area B and display area C can be refreshed synchronously to improve the limitations of using folding screen mobile phones.

[0005] In a first aspect, an embodiment of the present application provides an interface display method, which is applied to a folding screen device, wherein the folding screen device includes: a physical display screen, wherein the physical display screen includes: a first display area and a second display area, wherein the first display area and the second display area are arranged opposite to each other when the folding screen device is in a folded state, and the method includes: creating a virtual screen, wherein the virtual screen corresponds to the second display area; the first display area displays a first interface, wherein the first interface includes: a first full-screen window corresponding to a first application and a first floating window corresponding to a second application, wherein the folding screen device is in a folded state, and the first floating window includes a first application interface corresponding to the second application; in response to a first operation on the second display area, a first full-screen window corresponding to the second application is displayed in the first display area. Two floating windows are provided, and the display area of ​​the virtual screen is set as the second display area, and the first application interface is displayed in the second display area through the virtual screen, and the size of the second floating window is smaller than that of the first floating window; in response to the second operation on the second floating window, the first floating window is displayed in the first display area, and the first application interface is displayed in the second display area; in response to the third operation on the first floating window, a third floating window corresponding to the second application is displayed in the first display area, and the second application interface is displayed in the second display area, wherein the size of the third floating window is larger than that of the second floating window, and the third floating window includes the second application interface corresponding to the second application, and the second application interface is different from the first application interface.

[0006] The first display area may be the display area B described in the embodiment of the present application, and the second display area may be the display area C described in the embodiment of the present application.

[0007] The first interface may be the interface shown in FIG. 5C , the first application may be a note application, and the first full-screen window corresponding to the first application may be a note application interface displayed in full screen.

[0008] The second application may be a payment application, the first floating window corresponding to the second application may be floating window 501 in FIG. 5C , and the first application interface corresponding to the second application may be a payment interface in the payment application, such as the application interface in floating window 501, that is, the payment interface is displayed in floating window 501, and the first application interface does not include the control controls in floating window 501. It can be understood that the first application interface is not an interface in the first application.

[0009] The first operation may be the operation of double-clicking the display area C as described in FIG. 5C , or may be other operations for entering collaborative display, see Figure 5-2 to Figure 6-1 Description in .

[0010] The second floating window may be the mini window 506 in FIG. 5E .

[0011] The second operation may be a click operation on the mini window 506 .

[0012] As shown in FIG6A , the third operation may be an operation of sliding up the floating window 601. The third floating window may be the floating window 601 in FIG6C , and the second application interface corresponding to the second application may be the application interface displayed in the floating window 601, and the second application interface does not include the control controls in the floating window 601.

[0013] In this way, the folding screen device can not only realize the coordinated display of the content in the window of display area B to display area C, but also in response to the trigger operation performed by the user on display area C, the application interface in the floating window can be updated synchronously with the application interface in display area C, so that the user can view the updated application interface in display area C in real time.

[0014] In one possible implementation, the first display area is obtained by controlling the display interface through the first logical screen, and setting the display area of ​​the virtual screen to the second display area includes: setting the display area of ​​the physical display screen to the entire display area, so that the content in the first logical screen and the content in the virtual screen are both displayed from the starting position of the entire display area, and the starting position of the second display area is the same as the starting position of the entire display area.

[0015] The first logical screen may be the logical screen 1 described in the embodiment of the present application, and the starting position of the second display area may be Fig.14 The starting position 2 described in the above description, the starting position of the entire display area can be Fig.14 The starting position described in 1.

[0016] In this way, the folding screen device can set the starting position of the first display area and the starting position of the second display area at the starting position of all display areas by setting the entire display area. At this time, the first display area and the second display area can be displayed overlappingly.

[0017] In a possible implementation manner, the display layer of the first logical screen is moved from a starting position of the entire display area to a first position, where the first position is a starting position of the first display area.

[0018] In this way, the folding screen device can move the display layer of the first logical screen to the first position, so that the first logical screen can display the interface in the first display area, and the virtual screen can display the interface in the second display area, thereby reducing the overlapping display between the first display area and the second display area.

[0019] In one possible implementation, after setting the display area of ​​the virtual screen to the second display area, the method further includes: setting the virtual screen to the default display, and before setting the virtual screen to default display, the virtual screen corresponds to the first layer, and the first layer is not allowed to be displayed on the physical display.

[0020] The first layer corresponding to the virtual screen can be understood as the layer stack of the virtual screen itself.

[0021] It can be understood that the default display allows display on the physical display, so the folding screen device can display the content in the virtual screen on the physical display by setting the virtual screen as the default display.

[0022] In one possible implementation, the method also includes: when a second status message is received, the display layer of the first logical screen is restored from the first position to the starting position of the entire display area, and the layer of the virtual screen is restored to the first layer, wherein the second status message is generated when the folding screen device detects an operation of unfolding the folding screen device, or, when a third status message is received, the layer of the virtual screen is restored to the first layer, and the display area of ​​the physical display screen is restored to the first display area, wherein the third status message is generated when the folding screen device detects a preset operation, and the preset operation includes one or more of the following: an operation of switching the second floating window to a floating ball, an operation of displaying the content in the second floating window in full screen, or an operation of closing the second floating window.

[0023] The second status message may be the status change message 2 described in the embodiment of the present application. In this way, when the folding screen device detects that the folding screen device is unfolded, the folding screen device can restore the display position of the first logical screen and the original first layer of the virtual screen so that the content in the first display area can be connected to the physical display screen to reduce the interruption of the displayed content.

[0024] The third status message may be the status change message 3 described in the embodiment of the present application, and the preset operation may be the preset exit operation described in the embodiment of the present application. In this way, when the preset operation is detected, the folding screen device can restore the display position of the first logical screen and set the display area of ​​the physical display screen to the first display area to ensure the normal display of the content in the first display area, and no content may be displayed in the second display area.

[0025] In one possible implementation, after responding to the first operation on the second display area, the method also includes: when receiving a first status message related to the first operation, obtaining the task task in the first floating window; mirroring the layer in the task to obtain the second layer; and mounting the second layer to the virtual screen.

[0026] The first status message may be the status change message 1 described in the embodiment of the present application, and the second layer may be the layer 1 described in the embodiment of the present application.

[0027] In this way, the folding screen device can achieve coordinated display of the first floating window and the content in the second display area by mirroring the task in the first floating window and mounting the mirrored layer on the virtual screen.

[0028] In one possible implementation, the outer border of the second floating window is in a first state, and the outer borders of the first floating window and the third floating window are in a second state, wherein the thickness of the outer border line in the first state is greater than the thickness of the outer border line in the second state, and / or the color of the outer border in the first state is different from that of the outer border in the second state.

[0029] In this way, the folding screen device can use the first state to indicate that the content in the floating window has been mounted on the external screen, and use the second state to indicate that the content in the floating window is not mounted on the external screen, so that the user can determine the situation of collaborative display without checking the external screen, thereby improving the user experience of using the collaborative display function.

[0030] In one possible implementation, the method also includes: in response to a fourth operation on the first display area, displaying a fourth floating window corresponding to the third application in the first display area, the fourth floating window including a third application interface corresponding to the third application; in response to a fifth operation on the fourth floating window, displaying a fifth floating window corresponding to the third application in the first display area, and displaying a first prompt message in the second display area, wherein the size of the fifth floating window is smaller than that of the fourth floating window, and the first prompt message is used to prompt that the third application interface does not support collaborative display to the second display area; or, in response to the fifth operation, displaying the fifth floating window and the first prompt message in the first display area.

[0031] The fourth operation may be an operation of opening another floating window. The fourth floating window may be Figure 7 The floating window 701 in A.

[0032] The third application may be a financial application, and the third application interface may be an application interface displayed in the floating window 701, such as a transfer interface.

[0033] The first prompt information may be prompt information 801 .

[0034] In this way, the folding screen device can determine whether to enter collaborative display based on the attributes of the interface, and prompt the user through the first display area or the second display area when it is determined that the collaborative display cannot be entered, so as to improve the user experience of using the collaborative display function.

[0035] In one possible implementation, after displaying the first application interface in the second display area, the method further includes: displaying a second prompt message in the first display area, the second prompt message being used to prompt that the folding screen device is in an abnormality and whether to end displaying the first application interface in the second display area; and / or, after responding to the first operation on the second display area, the method further includes: displaying a third prompt message in the first display area, the third prompt message being used to prompt that the folding screen device is in an abnormality and whether to display the first application interface in the second display area.

[0036] The second prompt information may be the prompt information 1104 described in FIG. 11A , and the third prompt information may be the prompt information 1106 described in FIG. 11D .

[0037] In this way, the foldable screen device can promptly notify the user through prompt information when it detects that the device is in an abnormal state, so as to reduce the situation where the device battery level drops rapidly or the device freezes without the user's perception.

[0038] In one possible implementation, the folding screen device is in an abnormal state including: the folding screen device detects that the percentage of battery power is less than a first value, and / or the folding screen device detects that the device temperature is greater than a second value.

[0039] It is understandable that the collaborative display function has higher power consumption requirements and / or battery power requirements, so the folding screen device can determine that the folding screen device is abnormal when it detects that the device power is low and the device temperature is high.

[0040] In a possible implementation, after displaying the first application interface in the second display area, the method further includes:

[0041] In response to the operation of opening the notification center from the first display area, a fourth prompt message is displayed in the first display area, and the first application interface is displayed in the second display area, and the fourth prompt message is used to prompt the folding screen device to display the first application interface in the second display area.

[0042] The fourth prompt information can be Figure 8 Prompt message 801 in A.

[0043] In this way, the foldable screen device can view the status of the foldable screen device from the notification center.

[0044] In a possible implementation, after displaying the first application interface in the second display area, the method further includes:

[0045] In response to the operation of unfolding the folding screen device, a second floating window is displayed in the physical display screen.

[0046] In this way, when the folding screen device detects that the device is unfolded, it can connect the content displayed in the first display area to the physical display screen to reduce interruptions in the displayed content.

[0047] In a possible implementation, after displaying the first application interface in the second display area, the method further includes:

[0048] In response to a sixth operation on the first display area, cancel displaying any content in the second display area, wherein the sixth operation includes one or more of the following: an operation of switching the second floating window to a floating ball, an operation of displaying the content in the second floating window in full screen, or an operation of closing the second floating window.

[0049] The sixth operation may be the preset exit operation described in the embodiment of the present application.

[0050] In this way, the folding screen device can promptly cancel the display of any content in the second display area when a preset exit operation is detected to reduce power consumption.

[0051] In a possible implementation manner, the first operation on the second display area includes: multiple tapping operations on the second display area.

[0052] In a third aspect, an embodiment of the present application provides an interface display device, which may be an electronic device, or a chip or chip system in an electronic device. The interface display device may include a display unit and a processing unit. When the interface display device is an electronic device, the display unit may be a display screen. The display unit is used to perform the display step so that the electronic device implements an interface display method described in the first aspect or any possible implementation of the first aspect, or implements an interface display method described in the second aspect or any possible implementation of the second aspect. When the interface display device is an electronic device, the processing unit may be a processor. The interface display device may also include a storage unit, which may be a memory. The storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit so that the electronic device implements an interface display method described in the first aspect or any possible implementation of the first aspect, or implements an interface display method described in the second aspect or any possible implementation of the second aspect. When the interface display device is a chip or chip system in an electronic device, the processing unit may be a processor. The processing unit executes the instructions stored in the storage unit to enable the electronic device to implement an interface display method described in the first aspect or any possible implementation of the first aspect, or to implement an interface display method described in the second aspect or any possible implementation of the second aspect. The storage unit may be a storage unit within the chip (e.g., a register, a cache, etc.), or may be a storage unit within the electronic device that is located outside the chip (e.g., a read-only memory, a random access memory, etc.).

[0053] Exemplarily, a processing unit is used to create a virtual screen, which corresponds to the second display area; a display unit is used to display a first interface in the first display area, wherein the first interface includes: a first full-screen window corresponding to the first application and a first floating window corresponding to the second application, wherein the folding screen device is in a folded state, and the first floating window includes a first application interface corresponding to the second application; the processing unit is also used to respond to a first operation on the second display area, the display unit is also used to display a second floating window corresponding to the second application in the first display area, the processing unit is also used to set the display area of ​​the virtual screen to the second display area, and the display unit is also used to display the first full-screen window corresponding to the first application in the second display area through the virtual screen. An application interface, the size of the second floating window is smaller than the size of the first floating window; the processing unit is further used to respond to a second operation on the second floating window, and the display unit is further used to display the first floating window in the first display area, and to display the first application interface in the second display area; the processing unit is further used to respond to a third operation on the first floating window, and the display unit is further used to display a third floating window corresponding to the second application in the first display area, and to display the second application interface in the second display area, wherein the size of the third floating window is larger than the size of the second floating window, the third floating window includes a second application interface corresponding to the second application, and the second application interface is different from the first application interface.

[0054] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method described in the first aspect or any possible implementation of the first aspect.

[0055] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method described in the first aspect or any possible implementation of the first aspect.

[0056] In a fifth aspect, an embodiment of the present application provides a computer program product comprising a computer program. When the computer program product comprises computer program code, when the computer program code runs on an electronic device, the electronic device executes the method described in the first aspect or any possible implementation manner of the first aspect.

[0057] In a sixth aspect, the present application provides a chip system, which is applied to an electronic device. The chip system includes one or more processors, and the one or more processors are used to call computer instructions to enable the electronic device to execute the method described in the first aspect or any possible implementation of the first aspect.

[0058] In a possible implementation, the chip system described above in the present application further includes at least one memory, in which instructions are stored. The memory may be a storage unit inside the chip system, such as a register, a cache, etc., or a storage unit of the chip system (e.g., a read-only memory, a random access memory, etc.).

[0059] It should be understood that the second to sixth aspects of the present application correspond to the technical solutions of the first aspect of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Figure 1 A schematic diagram of a folding screen mobile phone provided in an embodiment of the present application;

[0061] Figure 2 A schematic diagram of a scenario provided for an embodiment of the present application;

[0062] Figure 3 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0063] Figure 4 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0064] Figure 5-1 A schematic diagram of an interface for entering collaborative display provided in an embodiment of the present application;

[0065] Figure 5-2 A schematic diagram of an interface for entering collaborative display provided in an embodiment of the present application;

[0066] Figure 5-3 A schematic diagram of an interface for entering collaborative display provided in an embodiment of the present application;

[0067] Figure 5-4 A schematic diagram of an interface for entering collaborative display provided in an embodiment of the present application;

[0068] Figure 6-1 A schematic diagram of a collaborative interaction interface provided in an embodiment of the present application;

[0069] Figure 6-2 A schematic diagram of a collaborative interaction interface provided in an embodiment of the present application;

[0070] Figure 7 A schematic diagram of a safety prompt interface provided in an embodiment of the present application;

[0071] Figure 8 A schematic diagram of an interface for prompting collaborative display status provided in an embodiment of the present application;

[0072] Figure 9-1 A schematic diagram of a collaborative display interface in which a floating window is displayed in landscape mode provided in an embodiment of the present application;

[0073] Figure 9-2 A schematic diagram of a collaborative display interface in which a floating window is displayed in landscape mode provided in an embodiment of the present application;

[0074] Figure 10-1 A schematic diagram of a collaborative display interface in which a floating window is displayed in portrait mode provided in an embodiment of the present application;

[0075] Figure 10-2 A schematic diagram of a collaborative display interface in which a floating window is displayed in portrait mode provided in an embodiment of the present application;

[0076] Figure 11-1 A schematic diagram of an interface for prompting an abnormal scenario provided in an embodiment of the present application;

[0077] Figure 11-2 A schematic diagram of an interface for prompting an abnormal scenario provided in an embodiment of the present application;

[0078] Fig.12 A schematic diagram of an interface for collaborative display in a connection scenario provided in an embodiment of the present application;

[0079] Fig.13 A schematic diagram of a collaborative display architecture provided in an embodiment of the present application;

[0080] Fig.14 A schematic diagram of a display area provided in an embodiment of the present application;

[0081] Fig.15 A schematic diagram of module interaction of an interface display method provided in an embodiment of the present application;

[0082] Fig.16 A schematic diagram of module interaction for exiting collaborative display provided in an embodiment of the present application;

[0083] Fig.17 A schematic diagram of module interaction of another interface display method provided in an embodiment of the present application;

[0084] Fig.18 A flowchart of an interface display method provided in an embodiment of the present application;

[0085] Fig.19 A schematic diagram of the hardware structure of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0086] In order to clearly describe the technical solutions of the embodiments of the present application, some terms and technologies involved in the embodiments of the present application are briefly introduced below:

[0087] 1. Floating window and mini window

[0088] Both floating windows and mini windows are movable windows that are displayed on top of other application interfaces, so that users can view different applications at the same time. Mini windows and floating windows are both a form of application displayed in the foreground, and the window properties of mini windows and floating windows are both visible. Mini windows are a special form of floating windows, and the display area occupied by floating windows is larger than that of mini windows.

[0089] The floating window can be an interactive window, and the way to operate the application based on the floating window is the same as the way to operate the application in the full-screen window. For example, the floating window can respond to the trigger operation performed by the user to implement various functions such as interface switching, function activation or deactivation, etc.

[0090] The mini window may be another interactive window. For example, the mini window is usually used to display an application interface. The electronic device may display a floating window corresponding to the mini window in response to a user clicking on the mini window, or the electronic device may display the application interface in the mini window in full screen in response to a user double-clicking on the mini window. In addition, the mini window cannot respond to a user triggering operation on the application in the mini window.

[0091] It is understood that the application can switch between a floating window and a mini window. For example, the electronic device can shrink the floating window to a mini window in response to a user dragging the floating window to any corner of the electronic device. The electronic device can expand the mini window to a floating window in response to a user clicking on the mini window. It is understood that the method of switching between a floating window and a mini window is not specifically limited in the embodiments of the present application.

[0092] 2. Folding screen devices

[0093] A foldable screen device is an electronic device that can be folded through hinges and flexible screens. Types of foldable screen devices may include: horizontally foldable screen devices (such as Figure 1 ), or a folding screen device that folds vertically, etc. Among them, the horizontally folding folding screen mobile phone may include: an inner folding device (such as an inner folding mobile phone), and an outer folding device (such as an outer folding mobile phone), etc.

[0094] The inward folding mobile phone may include two display screens, such as an inner screen and an outer screen, and the inner screen may be foldable. After the user folds the inner screen inward, the screen displayed on the outside may be the outer screen, and the screen folded inward may be the inner screen. The shape of the inward folding mobile phone is similar to that of a flip phone.

[0095] The foldable mobile phone may include a display screen, such as display screen A, which is foldable. After the user folds the display screen A outward, part of the display area in the display screen A may constitute a display area B, and part of the display area in the display screen A may constitute a display area C. The display area B and the display area C do not overlap.

[0096] The following uses an external folding mobile phone as an example to illustrate the display screen of the external folding mobile phone. Figure 1 A schematic diagram of a foldable screen mobile phone provided in an embodiment of the present application.

[0097] When the foldable screen mobile phone is in the unfolded state, the front (or front view) of the foldable screen mobile phone can be seen Figure 1 As shown in A, the back side (or rear view) of the foldable screen mobile phone can be seen Figure 1 B. The unfolded state can be understood as a state when the folding angle of the folding screen mobile phone is close to 180 degrees (such as 175 degrees, etc.), and the folding angle can be the angle generated when the display area B is folded.

[0098] When the foldable screen mobile phone is in the unfolded state, the foldable screen mobile phone can Figure 1 Display screen A shown in A is used for interface display.

[0099] Display screen A may be a screen of a foldable screen mobile phone in an unfolded state, and display screen A may also be called a full screen, etc. Display screen A is usually foldable. Display screen A may be composed of a display area 101 , a folding area, and a display area 102 .

[0100] The folding area can be understood as the folding position when the folding screen mobile phone is folded outward. When the folding screen mobile phone is in the folded state, the folding area is generally located on the side of the folding screen mobile phone. The dotted box corresponding to the folding area is not actually displayed. Figure 1 A.

[0101] A camera 1 is disposed at the upper right corner of the display screen A. The camera 1 may also be referred to as a front camera, and may collect image data facing the display screen A.

[0102] Figure 1The left area in B may be the back panel of the folding screen mobile phone, and a combination camera and a switch may be provided in the back panel. The number of cameras in the combination camera may be 3, etc. Any camera in the combination camera may also be called a rear camera, which may collect image data from the back of the folding screen mobile phone. The switch may be used to fix the folding screen mobile phone in a folded state, and to unfold the folding screen mobile phone.

[0103] When the foldable screen mobile phone is in the folded state, the front (or front view) of the foldable screen mobile phone can be seen Figure 1 D, the back side (or rear view) of the foldable screen mobile phone can be seen Figure 1 C. The folded state can be understood as a state when the folding angle is close to 0 degrees (such as 5 degrees), and the folded state can also be called a closed state.

[0104] When the foldable screen mobile phone is in the folded state, the foldable screen mobile phone can Figure 1 The display area C shown in C, and / or, through Figure 1 The display area B shown in D is used for interface display.

[0105] It should be noted that both display area B and display area C can be the display area when the foldable screen mobile phone is in the folded state. Or it can be understood that when the foldable screen mobile phone is in the unfolded state, the interface cannot be displayed only through display area C and / or display area B.

[0106] The display area C may be formed by the display area 101 in the display screen A.

[0107] The display area B may be composed of the display area 102 in the display screen A, and the display area B may be the main display area when the folding screen mobile phone is in the folded state. The display area C includes the camera 1.

[0108] The size of display area B may be larger than that of display area C, or the size of display area B may be equal to the size of display area C, or the size of display area B may be equal to the size of display area C, which is not limited in the embodiments of the present application.

[0109] Understandable, Figure 1 The foldable screen mobile phone described in is only an example. For example, the foldable screen mobile phone may not have a switch, or when the foldable screen mobile phone is in a folded state, the sizes of the two display areas may be the same, etc. The structure of the foldable screen mobile phone is not specifically limited in the embodiments of the present application.

[0110] In possible implementations, there is also a semi-folded state in the foldable screen mobile phone, which can be understood as a partially folded state of the foldable screen mobile phone. In this case, the folding angle is between the unfolded state and the folded state, such as the folding angle meets the range of 90 degrees to 135 degrees. In the semi-folded screen state, the foldable screen mobile phone can be used as a natural stand, so that users can use part of the display area to take pictures, make video calls or watch videos without holding the phone.

[0111] It can be understood that the embodiment of the present application will use the folded state and the unfolded state as examples to schematically illustrate the interface display method. Figure 1 The front and back sides described in the specification are only used to distinguish the different sides of the folding screen mobile phone and are not intended to limit the embodiments of the present application.

[0112] 3. Collaborative display

[0113] Collaborative display can be understood as an electronic device being able to display related content on different display screens, and along with a user triggering operation on one of the display screens, the content on the other display screen can be refreshed synchronously.

[0114] For example, when the electronic device is a foldable screen mobile phone, collaborative display can be understood as the foldable screen mobile phone mirroring the application interface in the window of display area B to display area C, so that the application interface displayed in display area C is the same as the application interface in the window of display area B, see Figure 5-1 to Figure 5-4 In response to the trigger operation performed by the user on the window of display area B, the application interface displayed in display area C can be refreshed synchronously with the application interface in the window of display area B, see Figure 6-1 to Figure 6-2 Description in .

[0115] 4. Other terms

[0116] In the embodiments of the present application, words such as "first" and "second" are used to distinguish the same or similar items with substantially the same functions and effects. For example, the first chip and the second chip are only used to distinguish different chips, and their order is not limited. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit them to be different.

[0117] It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0118] In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, a--c, bc, or abc, where a, b, c can be single or multiple.

[0119] 5. Electronic equipment

[0120] The electronic device of the embodiment of the present application may be a device having at least two display screens, etc. The electronic device may also be referred to as a terminal device, user equipment (UE), mobile terminal (MT), user terminal, terminal or user device, etc.

[0121] For example, the electronic device includes: foldable screen mobile phones, tablet computers, PDAs, laptop computers, mobile Internet devices (MID), wearable devices, virtual reality (VR) devices, augmented reality (AR) devices, etc., which are not limited to the embodiments of the present application.

[0122] The following uses an inward folding mobile phone as an example of an electronic device to illustrate the usage scenario of the interface display method. Figure 2 A schematic diagram of a scenario provided for an embodiment of the present application.

[0123] like Figure 2 As shown, the electronic device may include two display screens, namely, display area B and display area C.

[0124] When the electronic device is in the unfolded state, the display area B may display the following: Figure 2 The interface shown in A and the display area C can display the following Figure 2 The interface shown in B.

[0125] Figure 2A can display the note application interface. The note application interface may include: note information, and note control controls, etc. For example, the note information may display: the title of the note (such as note 1), the time when the note was created (such as 8:00 today), the body of the note (such as 1, AAAA, 2, BBBB, 3, CCCC), etc. The note control controls may include one or more of the following: sharing controls, collection controls, deletion controls, or more controls, etc.

[0126] like Figure 2 As shown in B, the display area C can be in a black screen state. Or Figure 2 Other contents may also be displayed in B, which is not limited in the embodiments of the present application.

[0127] In response to the user Figure 2 The trigger operation performed in B on the display area C causes the electronic device to display in the display area B Figure 2 The interface shown in C can be displayed in the display area C. Figure 2 The interface shown in D. Figure 2 C may display the note application interface and the floating ball 201 , and the floating ball 201 may display a logo with a payment code. Figure 2 The preset payment code can be displayed in D.

[0128] Optional, Figure 2 In C, the floating ball 201 may not be displayed or other symbols other than the floating ball 201 may be displayed.

[0129] However, although the above method can realize collaborative display, it has certain limitations. For example, display area C cannot respond to the trigger operation performed by the user, so the payment code in display area C cannot realize page refresh, which will lead to abnormal situations such as payment code timeout and payment failure.

[0130] In order to better understand the embodiments of the present application, the structure of the electronic device of the embodiments of the present application is introduced below. Figure 3 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0131] The electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, an indicator 192, a camera 193, and a display screen 194, etc.

[0132] The sensor module 180 may include a Hall sensor, which can be used to detect the folding state of the folding screen mobile phone. For example, the Hall sensor can obtain the folding angle of the electronic device.

[0133] It can be understood that the Hall sensor can be used as a schematic for detecting the folding status of the device, and is not a limitation of the embodiments of the present application.

[0134] In a possible implementation, the sensor module 180 may further include one or more of the following: a proximity light sensor, an ambient light sensor, a touch sensor, a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a temperature sensor, a touch sensor, or a bone conduction sensor, etc. ( Figure 3 ), which is not specifically limited in the embodiments of the present application.

[0135] It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0136] The processor 110 may include one or more processing units, and the processor 110 may implement the steps of executing corresponding instructions in the interface display method provided in the embodiment of the present application.

[0137] The USB interface 130 is an interface that complies with USB standard specifications, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.

[0138] The charging management module 140 is used to receive charging input from a charger. The power management module 141 is used to connect the charging management module 140 and the processor 110 .

[0139] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0140] The electronic device realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor.

[0141] The display screen 194 is used to display images and videos. In the embodiment of the present application, the electronic device may include a display screen, such as a display screen A, and the display screen A may include a display area B and a display area C. The meaning of each display area can be found in Figure 1 Description in .

[0142] The electronic device can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0143] The camera 193 is used to capture static images or videos. In the embodiment of the present application, the number of cameras can be multiple, for example, the display A can be provided with a camera 1, and the back of the electronic device can be provided with a combination camera, etc. For details, see Figure 1 Description in .

[0144] The external memory interface 120 may be used to connect an external memory card. The internal memory 121 may be used to store computer executable program codes, which may include instructions.

[0145] The electronic device can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0146] Buttons 190 include a power button, a volume button, and the like.

[0147] The software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture, etc., which will not be elaborated here.

[0148] For example, Figure 4 The software structure diagram of an electronic device provided in an embodiment of the present application is shown in FIG. Figure 4 As shown in Figure 1, the layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces.

[0149] In some embodiments, the Android system is divided into multiple layers, including, from top to bottom, an application (APP) layer, an application framework layer (or simply referred to as a framework layer), and a driver layer, etc. This is not limited in the embodiments of the present application.

[0150] The application layer may include a series of application packages. The application layer may include one or more of the following: camera application, note application, video application, etc., which is not limited in the embodiments of the present application.

[0151] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer.

[0152] The application framework layer includes some predefined interfaces. The application framework layer may include one or more of the following: device state manager service, display manager service (DMS), power manager service (PMS), window manager service (WMS), display synthesis system (surface flinger), or floating window framework, etc. Among them, surface flinger can also be translated as interface deliverer, or layer processor, etc., which is not limited in the embodiments of the present application.

[0153] The device status management module can be used to receive device status requests initiated by the framework layer and dispatch the device status to the display management service and the window management service, etc. The device status management module can also determine the device status based on the sensor data change message initiated by the sensor and dispatch the device status to the display management service and the window management service, etc.

[0154] The device state may include one or more of the following: collaborative display state, folded state, unfolded state, etc. The collaborative display state may be understood as the electronic device collaboratively displaying the application interface in the window of display area B to display area C.

[0155] The display management service can also realize the display management of the logical screen 1 and the virtual screen in the electronic device. The meaning of the logical screen 1 and the logical screen 2 can be found in Fig.13 Description in .

[0156] The power management service can be used to update the power status of the display screen, which can include: power-on state or power-off state.

[0157] The window management service can be used to perform various operations such as moving out of the mirror layer, scaling the mirror layer, obtaining the layer where the floating window is located, and rotating the mirror layer.

[0158] The window management service may include: a display content (DisplayContent) module, a display rotation (DisplayRotation) module, and a display rotation coordination (DisplayRotationCoordinator) module.

[0159] The display content module can be used to transmit the folding state to the display rotation module; the display rotation module can be used to monitor the rotation direction of the electronic device and calculate the rotation direction of the mirror layer in the display area C based on the rotation direction of the electronic device; the display rotation coordination module can be used to return the rotation direction of the electronic device to the display rotation module.

[0160] The display composition system can be used to perform layer composition processing, layer mirroring and other services.

[0161] The floating window framework can be used to implement window management for floating windows and mini windows. For example, in response to a user entering a collaborative display operation, the floating window framework can be used to initiate a collaborative display state request to the device state management service; or, in response to a user exiting a collaborative display operation, the floating window framework can be used to initiate a collaborative display state cancellation request to the device state management service.

[0162] The driver layer is a layer between hardware and software. The driver layer is used to drive the hardware to make it work. For example, the driver layer may include a display driver, which can be used to control the power on or off of the display screen.

[0163] In a possible implementation, the electronic device may include a hardware layer. Figure 4 For example, the hardware layer may include one or more of the following: an organic light-emitting diode (OLED) 1. A portion of the display area in the OLED 1 may constitute a display area B, and a portion of the display area in the OLED 1 may constitute a display area C.

[0164] It is understandable that the embodiments of the present application do not specifically limit the software layers involved in the software architecture, the modules included in the software layers, and the functions of the modules.

[0165] The following specific embodiments are used to describe in detail the technical solution of the present application and how the technical solution of the present application solves the above technical problems. The following specific embodiments can be implemented independently or in combination with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0166] In the embodiment of the present application, an electronic device is used as Figure 1 Taking the external folding mobile phone shown as an example, the collaborative display process when the external folding mobile phone is in a folded state is illustrated by example, and this example does not constitute a limitation on the embodiments of the present application.

[0167] 1. Enter collaborative display ( Figure 5-1 to Figure 5-4 )

[0168] For example, in response to a trigger operation performed by the user on display area C, the electronic device enters collaborative display.

[0169] Optionally, in response to other triggering operations performed by the user, the electronic device enters collaborative display. Other triggering operations may include one or more of the following: multi-finger sliding window operation, dragging the window to a preset area, circling display area B or display area C, air gesture operation, staring at display area B or display area C, or triggering operation on a hardware switch, etc. The embodiment of the present application does not limit the method of entering collaborative display.

[0170] For example, Figure 5-1 to Figure 5-4 A schematic diagram of an interface for entering collaborative display provided in an embodiment of the present application.

[0171] When the electronic device is in a folded state, the electronic device may display an interface as shown in FIG. 5A in display area B, and display area C may display an interface as shown in FIG. 5B .

[0172] As shown in Fig. 5A, the interface may display: a note application interface, and a floating window 500 covering the note application interface. The floating window 500 may display: the home page of the payment application, and at least one floating window control control, etc.

[0173] The home page of the payment application may include: a scan control, a payment control 50, and a travel control, etc.

[0174] The floating window control controls include one or more of the following: a maximize control 502, a minimize control 503, a drag control (or referred to as a top bar) 504, or a close control 505. The maximize control 502 is used to display the application interface in the floating window in full screen, the minimize control 503 is used to reduce the floating window to a floating ball, the drag control 504 is used to drag the floating window to any position in the interface, and the close control 505 is used to close the floating window.

[0175] In response to the user's click operation on the payment control 50 in FIG. 5A , the electronic device may display an interface as shown in FIG. 5C in display area B, and display area C may be as shown in FIG. 5D .

[0176] As shown in Fig. 5C, the interface may display: a note application interface, and a floating window 501 covering the note application interface. The floating window 501 may display: a payment interface in a payment application, and at least one floating window operation control.

[0177] It is understandable that the note application interface displayed on the lower side of the floating window 501 is only used as an illustration, and other application interfaces or the desktop can also be displayed on the lower side of the floating window 501, and the present embodiment of the application does not limit this. For example, the lower side of the floating window 501 can display the desktop interface provided by the desktop application, the video playback interface provided by the video playback application, or the interface provided by the shopping application.

[0178] In response to the trigger operation performed by the user on the display area C in FIG5D , the display area B of the electronic device may display the interface shown in FIG5E , and the display area C of the electronic device may display the interface shown in FIG5F . The trigger operation on the display area C may be an operation of tapping the display area C, for example, including one or more of the following: an operation of single-clicking the display area C, an operation of double-clicking the display area C, or an operation of tapping the display area C three times, etc.

[0179] As shown in FIG. 5E , the interface may display: a note application interface and a mini window 506 covering the note application interface. The application interface displayed in the mini window 506 is the same as the application interface displayed in the floating window 501. In this way, after entering the collaborative display, the user can determine the content displayed in the display area C based on the mini window 506, and the display area occupied by the mini window 501 is small, which is also convenient for the user to view other content in other display areas in FIG. 5E .

[0180] Optionally, FIG5E may also display a prompt message 5 (not shown in FIG5E ) for prompting that the device is in a collaborative display state. The prompt message 5 may be set at any position in FIG5E , such as at the top or bottom of FIG5E .

[0181] The outer frame around the mini window 506 may be displayed in a thickened line and / or in a colored line, or the interior of the mini window 506 may display any background color. For example, the outer frame line thickness of the mini window 506 may be greater than the outer frame line thickness of the floating window 501; or, the outer frame color of the mini window 506 may be different from the outer frame color of the floating window 501. In this way, the user can determine that the content in the mini window 506 has been mounted in the display area C through the form of the mini window.

[0182] It is understandable that the mini window 506 can be automatically set in the upper right corner; or when other mini windows are already displayed in the upper right corner of Figure 5C, in response to the user performing a multi-finger sliding operation on the floating window 501 in Figure 5C, the mini window 506 can be automatically set in other corners except the upper right corner, such as the upper left corner.

[0183] After entering the collaborative display, the mini window 506 can be moved to another position based on the user's dragging, so as to reduce the occlusion of the mini window 506 on other displayed contents in FIG. 5E .

[0184] As shown in FIG. 5F , the interface may display a payment interface, which may be the same as the application interface in the floating window 501 .

[0185] The payment interface in FIG5F may be displayed at the top of the display area C, or may be displayed in the middle of the display area C. When the payment interface is displayed at the top of the display area C, the lower side of the payment interface in the display area C may be displayed in white or black, etc.; or, when the payment interface is displayed in the middle of the display area C, the upper side and the lower side of the payment interface in the display area C may be displayed in white or black, etc., which is not limited in the embodiments of the present application.

[0186] Optionally, the status bar may not be displayed at the top of the interface of FIG. 5F. Alternatively, the status bar may also be displayed at the top of the interface of FIG. 5F. The status bar may display one or more of the following logos: WIFI logo, time information, operator logo, power logo, or notification logo, etc., which is not limited in the embodiments of the present application.

[0187] Optionally, after entering the collaborative display, the electronic device may also highlight the outer frame of the floating window 501 in the display area B, and display the interface shown in FIG5F in the display area C. In this scenario, the electronic device may not display the mini window 506. Further, in response to the user's operation of dragging the highlighted floating window 501 to any corner of the display area B in FIG5C, the electronic device may display the interface shown in FIG5E in the display area B, and continue to display the interface shown in FIG5F in the display area C. Among them, highlighting includes: bold display and / or color line display.

[0188] Optionally, in response to the user dragging the floating window 501 to the upper right corner of the display area B in FIG5C, the electronic device may display an interface as shown in FIG5G in the display area B, and the display area C may be as shown in FIG5H. As shown in FIG5G, the interface may include: a note application interface and a mini window 507 covering the note application interface.

[0189] It can be understood that, referring to the interfaces shown in FIG. 5E and FIG. 5G , the outer frame around mini window 506 can be highlighted, and the outer frame around mini window 507 can be not highlighted; the interior of mini window 506 can display any background color, and the interior of mini window 507 does not display any background color; FIG. 5E can display prompt information 5, and FIG. 5G may not display prompt information 5. The color of the outer frame around mini window 506 can be different from the color of the outer frame around mini window 507.

[0190] It should be noted that, when the electronic device enters collaborative display based on floating window 501, the outer frame around mini window 506 may be highlighted, so that the user can determine that the device has entered collaborative display through the outer frame around mini window 506. When the electronic device shrinks floating window 501 to mini window 507, the outer frame around mini window 507 is not highlighted, and the user can determine that the device has not entered collaborative display through the outer frame around mini window 507.

[0191] Based on this, in response to the trigger operation performed by the user on display area C in Figure 5D, the electronic device can mirror the application interface in the window of display area B to display area C, thereby achieving coordinated display of the window of display area B and display area C.

[0192] Optionally, when more mini windows are allowed to be mounted in the electronic device, the electronic device may also support the coordinated display of the contents in other mini windows in the display area C. In this case, multiple mini windows may be displayed in FIG. 5E , and the specific process will not be repeated here.

[0193] In a possible implementation, the electronic device may also enter collaborative display based on an operation of the user sliding the floating window 501 with multiple fingers, or an operation of dragging the floating window 501 to a preset area.

[0194] In one implementation, the operation of sliding the floating window 501 with multiple fingers may include: sliding up the floating window 501 with three fingers, sliding down the floating window 501 with three fingers, sliding up the floating window 501 with two fingers, or sliding down the floating window with two fingers, etc. The specific form of the multi-finger sliding operation is not limited in the embodiment of the present application.

[0195] Optionally, in response to the user's operation of sliding the floating window 501 upward with three fingers in FIG. 5C , the electronic device can shrink the floating window 501 into a mini window, and display the mini window in the upper left corner (or lower right corner) of FIG. 5C . Alternatively, in response to the user's operation of sliding the floating window 501 downward with three fingers in FIG. 5C , the electronic device can shrink the floating window 501 into a mini window, and display the mini window in the lower left corner (or lower right corner) of FIG. 5C , etc. In this way, the user can control the display position of the mini window when entering the collaborative display function through gesture operation, thereby improving the flexibility of operation.

[0196] In another implementation, the preset area may be pre-set in the top area of ​​the interface of display area B. The words "dual-screen collaboration" or "collaborative display" may be displayed in the preset area, or no words may be displayed. For example, the user may trigger collaborative display by dragging the floating window 501 into the preset area, so that the display area B of the electronic device may display the interface shown in FIG. 5E, and the display area C of the electronic device may display the interface shown in FIG. 5F.

[0197] Optionally, the preset area can also be set on the left side, right side or bottom of the interface as shown in Figure 5C. In the embodiment of the present application, there is no limitation on the display position, area size, area shape, etc. of the preset area.

[0198] In another implementation, when the electronic device displays the full-screen transfer application interface in display area B, in response to the user sliding upward at the bottom of the transfer application interface and dragging the transfer application interface to a preset area, the electronic device can display a mini window 506 in display area B and an interface as shown in Figure 5F in display area C.

[0199] 2. Content synchronization after entering collaborative display ( Figure 6-2 as well as Figure 6-2 )

[0200] For example, Figure 6-1 as well as Figure 6-2 A schematic diagram of a collaborative interaction interface provided in an embodiment of the present application.

[0201] After the electronic device enters the collaborative display, in response to the user performing a click operation on the mini window 506 in FIG5E, the electronic device may display an interface as shown in FIG6A in display area B, and an interface as shown in FIG6B in display area C. The content displayed in FIG6A can refer to the description in FIG5C, and the content displayed in FIG6B can refer to the description in FIG5F, which will not be repeated here.

[0202] In response to the trigger operation performed by the user in FIG. 6A on the payment code 600 in the floating window 501, the electronic device may display an interface as shown in FIG. 6C in display area B and an interface as shown in FIG. 6D in display area C. As shown in FIG. 6C , the payment code may be displayed in the floating window 601; as shown in FIG. 6D , the payment code may also be displayed in the display area C. The application interface in the floating window 601 is different from the application interface in the floating window 501.

[0203] Optionally, the outer frames around the floating window 501 and the floating window 601 may be highlighted so that the user can determine that the collaborative display has been entered through the state of the outer frames around the floating windows.

[0204] Optionally, in response to other trigger operations performed by the user on the floating window 501 in Figure 6A, the electronic device may also display other application interfaces in the floating window 601 and the display area C, and synchronize the application interfaces in the floating window 601 and the display area C.

[0205] For example, in response to the user performing a trigger operation on the payment collection control 602 in FIG. 6A , display area B may display an interface as shown in FIG. 6E , and display area C may display an interface as shown in FIG. 6F .

[0206] As shown in FIG6E , the interface may display: a note application interface and a floating window 603 , in which a payment interface may be displayed, and the payment interface may display a payment code, etc. The payment interface in FIG6F is the same as the payment interface in the floating window 603 .

[0207] Optionally, in response to the trigger operation performed by the user on display area C in FIG. 6B , the electronic device may update the display content in display area C and mirror the display content in display area C to the floating window or mini window of display area B. The trigger operation on display area C may be a click operation, a slide operation, or an operation of inputting information in display area C. In this scenario, the electronic device may synchronize the content of display area C to the window of display area B based on the trigger operation of the user on display area C, so as to realize the coordinated display of the windows of display area C and display area B.

[0208] Based on this, in response to the user's operation performed on display area B in Figure 6A, the application interface in floating window 601 (or floating window 603) can be updated synchronously with the application interface in display area C, so that the user can view the latest application interface in display area C in real time.

[0209] 3. Unable to enter collaborative display ( Figure 7 )

[0210] The electronic device can also display a transfer interface in a financial application in a floating window in display area B (eg Figure 7 A) and the display area C may be Figure 7 B. In response to the user Figure 7 In the operation of tapping the display area C performed in B, the electronic device can prompt the user that collaborative display is not possible when it determines that the application interface in the floating window 701 is a security and privacy interface.

[0211] It is understandable that the electronic device may prompt the user in display area B and / or display area C that collaborative display is not possible.

[0212] In one implementation, in response to a user Figure 7 B performs the operation of tapping the display area C. When the electronic device determines that the application interface in the floating window 701 has a security privacy mark (such as flag_secure), the electronic device can display in the display area B as shown in FIG. Figure 7 The interface shown in C is displayed in the display area C. Figure 7 The interface shown in D.

[0213] like Figure 7 As shown in FIG. 3 , the interface may display: a note application interface and a mini window 702. The outer frame around the mini window 702 may not be highlighted, which is not limited in the embodiment of the present application.

[0214] like Figure 7 As shown in D, the interface may display a prompt message 703, and the prompt message 703 is used to prompt the user that the interface displayed by the mirror is a security and privacy interface and does not support collaborative display.

[0215] In another implementation, in response to a user Figure 7 In the operation of tapping display area C in B, when the electronic device determines that the application interface in the floating window 701 has flag_secure, the electronic device can also display prompt information 703 in display area B, and display area C can maintain low power consumption. In this scenario, display area C is in low power consumption, reducing power consumption waste.

[0216] In another implementation, in response to a user Figure 7 The operation of tapping display area C performed in B, when the electronic device determines that the application interface in the floating window 701 has flag_secure, the electronic device can also display prompt information 703 in display area B and display area C at the same time, which is not limited in the embodiment of the present application.

[0217] Based on this, the electronic device determines whether to enter collaborative display according to the attributes of the interface, and prompts the user when it is determined that the collaborative display cannot be entered, so as to improve the user experience of using the collaborative display function.

[0218] 4. Status prompt after entering collaborative display ( Figure 8 )

[0219] After entering collaborative display, in response to the user's operation of opening the notification center, the electronic device may display a prompt message for prompting that the collaborative display state is currently in display area B. The operation of opening the notification center may include: the user swiping down from the upper left corner of display area B, etc.

[0220] For example, Figure 8 A schematic diagram of an interface for prompting collaborative display status provided in an embodiment of the present application.

[0221] In response to the user's operation of opening the notification center in FIG. 5E , the electronic device may display in display area B the following information: Figure 8 The interface shown in A, and the interface shown in the display area C continues to be displayed as follows Figure 8 B shows the interface. Figure 8 As shown in A, the notification center of the interface may include: prompt information 801, which may be used to prompt that the collaborative display state is currently in progress. An exit control 802 may be displayed around the prompt information 801, which may be used to exit the collaborative display state.

[0222] Optionally, other information may also be displayed around the prompt information 801, such as time information for indicating the duration of the collaborative display, and / or an application logo for displaying the collaborative display, etc., which is not limited in the embodiments of the present application.

[0223] Optionally, the prompt information 801 and the exit control 802 may also be displayed at any position as shown in FIG. 5E , so that the user can determine that the user is currently in a collaborative display state without opening the notification center.

[0224] Optionally, in response to the user Figure 8 The electronic device may terminate the collaborative display by performing the trigger operation for exiting the control 802 in A. The electronic device may display in the display area B as follows: Figure 8 In the interface shown in C, the display area C can be Figure 8 D. At this time, compared with Figure 5E, Figure 8 The outer frame around the mini window 803 in C is not highlighted, etc. In the embodiment of the present application, there is no limitation on the interface displayed by the electronic device after exiting the collaborative display based on the exit control 802.

[0225] In a possible implementation, the electronic device may also exit the collaborative display state when detecting at least one of the following exit operations. For example, the exit operation may include one or more of the following: the operation of expanding the electronic device, the operation of turning off the screen, the operation of switching the floating window to a floating ball when the window is in a floating window state, the operation of switching the mini window to a floating ball when the window is in a mini window state, the operation of displaying the content in the floating window in full screen when the window is in a floating window state, or the operation of exiting the floating window when the window is in a mini window state, etc.

[0226] For example, the operation of switching the floating window to the floating ball may include: triggering the operation of minimizing the control 503 in FIG. 5, etc. The operation of displaying the content in the floating window in full screen may include: triggering the operation of maximizing the control 502 in FIG. 5, etc. The operation of exiting the floating window may include: triggering the operation of closing the control 505 in FIG. 5, etc.

[0227] Based on this, the user can determine the state of the electronic device according to the prompt information 801 in the notification center, and trigger the exit control 802 when it is necessary to exit the collaborative state.

[0228] 5. Device rotation after entering collaborative display ( Figure 9-1 to Figure 10-2 )

[0229] After the electronic device enters collaborative display based on the embodiment corresponding to FIG. 5 , the electronic device can determine how to display the content in the floating window in the display area C according to the display direction of the display area C and the display method of the floating window. For example, when the floating window is in landscape display, the electronic device can display the content in the floating window in the display area C according to the display direction of the display area C and the display method of the floating window. Figure 9-1 as well as Figure 9-2 or, when the floating window is displayed in portrait mode, the electronic device may display the floating window in a coordinated manner according to the description in Figure 10-1 as well as Figure 10-2 The description in is displayed in coordination.

[0230] Figure 9-1 as well as Figure 9-2 A schematic diagram of a collaborative display interface in which a floating window is displayed in landscape mode, provided in an embodiment of the present application.

[0231] The electronic device can display an interface as shown in FIG. 9A in display area B, in which a floating window 901 can be displayed, and the floating window 901 can display video content in any application. For example, the floating window 901 can be in a horizontal screen state, or it can be understood that the floating window 901 can display video 1 in a horizontal screen state, and the camera can be located in the upper right corner of the display area B. FIG. 9A can be an interface displayed in the display area B of the electronic device in the vertical screen state.

[0232] When the display area B of the electronic device is displayed as shown in Figure 9A, the display area C of the electronic device displays the interface shown in Figure 9B. As shown in Figure 9B, the display area C is in a vertical screen state, and the video 1 can be displayed in a horizontal screen in the middle of the display area C. The upper and lower sides of the video 1 may not display any content (such as the upper and lower sides of the video 1 may be black), or may also be displayed in white or other situations. Figure 9B can be understood as the interface displayed when the electronic device is not rotated. For example, the rotation angle of the electronic device can be 0 degrees at this time, that is, the electronic device has not rotated.

[0233] As described in Figures 9A and 9B, since the floating window 901 is in a horizontal state and the display area C is in a vertical state (or it can be understood that the display direction of the floating window is different from the display direction of the display area C), video 1 can be displayed horizontally in the middle area of ​​display area C after being scaled proportionally. At this time, video 1 cannot be displayed in full screen in display area C.

[0234] Optionally, when the display direction of the floating window is different from the display direction of the display area C, prompt information 1 (not shown in Figure 9) may also be displayed in the interface shown in Figure 9A (or Figure 9B, or Figure 9E, or 9F, etc.), and prompt information 1 is used to prompt the user to rotate the display screen to obtain a better visual experience.

[0235] When display area B displays as shown in Figure 9A and display area C displays as shown in Figure 9B, in response to the user rotating the electronic device 90 degrees clockwise, the electronic device can display in display area B as shown in Figure 9C and in display area C as shown in Figure 9D.

[0236] As shown in FIG9C , display area B is in a horizontal state, and the camera can be located in the upper left corner of display area B; as shown in FIG9D , display area C is in a horizontal state, and video 1 can be displayed in full screen in display area C. At this time, the rotation angle of the electronic device can be 90 degrees. In this way, the floating window 901 is in a horizontal state and the display area C is in a horizontal state (or it can be understood that the display direction of the floating window is the same as the display direction of the display area C), and the content in the floating window 901 can be displayed in full screen in the display area C, which is convenient for users to view.

[0237] When display area B displays as shown in Figure 9C and display area C displays as shown in Figure 9D, in response to the user rotating the electronic device 90 degrees clockwise, the electronic device may display an interface as shown in Figure 9E in display area B and an interface as shown in Figure 9F in display area C.

[0238] As shown in FIG9E , display area B is in a vertical screen state, and the camera can be located at the lower left corner of display area B. As shown in FIG9F , display area C is in a vertical screen state, and video 1 cannot be displayed in full screen in display area C. At this time, the rotation angle of the electronic device can be 180 degrees.

[0239] When display area B displays as shown in Figure 9E and display area C displays as shown in Figure 9F, in response to the user rotating the electronic device 90 degrees clockwise, the electronic device may display an interface as shown in Figure 9G in display area B and an interface as shown in Figure 9H in display area C.

[0240] As shown in FIG9G , display area B is in a horizontal state, and the camera can be located at the upper left corner of display area C; as shown in FIG9H , display area C is in a horizontal state, and video 1 can be displayed in full screen in display area C. At this time, the rotation angle of the electronic device can be 270 degrees. In this way, the floating window 901 is in a horizontal state and the display area C is in a horizontal state (or it can be understood that the display direction of the floating window is the same as the display direction of the display area C), and the content in the floating window 901 can be displayed in full screen in the display area C, which is convenient for users to view.

[0241] akin, Figure 10-1 as well as Figure 10-2 A schematic diagram of a collaborative display interface in which a floating window is displayed in portrait mode, provided in an embodiment of the present application.

[0242] The electronic device can display an interface as shown in FIG. 10A in display area B, in which a floating window 1001 can be displayed, and video content in any application can be displayed in the floating window 1001. For example, the floating window 1001 can be in a vertical screen state, or it can be understood that the floating window 1001 can display video 2 in a vertical screen, and the camera can be located in the upper right corner of display area B.

[0243] It can be understood that Figure 10A can be an interface displayed in the display area B of the electronic device in the vertical screen state. When the electronic device is in the horizontal screen state, the electronic device can also display a floating window 1001 in the vertical screen state in the display area B. At this time, the content displayed in the display area B can be similar to that in Figure 10C, which will not be repeated here.

[0244] When the display area B of the electronic device is displayed as shown in Figure 10A, the display area C of the electronic device displays the interface shown in Figure 10B. As shown in Figure 10B, the display area C is in a vertical screen state, and the video 2 can be displayed in full screen in the display area C. Figure 10B can be understood as an interface displayed when the electronic device is not rotated, for example, the rotation angle of the electronic device can be 0 degrees. In this way, the floating window 1001 is in a vertical screen state and the display area C is in a vertical screen state (or it is understood that the display direction of the floating window is the same as the display direction of the display area C), and the content in the floating window 1001 can be displayed in full screen in the display area C, which is convenient for users to view.

[0245] When display area B displays as shown in Figure 10A and display area C displays as shown in Figure 10B, in response to the user rotating the electronic device 90 degrees clockwise, the electronic device can display in display area B as shown in Figure 10C and in display area C as shown in Figure 10D.

[0246] As shown in FIG10C , display area B is in a horizontal state, and the camera can be located at the lower right corner of FIG10C ; as shown in FIG10D , display area C is in a horizontal state, video 2 cannot be displayed in full screen in display area C, and the left and right sides of video 2 may not display any content (or it can be understood that the left and right sides of video 2 can be black). At this time, the rotation angle of the electronic device can be 90 degrees.

[0247] Optionally, as described in FIG. 10C and FIG. 10D , when the display direction of the floating window is different from the display direction of the display area C, FIG. 10C (or FIG. 10D , or FIG. 10G , or FIG. 10H ) may also display prompt information 1 , and the content of prompt information 1 may be referred to in Figure 9-1 Description in .

[0248] When display area B displays as shown in Figure 10C and display area C displays as shown in Figure 10D, in response to the user rotating the electronic device 90 degrees clockwise, the electronic device can display in display area B as shown in Figure 10E and in display area C as shown in Figure 10F.

[0249] As shown in FIG. 10E , display area B is in a vertical screen state, and the camera can be located at the lower left corner of display area B in FIG. 10E ; as shown in FIG. 10F , display area C is in a vertical screen state, and video 2 can be displayed in full screen in display area C. At this time, the rotation angle of the electronic device can be 180 degrees. In this way, the floating window 1001 is in a vertical screen state and the display area C is in a vertical screen state (or it can be understood that the display direction of the floating window is the same as the display direction of the display area C), and the floating window 1001 can be displayed in full screen in the display area C, which is convenient for users to view.

[0250] When display area B displays as shown in Figure 10E and display area C displays as shown in Figure 10F, in response to the user rotating the electronic device 90 degrees clockwise, the electronic device can display in display area B as shown in Figure 10G and in display area C as shown in Figure 10H.

[0251] As shown in FIG10G , display area B is in a horizontal state, and the camera can be located at the upper left corner of display area B in FIG10G ; as shown in FIG10H , display area C is in a horizontal state, and video 2 cannot be displayed in full screen in display area C. At this time, the rotation angle of the electronic device can be 270 degrees.

[0252] based on Figure 9-1 to Figure 10-2 As described in, when the display direction of the floating window is different from the display direction of display area C, the electronic device can prompt the user to rotate the phone in display area B (or display area C) to obtain a better experience; or when the display direction of the floating window is the same as the display direction of display area C, the content in the floating window can be displayed in full screen in display area C for user convenience.

[0253] Understandable, Figure 9-1 to Figure 10-2 The position of the camera in the display area described in the figure can be understood as the position of the camera relative to the user when the user faces the display area. For example, the camera is located at the upper right corner of display area B, which means that when the user faces display area C, the camera is located at the upper right hand side of the user, and similar positional relationships are not repeated here.

[0254] 6. Abnormal scenarios during collaborative display ( Figure 11-1 as well as Figure 11-2 )

[0255] Abnormal scenarios may include: the percentage of the battery power of the electronic device is lower than value 1, and / or the temperature of the electronic device is higher than value 2, etc., which are not limited in the embodiments of the present application. Among them, value 1 can be a value such as 20%, and value 2 can be a value such as 40 degrees Celsius.

[0256] The following is an illustration using an abnormal scenario in which the temperature of an electronic device is higher than a value of 2 as an example, which does not constitute a limitation on the embodiments of the present application.

[0257] In one implementation, after the electronic device enters collaborative display, the electronic device may display an interface as shown in FIG. 11A in display area B when detecting that the temperature of the electronic device is higher than a value of 2, and display area C may display an interface as shown in FIG. 5F.

[0258] As shown in FIG. 11A , the interface may display: a note application interface, a mini window 506, and a prompt box 1101. The prompt box 1101 may include: a control 1102 (with the word “yes”), a control 1103 (with the word “no”), and a prompt message 1104. The control 1102 is used to exit the collaborative display, the control 1103 is used to refuse to exit the collaborative display, and the prompt message 1104 is used to prompt the user whether to exit the collaborative display when a high device temperature is detected.

[0259] For example, when the electronic device receives the user's operation on the control 1103, the electronic device can display the interface shown in FIG11B in the display area B, and the display area C can continue to display the interface shown in FIG5F. Alternatively, when the electronic device receives the user's operation on the control 1102, the electronic device can display the interface shown in FIG11C in the display area B, and the display area C can be the interface shown in FIG5D. In FIG11C, the outer frame around the mini window 1100 is not highlighted.

[0260] Optionally, after the electronic device enters the collaborative display, the electronic device may display a prompt box 1101 in the display area C when an abnormal scene is detected, or directly exit the collaborative display.

[0261] In another implementation, when the temperature of the electronic device is higher than a value of 2, in response to the user entering a collaborative display operation, the electronic device may display an interface as shown in FIG. 11D in display area B, while display area C may be in a black screen state or may also display other application interfaces.

[0262] As shown in FIG. 11D , the interface may display: a note application interface and a prompt box 1105. The prompt box 1105 may include: a control 1107 (with the word "yes"), a control 1108 (with the word "no"), and a prompt message 1106. The control 1107 is used to enter the collaborative display, the control 1108 is used to refuse to enter the collaborative display, and the prompt message 1106 is used to prompt the user whether to continue to enter the collaborative display when the device temperature is detected to be high.

[0263] For example, when the electronic device receives the user's operation on the control 1107, the electronic device can display the interface shown in FIG11E in the display area B, and the display area C can display the interface shown in FIG5F. Alternatively, when the electronic device receives the user's operation on the control 1108, the electronic device displays the interface shown in FIG11F, and the display area C can remain black or display other application interfaces.

[0264] Based on this, since the collaborative display function has high demands on power consumption and / or battery power, the electronic device can promptly prompt the user whether to exit the collaborative display (or whether to enter the collaborative display) when an abnormal scenario is detected, thereby reducing the situation where the device power drops rapidly or the device freezes without the user's perception.

[0265] 7. Exit collaborative display ( Fig.12 )

[0266] After entering the collaborative display, the electronic device may also exit the collaborative display when receiving an operation to unfold the electronic device.

[0267] Fig.12 A schematic diagram of an interface for collaborative display in a connection scenario provided in an embodiment of the present application.

[0268] When the display area B of the electronic device displays the interface shown in FIG. 5E and the display area C displays the interface shown in FIG. 5F, in response to the user's operation of unfolding the electronic device, the electronic device may display the interface shown in FIG. Fig.12 The interface shown in A.

[0269] Fig.12 A may include: a note application interface, and a mini window 1201. It is understood that since unfolding the electronic device will result in exiting the collaborative display, the outer frame around the mini window 1402 may not be highlighted. It is understood that when the electronic device receives the user's operation of unfolding the electronic device, the electronic device may connect the content in the display area B to the display screen A.

[0270] For other ways to exit collaborative display, please refer to Figure 8 The description of the place will not be repeated here.

[0271] Based on this, in response to the user's operation of folding the electronic device, the electronic device can exit the collaborative display and continue to display the content displayed in area B in display screen A.

[0272] Above Figure 5-1 to Figure 12 The application interface involved in the collaborative display is schematically explained below. Fig.13 The architecture of collaborative display is schematically explained, combined with Figure 14-16 The description in , explains the interface display method for realizing collaborative display.

[0273] For example, Fig.13 A schematic diagram of a collaborative display architecture provided by an embodiment of the present application. Fig.13 As shown, the interface display method can be applied to business scenarios using foldable screen mobile phones.

[0274] The foldable screen mobile phone may include: OLED1, OLED1 can realize the capabilities of display area B and display area C. The meaning and form of display area B and display area C can be found in Figure 1 Description in .

[0275] To facilitate the management of display content in the display screen, the electronic device can generate a physical screen (physical display) corresponding to the OLED and a logical screen (logical display) corresponding to the physical screen at the framework layer, and manage the physical screen and the logical screen through the display management service.

[0276] The physical screen may be a display screen mapped by the electronic device based on the reading of the OLED, and the screen information of the physical screen may be the same as the screen information of the OLED. For example, the screen information may include screen resolution, screen size, etc. The screen information of the physical screen is not allowed to be changed. For example, the electronic device may map the physical screen 1 corresponding to the display screen A by reading the screen information of OLED1.

[0277] In order to facilitate controlling the display of different display areas in the physical screen, the electronic device may map a logical screen corresponding to the physical screen, and the screen information of the logical screen may be different from the screen information of the physical screen.

[0278] The logical screen can be understood as an abstract screen, which is used to process the content and layout of the physical screen. For example, the logical screen can realize the setting of the display area, display position coordinates, and display direction of the corresponding physical screen. For example, the electronic device generates a logical screen 1 related to the physical screen 1. The logical screen 1 can realize the interface display of any display area of ​​the electronic device in the display screen A.

[0279] In a possible implementation, in order to facilitate displaying the application interface in a partial area of ​​the OLED, the electronic device may create a virtual screen when it is turned on or when the interface needs to be displayed in the display area C, generate a virtual physical screen corresponding to the virtual screen, and a logical screen 2 corresponding to the virtual screen. The virtual screen may be used to control the electronic device to display the interface in the display area C. The virtual physical screen may be determined based on the screen information of the virtual screen, and the screen information of the virtual screen may be set by the electronic device.

[0280] like Fig.13 As shown, when the electronic device is in a folded state, the electronic device can generate a physical screen 1 by reading the screen information of OLED 1, and data can be transmitted between the physical screen 1 and OLED 1 through a display serial interface (DSI)-1. The physical screen 1 can correspond to the logical screen 1 in the framework layer.

[0281] When the electronic device is turned on or detects that the device is in a folded state, it can create a virtual screen and set the display of the virtual screen to the display area of ​​display area C, generating a virtual physical screen and a logical screen 2 corresponding to the virtual screen. Data can also be transmitted between the virtual physical screen and OLED1 through DSI-1, and there is a corresponding relationship between the virtual physical screen and the logical screen 2.

[0282] Among them, DSI can be used to transmit image data, control signals, etc. in the controller to the OLED.

[0283] It can be understood that since both the physical screen 1 and the virtual screen are composed of a partial display area in the display screen A, the display in the physical screen 1 and the virtual screen both depends on the OLED 1.

[0284] The following is a schematic illustration of different display areas. Fig.14 A schematic diagram of a display area provided in an embodiment of the present application.

[0285] When the electronic device is in the unfolded state, when the electronic device displays an interface through the display screen A, the electronic device can set the display area in the full-screen display area, so that the electronic device can start the interface display from the starting position 1 and complete the interface display at the ending position 1. The full-screen display area includes: a display area 101, a folding area, and a display area 102.

[0286] When the electronic device is in the folded state, when the electronic device displays the interface through the display area B, the electronic device can set the display area 102 so that the electronic device can start the interface display from the starting position 2 and complete the interface display at the end position 2. In this case, the display area 101 and the folded area can be in a low power consumption state, for example, the display area 101 and the folded area can be in a black screen state. The offset between the starting position 2 and the starting position 1 can be offset 1.

[0287] When the electronic device is in the folded state, when the electronic device displays the interface through the display area B and the display area C, the electronic device can set the full-screen display area to ensure that the display area B and the display area C can be displayed in the display screen A. At this time, after the full-screen display area is set successfully, the electronic device will start to display the content in the display area B and the display area C from the starting position 1, so the electronic device can offset the layer of the display area B to the display area 102 to reduce the overlapping display of the content in the display area B and the display area C. For the specific implementation process, please refer to the description in S1508-S1510.

[0288] based on Figure 13-Figure 14 Description in Fig.15A schematic diagram of module interaction of an interface display method provided in an embodiment of the present application. Fig.15 In the corresponding embodiment, the electronic device may include: a device state management service, a display management service, a window management service, a display synthesis system, etc. The meaning of any module can be found in Figure 4 Description in .

[0289] It can be understood that since both display area B and display area C are displayed in display screen A. When the electronic device is in a folded state, the electronic device can create a virtual screen so that the virtual screen can display the content in display area C. Since there is no display layer on the virtual screen, the electronic device can set the virtual screen to the form of a default display screen to ensure that the content in the virtual screen can be displayed normally. Setting the virtual screen to the form of a default display screen can be understood as displaying the content in the virtual screen in display area C.

[0290] like Fig.15 As shown, the interface display method may include the following steps:

[0291] S1501. In response to a collaborative display operation for a target application, a device state management service receives a collaborative display state request.

[0292] The target application may be an application running in the foreground. For example, the target application may be an application displayed in a floating window. It is understandable that an application not running in the foreground cannot respond to the user's collaborative display operation.

[0293] Collaborative display operations may include: Figure 5-1 to Figure 5-4 The trigger operation for display area C described in, etc.

[0294] The coordination display state (coordintion_display_mode) is one of the device states, and the coordination display state can be understood as a state in which the electronic device mirrors the content displayed in the window of the display area B to the display area C. For example, the electronic device can pre-define the coordination display state in / vendor / etc / devicestate.

[0295] The collaborative display state may include: flag 1, which may be flag_cancel_with_request_not_on_top. Flag 1 may be understood as a failure in the collaborative display state request when the target application is not the foreground application. Alternatively, flagg 1 may also be understood as a successful request for the collaborative display state only when the target application is running in the foreground. In this way, when the electronic device detects that the target application is not running in the foreground, the collaborative display state may be canceled to reduce power consumption.

[0296] For example, the floating window frame in the framework layer may send a collaborative display state request to the device state management service by calling requestState(), and request state() may include an identifier of the collaborative display state.

[0297] S1502. In response to the collaborative display state request, the device state management service updates the device state to the collaborative display state.

[0298] For example, the device state management service can calculate whether the collaborative display state can be sent by calling onOverrideRequestStatechangedLocked().

[0299] When the collaborative display state includes an active state (status_active) flag, the device state management service determines that the collaborative display state can be issued, and then updates the device state to the collaborative display state by calling updatePendingStateLocked(). updatePendingStateLocked() may include: the collaborative display state flag.

[0300] Alternatively, when the collaborative display status includes a cancel status (status_cancel) flag, the device status management service determines that the collaborative display status cannot be issued, that is, the device status management service cannot dispatch the collaborative display status. At this time, it can be understood that the collaborative display process is ended.

[0301] The collaborative display state including status_active can be understood as the electronic device requesting the collaborative display state; the collaborative display state including status_cancel can be understood as the electronic device requesting to cancel the collaborative display state.

[0302] S1503. The device status management service submits the collaborative display status to the local.

[0303] For example, the device state management service may commit the collaborative display state through commitPendingState(). commitPendingState() may include: an identifier of the collaborative display state.

[0304] S1504. The device status management service dispatches the collaborative display status.

[0305] In the process of dispatching the collaborative display state, the device state management service can obtain the service pre-registering the collaborative display state, such as the display management service and the window management service, and then execute S1505 and S1511. For example, the device state management service can obtain the service pre-registering the collaborative display state through notifyDeviceStatePreCallback(). notifyDeviceStatePreCallback() may include the identifier of the collaborative display state.

[0306] It can be understood that S1502-S1504 can all be understood as an illustration of a process of an electronic device distributing a device status, and this is not specifically limited in the embodiments of the present application.

[0307] After S1504, the device status management service can simultaneously (or sequentially) execute the steps shown in S1505 and S1511 to notify the display management service and the window management service that the device is currently in a collaborative display state. The electronic device can then determine the display position of the virtual screen based on S1506-S1510, and perform the layer mirroring process based on S1512-S1520.

[0308] S1505. The display management service receives a status change message 1 from the device status management service.

[0309] The state change message 1 may be used to indicate that the device state has changed, and the identification of the collaborative display state may be included in the state change message 1. For example, the display management service may receive the state change message 1 dispatched by the device state management service through the callback function onStateChanged().

[0310] S1506 . In response to the state change message 1 , the display management service sets the display area of ​​the logical screen 1 to the display area 102 .

[0311] For example, the display management service may set the logical screen 1 to the display area 102 by calling setDisplayOffsets(), and setDisplayOffsets() may include an offset value of 1.

[0312] It is understandable that when the electronic device is in the folded state, the electronic device can set the display area of ​​the logical screen 1 to the display area 102 based on the step shown in S1506 to avoid the content in the logical screen 1 from being displayed in the center of the display screen A. And after S1506, the electronic device can receive a trigger operation of the user on the display area 102.

[0313] Optionally, S1507, the display management service sets the size of the logical screen 1 and the size of the virtual screen.

[0314] For example, the display management service may set the size of the logical screen 1 to the size of the display area 102 and set the size of the virtual screen to the size of the display area 101 by calling setDisplayInfoOverrideFromWindowManagerInternal().

[0315] It is understandable that, in the case where the display management service pre-sets the logical screen 1 size and the virtual screen size, the display management service may not execute the step shown in S1507.

[0316] After S1506, the display management service may simultaneously or sequentially execute the steps shown in S1508-S1510 below; the display composition system executes S1511, that is, the display composition system responds to the instructions described in S1508-S1510 simultaneously.

[0317] S1508. The display management service display synthesis system sets a full-screen display area.

[0318] The meaning of the full screen display area can be found in Fig.14 After setting the full screen display area, the contents in the logical screen 1 and the virtual screen can be displayed starting from the starting position 1.

[0319] S1509 . The display management service notifies the display synthesis system to shift the display layer of the logical screen 1 to the display area 102 .

[0320] The display layer may also be referred to as a layer. It is understood that the display management service can offset the display layer of the logical screen 1 to the display area 102 through S1509 to reduce the overlap of the content in the virtual screen and the content in the logical screen 1 when the full screen display area is set.

[0321] For example, the display management service may offset the display layer of the logical screen 1 to the display area 102 by calling setPosition().

[0322] Combined with the description in S1508-S1509, it can be understood that in order to realize the interface display of multiple display areas in display screen A, the electronic device can set the full-screen display area based on S1508 to ensure the normal display of display screen A; further, the electronic device can set the display area to a suitable position by moving the display layer.

[0323] For example, in electronic devices such as Figure 1In the case of the folding screen mobile phone described in the embodiment, the electronic device can move the display layer of the logical screen 1 from the starting position 1 to the starting position 2 based on S1509 to ensure that the display area B and the display area C do not overlap. Alternatively, in the case of the electronic device with other structures, the electronic device can also move the display layer of the virtual screen so that the display area B and the display area C do not overlap, which is not limited in the embodiments of the present application.

[0324] S1510: The display management service notifies the display synthesis system to set the virtual screen as the default display screen.

[0325] It is understandable that since the virtual screen has no display layer, the electronic device can set the virtual screen as the default display so that the content set in the virtual screen can be displayed in the display area 101. For example, the display management service can set the virtual screen as the default display by calling setLayerStack().

[0326] S1511 , the display synthesis system sets a full-screen display area, offsets the display layer of the logical screen 1 to the display area 102 , and sets the virtual screen as the default display screen.

[0327] S1512. The device status management service sends a status change message 1 to the window management service.

[0328] The meaning of the state change message 1 can be found in the description of S1505 and will not be repeated here.

[0329] In a possible implementation, after S1512, the window management service determines whether there is a mirror layer.

[0330] A mirror layer may be a preset defined layer, and a mirror layer may be understood as a layer obtained by mirroring (or copying) other layers.

[0331] The window management service can obtain the mirror layer mirror surface, and determine whether the mirror layer exists according to whether the mirror surface is empty. When the mirror surface is empty, it is determined that there is no mirror layer, and the window management service executes the steps shown in S1513-S1519; or when the mirror surface is not empty, it is determined that there is a mirror layer, and the window management service removes the mirror layer, and then executes the steps shown in S1513-S1519.

[0332] S1513. The window management service traverses task 1 in the preset window.

[0333] The preset window may be a window including a preset window type (window_mode). The preset window may include: a floating window or a mini window, etc.

[0334] In Fig. 5C, task 1 in the preset window may be a task of the note application in the floating window. For example, the window management service may obtain task 1 in the preset window by calling forAllRootTasks().

[0335] S1514. The window management service obtains layer 1 under task 1.

[0336] Task 1 can be understood as the parent node of layer 1, and layer 1 can be understood as all layers mounted under task 1. In FIG. 5C , layer 1 can be a layer displayed in the note application. The number of layer 1 can be at least one. For example, the window management service can obtain layer 1 under task 1 through getSurfaceControl().

[0337] S1515. The window management service sends a message to the display composition system to instruct the layer 1 to be mirrored.

[0338] For example, the window management service may call mirrorSurface() to notify the display composition system to mirror layer 1 to obtain a mirrored layer.

[0339] S1516. The display synthesis system mirrors layer 1 to obtain a mirrored layer.

[0340] S1517: The display composition system returns the mirror layer to the window management service.

[0341] S1518. The window management service scales the mirror layer according to the virtual screen size and the horizontal and vertical screen states of the virtual screen.

[0342] The window management service can call updateMirroredSurface() to scale the mirror layer in proportion to the length and width of the virtual screen and the horizontal and vertical screen state of the virtual screen, so that the mirror layer can be fully displayed in the virtual screen. For example, when the virtual screen is in the vertical screen state and the mirror layer is displayed in the vertical screen (or the floating window corresponding to the mirror layer is in the vertical screen state), the electronic device can make the width of the mirror layer the same as the width of the virtual screen, and scale the height of the mirror layer in proportion.

[0343] S1519. The window management service mounts the image layer to the virtual screen.

[0344] For example, the window management service can mount the mirror layer to the virtual screen by calling reparent(). reparent() may include: the identifier of the virtual screen. After the electronic device completes the mirroring of layer 1, the electronic device can display the interface shown in FIG. 5F in display area C.

[0345] Based on this, the electronic device can realize the coordinated display of the application interface in the window of display area B to display area C by setting the position of the virtual screen and mirroring a layer in display area B, so as to improve the user experience of using the electronic device.

[0346] exist Fig.15 In the case where the corresponding embodiment realizes collaborative display, the embodiment of the present application also provides a method for exiting collaborative display, see Fig.16 Description in .

[0347] For example, Fig.16 A schematic diagram of module interaction for exiting collaborative display provided in an embodiment of the present application. Fig.16 In a corresponding embodiment, the electronic device may include: a device state management service, a display management service, a window management service, a display composition system, and the like.

[0348] like Fig.16 As shown, the method for exiting collaborative display may include the following steps:

[0349] S1601: In response to a user's operation of unfolding an electronic device, a device state management service receives a sensor data change message reported by a sensor.

[0350] The sensor data change message is used to indicate that the sensor of the electronic device has detected a data change. For example, the sensor data change message may be onSensorChanged(), and the sensor data change message may include a sensor event (sensorEvent). The sensorEvent may include: the type of sensor, the timestamp of the sensor event, and the data detected by the sensor.

[0351] For example, in response to a user's operation of unfolding an electronic device, the device status management service may receive data in a sensor data change message indicating that the folding angle is 180 degrees, and based on the data indicating that the folding angle is 180 degrees, it may be understood that the electronic device is in an unfolded state.

[0352] It is understandable that the electronic device may execute the steps shown in S1602-S1610 when it is determined that the collaborative display is exited due to a change in sensor data. Alternatively, when the sensor data has not changed and the electronic device receives a preset exit operation, the electronic device may also execute the steps shown in S1603-S1610 based on the received request to cancel the collaborative display state. Among them, the preset exit operation may include one or more of the following: the operation of switching the floating window to a floating ball when the window is in a floating window state, the operation of switching the mini window to a floating ball when the window is in a mini window state, the operation of displaying the content in the floating window in full screen when the window is in a floating window state, or the operation of exiting the floating window when the window is in a mini window state, etc.

[0353] For example, in response to the user's operation of exiting the floating window, the floating window frame in the framework layer may send a request to cancel the collaborative display state to the device state management module. In response to the request to cancel the collaborative display state, the electronic device may execute the steps shown in S1603-S1610.

[0354] The collaborative display state cancel request is used to cancel the collaborative display state requested in S1501. For example, the collaborative display state cancel request may be: cancelStateRequest(), and the collaborative display state identifier may be included in the cancelStateRequest().

[0355] S1602: In response to the sensor data change message, the device state management service dispatches a development state.

[0356] For example, when receiving a sensor data change message, the device state management service can determine that the device is in the expanded state, update the device state to the expanded state by calling updatePendingStateLocked(), commit the expanded state through commitPendingState(), and then dispatch the expanded state through notifyDeviceStatePreCallback().

[0357] In S1602, updatePendingStateLocked(), commitPendingState(), and notifyDeviceStatePreCallback() may include an identifier of the expansion state.

[0358] After S1602, the device status management service can simultaneously (or successively) execute the steps shown in S1603 and S1605 to notify the display management service and the window management service that the device is currently in the expanded state, and then the electronic device can remove the mirror layer based on S1603 and clear the settings for the virtual screen based on S1606-S1610.

[0359] S1603. The device status management service sends a status change message 2 to the window management service.

[0360] The state change message 2 may be used to indicate that the device state has changed. For example, the state change message may include an identifier of the expansion state. For example, the device state management service may notify the window management service that the device state has changed by calling onStateChanged().

[0361] S1604. In response to the device change message 2, the window management service removes the mirror layer.

[0362] It is understandable that the window management service can remove the mirrored layer when determining that the device change message 2 does not include the identification of the collaborative display state. The step of removing the mirrored layer by the window management service can refer to the description in S1513, which will not be repeated here.

[0363] S1605. The device state management service sends a state change message 2 to the display management service.

[0364] The meaning of the state change message 2 can be found in the description of S1603 and will not be repeated here.

[0365] S1606 . The display management service cancels setting the display area of ​​the logical screen 1 as the display area 102 in response to the state change message 2 .

[0366] For example, when the display management service executes S1506, the display management service can call setDisplayOffsets() to notify the display composition system to cancel setting the display area of ​​logical screen 1 to display area 102. In this way, the situation where the display content is still displayed in display area 102 in the expanded state can be reduced.

[0367] Optionally, S1607, the display management service sets the size of display screen A.

[0368] For example, the display management service can set the size of display A by calling setDisplayInfoOverrideFromWindowManagerInternal().

[0369] It is understandable that, in the case where the display management service pre-sets the size of the display screen A, the display management service may not execute the step shown in S1607.

[0370] S1608. The display management service notifies the display synthesis system to set a full-screen display area.

[0371] It is understandable that, in the case where the display management service has set the full-screen display area, the display management service may not execute the step shown in S1608.

[0372] S1609 . The display management service notifies the display synthesis system to clear the offset of the display layer of logical screen 1 .

[0373] For example, when the display management service executes S1509, the display management service can clear the display layer offset of logical screen 1 by calling setPosition(). Clearing the display layer offset of logical screen 1 can be understood as moving the display layer of logical screen 1 from starting position 2 to starting position 1.

[0374] S1610. The display management service notifies the display composition system to restore the layer stack (LayerStack) of the virtual screen.

[0375] Restoring the layer stack of the virtual screen can be understood as restoring the invisibility of the virtual screen itself, that is, the content in the virtual screen cannot be displayed in the display area C. For example, when the display management service executes S1510, the display management service can restore the layer stack of the virtual screen by calling setLayerStack().

[0376] Based on this, when the electronic device detects that the electronic device is in the unfolded state, the electronic device can exit the collaborative display function by removing the mirror layer and restoring the full-screen display of the electronic device, thereby reducing the waste of device power consumption.

[0377] Optionally, in response to a preset exit operation performed by the user, when the device status management service receives a request to cancel the collaborative display status, the electronic device may execute steps S1603-S1605, S1609-S1610, and S1506.

[0378] The preset exit operation may include one or more of the following: switching the floating window to a floating ball when the window is in a floating window state, switching the mini window to a floating ball when the window is in a mini window state, displaying the content in the floating window in full screen, or closing the floating window. It is understood that after the electronic device exits the collaborative display state. It is understood that during the process of the user performing the preset exit operation, the folded state of the electronic device is changed to the unfolded state.

[0379] Understandably, electronic devices Fig.15 as well as Fig.16 The settings for the virtual screen are all implemented through logical screen 2. The relationship between logical screen 2 and the virtual screen can be seen in Fig.13 Description in .

[0380] exist Fig.15 On the basis of the corresponding embodiment, the embodiment of the present application also provides an interface display method based on horizontal and vertical screen rotation, see Fig.17 Description in .

[0381] For example, Fig.17 A schematic diagram of module interaction of another interface display method provided in an embodiment of the present application. Fig.17 In the corresponding embodiment, the electronic device may include: a display content module, a display rotation module and a display rotation coordination module. The meaning of any module can be found in Figure 4 Description in .

[0382] It is understandable that the electronic device can detect the rotation direction of the display screen, and the rotation direction of the virtual screen can be obtained by negating the rotation direction of the display screen. For example, when the rotation direction of the display screen is 90 degrees, the electronic device can obtain 270 degrees by negating 90 degrees, that is, when the rotation direction of the display screen is 90 degrees, the rotation direction of the virtual screen can be 270 degrees.

[0383] S1701: In response to a device power-on or restart operation, a display screen rotation module registers for monitoring.

[0384] It is understandable that the display screen rotation module can monitor the change of the rotation direction of the electronic device by registering to monitor. For example, the display screen rotation module can register to monitor by calling newDisplayRotation().

[0385] S1702. The display screen rotation module notifies the display screen rotation coordination module to set callback function 1.

[0386] The callback function 1 can be used to notify the virtual screen of the rotation of the logical screen 1. For example, the display screen rotation module can notify the display screen rotation coordination module to set the callback function 1 by calling setDefaultDisplayRotationchangedCallback().

[0387] S1703: In response to the operation of rotating the electronic device, the display screen content module sends a rotation message to the display screen rotation module.

[0388] The rotation message may include: a rotation angle, such as angle 1. For example, the display screen content module may send a rotation message to the display screen rotation module by calling foldStateChanged().

[0389] S1704: In response to the rotation message, the display screen rotation module updates the rotation angle of the electronic device to angle 1. For example, the display screen rotation module can update the rotation angle of the electronic device by calling updateRotationUnchecked().

[0390] S1705. The display screen rotation module sends angle 1 to the application.

[0391] Exemplarily, the display screen rotation module may distribute angle 1 to the application running in the foreground, so that the application may rotate the displayed content according to angle 1.

[0392] S1706. The display screen rotation module sends a rotation message to the display screen rotation coordination module.

[0393] For example, the display rotation module may notify the display rotation coordination module that the electronic device has rotated by calling onDefaultDisplayRotationChanged.

[0394] S1707. The display screen rotation coordination module notifies the virtual screen in the display screen rotation module through callback function 1, and the rotation angle is angle 1.

[0395] For example, the display screen rotation coordination module notifies the virtual screen in the display screen rotation module through callback function 1 (such as updateRotationAndSendConfigIfChanged()) that the rotation angle is angle 1.

[0396] S1708. The display screen rotation module inverts angle 1 to obtain angle 2.

[0397] For example, when angle 1 is 90 degrees, angle 2 may be 270 degrees. That is, when the electronic device is rotated 90 degrees, the electronic device may rotate the mirror layer 270 degrees so that the content in the mirror layer can be properly displayed on the virtual screen.

[0398] S1709. The display screen rotation module notifies the window management service to rotate the mirror layer based on angle 2.

[0399] It is understandable that after the window management service receives angle 2, the window management service can implement processing of the mirror layer in S1518.

[0400] Based on this, when the electronic device detects that a rotation has occurred, it can rotate the mirror layer in the virtual screen by reversing the rotation direction to ensure that the mirror layer can be reasonably displayed in the virtual screen.

[0401] It can be understood that the embodiments of the present application can realize the collaborative display of applications in the whitelist, and the applications in the whitelist may include: applications that can be displayed in a floating window state.

[0402] It should be noted that the module names involved in the embodiments of the present application can be defined as other names as long as the functions of each module can be achieved, and there is no specific restriction on the names of the modules.

[0403] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in the embodiments of the present application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0404] Combination Fig.15 Description in Fig.18 A flowchart of an interface display method provided in an embodiment of the present application. Fig.18 In the corresponding embodiment, an electronic device is taken as an example of a folding screen device, which does not constitute a limitation on the embodiments of the present application. The folding screen device includes: a physical display screen, and the physical display screen includes: a first display area and a second display area. When the folding screen device is in a folded state, the first display area and the second display area are arranged opposite to each other.

[0405] like Fig.18 As shown, the interface display method may include the following steps:

[0406] S1801. Create a virtual screen.

[0407] The virtual screen corresponds to the second display area. The meaning of the virtual screen can be found in Figure 13-Figure 15 Description in .

[0408] S1802: The first display area displays a first interface.

[0409] The first interface includes: a first full-screen window corresponding to a first application and a first floating window corresponding to a second application, wherein the folding screen device is in a folded state, and the first floating window includes a first application interface corresponding to the second application.

[0410] The first display area may be the display area B described in the embodiment of the present application, and the second display area may be the display area C described in the embodiment of the present application.

[0411] The first interface may be the interface shown in FIG. 5C , the first application may be a note application, and the first full-screen window corresponding to the first application may be a note application interface displayed in full screen.

[0412] The second application may be a payment application, the first floating window corresponding to the second application may be floating window 501 in FIG. 5C , and the first application interface corresponding to the second application may be a payment interface in the payment application, such as the application interface in floating window 501, that is, the payment interface is displayed in floating window 501, and the first application interface does not include the control controls in floating window 501. It can be understood that the first application interface is not an interface in the first application.

[0413] S1803. In response to the first operation on the second display area, display a second floating window corresponding to the second application in the first display area, set the display area of ​​the virtual screen to the second display area, and display the first application interface in the second display area through the virtual screen.

[0414] The first operation may be the operation of double-clicking the display area C as described in FIG. 5C , or may be other operations for entering collaborative display, see Figure 5-2 to Figure 6-1 Description in .

[0415] The size of the second floating window is smaller than the size of the first floating window.

[0416] S1804: In response to a second operation on the second floating window, display the first floating window in the first display area, and display the first application interface in the second display area.

[0417] The second operation may be a click operation on the mini window 506 .

[0418] S1805: In response to the third operation on the first floating window, display a third floating window corresponding to the second application in the first display area, and display the second application interface in the second display area.

[0419] The size of the third floating window is larger than that of the second floating window, and the third floating window includes a second application interface corresponding to the second application, and the second application interface is different from the first application interface.

[0420] As shown in FIG6A , the third operation may be an operation of sliding up the floating window 601. The third floating window may be the floating window 601 in FIG6C , and the second application interface corresponding to the second application may be the application interface displayed in the floating window 601, and the second application interface does not include the control controls in the floating window 601.

[0421] Based on this, the folding screen device can not only realize the coordinated display of the content in the window of display area B to display area C, but also in response to the trigger operation performed by the user on display area C, the application interface in the floating window can be updated synchronously with the application interface in display area C, so that the user can view the updated application interface in display area C in real time.

[0422] The interface display method of the embodiment of the present application has been described above, and the device for executing the above method provided by the embodiment of the present application is described below. Those skilled in the art can understand that the method and the device can be combined and referenced with each other, and the relevant device provided by the embodiment of the present application can execute the steps in the above list sorting method.

[0423] Fig.19 A schematic diagram of the hardware structure of another electronic device provided in an embodiment of the present application.

[0424] The electronic device includes a processor 1901, a communication circuit 1904 and at least one communication interface ( Fig.19 The communication interface 1903 is used as an example for explanation).

[0425] Processor 1901 may be a general-purpose CPU, a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

[0426] Communications link 1904 may include circuitry for transmitting information between the above-described components.

[0427] The communication interface 1903 uses any transceiver or other device for communicating with other devices or communication networks, such as Ethernet, wireless local area networks (WLAN), etc.

[0428] Possibly, the electronic device may further include a memory 1902 .

[0429] The memory 1902 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory may exist independently and be connected to the processor via a communication line 1904. The memory may also be integrated with the processor.

[0430] The memory 1902 is used to store computer-executable instructions for executing the solution of the present application, and the execution is controlled by the processor 1901. The processor 1901 is used to execute the computer-executable instructions stored in the memory 1902, thereby implementing the method provided by the embodiment of the present application.

[0431] Possibly, the computer-executable instructions in the embodiments of the present application may also be referred to as application code, and the embodiments of the present application do not specifically limit this.

[0432] In a specific implementation, as an embodiment, the processor 1901 may include one or more CPUs, such as Fig.19 CPU0 and CPU1 in.

[0433] In a specific implementation, as an embodiment, the electronic device may include multiple processors, such as Fig.19 1901 and processor 1905 in the embodiment of the present invention. Each of these processors may be a single-CPU processor or a multi-CPU processor. The processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0434] The interface display method provided in the embodiment of the present application can be applied to electronic devices with communication functions. The electronic devices include terminal devices, and the specific device form of the terminal devices can refer to the above related descriptions, which will not be repeated here.

[0435] An embodiment of the present application provides a terminal device, which includes: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, so that the terminal device executes the above method.

[0436] The embodiment of the present application provides a chip. The chip includes a processor, and the processor is used to call a computer program in a memory to execute the technical solution in the above embodiment. Its implementation principle and technical effect are similar to those of the above related embodiments, and will not be repeated here.

[0437] The embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium stores a computer program. The above method is implemented when the computer program is executed by the processor. The method described in the above embodiment can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, the function can be stored as one or more instructions or codes on a computer-readable medium or transmitted on a computer-readable medium. Computer-readable media can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium that can be accessed by a computer.

[0438] In one possible implementation, a computer-readable medium may include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disk storage, disk storage or other magnetic storage devices, or any other medium that is intended to carry or store the required program code in the form of instructions or data structures and can be accessed by a computer. Moreover, any connection is appropriately referred to as a computer-readable medium. For example, if a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL) or wireless technology (such as infrared, radio and microwave) is used to transmit software from a website, server or other remote source, the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology such as infrared, radio and microwave are included in the definition of medium. Disks and optical disks as used herein include optical disks, laser disks, optical disks, digital versatile disks (DVD), floppy disks and Blu-ray disks, where disks usually reproduce data magnetically, while optical disks reproduce data optically using lasers. Combinations of the above should also be included in the scope of computer-readable media.

[0439] An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed, the computer executes the above method.

[0440] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable device to generate a machine, so that the instructions executed by the processing unit of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0441] The above specific implementation methods further illustrate the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above are only specific implementation methods of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solutions of the present invention should be included in the scope of protection of the present invention.

Claims

1. An interface display method, characterized in that: Applied to a folding screen device, the folding screen device includes: a physical display screen, the physical display screen includes: a first display area and a second display area, when the folding screen device is in a folded state, the first display area and the second display area are arranged opposite to each other, the method includes: Create a virtual screen; The first display area displays a first interface, the first interface including: a first full-screen window corresponding to a first application and a first floating window corresponding to a second application, wherein the folding screen device is in the folded state, and the first floating window includes a first application interface corresponding to the second application; In response to a first operation on the second display area, a second floating window corresponding to the second application is displayed in the first display area, the display area of ​​the virtual screen is set to be the second display area, and the first application interface is displayed in the second display area through the virtual screen, and the size of the second floating window is smaller than the size of the first floating window; In response to a second operation on the second floating window, displaying the first floating window in the first display area, and displaying the first application interface in the second display area; In response to a third operation on the first floating window, a third floating window corresponding to the second application is displayed in the first display area, and a second application interface is displayed in the second display area, wherein a size of the third floating window is larger than a size of the second floating window, and the third floating window includes the second application interface corresponding to the second application, and the second application interface is different from the first application interface.

2. The method according to claim 1, characterized in that The first display area is obtained by controlling the display interface through the first logical screen, and the setting of the display area of ​​the virtual screen as the second display area includes: The display area of ​​the physical display screen is set to the entire display area, so that the content in the first logical screen and the content in the virtual screen are displayed from the starting position of the entire display area, and the starting position of the second display area is the same as the starting position of the entire display area.

3. The method according to claim 2, characterized in that The method further comprises: The display layer of the first logical screen is moved from the starting position of the entire display area to a first position, where the first position is the starting position of the first display area.

4. The method according to claim 2 or 3, characterized in that: After setting the display area of ​​the virtual screen as the second display area, the method further includes: The virtual screen is set as a default display, wherein before the virtual screen is set as the default display, the virtual screen corresponds to a first layer and the first layer is not allowed to be displayed in the physical display.

5. The method according to claim 4, characterized in that The method further comprises: When receiving a second status message, the display layer of the first logical screen is restored from the first position to the starting position of the entire display area, and the layer of the virtual screen is restored to the first layer, wherein the second status message is generated when the folding screen device detects an operation of unfolding the folding screen device, Alternatively, when a third status message is received, the layer of the virtual screen is restored to the first layer, and the display area of ​​the physical display screen is set to the first display area, wherein the third status message is generated when the folding screen device detects a preset operation, and the preset operation includes one or more of the following: the operation of switching the second floating window to a floating ball, the operation of displaying the content in the second floating window in full screen, or the operation of closing the second floating window.

6. The method according to any one of claims 1 to 5, characterized in that: After the first operation on the second display area is responded, the method further includes: When receiving a first status message related to the first operation, obtaining a task task in the first floating window; Mirroring the layer in the task to obtain a second layer; The second layer is mounted on the virtual screen.

7. The method according to any one of claims 1 to 6, characterized in that: The outer border of the second floating window is in a first state, and the outer borders of the first floating window and the third floating window are in a second state, wherein the thickness of the outer border line in the first state is greater than the thickness of the outer border line in the second state, and / or the color of the outer border in the first state is different from that of the outer border in the second state.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: In response to a fourth operation on the first display area, displaying a fourth floating window corresponding to a third application in the first display area, wherein the fourth floating window includes a third application interface corresponding to the third application; In response to a fifth operation on the fourth floating window, a fifth floating window corresponding to the third application is displayed in the first display area, and a first prompt message is displayed in the second display area, wherein a size of the fifth floating window is smaller than a size of the fourth floating window, and the first prompt message is used to prompt that the third application interface does not support collaborative display in the second display area; Alternatively, in response to the fifth operation, the fifth floating window and the first prompt information are displayed in the first display area.

9. The method according to any one of claims 1 to 8, characterized in that: After displaying the first application interface in the second display area, the method further includes: displaying a second prompt message in the first display area, the second prompt message being used to prompt that the folding screen device is abnormal and whether to end displaying the first application interface in the second display area; And / or, after the response to the first operation on the second display area, the method also includes: displaying a third prompt message in the first display area, the third prompt message being used to prompt that the folding screen device is in an abnormal state and whether to display the first application interface in the second display area.

10. The method according to claim 9, characterized in that The folding screen device is in an abnormal state including: the folding screen device detects that the percentage of battery power is less than a first value, and / or the device temperature detected by the folding screen device is greater than a second value.

11. The method according to any one of claims 1 to 8, characterized in that: After displaying the first application interface in the second display area, the method further includes: In response to the operation of opening the notification center from the first display area, a fourth prompt message is displayed in the first display area, and the first application interface is displayed in the second display area, and the fourth prompt message is used to prompt the folding screen device to display the first application interface in the second display area.

12. The method according to any one of claims 1 to 11, characterized in that: After displaying the first application interface in the second display area, the method further includes: In response to an operation of unfolding the folding screen device, the second floating window is displayed in the physical display screen.

13. The method according to any one of claims 1 to 12, characterized in that: After displaying the first application interface in the second display area, the method further includes: In response to a sixth operation on the first display area, cancel displaying any content in the second display area, wherein the sixth operation includes one or more of the following: an operation of switching the second floating window to a floating ball, an operation of displaying the content in the second floating window in full screen, or an operation of closing the second floating window.

14. The method according to any one of claims 1 to 13, characterized in that: The first operation on the second display area includes: multiple tapping operations on the second display area.

15. An electronic device, characterized in that: The electronic device comprises: one or more processors and a memory; The memory is coupled to the one or more processors, and the memory is used to store computer program codes, wherein the computer program codes include computer instructions, and the one or more processors call the computer instructions to enable the electronic device to perform the method according to any one of claims 1 to 14.

16. A chip system, characterized in that: The chip system is applied to an electronic device, and the chip system includes one or more processors, and the one or more processors are used to call computer instructions so that the electronic device executes the method as described in any one of claims 1 to 14.

17. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises computer instructions, and when the computer instructions are executed on an electronic device, the electronic device is caused to perform the method according to any one of claims 1 to 14.

18. A computer program product, characterized in that The computer program product comprises a computer program code, and when the computer program code is run on an electronic device, the electronic device is caused to perform the method according to any one of claims 1 to 14.

Citation Information

Patent Citations

  • Window switching method, electronic equipment and readable storage medium

    CN114416227A

  • Floating window display method, electronic equipment and storage medium

    CN115033333A

  • Management method of electronic equipment, electronic equipment and readable storage medium

    CN115567630A

  • Display screen window switching method and electronic equipment

    CN116225276A

  • Screen display method and electronic equipment

    CN116339568A