Interface display method and apparatus

Abstract

Embodiments of the present application relate to the technical field of terminals, and provide an interface display method and apparatus. The method comprises: in response to a first operation for a first floating window, displaying, in a first display screen, a second floating window corresponding to a second application, and displaying a first application interface in a second display screen; in response to a second operation for the second floating window, displaying the first floating window in the first display screen, and displaying the first application interface in the second display screen; and in response to a third operation for the first floating window, displaying, in the first display screen, a third floating window corresponding to the second application, and displaying a second application interface in the second display screen, wherein the second application interface is different from the first application interface. Therefore, an electronic device can not only collaboratively display the application interface displayed in a window of the first display screen on the second display screen, but also achieve collaborative updating of the window of the first display screen and the second display screen.

Description

Interface display method and device TECHNICAL FIELD

[0001] The present application relates to the technical field of terminals, and in particular to an interface display method and device. BACKGROUND

[0002] With the popularity and development of the Internet, the functional requirements of people for electronic devices are increasingly diversified. For example, in order to improve the use requirements of users for multiple services, foldable screen mobile phones gradually enter the field of vision of users, and users can use multiple display screens in the foldable screen mobile phone to perform multiple services. For example, when the foldable screen mobile phone is in an unfolded state, the user can use the inner screen and / or the outer screen to display content; when the foldable screen mobile phone is in a folded state, the user can use the outer screen to display content.

[0003] However, the use method of the foldable screen mobile phone has certain limitations.

[0004] SUMMARY

[0005] The embodiments of the present application provide a display method and device, which are applied to the technical field of terminals, so that the electronic device can mirror the content displayed in the inner screen window to the outer screen, thereby improving the limitations of using the foldable screen mobile phone.

[0006] In a first aspect, the embodiments of the present application provide an interface display method, which is applied to an electronic device, and the electronic device includes a first display screen and a second display screen, the first display screen and the second display screen are arranged opposite to each other, and the method includes: displaying a first interface on the first display screen, the first interface includes a first full-screen window corresponding to a first application and a first floating window corresponding to a second application, and the first floating window includes a first application interface corresponding to the second application; in response to a first operation on the first floating window, displaying a second floating window corresponding to the second application in the first display screen, and displaying the first application interface in the second display screen, and the size of the second floating window is smaller than the size of the first floating window; in response to a second operation on the second floating window, displaying the first floating window in the first display screen, and displaying the first application interface in the second display screen; and in response to a third operation on the first floating window, displaying a third floating window corresponding to the second application in the first display screen, and displaying a second application interface corresponding to the second application in the second display screen, wherein the size of the third floating window is larger than the size of the second floating window, the third floating window includes the second application interface corresponding to the second application, and the second application interface is different from the first application interface.

[0007] The first display screen can be the inner screen described in the embodiments of the present application, and the second display screen can be the outer screen described in the embodiments of the present application.

[0008] The first interface can be the interface shown in FIG. 5C, the first application can be a camera application, and the first full-screen window corresponding to the first application can be a full-screen camera application interface.

[0009] The second application can be a note application, the first floating window corresponding to the second application can be the floating window 501 in FIG. 5C, and the first application interface corresponding to the second application can be an application interface in the note application, such as the application interface in the floating window 501, that is, the note application interface is displayed in the floating window 501, and the first application interface does not include the operation control in the floating window 501. It can be understood that the first application interface is not an interface in the first application.

[0010] The first operation can be the three-finger up sliding operation described in FIG. 5C, or can also be other operations for entering the collaborative display, see the description in FIGS. 5-1 to 6-2.

[0011] The second floating window can be the mini window 506 in FIG. 5E.

[0012] The second operation can be a click operation on the mini window 506.

[0013] As shown in FIG. 7A, the third operation can be an operation of sliding up the floating window 501. The third floating window can be the floating window 701 in FIG. 7C, and the second application interface corresponding to the second application can be an application interface displayed in the floating window 701, and the second application interface does not include the operation control in the floating window 701.

[0014] In this way, the electronic device can not only realize the collaborative display of the content in the inner screen window to the outer screen, and in response to the trigger operation performed by the user on the inner screen, the application interface in the floating window can be synchronized with the application interface in the outer screen. The updated application interface can be viewed by the user in real time on the outer screen.

[0015] In a possible implementation, after displaying the second floating window corresponding to the second application in the first display screen and displaying the first application interface in the second display screen, the method further includes: in response to a fourth operation on the first display screen, displaying the second floating window and a fourth floating window corresponding to a third application in the first display screen, and displaying the first application interface in the second display screen, the third application interface corresponding to the third application is included in the fourth floating window; in response to a fifth operation on the fourth floating window, displaying the second floating window and a fifth floating window corresponding to the third application in the first display screen, and displaying the third application interface in the second display screen, the size of the fifth floating window is smaller than the size of the fourth floating window.

[0016] The fourth operation can be an operation of opening another floating window, such as an operation of opening a fourth floating window, which can be the floating window 1201 described in FIG. 12A, and the third application can be a social application.

[0017] The third application interface corresponding to the third application can be a social application interface displayed in the floating window 1201.

[0018] The fifth operation can be a three-finger upswipe operation or other operation of entering collaborative display.

[0019] The fifth floating window can be the mini window 1202 described in FIG. 12C.

[0020] In this way, in response to the operation of triggering the collaborative display performed by the user again, the electronic device can switch the content of the collaborative display on the outer screen, so that the user can adjust the content of the collaborative display at any time according to the needs.

[0021] In a possible implementation, the outer border of the second floating window is in the first state, and the outer borders of the first floating window and the third floating window are in the second state, where the line thickness of the outer border in the first state is greater than the line thickness of the outer border in the second state, and / or the color of the outer border in the first state is different from the color of the outer border in the second state. For example, the color of the outer border in the first state can be red, and the color of the outer border in the second state can be blue.

[0022] In a possible implementation, after responding to the fourth operation for the first display screen, the method further includes setting the outer border of the second floating window to the first state; and after responding to the fifth operation for the fourth floating window, the method further includes setting the outer border of the second floating window to the second state and setting the outer border of the fifth floating window to the first state, where the line thickness of the outer border in the first state is greater than the line thickness of the outer border in the second state, and / or the color of the outer border in the first state is different from the color of the outer border in the second state.

[0023] In this way, the electronic device can identify that the content in the floating window has been mounted to the outer screen through the first state, and identify that the content in the floating window is not mounted to the outer screen through the second state, so that the user can determine the situation of the collaborative display without viewing the outer screen, thereby improving the experience of the user using the collaborative display function.

[0024] In a possible implementation, the method further includes: in response to the sixth operation for the first display screen, displaying a sixth floating window corresponding to the fourth application in the first display screen, the sixth floating window including a fourth application interface corresponding to the fourth application; in response to a seventh operation for the sixth floating window, displaying a seventh floating window corresponding to the fourth application in the first display screen, and displaying first prompt information in the second display screen, wherein the size of the seventh floating window is smaller than the size of the sixth floating window, and the first prompt information is used to prompt that the fourth application interface does not support cooperative display to the second display screen; or in response to the seventh operation, displaying the seventh floating window and the first prompt information in the first display screen, and the second display screen is in an off-screen state.

[0025] The sixth operation can be an operation of opening another floating window, and the sixth floating window can be the floating window 801 in FIG. 8A.

[0026] The fourth application can be a financial application, and the fourth application interface can be an application interface displayed in the floating window 801, such as a transfer interface.

[0027] The first prompt information can be the prompt information 803.

[0028] In this way, the electronic device determines whether to enter cooperative display according to the attribute of the interface, and prompts the user through the inner screen or the outer screen when it is determined that cooperative display cannot be entered, so as to improve the user experience of using the cooperative display function.

[0029] In a possible implementation, after displaying the second floating window corresponding to the second application in the first display screen and displaying the first application interface in the second display screen, the method further includes: displaying second prompt information in the first display screen, the second prompt information being used to prompt that the electronic device is abnormal, and whether to end the display of the first application interface in the second display screen; and / or after responding to the first operation for the first floating window, the method further includes: displaying third prompt information in the first display screen, the third prompt information being used to prompt that the electronic device is abnormal, and whether to display the first application interface in the second display screen.

[0030] The second prompt information can be the prompt information 1304 described in FIG. 13A, and the third prompt information can be the prompt information 1306 described in FIG. 13D.

[0031] In this way, the electronic device can timely prompt the user through prompt information when it is detected that the device is abnormal, so as to reduce the situation that the device power is rapidly reduced or the device is stuck without the user's awareness.

[0032] In a possible implementation, the electronic device being abnormal includes that the electronic device detects that the percentage of the battery power is less than a first value, and / or the electronic device detects that the device temperature is greater than a second value.

[0033] It can be understood that the cooperative display function has a high requirement on power consumption and / or battery power, and thus the electronic device can determine that the electronic device is abnormal when detecting that the device power is low and the device temperature is high.

[0034] In a possible implementation, after displaying the second application corresponding second floating window in the first display screen and displaying the first application interface in the second display screen, the method further includes: in response to an operation of opening the notification center from the first display screen, displaying fourth prompt information in the first display screen and displaying the first application interface in the second display screen, the fourth prompt information being used to prompt the electronic device to display the first application interface in the second display screen.

[0035] The fourth prompt information can be the prompt information 901 in FIG. 9A.

[0036] In this way, the electronic device can view the state of the electronic device from the notification center.

[0037] In a possible implementation, after displaying the second application corresponding second floating window in the first display screen and displaying the first application interface in the second display screen, the method further includes: in response to an operation of folding the electronic device, displaying the second floating window in the second display screen, and the first display screen being in an off-screen state.

[0038] In this way, the electronic device can continue the content displayed on the inner screen to the outer screen when detecting that the electronic device is folded, so as to reduce the situation that the display content is interrupted.

[0039] In a possible implementation, after displaying the second application corresponding second floating window in the first display screen and displaying the first application interface in the second display screen, the method further includes: in response to an eighth operation on the first display screen, the second display screen is turned off, wherein the eighth operation includes one or more of the following: an operation of turning off the first display screen, an operation of switching the second floating window to a floating ball, an operation of full-screen displaying the content in the second floating window, or an operation of closing the second floating window.

[0040] The eighth operation can be a preset exit operation described in the embodiments of the present application.

[0041] In this way, the electronic device can turn off the second display screen in time when detecting the preset exit operation, so as to reduce the waste of power consumption.

[0042] In a possible implementation, the first operation on the first floating window includes a three-finger up sliding operation on the first floating window.

[0043] In a possible implementation, in response to the first operation on the first floating window, the second application corresponding second floating window is displayed in the first display screen, and the first application interface is displayed in the second display screen, which includes: in response to a ninth operation of dragging the first floating window to the second hot area, the first floating window and an identifier of the first hot area are displayed in the first display screen, the first hot area is located in the second hot area; in the case that the ninth operation continues to act on the first floating window, in response to the first operation of dragging the first floating window to the first hot area, the second floating window is displayed in the first display screen, and the first application interface is displayed in the second display screen.

[0044] As shown in FIG. 6-1, the second hot area can be the area 600, and the first hot area can be the preset area 602.

[0045] In this way, the electronic device can pre-set the first hot area, and in response to the operation of dragging the first floating window to the first hot area in the second hot area performed by the user, the electronic device can view the application interface in the first floating window on the outer screen.

[0046] In a possible implementation, after responding to the first operation on the first floating window, the method further includes: when a first state message related to the first operation is received, obtaining a task task in the first floating window; mirroring a layer in the task to obtain a first layer; and mounting the first layer to the second display screen.

[0047] The first state message can be the state change message 1 described in the embodiments of the present application, and the first layer can be the layer 1 described in the embodiments of the present application.

[0048] In this way, the electronic device can realize the cooperative display of the first floating window and the second display screen by mirroring the task in the first floating window and mounting the mirrored layer to the second display screen.

[0049] In a possible implementation, when the first state message related to the first operation is received, the task task in the first floating window is obtained, which includes: in the case that the first state message is received and the electronic device does not contain a preset layer, the task task in the first floating window is obtained, the preset layer being a layer obtained by mirroring any layer; or in the case that the first state message is received and the electronic device contains the preset layer, the preset layer is removed, and the task task in the first floating window is obtained.

[0050] The preset layer can be the mirrored layer described in the embodiments of the present application.

[0051] In this way, the electronic device can remove the mirror layer when detecting that the mirror layer currently exists, and then mirror the task in the first floating window, so as to reduce abnormal situations when multiple mirror layers exist.

[0052] In a possible implementation, the method further includes: removing the first layer, exchanging display content of the first display screen and the second display screen, and powering off the first display screen when a second state message is received, wherein the second state message is generated when the electronic device detects folding of the electronic device; and / or removing the first layer and powering off the second display screen when a third state message is received, wherein the third state message is generated when the electronic device detects a preset operation, and the preset operation includes one or more of the following: an operation of turning off the first display screen, an operation of switching the second floating window to a floating ball, an operation of full-screen displaying content in the second floating window, or an operation of closing the second floating window.

[0053] The second state message can be the state change message 2 described in the embodiments of the present application. In this way, the electronic device can power off the first display screen when detecting that the device is folded, and continue the content in the first display screen to the second display screen, so as to reduce the situation that the display content is interrupted.

[0054] The third state message can be the state change message 3 described in the embodiments of the present application. The preset operation can be the preset exit operation described in the embodiments of the present application. In this way, the electronic device can power off the first display screen in time when detecting the preset exit operation, so as to save power waste.

[0055] In a possible implementation, the electronic device is an inner folding device, the first display screen is an inner screen, and the second display screen is an outer screen.

[0056] In a second aspect, the embodiments of the present application provide an interface display method, applied to an electronic device, the electronic device including: a first display screen and a second display screen, the first display screen and the second display screen being arranged opposite to each other, and the method including: the first display screen displaying a first interface, the first interface including: a first full-screen window corresponding to a first application and a first floating window corresponding to a second application; in response to a first operation on the first floating window, displaying an outer frame of the first floating window in the first state in the first display screen, and displaying a first application interface in the second display screen, the first state including: thick lines and / or colored lines; in response to a third operation on the first floating window, displaying a third floating window corresponding to the second application in the first display screen, and displaying a second application interface in the second display screen, wherein the third floating window includes the second application interface corresponding to the second application, the size of the first floating window is the same as the size of the third floating window, and the second application interface is different from the first application interface.

[0057] In this way, the electronic device can also make the user perceive that the content in the first floating window has been cooperatively displayed to the outer screen by adding the first state to the first floating window.

[0058] In a possible implementation, after the outer frame of the first floating window is displayed in the first state in the first display screen and the first application interface is displayed in the second display screen, the method further includes: in response to a tenth operation on the first floating window, displaying a second floating window corresponding to a second application in the first display screen, and displaying the first application interface in the second display screen, the size of the second floating window being smaller than the size of the first floating window. The second floating window is in the first state.

[0059] The tenth operation can be understood as an operation of dragging the first floating window to any corner of the display screen. In this way, the user can also determine that the current has entered the cooperative display state through the second floating window in the first state.

[0060] In a third aspect, an interface display apparatus is provided. The interface display apparatus can be an electronic device, or a chip or chip system in the electronic device. The interface display apparatus can include a display unit and a processing unit. When the interface display apparatus is an electronic device, the display unit can be a display screen. The display unit is configured to perform the steps of displaying, so that the electronic device implements the interface display method described in the first aspect or any possible implementation of the first aspect, or implements the interface display method described in the second aspect or any possible implementation of the second aspect. When the interface display apparatus is an electronic device, the processing unit can be a processor. The interface display apparatus can further include a storage unit, which can be a memory. The storage unit is configured to store instructions, and the processing unit is configured to execute the instructions stored in the storage unit, so that the electronic device implements the interface display method described in the first aspect or any possible implementation of the first aspect, or implements the interface display method described in the second aspect or any possible implementation of the second aspect. When the interface display apparatus is a chip or chip system in the electronic device, the processing unit can be a processor. The processing unit executes the instructions stored in the storage unit, so that the electronic device implements the interface display method described in the first aspect or any possible implementation of the first aspect, or implements the interface display method described in the second aspect or any possible implementation of the second aspect. The storage unit can be a storage unit (for example, a register, a cache, etc.) in the chip, or a storage unit (for example, a read-only memory, a random access memory, etc.) in the electronic device and located outside the chip.

[0061] An example display unit is configured to display a first interface on a first display screen, the first interface including a first full-screen window corresponding to a first application and a first floating window corresponding to a second application, the first floating window including a first application interface corresponding to the second application. An example processing unit is configured to, in response to a first operation on the first floating window, cause the display unit to display a second floating window corresponding to the second application on the first display screen and the first application interface on a second display screen, the second floating window having a size smaller than that of the first floating window. The processing unit is further configured to, in response to a second operation on the second floating window, cause the display unit to display the first floating window on the first display screen and the first application interface on the second display screen. The processing unit is further configured to, in response to a third operation on the first floating window, cause the display unit to display a third floating window corresponding to the second application on the first display screen and a second application interface corresponding to the second application on the second display screen, the third floating window having a size larger than that of the second floating window, the third floating window including the second application interface, and the second application interface being different from the first application interface.

[0062] In a fourth aspect, an embodiment of the present application provides an electronic device, including one or more processors and a memory; the memory is coupled with the one or more processors, and is configured to store computer program codes, the computer program codes including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method described in the first aspect or any possible implementation manner of the first aspect, or perform the method described in the second aspect or any possible implementation manner of the second aspect.

[0063] In a fifth aspect, an embodiment of the present application provides a computer readable storage medium, including computer instructions, when the computer instructions run on an electronic device, causing the electronic device to perform the method described in the first aspect or any possible implementation manner of the first aspect, or perform the method described in the second aspect or any possible implementation manner of the second aspect.

[0064] In a sixth aspect, an embodiment of the present application provides a computer program product including a computer program, when the computer program product includes computer program codes, when the computer program codes run on an electronic device, causing the electronic device to perform the method described in the first aspect or any possible implementation manner of the first aspect, or perform the method described in the second aspect or any possible implementation manner of the second aspect.

[0065] In a seventh aspect, the present application provides a chip system, which is applied to an electronic device, and includes one or more processors configured to invoke computer instructions to cause the electronic device to perform the method described in the first aspect or any possible implementation manner of the first aspect, or perform the method described in the second aspect or any possible implementation manner of the second aspect.

[0066] In a possible implementation, the chip system described above in the present application further includes at least one memory having instructions stored therein. The memory can be a storage unit inside the chip system, such as a register, a cache, etc., or a storage unit of the chip system (for example, a read-only memory, a random access memory, etc.), or perform the method described in the second aspect or any possible implementation manner of the second aspect.

[0067] It should be understood that the third aspect to the seventh aspect of the present application correspond to the technical solutions of the first aspect to the second aspect of the present application, and the beneficial effects obtained by each aspect and the corresponding possible implementation manner are similar, which will not be described again. BRIEF DESCRIPTION OF DRAWINGS

[0068] FIG. 1 is a schematic diagram of a foldable-screen mobile phone according to an embodiment of the present application;

[0069] FIG. 2 is a schematic diagram of a scene according to an embodiment of the present application;

[0070] FIG. 3 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application;

[0071] FIG. 4 is a schematic diagram of a software structure of an electronic device according to an embodiment of the present application;

[0072] FIG. 5-1 is a schematic diagram of an interface for entering a cooperative display according to an embodiment of the present application;

[0073] FIG. 5-2 is a schematic diagram of an interface for entering a cooperative display according to an embodiment of the present application;

[0074] FIG. 5-3 is a schematic diagram of an interface for entering a cooperative display according to an embodiment of the present application;

[0075] FIG. 5-4 is a schematic diagram of an interface for entering a cooperative display according to an embodiment of the present application;

[0076] FIG. 6-1 is a schematic diagram of another interface for entering a cooperative display according to an embodiment of the present application;

[0077] FIG. 6-2 is a schematic diagram of another interface for entering a cooperative display according to an embodiment of the present application;

[0078] FIG. 7 is a schematic diagram of an interface for cooperative interaction according to an embodiment of the present application;

[0079] FIG. 8 is a schematic diagram of an interface for a safety prompt according to an embodiment of the present application;

[0080] FIG. 9 is a schematic diagram of an interface for a prompt cooperative display state according to an embodiment of the present application;

[0081] FIG. 10-1 is a schematic diagram of a cooperative display interface for a floating window in a horizontal screen display according to an embodiment of the present application;

[0082] FIG. 10-2 is a schematic diagram of a cooperative display interface for a floating window in a horizontal screen display according to an embodiment of the present application;

[0083] FIG. 11-1 is a schematic diagram of a cooperative display interface for a floating window in a vertical screen display according to an embodiment of the present application;

[0084] FIG. 11-2 is a schematic diagram of a cooperative display interface for a floating window in a vertical screen display according to an embodiment of the present application;

[0085] FIG. 12 is a schematic diagram of an interface for switching cooperative display content according to an embodiment of the present application;

[0086] FIG. 13-1 is a schematic diagram of an interface for an abnormal scenario according to an embodiment of the present application;

[0087] FIG. 13-2 is a schematic diagram of an interface for an abnormal scenario according to an embodiment of the present application;

[0088] FIG. 14 is a schematic diagram of an interface for cooperative display in a continuation scenario according to an embodiment of the present application;

[0089] FIG. 15 is a schematic diagram of an architecture for inner folding cooperative display according to an embodiment of the present application;

[0090] FIG. 16 is a schematic diagram of module interaction for an interface display method according to an embodiment of the present application;

[0091] FIG. 17 is a schematic diagram of module interaction for exiting cooperative display according to an embodiment of the present application;

[0092] FIG. 18 is a schematic diagram of module interaction for another method of exiting cooperative display according to an embodiment of the present application;

[0093] FIG. 19 is a schematic diagram of module interaction for another interface display method according to an embodiment of the present application;

[0094] FIG. 20 is a schematic diagram of a cooperative display interface according to an embodiment of the present application;

[0095] FIG. 21 is a schematic diagram of a flow of an interface display method according to an embodiment of the present application;

[0096] FIG. 22 is a schematic diagram of a hardware structure of another electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0097] For the purpose of clearly describing the technical solutions of the embodiments of the present application, the following briefly introduces some terms and technologies involved in the embodiments of the present application:

[0098] 1. Suspended window and mini window

[0099] Both the suspended window and the mini window are movable windows displayed on the upper layer of other application interfaces, so as to allow the user to view different applications simultaneously. The mini window and the suspended window are both a form of application display in the foreground, and the window properties of the mini window and the suspended window are both visible. The mini window is a special form of the suspended window, and the size of the suspended window is larger than that of the mini window.

[0100] The suspended window can be an interactive window, and the manner of application control based on the suspended window is the same as that in the full-screen window. For example, the suspended window can respond to the trigger operation performed by the user to realize interface switching, function starting or closing, and the like.

[0101] The mini window can be another interactive window. For example, the mini window is usually used to display an application interface, and the electronic device can respond to the click operation performed by the user on the mini window to display the suspended window corresponding to the mini window, or the electronic device can respond to the double-click operation performed by the user on the mini window to display the application interface in the mini window in full screen. In addition, the mini window cannot respond to the trigger operation performed by the user on the application in the mini window.

[0102] It can be understood that the application can be switched between the suspended window and the mini window. For example, the electronic device can respond to the operation of dragging the suspended window to any corner of the electronic device performed by the user to reduce the suspended window to the mini window. The electronic device can respond to the click operation performed by the user on the mini window to expand the mini window to the suspended window. It can be understood that the manner of switching between the suspended window and the mini window is not limited in the embodiments of the present application.

[0103] 2. Foldable screen device

[0104] The foldable screen device is an electronic device that can realize foldable display form through hinges and flexible screens and the like. The foldable screen device can include at least one display screen, such as an inner screen and an outer screen.

[0105] The inner screen is the main screen displayed after the foldable screen device is unfolded, and is the main display area of the foldable screen device. The inner screen is usually foldable.

[0106] The outer screen, which can also be referred to as a back screen, can be a screen displayed by the folding screen device in a folded state. The outer screen is generally located on the back of the folding screen device, that is, the inner screen and the outer screen are arranged opposite to each other.

[0107] It can be understood that the types of the folding screen device can include a horizontally folded folding screen device, or a vertically folded folding screen device (as described in FIG. 20), and the like. The horizontally folded folding screen device can include an inner folding device (such as an inner folding mobile phone), and an outer folding device (such as an outer folding mobile phone), and the like.

[0108] The inner folding mobile phone can include two display screens, such as an inner screen and an outer screen, and the inner screen is foldable. After the user folds the inner screen inward, the inner screen and the outer screen are arranged opposite to each other, the screen displayed on the outside can be the outer screen, and the screen folded on the inside can be the inner screen. The form of the inner folding mobile phone is similar to that of a flip phone.

[0109] The outer folding mobile phone can include one display screen, such as display screen A, and the display screen A is foldable. After the user folds the display screen A outward, the inner screen and the outer screen are arranged opposite to each other, the display area 1 in the display screen A can constitute the inner screen, and the display area 2 in the display screen A can constitute the outer screen. The display area 1 and the display area 2 do not overlap, and the size of the display area 1 is greater than the size of the display area 2.

[0110] Next, taking the folding screen mobile phone as an example, the inner screen and the outer screen of the inner folding mobile phone are schematically illustrated, and FIG. 1 is a schematic diagram of a folding screen mobile phone provided by an embodiment of the present application.

[0111] When the folding screen mobile phone is in an unfolded state, the front (or front view) of the folding screen mobile phone can be seen from FIG. 1A, and the back (or rear view) of the folding screen mobile phone can be seen from FIG. 1B. The unfolded state can be understood as a state when the folding angle of the folding screen mobile phone is close to 180 degrees (such as 175 degrees, etc.), and the folding angle can be an angle generated when the inner screen is folded.

[0112] The display screen in FIG. 1A can be the inner screen, and the top position of the right half of the inner screen can be provided with a camera 1, which can also be referred to as a front camera, and can collect image data facing the inner screen.

[0113] It can be understood that FIG. 1A can include a dashed line 101, which can be understood as a folding position when the electronic device is folded. The dashed line 101 is not actually displayed in the interface of FIG. 1A, and will not be described again subsequently. Folding the electronic device by the user can be understood as folding the inner screen horizontally along the position of the dashed line 101, so that the electronic device is in a folded state.

[0114] The left region in FIG. 1B can be the backboard of the folding screen mobile phone, and the combined camera 1 can be arranged in the backboard. The number of cameras in the combined camera 1 can be three or the like. Any camera in the combined camera 1 can also be referred to as a rear camera, which can collect image data of the back of the folding screen mobile phone.

[0115] The right region in FIG. 1B can be the outer screen of the folding screen mobile phone, and the camera 2 can be arranged at the top position of the outer screen. The camera 2 can collect image data facing the outer screen.

[0116] When the folding screen mobile phone is in a folded state, the front (or front view) of the folding screen mobile phone can be seen from FIG. 1C, and the back (or rear view) of the folding screen mobile phone can be seen from FIG. 1D. The folded state can be understood as a state in which the folding angle is close to 0 degrees (such as 5 degrees or the like), and the folded state can also be referred to as a closed state.

[0117] The display screen in FIG. 1C can be an outer screen, and the content contained in the outer screen can be referred to the description of the right region in FIG. 1B. FIG. 1D can be the backboard of the folding screen mobile phone, and the content contained in the backboard can be referred to the description of the left region in FIG. 1B.

[0118] When the folding screen mobile phone is in an unfolded state, the folding screen mobile phone can display an interface through the inner screen and the outer screen, or through the inner screen; when the folding screen mobile phone is in a folded state, the folding screen mobile phone can display an interface through the outer screen.

[0119] In a possible implementation, the folding screen mobile phone also has a half-folded state (or referred to as a hovering state), which can be understood as a state in which the folding screen mobile phone is partially folded. In the half-folded state, the folding screen mobile phone can be used as a natural stand, so that the user can realize functions such as photographing, video calling or video watching without holding the mobile phone.

[0120] It can be understood that the embodiments of the present application will be described by taking the folded state and the unfolded state as examples to illustrate the interface display method. The front and back described in FIG. 1 are only used to distinguish different faces of the folding screen mobile phone, and are not intended to limit the embodiments of the present application.

[0121] 3, cooperative display

[0122] The cooperative display can be understood as that the folding screen mobile phone can display related content in different display screens, and when the user performs a triggering operation on one of the display screens, the content in the other display screen can be refreshed synchronously.

[0123] For example, the cooperative display can be understood as that the folding screen phone mirrors the content displayed in the inner screen window to the outer screen, so that the content displayed in the outer screen is the same as the content displayed in the inner screen window, see the description in FIGS. 5-1 to 5-4. In response to the trigger operation in the inner screen window performed by the user, the application interface displayed in the outer screen can be refreshed synchronously with the application interface displayed in the inner screen window, see the description in FIG. 7.

[0124] 4. Other terms

[0125] In the embodiments of the present application, the same items or similar items with basically the same functions and effects are distinguished by using "first", "second", and the like. For example, the first chip and the second chip are only used to distinguish different chips, and do not limit the sequence. Those skilled in the art can understand that "first", "second", and the like do not limit the quantity and execution sequence, and "first", "second", and the like do not necessarily mean different.

[0126] It should be noted that in the embodiments of the present application, "exemplary" or "for example" is used to represent an example, illustration or description. Any embodiment or design scheme described as "exemplary" or "for example" in the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the use of "exemplary" or "for example" is intended to present the relevant concept in a specific manner.

[0127] In the embodiments of the present application, "at least one" means one or more, and "multiple" means two or more. "And / or" describes the association relationship of the associated objects, which means that there can be three kinds of relationships, for example, A and / or B, which can represent the following three cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects. "At least one of the following" or similar expressions means any combination of these items, including any combination of single item or multiple items. For example, at least one of a, b, or c, can represent a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, and c can be single or multiple.

[0128] 5. Electronic device

[0129] The electronic device of the embodiments of the present application can be a device with at least two display screens, etc. The electronic device can also be referred to as a terminal device, a user equipment (UE), a mobile terminal (MT), a user terminal, a terminal, or a user apparatus, etc.

[0130] For example, the electronic device is a foldable-screen mobile phone, a tablet computer, a palm computer, a notebook computer, a mobile internet device (MID), a wearable device, a virtual reality (VR) device, an augmented reality (AR) device, and the like, and the embodiments of the present application are not limited thereto.

[0131] The following takes an inner folding mobile phone as an example to illustrate the use scenario of the interface display method. FIG. 2 is a schematic diagram of a scenario provided by an embodiment of the present application.

[0132] As shown in FIG. 2, the electronic device can include two display screens, namely, an inner screen 201 and an outer screen 202.

[0133] In the case where the electronic device is in an unfolded state, the inner screen 201 can display an interface as shown in FIG. 2A, and the outer screen can be turned off, as shown in FIG. 2B.

[0134] FIG. 2A can be a camera application interface displayed after the electronic device starts the camera application, which can display a preview window 203, a virtual shutter 204, a menu bar 205, and a collaborative shooting control 206, and the like.

[0135] The preview window 203 can be used to display image data collected by a camera in real time. The virtual shutter 204 can be used to receive a shooting operation of a user. The menu bar 205 can display a plurality of shooting mode options, such as a movie, a video, a photograph, a portrait, or a night scene, and the like.

[0136] The collaborative shooting control 206 can be used to trigger the outer screen to synchronously display the content in the preview window 203. The collaborative shooting control 206 shown in FIG. 2A is in an open state.

[0137] As shown in FIG. 2B, the outer screen 202 can be in a black screen state or can also display other content, which is not limited in the embodiments of the present application.

[0138] In response to the triggering operation of the collaborative shooting control 206 performed by the user in FIG. 2A, the electronic device can mirror the preview picture in the preview window 203 to the outer screen 202, so that the inner screen 201 of the electronic device displays an interface as shown in FIG. 2C, and the outer screen 202 displays an interface as shown in FIG. 2D.

[0139] FIG. 2C can include a collaborative shooting control 206' and a preview window 203'. Other content displayed in FIG. 2C can refer to the description in FIG. 2A, which will not be repeated here. The collaborative shooting control 206' shown in FIG. 2C is in a closed state.

[0140] The content in the preview window 203' in FIG. 2D can be displayed or FIG. 2D can also be cropped for the content in the preview window 203'. The content displayed in FIG. 2D is updated synchronously with the content displayed in the preview window 203' in FIG. 2C.

[0141] It can be understood that in the scenario in which the user A uses the electronic device to photograph the user B, the user A can take a photo of the user B by using FIG. 2C, and at this time, the user B can view the photographed picture synchronously by using FIG. 2D to adjust the photographing posture, expression, and the like, thereby obtaining a better photographing experience.

[0142] However, the interface display method described in FIG. 2 can only realize mirroring of the preview stream in the photographing scenario, and has certain limitations.

[0143] Therefore, the embodiment of the present application provides a collaborative implementation manner, so that the electronic device can mirror the content displayed in the inner screen window to the outer screen when receiving an operation of entering the collaborative display, and the content displayed in the outer screen can be updated synchronously with the content displayed in the inner screen window, accompanying the triggering of the user in the inner screen window, so as to improve the limitations of the interface display method and improve the use experience of the user.

[0144] In order to better understand the embodiment of the present application, the structure of the electronic device of the embodiment of the present application is introduced below. For example, FIG. 3 is a schematic diagram of the hardware structure of an electronic device provided by the embodiment of the present application.

[0145] The electronic device can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, an indicator 192, a camera 193, and a display screen 194, and the like.

[0146] The sensor module 180 can include a Hall sensor, which can be used to detect the folding condition of the folding screen mobile phone. For example, the Hall sensor can obtain the folding angle of the electronic device.

[0147] It can be understood that the Hall sensor can be used as an example of detecting the folding condition of the device, and does not limit the embodiment of the present application.

[0148] In a possible implementation, the sensor module 180 can further include one or more of the following: a proximity light sensor, an ambient light sensor, a touch sensor, a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a temperature sensor, a touch sensor, or a bone conduction sensor, etc. (not shown in FIG. 3), which are not limited in the embodiments of the present application.

[0149] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0150] The processor 110 can include one or more processing units, and the processor 110 can implement the steps of executing corresponding instructions in the interface display method provided by the embodiments of the present application.

[0151] The USB interface 130 is an interface conforming to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.

[0152] The charging management module 140 is configured to receive a charging input from a charger. The power management module 141 is configured to connect the charging management module 140 and the processor 110.

[0153] The wireless communication function of the electronic device can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0154] The electronic device implements the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor.

[0155] The display screen 194 is configured to display images, videos, etc. In the embodiments of the present application, the electronic device can include multiple display screens, such as an inner screen and an outer screen. The meanings of the inner screen and the outer screen can be referred to the description in FIG. 1.

[0156] The electronic device can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0157] The camera 193 is configured to capture still images or videos. In the embodiments of the present application, the number of cameras can be multiple, for example, a camera can be arranged in the inner screen, a camera can be arranged in the outer screen, and a camera can be arranged on the back plate, etc. For details, refer to the description in FIG. 1.

[0158] The external memory interface 120 can be used to connect an external memory card. The internal memory 121 can be used to store computer executable program codes, which include instructions.

[0159] The electronic device can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor, etc. For example, music playing, recording, etc.

[0160] The keys 190 include a power key, a volume key, etc.

[0161] The software system of the electronic device can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture, etc. and will not be described here.

[0162] For example, FIG. 4 is a schematic diagram of a software structure of an electronic device according to an embodiment of the present application. As shown in FIG. 4, the layered architecture divides the software into several layers, each of which has a clear role and division of labor. The layers communicate with each other through software interfaces.

[0163] In some embodiments, the Android system is divided into multiple layers, from top to bottom, including an application (APP) layer, an application framework layer (or simply referred to as a framework layer), and a driver layer, etc. The present application does not limit this.

[0164] The application layer can include a series of application packages. The application layer can include one or more of the following: a camera application, a note application, a video application, etc. The present application does not limit this.

[0165] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer.

[0166] The application framework layer includes some predefined interfaces. The application framework layer can include one or more of the following: a device state manager service, a display manager service (DMS), a power manager service (PMS), a window manager service (WMS), a surface flinger, or a floating window framework. The surface flinger can also be referred to as an interface deliverer or a layer processor, and the present application does not limit the surface flinger.

[0167] The device state management module can be configured to receive a device state request initiated by the framework layer, and distribute the device state to the display manager service and the window manager service. The device state management module can also determine the device state based on a sensor data change message initiated by the sensor, and distribute the device state to the display manager service and the window manager service.

[0168] The device state can include one or more of the following: a collaborative display state, a folding state, an unfolding state, and the like. The collaborative display state can be understood as displaying the application interface in the inner screen window on the outer screen by the electronic device.

[0169] The display manager service can be configured to receive a state change message, and determine to power on or power off the display screen based on the state change message. The display manager service can also implement display management of the logical screen 1 and the logical screen 2 in the electronic device. The meanings of the logical screen 1 and the logical screen 2 can be referred to the description in FIG. 15.

[0170] The power manager service can be configured to update the power state of the display screen. The power state can include a power on state or a power off state.

[0171] The window manager service can be configured to perform a plurality of services such as moving out of the mirror layer, scaling the mirror layer, obtaining the layer where the floating window is located, and rotating the mirror layer.

[0172] The window manager service can include a display content (DisplayContent) module, a display rotation (DisplayRotation) module, and a display rotation coordinator (DisplayRotationCoordinator) module.

[0173] The display screen content module can be configured to deliver the folding state to the display screen rotation module; the display screen rotation module can be configured to listen to the rotation direction of the electronic device and calculate the rotation direction of the mirror image layer in the outer screen based on the rotation direction of the electronic device; and the display screen rotation coordination module can be configured to return the rotation direction of the electronic device to the display screen rotation module.

[0174] The display composition system can be configured to perform layer composition processing, mirror image processing on the layers, and deliver messages such as powering on or powering off the display screen.

[0175] It can be understood that the display composition system cannot perform the step of powering on or powering off the display screen alone, but can deliver the message of powering on or powering off the display screen to the driver layer to instruct the display driver to control the powering on or powering off of the display screen.

[0176] The floating window framework can be configured to implement window management for floating windows and mini windows, etc. For example, in response to a user performing a cooperative display operation on a target application, the floating window framework can be configured to initiate a cooperative display state request to the device state management service; or in response to a user performing an operation of closing the floating window, the floating window framework can be configured to initiate a cooperative display state cancellation request to the device state management service.

[0177] The driver layer is a layer between hardware and software. The driver layer is configured to drive the hardware to work. For example, the display driver can be included in the driver layer, and the display driver can be configured to control the powering on or powering off of the display screen.

[0178] In a possible implementation manner, the electronic device can include a hardware layer, which is not shown in FIG. 4. For example, the hardware layer can include one or more of the following: an organic light-emitting diode (OLED) 1 and an OLED 2. The OLED 1 can constitute an inner screen, and the OLED 2 can constitute an outer screen.

[0179] It can be understood that the software layers involved in the software architecture, the modules included in the software layers, and the roles of the modules are not limited in the embodiments of the present application.

[0180] The technical solutions of the present application and how the technical solutions of the present application solve the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be implemented independently, or can be combined with each other. For the same or similar concepts or processes, some embodiments can not be described again.

[0181] In the embodiments of the present application, the electronic device is taken as a folding screen mobile phone as shown in FIG. 1 as an example for illustration, which does not constitute a limitation on the embodiments of the present application.

[0182] The embodiment of the present application provides an interface display method, so that the electronic device can realize cooperative display of the inner screen window and the outer screen. The interface changes involved in the cooperative display process are described below.

[0183] 1. Entering cooperative display (Fig. 5-1 to Fig. 6-2)

[0184] For example, in response to a multi-finger sliding window operation performed by the user, the electronic device enters the cooperative display (see the description in Fig. 5-1 to Fig. 5-4). Alternatively, in response to an operation of dragging the window to a preset area performed by the user, the electronic device enters the cooperative display (see the description in Fig. 6-1 and Fig. 6-2).

[0185] Optionally, in response to other trigger operations performed by the user, the electronic device enters the cooperative display. The other trigger operations can include one or more of the following: a tapping operation on the inner screen or the outer screen, a circle selection operation on the inner screen or the outer screen, a hand-free gesture operation, an operation of staring at the inner screen or the outer screen, or a trigger operation on a hardware switch, etc. The embodiment of the present application does not limit the way of entering the cooperative display.

[0186] Fig. 5-1 to Fig. 5-4 are interface diagrams of entering the cooperative display provided by the embodiment of the present application.

[0187] In the case that the electronic device is in the unfolded state, the electronic device can display the interface as shown in Fig. 5A on the inner screen, and the outer screen is in the off-screen state, such as the interface shown in Fig. 5B.

[0188] As shown in Fig. 5A, the interface can display: a camera application interface, and a floating window 500 overlaid on the camera application interface. The floating window 500 can display: a homepage of a note application, and at least one floating window control control, etc.

[0189] The homepage of the note application can include: note 1, note 2, note 3, and a control for creating a note (such as the control in the lower right corner of the floating window 500), etc.

[0190] The floating window control control includes one or more of the following: a maximize control 502, a minimize control 503, a drag control (or top bar) 504, or a close control 505. The maximize control 502 is used to full-screen display the application interface in the floating window, the minimize control 503 is used to reduce the floating window to a floating ball, the drag control 504 is used to drag the floating window to any position in the interface, and the close control 505 is used to close the floating window.

[0191] In response to a click operation performed by the user on note 1 in Fig. 5A, the electronic device can display the interface as shown in Fig. 5C on the inner screen, and the outer screen is in the off-screen state, such as Fig. 5D.

[0192] As shown in FIG. 5C, the interface can display: a camera application interface, and a floating window 501 overlaid on the camera application interface, the camera application interface is displayed in full screen, that is, the camera application interface is displayed in a full screen window. The floating window 501 can display: a note application interface, and at least one floating window operation control, etc.

[0193] The content displayed in the camera application interface can refer to the description in FIG. 2A, which will not be repeated here. The note application interface can include: note information, and note operation controls. As shown in the note information, the title of the note (such as Note 1), the time of creating the note (such as today 8:00), the note text (such as 1, AAAA, 2, BBBB, 3, CCCC), etc. The note operation controls can include one or more of the following: a return control (such as the control below the maximize control 502), a sharing control (such as the control at the bottom left of the floating window 501), or a more control (such as the control at the bottom right of the floating window 501), etc.

[0194] It can be understood that the camera application interface displayed below the floating window 501 is only an example, and other application interfaces can also be displayed below the floating window 501, etc., and the embodiments of the present application do not limit this. For example, the desktop interface provided by the desktop application, the video playing interface provided by the video playing application, or the interface provided by the shopping application, etc. can be displayed below the floating window 501.

[0195] In response to the operation of the user performing the multi-finger sliding of the floating window 501 in FIG. 5C, the inner screen of the electronic device can display the interface as shown in FIG. 5E, and the outer screen of the electronic device can display the interface as shown in FIG. 5F.

[0196] The operation of the multi-finger sliding of the floating window 501 can include: the operation of the three-finger up sliding (or down sliding) of the floating window 501, the operation of the three-finger horizontal sliding (or vertical sliding) of the floating window 501, the operation of the two-finger up sliding (or down sliding) of the floating window 501, or the operation of the two-finger horizontal sliding (or vertical sliding) of the floating window, etc. The specific form of the multi-finger sliding operation is not limited in the embodiments of the present application. Wherein, the horizontal sliding can be understood as the sliding along the horizontal direction (or the horizontal direction) of the display screen, and the vertical sliding can be understood as the sliding along the vertical direction (or the vertical direction) of the display screen.

[0197] For example, in response to the operation of the three-finger up sliding of the user performing on the floating window 501 in FIG. 5C, the electronic device can mirror the application interface in the floating window 501 to the outer screen, so that the outer screen displays the interface as shown in FIG. 5F.

[0198] It can be understood that the gesture in FIG. 5C (such as a five-finger splay gesture) can be marked with three arrows, which can be used to illustrate that the multi-finger sliding operation can be a three-finger sliding operation. The gesture and the three arrows are only used to illustrate the user gesture operation and are not actually displayed in FIG. 5C. Subsequent similar gestures will not be described again.

[0199] In a possible implementation, in response to the user performing the three-finger upward sliding operation on the floating window 501 in FIG. 5C, the electronic device can reduce the floating window 501 to a mini window and display the mini window at the top left corner (or the top right corner) in FIG. 5C. Alternatively, in response to the user performing the three-finger downward sliding operation on the floating window 501 in FIG. 5C, the electronic device can reduce the floating window 501 to a mini window and display the mini window at the bottom left corner (or the bottom right corner) in FIG. 5C, and the like. In this way, the user can control the display position of the mini window when entering the collaborative display function through gesture operation, improving the flexibility of operation.

[0200] As shown in FIG. 5E, the interface can display: a camera application interface, and a mini window 506 overlaid on the camera application interface. The application interface displayed in the mini window 506 is the same as the application interface displayed in the floating window 501. In this way, after entering the collaborative display, the user can determine the content displayed on the outer screen based on the mini window 506, and the display area occupied by the mini window 506 is small, which is also convenient for the user to view other content in other display areas in FIG. 5E.

[0201] Optionally, the prompt information 50 (not shown in FIG. 5E) for prompting that the device is in the collaborative display state can also be displayed in FIG. 5E. The prompt information 50 can be set at any position of FIG. 5E, such as the top or bottom of FIG. 5E.

[0202] The outer frame around the mini window 506 can be displayed in a thick line and / or in a colored line, or the inside of the mini window 506 can be displayed in any background color, and the like. For example, the outer frame line of the mini window 506 can be thicker than the outer frame line of the floating window 501; or the outer frame color of the mini window 506 can be different from the outer frame color of the floating window 501. In this way, the user can determine that the content in the mini window 506 has been mounted on the outer screen through the form of the mini window.

[0203] It can be understood that the mini window 506 can be automatically set at the top right; or in the case that other mini windows are already displayed at the top right of FIG. 5C, in response to the user performing the multi-finger sliding operation in FIG. 5C, the mini window 506 can be automatically set at other corners such as the top left corner.

[0204] After entering the collaborative display, the mini-window 506 can be moved to other positions based on the user's dragging operation. In this way, the blocking of the mini-window 506 to other display contents in FIG. 5E can be reduced.

[0205] Optionally, after entering the collaborative display, the electronic device can also highlight the outer frame of the floating window 501 in the inner screen, and display the interface as shown in FIG. 5F in the outer screen. In this scenario, the electronic device can not display the mini-window 506. Further, in response to the user's operation of dragging the highlighted floating window 501 to any corner of the inner screen in FIG. C, the electronic device can display the interface as shown in FIG. 5E in the inner screen, and continue to display the interface as shown in FIG. 5F in the outer screen. The highlighting includes bold display and / or color line display.

[0206] As shown in FIG. 5F, the interface can display a note application interface, which can be the same as the note application interface in the floating window 501.

[0207] The note application interface in FIG. 5F can be displayed at the top position of the outer screen, or can also be displayed at the middle position of the outer screen. In the case where the note application interface is displayed at the top position of the outer screen, the lower side of the note application interface in the outer screen can be displayed as white or black, etc.; or in the case where the note application interface is displayed at the middle position of the outer screen, the upper side and the lower side of the note application interface in the outer screen can be displayed as white or black, etc., which is not limited in the embodiments of the present application.

[0208] Optionally, the top position of the interface in FIG. 5F can not display a status bar. Alternatively, the top position of the interface in FIG. 5F can also display a status bar. The status bar can display one or more of the following identifiers: a WIFI identifier, time information, an operator identifier, a power level identifier, or a notification identifier, etc., which is not limited in the embodiments of the present application.

[0209] Optionally, in response to the user's operation of dragging the floating window 501 to the upper right corner of the inner screen in FIG. 5C, the electronic device can display the interface as shown in FIG. 5G in the inner screen, and the outer screen is in an off-screen state, which can be as shown in FIG. 5H. As shown in FIG. 5G, the interface can include a camera application interface and a mini-window 507 overlaid on the camera application interface.

[0210] It can be understood that, referring to the interfaces shown in FIG. 5E and FIG. 5G, the outer frame around the mini-window 506 can be displayed in a thick line and / or a colored line, the outer frame around the mini-window 507 can not be displayed in a thick line and / or a colored line; the inside of the mini-window 506 can be displayed in any background color, the inside of the mini-window 507 is not displayed in any background color; the prompt information 50 can be displayed in FIG. 5E, and the prompt information 50 can not be displayed in FIG. 5G. The color of the outer frame around the mini-window 506 can be different from the color of the outer frame around the mini-window 507.

[0211] It should be noted that, in the case that the electronic device enters the collaborative display based on the floating window 501, the outer frame around the mini-window 506 can be highlighted, so that the user can determine that the device has entered the collaborative display through the outer frame around the mini-window 506. In the case that the electronic device reduces the floating window 501 to the mini-window 507, the outer frame around the mini-window 507 is not highlighted, at this time the user can determine that the device has not entered the collaborative display through the outer frame around the mini-window 507.

[0212] Based on this, in response to the multi-finger sliding operation performed by the user in FIG. 5A, the electronic device can mirror the application interface in the window to the outer screen, facilitating the user to view the application interface in the inner screen window on the outer screen, so as to improve the limitation of using the folding screen mobile phone. For example, in the video recording scene, user A can use the rear camera to shoot user B, user A can open the note application interface in the floating window and enter the collaborative display, at this time user B can see the note application interface in the outer screen, and determine the content to be said in the video recording process based on the note application interface, at this time the outer screen is equivalent to a teleprompter, improving the user experience.

[0213] It should be noted that, the interface display method provided by the embodiments of the present application can be applied to an electronic device in an unfolded state, or applied to an electronic device in a hovering state. In the case that the electronic device is in a hovering state, the electronic device can display the interface shown in FIG. 5C or FIG. 5E in part of the display area of the inner screen, or can also display the interface shown in FIG. 5C or FIG. 5E in the entire display area of the inner screen.

[0214] FIG. 6-1 and FIG. 6-2 are another interface for entering the collaborative display provided by the embodiments of the present application.

[0215] In one implementation, in response to the operation of dragging the floating window 501 to the area 600 based on the top bar 504 performed by the user in FIG. 5C, the electronic device can display the interface shown in FIG. 6A on the inner screen, and the outer screen is in the off-screen state, as shown in FIG. 6B.

[0216] The area 600 can be understood as an area containing the area 601 in FIG. 6A, the preset area 602, and the area 603. The shape of the area 600 can be a rectangle or a rounded rectangle, etc. The border of the area 600 (the border can be a dashed line or a solid line) can be displayed in FIG. 6A or can not be displayed in FIG. 6A.

[0217] As shown in FIG. 6A, the top of the interface can display: the area 601 on the left side, the preset area 602 in the middle position, and the area 603 on the right side. The application interface displayed below the floating window 501 in FIG. 6A can be in a blurred or blurred state.

[0218] The area 601 can display the word "split screen" or can not display any word. The user can trigger the camera application interface and the content in the floating window 501 to be split into left and right or top and bottom by dragging the floating window to the area 601. The area 603 can display the word "mini window" or can not display any word. The user can reduce the floating window to a mini window by dragging the floating window to the area 603.

[0219] The preset area 602 can display the word "dual-screen collaboration" or "collaborative display" or can not display any word. The user can trigger the collaborative display by dragging the floating window into the preset area 602, that is, mirroring the application interface displayed in the floating window to the outer screen.

[0220] It can be understood that the preset area 602 can also be arranged at the left side, the right side, or the bottom end of the interface as shown in FIG. 6A. The display position, area size, area shape, etc. of the preset area 602 are not limited in the embodiments of the present application.

[0221] In the case that the dragging operation continues to act on the dragging control 504, in response to the operation of the user dragging the floating window 501 to the preset area 602 in FIG. 6A, when the user does not release the hand, the electronic device can display the interface as shown in FIG. 6C on the inner screen and turn off the screen as shown in FIG. 6D on the outer screen. Further, when the user releases the hand, the electronic device can display the interface as shown in FIG. 5E on the inner screen and display the interface as shown in FIG. 5F on the outer screen, completing the dual-screen collaboration.

[0222] As shown in FIG. 6C, the floating window 501 can perform a reduction animation following the hand. At this time, the floating window 501 can be reduced to a window 604, and other content can also be displayed in the preset area 602, such as the word "lift your hand to enter dual-screen collaboration". It can be understood that after entering the collaborative display, the floating window will be reduced to a mini window. Therefore, the electronic device can perform a reduction animation following the hand when receiving the operation of the user dragging the floating window to the preset area 602, and reduce the floating window until it is reduced to a mini window, to prompt the user that the subsequent collaborative display will be entered.

[0223] Based on this, the electronic device can set the preset area 602, so that the electronic device triggers the cooperative display after detecting that the user can drag the floating window to the preset area 602, facilitating the user to view the application interface on the outer screen.

[0224] In another implementation, the electronic device can display the interface as shown in FIG. 6E on the inner screen, and the outer screen is in the off-screen state. The note application interface can be displayed in FIG. 6E.

[0225] In response to the operation of swiping up from the bottom of the inner screen performed by the user in FIG. 6E, the electronic device can display the operation as shown in FIG. 6F on the inner screen, and the outer screen is in the off-screen state. FIG. 6F can include: area 601, area 602, area 603, and window 610, and the note application interface is displayed in window 610.

[0226] During the changes of FIG. 6E to FIG. 6F, areas 601, 602, and 603 gradually appear; as the user gradually drags window 610 upwards, areas 601, 602, and 603 gradually increase; as the user gradually drags window 610 upwards, window 610 performs a shrinking animation effect.

[0227] In response to the operation of continuing to drag window 610 into area 602 performed by the user in FIG. 6F, the electronic device can display the interface as shown in FIG. 6G on the inner screen, and display the interface as shown in FIG. 5H on the outer screen. As shown in FIG. 6G, the interface can include: a desktop interface and a mini window 611 overlaid on the desktop interface, the outer frame around the mini window 611 can be displayed in bold, and the desktop interface can include: an identifier 613 of the camera application and identifiers of other applications.

[0228] In response to the triggering operation performed by the user on identifier 613 in FIG. 6G, the electronic device can display the interface as shown in FIG. 5E on the inner screen, and continue to display the interface as shown in FIG. 5F on the outer screen.

[0229] 2. Content synchronization after entering cooperative display (FIG. 7)

[0230] After the electronic device enters the cooperative display, in response to the operation of swiping up the application interface performed by the user in the floating window 501 of FIG. 7A, the electronic device can display the floating window 501 in FIG. 7A, and in response to the operation of swiping up performed by the user in the floating window 501 of FIG. 7A, the electronic device can display the floating window 701 and update the application interface in the floating window 701 to the outer screen.

[0231] FIG. 7 is a schematic diagram of a cooperative interaction interface provided by an embodiment of the present application.

[0232] After the electronic device enters the collaborative display, in response to the click operation performed by the user in FIG. 5E on the mini-window 506, the electronic device can display the interface shown in FIG. 7A on the inner screen and the interface shown in FIG. 7B on the outer screen. The content displayed in FIG. 7A can refer to the description in FIG. 5C, and the content displayed in FIG. 7B can refer to the description in FIG. 5F, which will not be repeated here.

[0233] In response to the up swipe operation performed by the user on the floating window 501 in FIG. 7A to switch the application interface, the electronic device can display the interface shown in FIG. 7C on the inner screen and the interface shown in FIG. 7D on the outer screen.

[0234] As shown in FIG. 7C, more note content in the note application can be displayed in the floating window 701. For example, compared with the note application interface in the floating window 501 in FIG. 7A, the content such as "4, DDDD, 5, EEEE" can be added in the floating window 701 in FIG. 7C. The application interface displayed in FIG. 7D is the same as the application interface displayed in the floating window 701 in FIG. 7C, which will not be repeated here.

[0235] Optionally, in response to the operation of the user to view other notes in the floating window 501 in FIG. 7A, the electronic device can also display other note content in the outer screen to realize the synchronization of the application interface.

[0236] Optionally, in response to the trigger operation performed by the user on the outer screen, the electronic device can update the display content in the outer screen and mirror the display content in the outer screen to the floating window or the mini-window of the inner screen. The trigger operation on the outer screen can be a click operation, a sliding operation, or an operation of inputting information in the outer screen, etc. In this scenario, the electronic device can synchronize the content of the outer screen to the window of the inner screen based on the trigger operation of the user on the outer screen to realize the collaborative display of the outer screen and the window of the inner screen.

[0237] Optionally, the outer frame around the floating window 501 and the floating window 701 can be highlighted to help the user determine that the collaborative display has been entered through the state of the outer frame around the floating window.

[0238] Based on this, in response to the operation performed by the user on the inner screen, the application interface in the floating window can be updated synchronously with the application interface in the outer screen, so that the user can view the updated application interface in the outer screen in real time.

[0239] 3. Unable to enter collaborative display (FIG. 8)

[0240] The electronic device can also display a transfer interface in a financial application (such as the interface displayed in the inner screen pop-up window 801 in FIG. 8A) in the inner screen pop-up window, and the outer screen can be in an off-screen state, such as the outer screen shown in FIG. 8B. In response to the operation of entering the collaborative display performed by the user, the electronic device can prompt the user that collaborative display cannot be performed when it is determined that the application interface in the pop-up window 801 is a secure and private interface.

[0241] It can be understood that the electronic device can prompt the user that collaborative display cannot be performed in the inner screen and / or the outer screen.

[0242] In an implementation, in response to the operation of multi-finger sliding the pop-up window 801 performed by the user in FIG. 8A, when the electronic device determines that the application interface in the pop-up window 801 is marked with a secure and private flag (such as flag_secure), the electronic device can display the interface shown in FIG. 8C in the inner screen and the interface shown in FIG. 8D in the outer screen.

[0243] As shown in FIG. 8C, the interface can include a display mini-window 802, and other content displayed in the interface can be similar to that in FIG. 2A, which will not be described here. The outer frame around the mini-window 802 can display a thick line, or the outer frame around the mini-window 802 can not be displayed with a thick line, which is not limited in the embodiments of the present application.

[0244] As shown in FIG. 8D, the interface can display a prompt information 803, which is used to prompt the user that the mirrored interface is a secure and private interface and does not support collaborative display.

[0245] In another implementation, in response to the operation of multi-finger sliding the pop-up window 801 performed by the user in FIG. 8A, when the electronic device determines that the application interface in the pop-up window 801 is marked with flag_secure, the electronic device can also display the prompt information 803 in the inner screen, and the outer screen can remain off at this time. In this scenario, the electronic device can cancel the power-on process for the outer screen, reducing power waste.

[0246] In another implementation, in response to the operation of multi-finger sliding the pop-up window 801 performed by the user in FIG. 8A, when the electronic device determines that the application interface in the pop-up window 801 is marked with flag_secure, the electronic device can also display the prompt information 803 in the inner screen and the outer screen at the same time, which is not limited in the embodiments of the present application.

[0247] Based on this, the electronic device determines whether to enter collaborative display according to the attributes of the interface, and prompts the user when it is determined that collaborative display cannot be entered, so as to improve the user experience of using the collaborative display function.

[0248] 4, Status prompt after entering collaborative display (FIG. 9)

[0249] After entering the collaborative display, in response to an operation of opening the notification center performed by the user, the electronic device can display prompt information for prompting that the current is in the collaborative display state on the inner screen. The operation of opening the notification center can include an operation of swiping down from the upper left corner of the inner screen, and the like.

[0250] FIG. 9 is a schematic diagram of an interface for prompting the collaborative display state according to an embodiment of the present application.

[0251] In response to the operation of opening the notification center performed by the user in FIG. 5E, the electronic device can display the interface shown in FIG. 9A on the inner screen, and continue to display the interface shown in FIG. 9B on the outer screen. As shown in FIG. 9A, the notification center of the interface can include prompt information 901, which can be used to indicate that the current is in the collaborative display state. A quit control 902 can be displayed around the prompt information 901, and the quit control 902 can be used to quit the collaborative display state.

[0252] Optionally, other information can also be displayed around the prompt information 901, such as time information for indicating the collaborative display duration, and / or an application identifier for displaying the collaborative display, and the like, which are not limited in the embodiments of the present application.

[0253] Optionally, the prompt information 901 and the quit control 902 can also be displayed at any position of FIG. 5E, so that the user can determine that the current is in the collaborative display state without opening the notification center.

[0254] Optionally, in response to a triggering operation performed by the user on the quit control 902 in FIG. 9A, the electronic device can end the collaborative display and power off the outer screen. The electronic device can display the interface shown in FIG. 9C on the inner screen, and the outer screen is in the off state, as shown in FIG. 9D. At this time, compared with FIG. 5E, the outer frame around the mini window 903 in FIG. 9C is not displayed in bold, and the like. In the embodiments of the present application, the interface displayed by the electronic device after quitting the collaborative display based on the quit control 902 is not limited.

[0255] In a possible implementation, the electronic device can also quit the collaborative display state when detecting at least one of the following quit operations, for example, the quit operation can include one or more of the following: an operation of folding the electronic device, an operation of turning off the inner screen, an operation of switching the floating window to a floating ball when the window is in the floating window state, an operation of switching the mini window to a floating ball when the window is in the mini window state, an operation of full-screen displaying the content in the floating window when the window is in the floating window state, or an operation of closing the floating window when the window is in the mini window state, and the like. It can be understood that after the electronic device quits the collaborative display state based on the preset quit operation, the outer screen can be turned off.

[0256] For example, the operation of switching the floating window to a floating ball can include triggering operation of the minimize control 503 in FIG. 5, and the like. The operation of full-screen displaying the content in the floating window can include triggering operation of the maximize control 502 in FIG. 5, and the like. The operation of closing the floating window can include triggering operation of the close control 505 in FIG. 5, and the like.

[0257] Based on this, the user can determine the state of the electronic device according to the prompt information 901 in the notification center, and trigger the exit control 902 when it is needed to exit the collaborative state.

[0258] 5. Device rotation after entering collaborative display (FIGS. 10-1 to 11-2)

[0259] After entering the collaborative display, the electronic device can determine how to display the content in the floating window on the outer screen according to the display direction of the floating window and the display direction of the outer screen. For example, in the case that the floating window is in a landscape display, the electronic device can perform collaborative display according to the description in FIGS. 10-1 and 10-2; or in the case that the floating window is in a portrait display, the electronic device can perform collaborative display according to the description in FIGS. 11-1 or 11-2.

[0260] The display method of the outer screen can also be understood as the display direction of the electronic device, that is, in the case that the electronic device is in a portrait state, the outer screen is in a portrait state and the inner screen is in a portrait state, and in the case that the electronic device is in a landscape state, the outer screen is in a landscape state and the inner screen is in a portrait state.

[0261] FIGS. 10-1 and 10-2 are a collaborative display interface schematic diagram of a floating window in a landscape display according to an embodiment of the present application.

[0262] The electronic device can display an interface as shown in FIG. 10A on the inner screen, which can display a floating window 1001, and the floating window 1001 can display video content in any application. For example, the floating window 1001 can be in a landscape state, or it can be understood that the floating window 1001 can display video 1 in a landscape display, and the present application does not limit the content displayed in the floating window 1001. FIG. 10A can be an interface displayed on the inner screen of the electronic device in a portrait state.

[0263] In the case of the in-screen display of the electronic device as shown in FIG. 10A, the out-screen display of the electronic device is as shown in the interface of FIG. 10B. As shown in FIG. 10B, the out-screen is in a portrait screen state, the camera can be located at the top position in the out-screen, the video 1 can be displayed in a landscape screen state in the middle position of the out-screen, and the upper and lower sides of the video 1 can not display any content (for example, the upper and lower sides of the video 1 can be black) or can be displayed as white or other conditions. FIG. 10B can be understood as an interface displayed when the electronic device does not rotate, for example, the rotation angle of the electronic device at this time can be 0 degrees, that is, the electronic device does not rotate.

[0264] As described in FIG. 10A and FIG. 10B, because the floating window 1001 is in a landscape screen state and the out-screen is in a portrait screen state (or can be understood as the display direction of the floating window is different from the display direction of the out-screen), the video 1 can be displayed in a landscape screen state in the middle region of the out-screen after scaling, and at this time the video 1 cannot be displayed in full screen in the out-screen.

[0265] Optionally, in the case that the display direction of the floating window is different from the display direction of the out-screen, the interface shown in FIG. 10A (or FIG. 10B, or FIG. 10E, or FIG. 10F, etc.) can also display prompt information 1 (not shown in FIG. 10), which is used to prompt the user to rotate the display screen to obtain a better visual experience.

[0266] In the case of the in-screen display as shown in FIG. 10A and the out-screen display as shown in FIG. 10B, in response to the user rotating the electronic device by 90 degrees clockwise, the electronic device can display the in-screen as shown in FIG. 10C and the out-screen as shown in FIG. 10D.

[0267] As shown in FIG. 10C, the in-screen is in a landscape screen state, and the camera can be located at the right side position in the in-screen; as shown in FIG. 10D, the out-screen is in a landscape screen state, and the camera can be located at the right side position in the out-screen, and the video 1 can be displayed in full screen in the out-screen. At this time, the rotation angle of the electronic device can be 90 degrees. In this way, the floating window 1001 is in a landscape screen state and the out-screen is in a landscape screen state (or can be understood as the display direction of the floating window is the same as the display direction of the out-screen), and the content in the floating window 1001 can be displayed in full screen in the out-screen, which is convenient for the user to view.

[0268] In the case of the in-screen display as shown in FIG. 10C and the out-screen display as shown in FIG. 10D, in response to the user rotating the electronic device by 90 degrees clockwise, the electronic device can display the in-screen as shown in the interface of FIG. 10E and the out-screen as shown in the interface of FIG. 10F.

[0269] As shown in FIG. 10E, the in-screen is in a portrait screen state, and the camera can be located at the bottom position in the in-screen; as shown in FIG. 10F, the out-screen is in a portrait screen state, and the camera can be located at the bottom position in the out-screen, and the video 1 cannot be displayed in full screen in the out-screen. At this time, the rotation angle of the electronic device can be 180 degrees.

[0270] In the case of the inner screen display as shown in FIG. 10E and the outer screen display as shown in FIG. 10F, in response to the user rotating the electronic device by 90 degrees clockwise, the electronic device can display the interface as shown in FIG. 10G on the inner screen and display the interface as shown in FIG. 10H on the outer screen.

[0271] As shown in FIG. 10G, the inner screen is in a landscape state, and the camera can be located at the left side of the inner screen; as shown in FIG. 10H, the outer screen is in a landscape state, and the camera can be located at the left side of the outer screen, and video 1 can be displayed full screen on the outer screen. At this time, the rotation angle of the electronic device can be 270 degrees. In this way, the floating window 1001 is in a landscape state and the outer screen is in a landscape state (or it is understood that the display direction of the floating window is the same as the display direction of the outer screen), and the content in the floating window 1001 can be displayed full screen on the outer screen, facilitating the user to view.

[0272] Similarly, FIGS. 11-1 and 11-2 are schematic diagrams of a cooperative display interface provided by an embodiment of the present application when a floating window is in a portrait display state.

[0273] The electronic device can display the interface as shown in FIG. 11A on the inner screen, which can display a floating window 1101, and the floating window 1101 can display video content in any application. For example, the floating window 1101 can be in a portrait state, or it is understood that the floating window 1101 can display video 2 in a portrait state, and embodiments of the present application do not limit the content displayed in the floating window 1101.

[0274] It can be understood that FIG. 11A can be an interface displayed on the inner screen of the electronic device in a portrait state. When the electronic device is in a landscape state, the electronic device can also display the floating window 1101 in a portrait state on the inner screen. At this time, the content displayed on the inner screen can be similar to that in FIG. 11C, which will not be described herein.

[0275] In the case of the inner screen display as shown in FIG. 11A, the outer screen of the electronic device displays the interface as shown in FIG. 11B. As shown in FIG. 11B, the outer screen is in a portrait state, and the camera can be located at the top of the outer screen in FIG. 11B, and video 2 can be displayed full screen on the outer screen. FIG. 11B can be understood as an interface displayed when the electronic device does not rotate, for example, the rotation angle of the electronic device can be 0 degrees. In this way, the floating window 1101 is in a portrait state and the outer screen is in a portrait state (or it is understood that the display direction of the floating window is the same as the display direction of the outer screen), and the content in the floating window 1101 can be displayed full screen on the outer screen, facilitating the user to view.

[0276] In the case of the inner screen display as shown in FIG. 11A and the outer screen display as shown in FIG. 11B, in response to the user rotating the electronic device by 90 degrees clockwise, the electronic device can display the interface as shown in FIG. 11C on the inner screen and display the interface as shown in FIG. 11D on the outer screen.

[0277] As shown in FIG. 11C, the inner screen is in a landscape state, and the camera can be located at the right side of the inner screen in FIG. 11C; as shown in FIG. 11D, the outer screen is in a landscape state, and the camera can be located at the right side of the outer screen in FIG. 11D, and the video 2 cannot be displayed in full screen on the outer screen, and the left and right sides of the video 2 can not display any content (or be understood as the left and right sides of the video 2 can be black). At this time, the rotation angle of the electronic device can be 90 degrees.

[0278] Optionally, as described in FIG. 11C and FIG. 11D, in the case that the display direction of the floating window is different from the display direction of the outer screen, the prompt information 1 can also be displayed in FIG. 11C (or FIG. 10D, or FIG. 11G, or FIG. 11H), and the content of the prompt information 1 can be referred to the description in FIG. 10-1.

[0279] In the case that the inner screen displays as shown in FIG. 11C and the outer screen displays as shown in FIG. 11D, in response to the user rotating the electronic device by 90 degrees clockwise, the electronic device can display as shown in FIG. 11E on the inner screen and as shown in FIG. 11F on the outer screen.

[0280] As shown in FIG. 11E, the inner screen is in a portrait state, and the camera can be located at the bottom of the inner screen in FIG. 11E; as shown in FIG. 11F, the outer screen is in a portrait state, and the camera can be located at the bottom of the outer screen in FIG. 11F, and the video 2 can be displayed in full screen on the outer screen. At this time, the rotation angle of the electronic device can be 180 degrees. In this way, the floating window 1101 is in a portrait state and the outer screen is in a portrait state (or be understood as the display direction of the floating window is the same as the display direction of the outer screen), and the floating window 1101 can be displayed in full screen on the outer screen, which is convenient for the user to view.

[0281] In the case that the inner screen displays as shown in FIG. 11E and the outer screen displays as shown in FIG. 11F, in response to the user rotating the electronic device by 90 degrees clockwise, the electronic device can display as shown in FIG. 11G on the inner screen and as shown in FIG. 11H on the outer screen.

[0282] As shown in FIG. 11G, the inner screen is in a landscape state, and the camera can be located at the left side of the inner screen in FIG. 11G; as shown in FIG. 11H, the outer screen is in a landscape state, and the camera can be located at the left side of the outer screen in FIG. 11H, and the video 2 cannot be displayed in full screen on the outer screen. At this time, the rotation angle of the electronic device can be 270 degrees.

[0283] Based on the description in FIG. 10-1 to FIG. 11-2, when the display direction of the floating window is different from the display direction of the outer screen, the electronic device can prompt the user to rotate the phone on the inner screen (or the outer screen) to obtain a better experience; or when the display direction of the floating window is the same as the display direction of the outer screen, the content in the floating window can be displayed in full screen on the outer screen, which is convenient for the user to view.

[0284] It can be understood that the positions of the cameras in the display screen described in FIGS. 10-1 to 11-2 can be understood as the positions of the cameras relative to the user when the user faces the display screen. For example, the camera in the right position in the outer screen can be understood as being on the right hand side of the user when the user faces the outer screen; the camera in the top position in the inner screen can be understood as being on the upper side of the user's line of sight when the user faces the inner screen, and the like. Similar positional relationships will not be described here.

[0285] 6. Switching the display content in the outer screen after entering the collaborative display (FIG. 12)

[0286] After the electronic device enters the collaborative display based on the corresponding embodiments of FIGS. 5 and 6, the electronic device can also switch the content displayed in the outer screen during the collaborative display, as described in FIG. 12.

[0287] For example, FIG. 12 is a schematic diagram of an interface for switching the content of the collaborative display provided in an embodiment of the present application.

[0288] In response to the operation of opening another floating window performed by the user in FIG. 5E, the electronic device displays the interface shown in FIG. 12A in the inner screen, and displays the interface shown in FIG. 12B in the outer screen. As shown in FIG. 12A, the interface can include: a floating window 1201, and the floating window 1201 can display: a social application interface, and at least one floating window control control. The floating window control control or other content displayed in FIG. 12A can be referred to the description in FIG. 5E, and the content displayed in FIG. 12B can be referred to the description in FIG. 5F.

[0289] In response to the operation of displaying the floating window 1201 in the outer screen by the user in FIG. 12A, the electronic device displays the interface shown in FIG. 12C in the inner screen, and displays the interface shown in FIG. 12D in the outer screen. The operation of displaying the floating window 1201 in the outer screen by the user is the same as the operation of displaying the floating window 501 in the outer screen by the user, as described in FIGS. 5 and 6.

[0290] As shown in FIG. 12C, the interface can include a mini window 1202, and the application interface displayed in the mini window 1202 can be the same as the application interface displayed in the floating window 1201. Other content displayed in FIG. 12C can be referred to the description in FIG. 5E.

[0291] It can be understood that, since the mini window 506 has been displayed in the upper right corner of the inner screen (as described in FIG. 5E), the mini window 1202 can be displayed in the upper left corner of the inner screen or in other corners of the inner screen, which is not limited in the embodiments of the present application. In addition, the outer frame around the mini window 506 is not displayed in bold, and the outer frame around the mini window 1202 is displayed in bold lines to prompt the user that the content displayed in the outer screen is the application interface in the mini window 1202.

[0292] Optionally, after the user switches the content displayed in the application interface of the outer screen from the content in the mini-window 506 to the content in the mini-window 1202, the electronic device can also prompt the user whether to close the mini-window 506 (or close the floating window 1201) to simplify the content displayed in the interface.

[0293] As shown in FIG. 12D, the interface can display a social application interface. The application interface displayed in FIG. 12D can be the same as the application interface displayed in the floating window 1201 and the application interface displayed in the mini-window 1202.

[0294] It can be understood that FIG. 12 can be an example of mounting two mini-windows in the electronic device. Optionally, when the electronic device allows mounting more mini-windows, the electronic device can also support displaying the content in other mini-windows in cooperation on the outer screen. The specific implementation process is not described here.

[0295] Based on this, in response to the operation of triggering the cooperative display performed by the user again, the electronic device can switch the content displayed in cooperation on the outer screen, so that the user can adjust the content displayed in cooperation at any time according to the needs.

[0296] 7. Abnormal scenario in the process of cooperative display (FIG. 13-1 and FIG. 13-2)

[0297] The abnormal scenario can include a scenario in which the percentage of the battery power of the electronic device is lower than a value 1, and / or the device temperature of the electronic device is higher than a value 2, etc. The present embodiment is not limited in this regard. The value 1 can be 20%, and the value 2 can be 40 degrees Celsius.

[0298] The following takes the device temperature of the electronic device being higher than the value 2 as an example for illustrative purposes, which does not constitute a limitation on the embodiments of the present application.

[0299] In one implementation, after the electronic device enters the cooperative display, the electronic device can display the interface shown in FIG. 13A on the inner screen when it is detected that the device temperature of the electronic device is higher than the value 2. At this time, the outer screen can display the interface shown in FIG. 5F.

[0300] As shown in FIG. 13A, the interface can display a camera application interface, a mini-window 506, and a prompt box 1301. The prompt box 1301 can include a control 1302 (with the word “yes”), a control 1303 (with the word “no”), and a prompt information 1304. The control 1302 is used to exit the cooperative display, the control 1303 is used to refuse to exit the cooperative display, and the prompt information 1304 is used to prompt the user whether to exit the cooperative display when it is detected that the device temperature is high.

[0301] For example, when the electronic device receives a user operation on the control 1303, the electronic device can display the interface shown in FIG. 13B on the inner screen, and meanwhile the outer screen can continue to display the interface shown in FIG. 5F. Alternatively, when the electronic device receives a user operation on the control 1302, the electronic device can display the interface shown in FIG. 13C on the inner screen, and the electronic device can power off the outer screen. In this case, the outer frame around the mini window 1300 in FIG. 13C is not displayed in bold.

[0302] Alternatively, after the electronic device enters the cooperative display, the electronic device can also display a prompt box 1301 on the outer screen when an abnormal scenario is detected, or directly exit the cooperative display. In another implementation, when the device temperature of the electronic device is higher than a value 2, in response to a user operation of entering the cooperative display, the electronic device can display the interface shown in FIG. 13D on the inner screen, and meanwhile the outer screen can be in a screen-off state.

[0303] As shown in FIG. 13D, the interface can display a camera application interface and a prompt box 1305. The prompt box 1305 can include a control 1307 (with the word "Yes"), a control 1308 (with the word "No"), and a prompt information 1306. The control 1307 is used to enter the cooperative display, the control 1308 is used to refuse to enter the cooperative display, and the prompt information 1306 is used to prompt the user to detect that the device temperature is high and whether to continue to enter the cooperative display.

[0304] For example, when the electronic device receives a user operation on the control 1307, the electronic device can display the interface shown in FIG. 13E on the inner screen, and meanwhile the outer screen can display the interface shown in FIG. 5F. Alternatively, when the electronic device receives a user operation on the control 1308, the electronic device displays the interface shown in FIG. 13F, and meanwhile the outer screen can remain in a screen-off state.

[0305] Based on this, since the cooperative display function has a high demand for power consumption and / or battery power, the electronic device can timely prompt the user whether to exit the cooperative display (or whether to enter the cooperative display) when an abnormal scenario is detected, so as to reduce the situation that the device power rapidly decreases or the device is stuck without the user's awareness.

[0306] 8. Exiting the cooperative display (FIG. 14)

[0307] After entering the cooperative display, the electronic device can also exit the cooperative display when receiving an operation of folding the electronic device.

[0308] FIG. 14 is an interface for cooperative display in a continuation scenario according to an embodiment of the present application.

[0309] In the case that the inner screen of the electronic device displays the interface as shown in FIG. 5E and the outer screen displays the interface as shown in FIG. 5F, in response to the operation of folding the electronic device performed by the user, the electronic device can display the interface as shown in FIG. 14A on the outer screen and turn off the inner screen.

[0310] It can be understood that the collaborative photographing control 1402 and the mini window 1401 can be displayed in FIG. 14A. The collaborative photographing control 1402 is in a grayed state; or the collaborative photographing control 1402 can not be displayed in FIG. 14A, which is not limited in the embodiments of the present application. The outer frame around the mini window 1401 is not displayed in bold.

[0311] It can be understood that the outer frame around the mini window 1401 is not displayed in bold because folding the electronic device causes the collaborative display to be exited.

[0312] It can be understood that when the electronic device receives the operation of folding the electronic device performed by the user, the electronic device can implement the continuation of the content in the inner screen to the outer screen and power off the inner screen, so that the outer screen cannot continue to display the interface shown in FIG. 5F.

[0313] It can be understood that other methods of exiting the collaborative display can refer to the description of FIG. 9, which will not be repeated here.

[0314] Based on this, in response to the operation of folding the electronic device performed by the user, the electronic device can exit the collaborative display and continue the content displayed in the inner screen.

[0315] The application interfaces involved in the collaborative display are schematically illustrated in FIGS. 5-1 to 14, and the architecture of the collaborative display is schematically illustrated in FIG. 15, and the interface display method for implementing the collaborative display is illustrated in combination with the description in FIGS. 16-19.

[0316] For example, FIG. 15 is a schematic diagram of an architecture of inner folding collaborative display provided by the embodiments of the present application. As shown in FIG. 15, the interface display method can be applied to a business scenario using a folding screen mobile phone.

[0317] The folding screen mobile phone can include OLED1 (such as an inner screen) and OLED2 (such as an outer screen), and the meanings and forms of the inner screen and the outer screen can refer to the description in FIG. 1.

[0318] In order to manage the display content in the display screen, the electronic device can generate a physical screen (physical display) corresponding to OLED and a logical screen (logical display) corresponding to the physical screen in the framework layer, and manage the physical screen and the logical screen through a display management service.

[0319] The physical screen can be based on the display screen read by the OLED. The screen information of the physical screen can be the same as the screen information of the OLED. The screen information can include screen resolution, screen size, and the like. The screen information of the physical screen is not allowed to be changed.

[0320] To facilitate the control of the display of different windows in the physical screen, the electronic device can map a logical screen corresponding to the physical screen. The screen information of the logical screen can be different from the screen information of the physical screen.

[0321] The logical screen can be understood as an abstract screen. The logical screen is used to process the content and layout in the physical screen. For example, the logical screen can implement the setting of the display area, display position coordinates, and display direction of the corresponding physical screen.

[0322] As shown in FIG. 15, the electronic device can generate a physical screen 1 by reading the screen information of OLED 1, and generate a physical screen 2 by reading the screen information of OLED 2. The physical screen 1 and OLED 1 can perform data transmission through a display serial interface (DSI)-1, and the physical screen 2 and OLED 2 can perform data transmission through a DSI-2. The physical screen 1 can correspond to a logical screen 1 in the framework layer, and the physical screen 2 can correspond to a logical screen 2 in the framework layer.

[0323] The DSI can be used to transmit image data, control signals, and the like in the controller to the OLED.

[0324] It can be understood that, since the folding screen mobile phone described in FIG. 1 can actually include two display screens, the electronic device can manage the content in the two display screens through two logical screens and two physical screens, respectively.

[0325] It should be noted that the embodiments of the present application take the folding screen mobile phone including two display screens as an example for illustration. When the folding screen mobile phone includes multiple display screens, the electronic device can also implement the mirroring of the content in any display screen to other display screens based on the interface display method described in the embodiments of the present application.

[0326] Based on the architecture described in FIG. 15, FIG. 16 is a module interaction diagram of an interface display method provided by an embodiment of the present application. In the embodiment corresponding to FIG. 16, the electronic device can include a device state management service, a display management service, a window management service, a power management service, and a display composition system, and the meaning of any module can be referred to the description in FIG. 4.

[0327] As shown in FIG. 16, the interface display method can include the following steps:

[0328] S1601, in response to the coordination display operation for the target application, the device state management service receives a coordination display state request.

[0329] The target application can be an application running in the foreground. For example, the target application can be an application displayed in a floating window. It can be understood that an application not running in the foreground cannot respond to the user's coordination display operation.

[0330] The coordination display operation can include the operations described in FIGS. 5-1 to 5-4, or the operations described in FIG. 6-1 or FIG. 6-2, etc.

[0331] The coordination display state is a state in the device state, which can be understood as the state when the electronic device mirrors the content displayed in the inner screen window to the outer screen. For example, the electronic device can define the coordination display state in / vendor / etc / devicestate in advance.

[0332] The coordination display state can include a flag 1, which can be flag_cancel_with_request_not_on_top. The flag 1 can be understood as that the coordination display state request fails when the target application is not a foreground application. Alternatively, the flag 1 can also be understood as that the coordination display state request can only be successful when the target application is running in the foreground. In this way, when the electronic device detects that the target application is not running in the foreground, the coordination display state can be cancelled, reducing power waste.

[0333] For example, the floating window framework in the framework layer can send a coordination display state request to the device state management service by calling requestState(), which can include the identification of the coordination display state.

[0334] S1602, in response to the coordination display state request, the device state management service updates the device state to the coordination display state.

[0335] For example, the device state management service can calculate whether the coordination display state can be issued by calling onOverrideRequestStatechangedLocked().

[0336] When the status_active is included in the collaborative display state, the device state management service determines that the collaborative display state can be issued, and then updates the device state to the collaborative display state by calling updatePendingStateLocked().

[0337] Or, when the status_cancel is included in the collaborative display state, the device state management service determines that the collaborative display state cannot be issued, that is, the device state management service cannot dispatch the collaborative display state, and at this time, it can be understood that the collaborative display process ends.

[0338] The status_active included in the collaborative display state can be understood as that the electronic device requests the collaborative display state, and the status_cancel included in the collaborative display state can be understood as that the electronic device requests to cancel the collaborative display state.

[0339] S1603, the device state management service submits the local collaborative display state.

[0340] For example, the device state management service can submit the collaborative display state by commitPendingState(). The collaborative display state can be included in commitPendingState().

[0341] S1604, the device state management service dispatches the collaborative display state.

[0342] In the process of dispatching the collaborative display state, the device state management service can obtain the services pre-registered for the collaborative display state, such as the display management service and the window management service, and then perform S1605 and S1611. For example, the device state management service can obtain the services pre-registered for the collaborative display state by notifyDeviceStatePreCallback(). The collaborative display state can be included in notifyDeviceStatePreCallback().

[0343] It can be understood that S1602-S1604 can be understood as a process of an electronic device dispatching a device state, which is not limited in the embodiments of the present application.

[0344] After S1604, the device state management service can execute S1605 and S1611 simultaneously (or in sequence) to notify the display management service and the window management service that the device is currently in the collaborative display state, and then the electronic device can execute the outer screen power-on process based on S1606-S1610 and execute the layer mirroring process based on S1612-S1620.

[0345] It can be understood that there is no obvious sequence between S1605 and S1611. Generally, the outer screen power-on process can be about 400 milliseconds, and the layer mirroring process can be about 200 milliseconds. In the case that the electronic device executes S1605 and S1611 simultaneously (or executes S1611 first and then executes S1605), the electronic device can first complete the layer mirroring process, and after the completion of the outer screen power-on process, the electronic device can display the mirrored layer on the outer screen. In this way, the electronic device can directly display the mirrored layer after the outer screen is turned on, reducing the user's waiting for the mirrored layer after the outer screen is turned on.

[0346] Alternatively, the electronic device can execute S1611 after executing S1605 for a duration of 400 milliseconds or the like, and the outer screen of the electronic device can be turned on (at this time, no interface can be displayed) first, and then the mirrored layer is displayed. This is not limited in the embodiments of the present application.

[0347] S1605, the display management service receives the state change message 1 from the device state management service.

[0348] The state change message 1 can be used to indicate that the device state has changed, and the state change message 1 can include an identifier of the collaborative display state. For example, the display management service can receive the state change message 1 dispatched by the device state management service through the callback function onStateChanged().

[0349] S1606, in response to the state change message 1, the display management service sends an outer screen power-on request to the power management service.

[0350] The outer screen power-on request can be used to request to power on the outer screen. The outer screen power-on request can include an identifier of the outer screen. For example, the display management service can notify the power management service to power on the outer screen by calling onLogicalDisplaySwapped().

[0351] S1607, in response to the outer screen power-on request, the power management service sets the power state of the outer screen to the power-on state.

[0352] For example, in response to the outer screen power-on request, the power management service can set the power state to the power-on state by calling updatePowerStateLocked().

[0353] It can be understood that, in a case that the outer screen of the electronic device has been powered on, the electronic device cannot perform the step of setting the power state of the outer screen to the powered-on state in response to the outer screen power-on request. In this case, the electronic device cannot perform the outer screen power-on process in S1607-S1610.

[0354] The scenario in which the outer screen of the electronic device has been powered on can include that the electronic device mirrors the content in the inner screen window in the outer screen based on the collaborative display function, or the electronic device displays the content in the preview window in the outer screen based on the collaborative photographing function, and the like.

[0355] S1608, the power management service sends a power state request to the display management service.

[0356] The power state request is used to request to set the power state of the outer screen to the powered-on state. The power state request can include the identifier of the outer screen, the power state of the outer screen, and the like. For example, the power management service can send the power state request to the display management service by calling requestPowerState().

[0357] S1609, the display management service sends an outer screen power-on notification to the display composition system.

[0358] The outer screen power-on notification is used to instruct the display composition system to power on the outer screen. For example, the display management service can instruct the display composition system to power on the outer screen by calling setDisplayPowerMode(). The setDisplayPowerMode() can include the identifier of the outer screen, the power state of the outer screen, and the like.

[0359] S1610, the display composition system powers on the outer screen through the display driver.

[0360] The electronic device can also implement the setting of the outer screen backlight based on the path described in S1607-S1610 while powering on the outer screen based on S1607-S1610. For example, the power management service can also calculate the backlight value in S1607, and send a request to set the backlight to the display management service in S1608, the display management service sends a request to set the backlight to the display composition system in S1609, and the display composition system notifies the display driver to set the backlight for the outer screen while powering on the outer screen in S1610. The request to set the backlight includes the backlight value.

[0361] It can be understood that the display composition system itself cannot implement the process of powering on the outer screen, and therefore the display composition system can power on the outer screen and set the backlight by calling the display driver in the driver layer. For example, the display composition system can send an outer screen power-on notification to the display driver, and the display driver powers on the outer screen.

[0362] S1611, the window management service receives the state change message 1 from the device state management service.

[0363] The meaning of the state change message 1 can refer to the description in S1605, which will not be repeated here.

[0364] S1612, in response to the device state change message 1, the window management service determines whether there is a mirror surface.

[0365] The mirror surface can be a kind of preset defined layer, and the mirror surface can be understood as a layer obtained by mirroring (or copying) other layers.

[0366] The window management service can obtain the mirror surface, and determine whether there is a mirror surface according to whether the mirror surface is empty. When the mirror surface is empty, it is determined that there is no mirror surface, and then the step shown in S1614 is executed; or when the mirror surface is not empty, it is determined that there is a mirror surface, and then the step shown in S1613 is executed.

[0367] Among them, in the scenario where there is a mirror surface, the outer screen of the electronic device has already mounted the application interface in the inner screen window. In this case, the electronic device can remove the mirror surface after dispatching the cooperative state request, and then mirror the new layer based on S1614-S1620, without executing the outer screen power-on process of S1606-S1610.

[0368] S1613, the window management service removes the mirror surface.

[0369] It can be understood that after the window management service removes the mirror surface, the outer screen can not display any content, for example, only the backlight can be seen in the outer screen. After removing the mirror surface based on S1613, the electronic device can re-mirror the content in the other windows of the inner screen to the outer screen based on the steps shown in S1614-S1620.

[0370] Referring to the description in FIG. 5-1 and FIG. 12, when the electronic device displays as shown in FIG. 5E and FIG. 5F, the electronic device can remove the content displayed in FIG. 5F (i.e. remove the mirror surface), and display the interface as shown in FIG. 12D by re-mirroring the application interface in the floating window 1201.

[0371] S1614, the window management service traverses the task 1 in the preset window.

[0372] The preset window can be a window including a preset window type (window_mode). The preset window can include a floating window, a mini window, or the like.

[0373] In FIG. 5C, the task 1 in the preset window can be a task of the note application in the floating window. For example, the window management service can obtain the task 1 in the preset window by calling forAllRootTasks().

[0374] S1616, the window management service obtains the layer 1 under the task 1.

[0375] The task 1 can be understood as a parent node of the layer 1, and the layer 1 can be understood as all layers mounted under the task 1. In FIG. 5C, the layer 1 can be a plurality of layers displayed in the note application. The number of the layer 1 can be at least one.

[0376] For example, the window management service can obtain the layer 1 under the task 1 by getSurfaceControl().

[0377] S1616, the window management service sends a message for instructing to mirror the layer 1 to the display compositing system.

[0378] For example, the window management service can instruct the display compositing system to mirror the layer 1 by calling mirrorSurface(), and obtain a mirrored layer.

[0379] S1617, the display compositing system mirrors the layer 1, and obtains a mirrored layer.

[0380] S1618, the display compositing system returns the mirrored layer to the window management service.

[0381] S1619, the window management service performs scaling processing on the mirrored layer according to the size of the outer screen and the horizontal / vertical screen state of the outer screen.

[0382] The window management service can perform scaling on the mirrored layer in proportion to the size of the outer screen and the horizontal / vertical screen state of the outer screen by calling updateMirroredSurface(), so that the mirrored layer can be completely displayed on the outer screen.

[0383] For example, when the outer screen is in a vertical screen state and the mirrored layer is displayed in a vertical screen state (or the floating window corresponding to the mirrored layer is in a vertical screen state), the electronic device can make the width of the mirrored layer the same as the width of the outer screen, and perform proportional scaling on the height of the mirrored layer.

[0384] It can be understood that the window management service can rotate the mirror layer when detecting the rotation of the electronic device, so that the mirror layer can be reasonably displayed in the outer screen. For details, refer to the description in FIG. 19.

[0385] S1610, the window management service mounts the mirror layer to the outer screen.

[0386] For example, the window management service can mount the mirror layer to the outer screen by calling reparent(). The reparent() can include an identifier of the outer screen. After the electronic device completes mirroring of layer 1, the electronic device can display an interface as shown in FIG. 5F on the outer screen.

[0387] Based on this, the electronic device can display the application interface in the inner screen window on the outer screen by powering on the outer screen and mirroring a certain layer in the inner screen window, so as to improve the user experience of using the electronic device.

[0388] In the case of implementing cooperative display in the embodiment corresponding to FIG. 16, the embodiment of the present application further provides a way to exit the cooperative display, which is described with reference to FIGS. 17-18.

[0389] For example, the electronic device can exit the cooperative display based on FIG. 17 when it is determined that the cooperative display is exited due to changes in sensor data. Alternatively, when the sensor data does not change (for example, the folding state of the electronic device is in an unfolded state) and the electronic device receives a preset exit operation, the electronic device can exit the cooperative display based on FIG. 18.

[0390] FIG. 17 is a schematic diagram of module interaction for exiting the cooperative display provided by the embodiment of the present application. In the embodiment corresponding to FIG. 17, the electronic device can include a device state management service, a display management service, and a window management service, etc.

[0391] As shown in FIG. 17, the method for exiting the cooperative display can include the following steps:

[0392] S1701, in response to the operation of folding the electronic device performed by the user, the device state management service receives a sensor data change message reported by the sensor.

[0393] The sensor data change message is used to indicate that the sensor of the electronic device detects data changes. For example, the sensor data change message can be onSensorChanged(), and the sensor data change message can include a sensor event (sensorEvent). The sensorEvent can include the type of sensor, the timestamp of the sensor event, and the data detected by the sensor.

[0394] For example, in response to the user performing the folding operation of the electronic device, the device state management service can receive data of the folding angle being 0 degrees (or) or the like in the sensor data change message, and based on the data of the folding angle being 0 degrees, it can be understood that the electronic device is in the folded state.

[0395] S1702, in response to the sensor data change message, the device state management service dispatches the folding state.

[0396] For example, the device state management service can determine that the device is in the folded state when receiving the sensor data change message, update the device state to the folded state by calling updatePendingStateLocked(), commit the folded state by calling commitPendingState(), and then dispatch the folded state by calling notifyDeviceStatePreCallback().

[0397] In S1702, updatePendingStateLocked(), commitPendingState(), and notifyDeviceStatePreCallback() can all include the identification of the folding state.

[0398] S1703, the device state management service sends a state change message 2 to the window management service.

[0399] The state change message 2 can be used to indicate that the device state has changed, for example, the state change message can include the identification of the folding state. For example, the device state management service can notify the window management service that the device state has changed by calling onStateChanged().

[0400] S1704, in response to the device change message 2, the window management service removes the mirror layer.

[0401] It can be understood that the window management service can remove the mirror layer when it is determined that the device change message 2 does not include the identification of the collaborative display state. The step of the window management service removing the mirror layer can be referred to the description in S1613, which will not be repeated here.

[0402] S1705, the device state management service sends a state change message 2 to the display management service.

[0403] The meaning of the state change message 2 can be referred to the description in S1703, which will not be repeated here.

[0404] S1706, in response to the state change message 2, the display management service exchanges the display screen.

[0405] The switching display screen can be understood as switching the correspondence between the physical screen and the logical screen. For example, the display management service sets the correspondence between the logical screen 1 and the physical screen 2, and sets the correspondence between the logical screen 2 and the physical screen 1, and the correspondence between the physical screen and the OLED remains unchanged. In this way, the electronic device can transfer the display content in the inner screen to the outer screen through the switching display screen, so that the user can view the content in the inner screen on the outer screen, realizing the continuation of the display content from the inner screen to the outer screen.

[0406] For example, the display management service can switch the display screen by calling setDeviceStateLocked.

[0407] S1707, the display management service powers off the inner screen.

[0408] It can be understood that the display management service cannot independently complete the inner screen power-off process, and it needs to cooperate with other modules to complete the inner screen power-off. For example, the process of the display management service powering off the inner screen can include: the display management service sending an inner screen power-off request to the power management service, and notifying the display composition system and the display driver to complete the power-off of the outer screen. The specific power-off process can be similar to the power-on process described in S1606-S1610, and will not be described here.

[0409] Based on this, the electronic device can exit the collaborative display function by removing the mirror layer and powering off the inner screen when detecting that the electronic device is in a folded state, reducing the waste of device power consumption.

[0410] FIG. 18 is another module interaction diagram for exiting the collaborative display provided by an embodiment of the present application. In the embodiment corresponding to FIG. 18, the electronic device can include a device state management service, a display management service, a window management service, and the like.

[0411] As shown in FIG. 18, the method for exiting the collaborative display can include the following steps:

[0412] S1801, in response to a preset exit operation performed by the user, the device state management service receives a request to cancel the collaborative display state.

[0413] The preset exit operation can include one or more of the following: an inner screen screen-off operation, an operation of switching a floating window to a floating ball when the window is in a floating window state, an operation of switching a mini window to a floating ball when the window is in a mini window state, an operation of full-screen displaying the content in the floating window, or an operation of closing the floating window, and the like. It can be understood that after the electronic device exits the collaborative display state. It can be understood that during the process of the user performing the preset exit operation, the folding state of the electronic device is the unfolded state.

[0414] The state change message 3 can be used to indicate that the device state is changed, and the state change message 3 can include an identifier of the cancel collaborative display state.

[0415] The cancel collaborative display state request is used to cancel the collaborative display state requested in S1601. The cancel collaborative display state request can be cancelStateRequest(), and the cancelStateRequest() can include an identifier of the cancel collaborative display state.

[0416] S1802, in response to the cancel collaborative display state request, the device state management service sends a state change message 3 to the window management service.

[0417] S1803, in response to the device change message 3, the window management service removes the mirror layer.

[0418] S1804, the device state management service sends a state change message 3 to the display management service.

[0419] S1805, in response to the state change message 3, the display management service powers off the outer screen.

[0420] Based on this, the electronic device can exit the collaborative display function by removing the mirror layer and powering off the outer screen when detecting that the user performs the preset exit operation, thereby reducing the waste of device power consumption.

[0421] Based on the corresponding embodiment of FIG. 16, the embodiment of the present application further provides an interface display method based on horizontal and vertical screen rotation, which is described with reference to FIG. 19.

[0422] For example, FIG. 19 is a module interaction schematic diagram of another interface display method provided by the embodiment of the present application. In the corresponding embodiment of FIG. 19, the electronic device can include a display screen content module, a display screen rotation module, and a display screen rotation coordination module. The meanings of any module can be referred to the description in FIG. 4.

[0423] It can be understood that the electronic device can detect the rotation direction of the main screen (or the default display screen), and the rotation direction of the secondary screen can be the reverse of the rotation direction of the main screen. For example, when the rotation direction of the main screen is 90 degrees, the electronic device can obtain 270 degrees by reversing 90 degrees, that is, when the rotation direction of the main screen is 90 degrees, the rotation direction of the secondary screen can be 270 degrees.

[0424] When the electronic device is in an unfolded state, the main screen can be an inner screen, and the secondary screen can be an outer screen; when the electronic device is in a folded state, the main screen can be an outer screen, and the secondary screen can be an inner screen.

[0425] The following describes the display method of the inner screen and the outer screen after rotating the electronic device, with the electronic device in the unfolded state, the main screen as the inner screen, and the secondary screen as the outer screen as an example. As shown in FIG. 19, the interface display method can include the following steps:

[0426] In response to the operation of starting up or restarting the device, the display screen rotation module registers to listen.

[0427] It can be understood that the display screen rotation module can listen to the direction change of the rotation of the electronic device by registering to listen. For example, the display screen rotation module can register to listen by calling newDisplayRotation().

[0428] The display screen rotation module notifies the display screen rotation coordination module to set callback function 1.

[0429] The callback function 1 can be used to notify the inner screen rotation to the outer screen. For example, the display screen rotation module can notify the display screen rotation coordination module to set the callback function 1 by calling setDefaultDisplayRotationchangedCallback().

[0430] In response to the operation of rotating the electronic device, the display screen content module sends a rotation message to the display screen rotation module.

[0431] The rotation message can include a rotation angle, such as angle 1. For example, the display screen content module can send a rotation message to the display screen rotation module by calling foldStateChanged().

[0432] In response to the rotation message, the display screen rotation module updates the rotation angle of the electronic device to angle 1. For example, the display screen rotation module can update the rotation angle of the electronic device by calling updateRotationUnchecked().

[0433] The display screen rotation module dispatches angle 1 to the application.

[0434] For example, the display screen rotation module can dispatch angle 1 to the application running in the foreground, so that the application can rotate the displayed content according to angle 1.

[0435] The display screen rotation module sends a rotation message to the display screen rotation coordination module.

[0436] For example, the display screen rotation module can notify the display screen rotation coordination module that the electronic device has rotated by calling onDefaultDisplayRotationChanged.

[0437] S1907, the display screen rotation coordination module informs the outer screen in the display screen rotation module of the rotation angle of angle 1 through callback function 1.

[0438] For example, the display screen rotation coordination module informs the outer screen in the display screen rotation module of the rotation angle of angle 1 through callback function 1 (such as updateRotationAndSendConfigIfChanged ( ) ).

[0439] S1908, the display screen rotation module obtains angle 2 by taking the complement of angle 1.

[0440] For example, in the case of angle 1 being 90 degrees, angle 2 can be 270 degrees. That is, in the case of the electronic device rotating 90 degrees, the electronic device can rotate the mirror image layer by 270 degrees, so that the content in the mirror image layer can be properly displayed in the outer screen.

[0441] S1909, the display screen rotation module informs the window management service to rotate the mirror image layer based on angle 2.

[0442] It can be understood that after the window management service receives angle 2, the window management service can implement the processing of the mirror image layer in S1619.

[0443] Based on this, the electronic device can detect that the rotation occurs, and can perform rotation processing on the mirror image layer in the outer screen by taking the complement of the rotation direction, to ensure that the mirror image layer can be reasonably displayed in the outer screen.

[0444] It can be understood that the interface display method provided in the embodiments of the present application can not only be applied to a horizontally folded folding screen mobile phone, but also be applied to a vertically folded folding screen mobile phone, see the description in FIG. 20.

[0445] For example, FIG. 20 is a schematic diagram of a cooperative display interface provided by an embodiment of the present application. In the embodiment corresponding to FIG. 20, a vertically folded folding screen mobile phone is taken as an example for illustration.

[0446] The vertically folded folding screen mobile phone can include an inner screen and an outer screen. The top of the inner screen can be provided with a combination camera 2, and the lower left corner of the outer screen can be provided with a combination camera 3. The combination camera 2 and the combination camera 3 can each include at least one camera.

[0447] The electronic device can display the interface shown in FIG. 20A on the inner screen, and the outer screen is in an off-screen state, such as the outer screen shown in FIG. 20B. As shown in FIG. 20A, the interface can display a photographing application interface, and a floating window 2001 overlaid on the photographing application interface, and the content displayed in the floating window 2001 can refer to the description of the floating window 501.

[0448] In response to the user performing the operation of entering the collaborative display based on the floating window 2001 in FIG. 20A, the electronic device can display the interface shown in FIG. 20C on the inner screen and the interface shown in FIG. 20D on the outer screen.

[0449] As shown in FIG. 20C, the mini window 2002 can be displayed in the interface, and the application interface displayed in the mini window 2002 is the same as the application interface displayed in the floating window 2001, which will not be described herein again.

[0450] As shown in FIG. 20D, the interface can display the date information, the time information, and the note application interface in the dashed box 2003. The application interface in the dashed box 2003 is the same as the application interface in the floating window 2001, which will not be described herein again. It can be understood that the application interface in the dashed box 2003 can be obtained when the electronic device mirrors the content in the floating window 2001 to the outer screen.

[0451] Optionally, the interface of FIG. 20D can not display the status bar at the top position. Alternatively, the interface of FIG. 20D can also display the status bar at the top position, and the content in the status bar can refer to the description in FIG. 5-1.

[0452] Optionally, the electronic device can also display the application interface in the floating window 2001 in full screen on the outer screen, which is not limited in the embodiments of the present application.

[0453] It can be understood that in the case of the electronic device being a vertically folded folding screen mobile phone, the operation of entering the collaborative display can refer to the description in FIGS. 5-1 to 6-2. After entering the collaborative display function, the other capabilities allowed to run by the electronic device can refer to the description in FIGS. 7-19, which will not be described herein again.

[0454] It can be understood that the embodiments of the present application can realize the collaborative display of the applications in the white list, which can include the applications capable of being displayed in the floating window state.

[0455] It should be noted that the module names involved in the embodiments of the present application can be defined as other names, as long as the functions of the modules can be realized, and the names of the modules are not limited specifically.

[0456] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the embodiments of the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation portal for user to select authorization or refusal.

[0457] With the description above in FIG. 16, FIG. 21 is a flow diagram of an interface display method according to an embodiment of the present application. In the embodiment corresponding to FIG. 21, the electronic device includes a first display screen and a second display screen, the first display screen and the second display screen are arranged opposite to each other, and the interface display method can include the following steps.

[0458] S2101, the first display screen displays a first interface.

[0459] The first interface includes a first full-screen window corresponding to a first application and a first floating window corresponding to a second application, and the first floating window includes a first application interface corresponding to the second application.

[0460] The first display screen can be the inner screen described in the embodiments of the present application, and the second display screen can be the outer screen described in the embodiments of the present application.

[0461] The first interface can be the interface shown in FIG. 5C, the first application can be a camera application, and the first full-screen window corresponding to the first application can be a full-screen displayed camera application interface.

[0462] The second application can be a note application, the first floating window corresponding to the second application can be the floating window 501 in FIG. 5C, and the first application interface corresponding to the second application can be an application interface in the note application, such as the application interface in the floating window 501, that is, the note application interface displayed in the floating window 501, and the first application interface does not include the operation control in the floating window 501.

[0463] S2102, in response to a first operation on the first floating window, displaying a second floating window corresponding to the second application in the first display screen, and displaying the first application interface in the second display screen.

[0464] The size of the second floating window is smaller than the size of the first floating window.

[0465] The first operation can be the three-finger upward sliding operation described in FIG. 5C, or can also be other operations, see the description in FIGS. 5-1 to 6-2.

[0466] The second floating window can be the mini window 506 in FIG. 5E.

[0467] S2103, in response to a second operation on the second floating window, displaying the first floating window in the first display screen, and displaying the first application interface in the second display screen.

[0468] The second operation can be a click operation on the mini window 506, so that the electronic device restores the display of the first floating window (such as the floating window 501) in the first display screen, and the first application interface in the second display screen remains unchanged.

[0469] S2104, in response to the third operation on the first floating window, displaying a third floating window corresponding to the second application in the first display screen, and displaying the second application interface in the second display screen.

[0470] The third floating window has a size larger than that of the second floating window, and the third floating window includes the second application interface corresponding to the second application, and the second application interface is different from the first application interface.

[0471] As shown in FIG. 7A, the third operation can be an operation of sliding the floating window 501 upwards. The third floating window can be the floating window 701 in FIG. 7C, and the second application interface corresponding to the second application can be an application interface displayed in the floating window 701, and the second application interface does not include the operation control in the floating window 701. It can be understood that the application interface in the floating window 501 is different from the application interface in the floating window 701.

[0472] In this way, the electronic device can not only realize the display of the content in the inner screen window to the outer screen, and in response to the operation performed by the user on the inner screen, the application interface in the floating window can be synchronized with the application interface in the outer screen, so that the user can view the updated application interface in the outer screen in real time.

[0473] The interface display method of the embodiments of the present application has been described above, and the device for executing the above method provided by the embodiments of the present application will be described below. Those skilled in the art can understand that the method and the device can be combined and referenced with each other, and the related device provided by the embodiments of the present application can execute the steps in the above list sorting method.

[0474] FIG. 22 is a schematic diagram of the hardware structure of another electronic device provided by the embodiments of the present application.

[0475] The electronic device includes a processor 2201, a communication line 2204, and at least one communication interface (for example, the communication interface 2203 is exemplarily illustrated in FIG. 22).

[0476] The processor 2201 can be a general CPU, a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

[0477] The communication line 2204 can include a circuit for transmitting information between the above components.

[0478] The communication interface 2203 uses any transceiver-like device, for communicating with other devices or communication networks, such as Ethernet, wireless local area networks (WLAN), etc.

[0479] Possibly, the electronic device can further include a memory 2202.

[0480] The memory 2202 can be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM), or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disk storage, a magnetic disk storage or other magnetic storage devices, or any other medium capable of storing desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to this. The memory can exist independently, and be connected to the processor through a communication line 2204. The memory can also be integrated with the processor.

[0481] The memory 2202 is configured to store computer-executable instructions for implementing the solutions of the present application, and the processor 2201 is configured to control the execution of the computer-executable instructions stored in the memory 2202. The processor 2201 is configured to execute the computer-executable instructions stored in the memory 2202, so as to implement the method provided by the embodiments of the present application.

[0482] Possibly, the computer-executable instructions in the embodiments of the present application can also be referred to as application program codes, which are not specifically limited in the embodiments of the present application.

[0483] In a specific implementation, as an embodiment, the processor 2201 can include one or more CPUs, such as CPU0 and CPU1 in FIG. 22.

[0484] In a specific implementation, as an embodiment, the electronic device can include multiple processors, such as the processor 2201 and the processor 2205 in FIG. 22. Each of these processors can be a single-CPU processor or a multi-CPU processor. The processor herein can refer to one or more devices, circuits, and / or processing cores for processing data (for example, computer program instructions).

[0485] The interface display method provided by the embodiments of the present application can be applied to an electronic device with a communication function. The electronic device includes a terminal device, and the specific device form of the terminal device can refer to the related description above, which will not be repeated here.

[0486] The embodiments of the present application provide a terminal device, which includes: a processor and a memory; the memory stores computer execution instructions; and the processor executes the computer execution instructions stored in the memory, so that the terminal device executes the above method.

[0487] The embodiments of the present application also provide a chip. The chip includes a processor, and the processor is configured to invoke a computer program in a memory to execute the technical solutions in the above embodiments. The implementation principle and technical effects are similar to those of the above related embodiments, which will not be repeated here.

[0488] The embodiments of the present application also provide a computer readable storage medium. The computer readable storage medium stores a computer program. The computer program is executed by a processor to implement the above method. The method described in the above embodiments can be implemented by software, hardware, firmware or any combination thereof, in whole or in part. If implemented in software, the functions can be stored as one or more instructions or codes on a computer readable medium or transmitted on a computer readable medium. The computer readable medium can include computer storage medium and communication medium, and can also include any medium that can carry computer programs from one place to another. The storage medium can be any target medium that can be accessed by a computer.

[0489] In a possible implementation, the computer readable medium can include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that is targeted to carry the required program code in the form of instructions or data structures and can be accessed by a computer. Moreover, any connection is appropriately called a computer readable medium. For example, if software is transmitted from a website, server or other remote source using a coaxial cable, optical fiber cable, twisted pair, digital subscriber line (DSL) or wireless technology (such as infrared, radio and microwave), the coaxial cable, optical fiber cable, twisted pair, DSL or wireless technology (such as infrared, radio and microwave) is included in the definition of medium. As used herein, magnetic disks and optical disks include compact disks, laser disks, optical disks, digital versatile disks (DVD), floppy disks and Blu-ray disks, in which magnetic disks usually reproduce data magnetically, and optical disks reproduce data optically with laser. The above combinations should also be included in the scope of computer readable medium.

[0490] The embodiment of the present application provides a computer program product, which comprises a computer program, and when the computer program is executed, the computer executes the above method.

[0491] The embodiment of the present application is described with reference to flowcharts and / or block diagrams of the method, device (system) and computer program product according to the embodiment of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of the flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processing unit of the computer or other programmable data processing device produce a device for implementing the functions specified in one or more flows in the flowcharts and / or one or more blocks in the block diagrams.

[0492] The above detailed description is further detailed for the purpose of the present application, technical solutions and beneficial effects, and it should be understood that the above is only a specific embodiment of the present application, and is not used to limit the protection scope of the present application, and any modification, equivalent replacement, improvement, etc. made on the basis of the technical solutions of the present application should be included in the protection scope of the present application.

Claims

1. An interface display method characterized by, The method is applied to an electronic device including a first display screen and a second display screen arranged opposite to each other, and the method comprises: The first display screen displays a first interface including a first full-screen window corresponding to a first application and a first floating window corresponding to a second application, the first floating window including a first application interface corresponding to the second application; In response to a first operation on the first floating window, a second floating window corresponding to the second application is displayed on the first display screen, and the first application interface is displayed on the second display screen, the size of the second floating window being smaller than that of the first floating window; In response to a second operation on the second floating window, the first floating window is displayed on the first display screen, and the first application interface is displayed on the second display screen; In response to a third operation on the first floating window, a third floating window corresponding to the second application is displayed on the first display screen, and a second application interface is displayed on the second display screen, the size of the third floating window being larger than that of the second floating window, the third floating window including the second application interface corresponding to the second application, the second application interface being different from the first application interface.

2. The method of claim 1, wherein, After the second floating window corresponding to the second application is displayed on the first display screen, and the first application interface is displayed on the second display screen, the method further comprises: In response to a fourth operation on the first display screen, the second floating window and a fourth floating window corresponding to a third application are displayed on the first display screen, and the first application interface is displayed on the second display screen, the fourth floating window including a third application interface corresponding to the third application; In response to a fifth operation on the fourth floating window, the second floating window and a fifth floating window corresponding to the third application are displayed on the first display screen, and the third application interface is displayed on the second display screen, the size of the fifth floating window being smaller than that of the fourth floating window.

3. The method of claim 1, wherein, An outer frame of the second floating window is in a first state, and outer frames of the first floating window and the third floating window are in a second state, wherein the outer frame in the first state has a line thickness larger than that in the second state, and / or the outer frame in the first state has a color different from that in the second state.

4. The method of claim 2, wherein, After the response to the fourth operation on the first display screen, the method further comprises setting the outer frame of the second floating window to the first state. In response to the fifth operation on the fourth floating window, the method further includes: setting the outer frame of the second floating window to a second state, and setting the outer frame of the fifth floating window to the first state, wherein the line thickness of the outer frame in the first state is greater than the line thickness of the outer frame in the second state, and / or the color of the outer frame in the first state is different from the color of the outer frame in the second state.

5. The method according to any one of claims 1 to 4, characterized in that, The method further includes: In response to a sixth operation on the first display screen, displaying a sixth floating window corresponding to a fourth application in the first display screen, the sixth floating window including a fourth application interface corresponding to the fourth application; In response to a seventh operation on the sixth floating window, displaying a seventh floating window corresponding to the fourth application in the first display screen, and displaying first prompt information in the second display screen, wherein the size of the seventh floating window is smaller than the size of the sixth floating window, and the first prompt information is used to prompt that the fourth application interface does not support collaborative display to the second display screen; Alternatively, in response to the seventh operation, displaying the seventh floating window and the first prompt information in the first display screen, and the second display screen is in an off-screen state.

6. The method of any one of claims 1-5, wherein: After displaying the second floating window corresponding to the second application in the first display screen and displaying the first application interface in the second display screen, the method further includes: displaying second prompt information in the first display screen, the second prompt information being used to prompt whether to end displaying the first application interface in the second display screen in response to the electronic device being abnormal; And / or, after the response to the first operation on the first floating window, the method further includes: displaying third prompt information in the first display screen, the third prompt information being used to prompt whether to display the first application interface in the second display screen in response to the electronic device being abnormal.

7. The method of claim 6, wherein, The electronic device being abnormal includes: the electronic device detecting that the percentage of battery power is less than a first value, and / or the electronic device detecting that the device temperature is greater than a second value.

8. The method according to any one of claims 1 to 7, characterized in that, After displaying the second floating window corresponding to the second application in the first display screen and displaying the first application interface in the second display screen, the method further includes: In response to an operation of opening the notification center from the first display screen, displaying fourth prompt information in the first display screen, and displaying the first application interface in the second display screen, the fourth prompt information being used to prompt the electronic device to display the first application interface in the second display screen.

9. The method according to any one of claims 1 to 8, characterized in that, After displaying the second floating window corresponding to the second application in the first display screen and displaying the first application interface in the second display screen, the method further includes: In response to an operation of folding the electronic device, displaying the second floating window in the second display screen, and the first display screen being in an off-screen state.

10. The method according to any one of claims 1 to 9, characterized in that, The method further includes, after displaying the second application corresponding second floating window in the first display screen and displaying the first application interface in the second display screen: In response to an eighth operation for the first display screen, the second display screen is turned off, wherein the eighth operation includes one or more of the following: an operation of turning off the first display screen, an operation of switching the second floating window to a floating ball, an operation of full-screen displaying content in the second floating window, or an operation of closing the second floating window.

11. The method according to any one of claims 1 to 10, characterized in that, The first operation for the first floating window includes a three-finger upward sliding operation for the first floating window.

12. The method according to any one of claims 1 to 11, characterized in that, The displaying the second application corresponding second floating window in the first display screen and displaying the first application interface in the second display screen in response to the first operation for the first floating window includes: In response to a ninth operation of dragging the first floating window to a second hot area, displaying the first floating window and an identifier of a first hot area in the first display screen, the first hot area being located in the second hot area; In a case where the ninth operation continues to act on the first floating window, in response to a first operation of dragging the first floating window to the first hot area, displaying the second floating window in the first display screen and displaying the first application interface in the second display screen.

13. The method according to any one of claims 1 to 12, characterized in that, The method further includes, after the response to the first operation for the first floating window: Upon receiving a first state message related to the first operation, obtaining a task task in the first floating window; Mirroring a layer in the task to obtain a first layer; Mounting the first layer to the second display screen.

14. The method of claim 13, wherein, The obtaining the task task in the first floating window upon receiving the first state message related to the first operation includes: In a case where the first state message is received and a preset layer is not included in the electronic device, obtaining the task task in the first floating window, the preset layer being a layer obtained by mirroring any layer; Or, in a case where the first state message is received and the preset layer is included in the electronic device, removing the preset layer and obtaining the task task in the first floating window.

15. The method according to claim 13 or 14, characterized in that, The method further includes: Upon receiving a second state message, removing the first layer, exchanging display contents of the first display screen and the second display screen, and powering down the first display screen, wherein the second state message is generated when the electronic device detects an operation of folding the electronic device; And / or, when receiving a third state message, removing the first layer, and powering off the second display screen, wherein the third state message is generated when the electronic device detects a preset operation, and the preset operation includes one or more of the following: an operation of turning off the first display screen, an operation of switching the second floating window to a floating ball, an operation of full-screen displaying content in the second floating window, or an operation of closing the second floating window.

16. The method according to any one of claims 1 to 15, characterized in that, The electronic device is an inner folding device, the first display screen is an inner screen, and the second display screen is an outer screen.

17. An electronic device, comprising: The electronic device includes one or more processors and a memory; The memory is coupled to the one or more processors, and the memory is configured to store computer program code including computer instructions, and the one or more processors are configured to invoke the computer instructions to cause the electronic device to perform the method of any one of claims 1-16.

18. A chip system, characterized by The chip system is applied to an electronic device, and the chip system includes one or more processors configured to invoke computer instructions to cause the electronic device to perform the method of any one of claims 1-16.

19. A computer-readable storage medium, characterized in that, The computer readable storage medium includes computer instructions configured to cause the electronic device to perform the method of any one of claims 1-16 when the computer instructions are executed on the electronic device.

20. A computer program product, characterised in that, The computer program product includes computer program code configured to cause the electronic device to perform the method of any one of claims 1-16 when the computer program code is executed on the electronic device.

Images