Display method, electronic equipment and storage medium

By performing specific gesture operations at the bottom of the split-screen area, users can easily switch tasks in a single split-screen area, solving the problem of insufficient convenience in the existing technology, and realizing independent switching of a single split-screen area.

CN119556821AActive Publication Date: 2025-03-04HUAWEI TECH CO LTD

Patent Information

Application Number
CN202311135667.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-09-01
Publication Date
2025-03-04
Estimated Expiration
2043-09-01

AI Technical Summary

Technical Problem

In the prior art, in the split-screen display function, it is difficult for users to switch tasks in a single split-screen area easily without affecting the split-screen area on the other side.

Method used

By performing specific gestures at the bottom of the split-screen area, such as sliding and hovering over the two fingers, triggering a multitasking interface that displays the corresponding split-screen area, the user can choose to switch to the interface of the desired task without affecting the split-screen area on the other side.

Benefits of technology

The task interface that switches the split-screen area on one side is realized based on the multi-task interface, which improves the convenience of users when using the split-screen display function.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119556821A_ABST
    Figure CN119556821A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a display method, electronic equipment and a storage medium, relates to the technical field of electronic equipment, and can improve the convenience when a user uses a split-screen display function. The display method comprises the steps that a first interface is displayed in a first split screen area, and a second interface is displayed in a second split screen area; detecting a first operation; in response to the first operation, a third interface is displayed, the third interface is used for displaying tasks of a first multi-task list corresponding to the first split screen area, and the first multi-task list comprises the first tasks; detecting a second operation acting on the first task in the third interface; and in response to the second operation, displaying an interface of the first task in the first split screen area.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of electronic devices, and in particular to a display method, an electronic device and a storage medium. Background Art

[0002] With the development of electronic devices, more and more electronic devices can meet the user's multi-tasking needs. For example, users can use the split-screen display function of foldable screen mobile phones to handle different tasks. However, the current split-screen display function is not convenient enough in some scenarios. Summary of the invention

[0003] In view of this, the present application provides a display method, an electronic device and a storage medium, which can improve the convenience for users when using the split-screen display function.

[0004] In a first aspect, an embodiment of the present application provides a display method, including: displaying a first interface in a first split-screen area, and displaying a second interface in a second split-screen area; detecting a first operation; displaying a third interface in response to the first operation, the third interface being used to display tasks corresponding to a first multi-task list in the first split-screen area, the first multi-task list including a first task; detecting a second operation acting on the first task in the third interface; and displaying the interface of the first task in the first split-screen area in response to the second operation.

[0005] When the electronic device is in a split-screen display state, the multitasking interface corresponding to one side of the split-screen area can be triggered to be displayed through a first operation. By acting on the selection of a task in the multitasking interface, the split-screen area on one side can be triggered to switch to the interface of the selected task without affecting the split-screen area on the other side. That is, switching of a single split-screen area is realized based on the multitasking interface, thereby improving the convenience of users when using the split-screen display function.

[0006] In a possible implementation, the method also includes: detecting a third operation; in response to the third operation, displaying a fourth interface, the fourth interface being used to display tasks in a second multi-task list corresponding to the second split-screen area, the second multi-task list including the second task; detecting a fourth operation acting on the second task in the fourth interface; in response to the fourth operation, displaying the interface of the second task in the second split-screen area.

[0007] In one possible implementation, the first operation is a first operation acting on the first split-screen area; displaying the third interface includes: displaying the third interface in the first split-screen area; the second operation is a second operation acting on the second split-screen area; displaying the fourth interface includes: displaying the fourth interface in the second split-screen area.

[0008] In a possible implementation, the method also includes: detecting a fifth operation; in response to the fifth operation, displaying a fifth interface, the fifth interface being used to display a third task list, the third multi-task list including all tasks in the first multi-task list and the second multi-task list, the third task list including a combination of the third task and the fourth task and the fifth task; if a sixth operation acting on the combination of the third task and the fourth task in the fifth interface is detected; then in response to the sixth operation, displaying the interface of the third task in the first split-screen area, and displaying the interface of the fourth task in the second split-screen area; if a seventh operation acting on the fifth task in the fifth interface is detected; then in response to the seventh operation, displaying the interface of the fifth task in full screen.

[0009] In a possible implementation, before displaying the first interface in the first split-screen area, the method further includes: displaying an interface of a first task in the first split-screen area, and adding the first task to a first multi-task list.

[0010] In a possible implementation, before displaying the second interface in the second split-screen area, the method further includes: displaying an interface of a second task in the second split-screen area, and adding the second task to a second multi-task list.

[0011] In a possible implementation, the method also includes: displaying partial content of the application in a picture-in-picture area or a floating area; detecting an eighth operation acting on the picture-in-picture area or the floating area; and in response to the eighth operation, displaying the complete content interface of the application in the first split-screen area or the second split-screen area.

[0012] In a second aspect, a display method is provided, including: displaying partial content of an application in a picture-in-picture area or a floating area; detecting an eighth operation acting on the picture-in-picture area or the floating area; and displaying the complete content interface of the application in a first split-screen area or a second split-screen area in response to the eighth operation.

[0013] This method can find the corresponding application task according to the corresponding window of the picture-in-picture area or the floating area, and trigger the split screen of the corresponding application through a specific gesture on the window, thereby improving the convenience of users when using the split-screen display function.

[0014] According to a third aspect, an electronic device is provided, including: a processor and a memory, wherein the memory is used to store at least one instruction, and when the instruction is loaded and executed by the processor, the electronic device executes the above method.

[0015] In a fourth aspect, a computer-readable storage medium is provided, comprising a program or an instruction, and when the program or the instruction is run on a computer, the above method is executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0017] Figure 1 A schematic diagram of a multi-task interface of an electronic device in the related art;

[0018] Figure 2 A schematic diagram of a floating window display of an electronic device in the related art;

[0019] Figure 3 This is a structural block diagram of an electronic device in an embodiment of the present application;

[0020] Figure 4 A schematic diagram of the software architecture of an electronic device in an embodiment of the present application;

[0021] Figure 5 This is a schematic diagram of interface changes of an electronic device in an embodiment of the present application;

[0022] Figure 6 This is a schematic diagram of interface changes of another electronic device in an embodiment of the present application;

[0023] Figure 7 This is a schematic diagram of interface changes of another electronic device in an embodiment of the present application;

[0024] Figure 8 This is a schematic diagram of interface changes of another electronic device in an embodiment of the present application;

[0025] Fig. 9 A schematic diagram of a display method in an embodiment of the present application;

[0026] Fig.10 A schematic diagram of the relationship between multiple task lists in an embodiment of the present application;

[0027] Fig.11 This is a schematic diagram of interface changes of another electronic device in an embodiment of the present application;

[0028] Fig.12 A schematic diagram of another relationship between multiple task lists in an embodiment of the present application;

[0029] Fig.13 This is a schematic diagram of interface changes of another electronic device in an embodiment of the present application;

[0030] Fig.14 This is a schematic diagram of a process of triggering split screen in an embodiment of the present application;

[0031] Fig.15 This is a schematic diagram of interface changes of another electronic device in an embodiment of the present application. DETAILED DESCRIPTION

[0032] In order to better understand the technical solution of the present application, the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0033] It should be clear that the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0034] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0035] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0036] Before describing the embodiments of the present application, the related technologies and their technical problems are first described.

[0037] In the related art, when the electronic device is in split-screen mode, if the user wants to switch to other task interfaces in the background, the user can open the multi-tasking interface, such as Figure 1 As shown, in the multitasking interface, the user can select the task combination corresponding to the two split-screen areas for switching. However, if the user only wants to switch the task of one split-screen area without changing the task of the other split-screen area, a more complicated process is required, and the switching of a single split-screen area cannot be achieved based on the multitasking interface, resulting in lower convenience for users when using the split-screen display function.

[0038] In addition, in the related art, such as Figure 2 As shown, when part of the content of the application is displayed in the form of a picture-in-picture area or a floating area, the user needs a more complicated process to realize split-screen display for the content, resulting in low convenience for the user when using the split-screen display function.

[0039] In order to solve the problems in the related art, the embodiments of the present application provide the following technical solutions, which are described below.

[0040] Figure 3 A schematic structural diagram of an electronic device 100 is shown.

[0041] The electronic device 100 may include a processor 110, an internal memory 121, a sensor module 180, a display screen 194, etc. The sensor module 180 may include a touch sensor 180K, etc.

[0042] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0043] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0044] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0045] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0046] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0047] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0048] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0049] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0050] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the electronic device 100.

[0051] Figure 4 1 is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention.

[0052] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0053] The application layer can include a series of application packages.

[0054] like Figure 4 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0055] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0056] like Figure 4 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0057] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0058] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0059] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0060] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0061] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0062] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0063] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0064] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0065] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0066] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0067] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0068] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0069] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0070] A 2D graphics engine is a drawing engine for 2D drawings.

[0071] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0072] The present application embodiment provides a display method, and the execution subject of the method can be the above-mentioned electronic device, such as Figure 5 As shown, the method includes: displaying a first interface in a first split-screen area A1, and displaying a second interface in a second split-screen area A2; detecting a first operation, the first operation being, for example, a single-finger or double-finger swipe up operation, a single-finger or double-finger swipe up and hovering operation, etc., acting on the bottom of the first split-screen area A1; in response to the first operation, displaying a third interface, the third interface being used to display tasks in a first multi-task list corresponding to the first split-screen area A1, the first multi-task list including the first task, the third interface can be referred to as a multi-task interface of the first split-screen area A1 or a recent task interface of the first split-screen area A1, for example, the interface of the first task and its corresponding application name are displayed in the middle of the third interface, the tasks in the first multi-task list are recent tasks corresponding to the first split-screen area A1, that is, background tasks corresponding to the first split-screen area A1, and the tasks in the first multi-task list can specifically be tasks that have been opened in the first split-screen area A1. The third interface can display at least part of the tasks in the first multi-task list. Based on the sliding operation on the third interface, the third interface can scroll to display multiple tasks in the first multi-task list, so that the user can select the task interface that needs to be switched and displayed in the first split-screen area A1; a second operation acting on the first task in the third interface is detected, and the second operation is, for example, a click operation on the first task interface in the third interface; in response to the second operation, the interface of the first task is displayed in the first split-screen area A1.

[0073] Specifically, a specific example is used to illustrate that the electronic device is a foldable mobile phone, and the foldable mobile phone is in a left-right split-screen state. The first split-screen area A1 on the left side displays the first interface of the browser application, and the second split-screen area A2 on the right side displays the second interface of the video playback application. While watching the video through the second interface on the right side, the user searches for information through the web page interface on the left. At this time, the user wants to chat with other users without affecting the video viewing, so he can perform a two-finger swipe up and hover operation at the bottom of the first split-screen area A1, and the multitasking interface corresponding to the first split-screen area A1, that is, the third interface, will be displayed. The most recent tasks corresponding to the first split-screen area A1 are displayed in the third interface, including the interface of the first task, and the first task is the instant messaging application. At this time, the user clicks on the interface of the instant messaging application in the third interface, which can switch the web page interface previously displayed on the left side of the mobile phone to the chat interface of the instant messaging application, while the previous video interface is still maintained on the right side of the mobile phone. The first multi-task list is only related to the first split-screen area A1 and has nothing to do with the second split-screen area A2. The first multi-task list is used to manage tasks corresponding to the first split-screen area A1. Therefore, the selection of tasks in the first multi-task list only involves the interface switching of the tasks displayed in the first split-screen area A1 and will not affect the second split-screen area A2.

[0074] It should also be noted that the embodiment of the present application is only described by taking a folding mobile phone with two split screens as an example, but the embodiment of the present application does not limit the number of split screens. For example, the mobile phone can also be split into three split screen areas, four split screen areas, etc. The first split screen area A1 and the second split screen area A2 in the embodiment of the present application can be any two of the multiple split screens of an unlimited number. In addition, the electronic device applied by the embodiment of the present application is not limited to the folding screen device, but can also be applied to a straight-plate mobile phone, a tablet, etc. In addition, when the embodiment of the present application is applied to the folding screen device, the folding screen device is not limited to having only one folding axis. For example, it can also be applied to a 3-fold electronic device with two folding axes, or to a 4-fold electronic device with three folding axes, etc. For example, a 3-fold electronic device can correspond to 3 split screen areas, and a 4-fold electronic device can correspond to 4 split screen areas. That is to say, when the electronic device displays multiple split screen areas, in response to the first operation at the bottom of any split screen area, the multi-task interface corresponding to the split screen area can be displayed, and based on the selection of the task in the multi-task interface, the split screen area can be switched to an interface for displaying the selected task.

[0075] In the embodiment of the present application, when the electronic device is in a split-screen display state, the multitasking interface corresponding to the split-screen area on one side can be triggered to be displayed through a first operation, and by selecting a task in the multitasking interface, the split-screen area on one side can be triggered to switch to the interface of the selected task without affecting the split-screen area on the other side, that is, switching of a single split-screen area is realized based on the multitasking interface, which improves the convenience of users when using the split-screen display function. In addition, the multitasking interface displayed in the split-screen area is the task corresponding to the split-screen area, which can facilitate users to select and run the corresponding task in the corresponding split-screen.

[0076] In some embodiments, Figure 6 As shown, the above method also includes: detecting a third operation, the third operation being, for example, a single-finger or double-finger swipe up operation, a single-finger or double-finger swipe up and hovering operation, etc. acting on the bottom of the second split-screen area A2; in response to the third operation, displaying a fourth interface, the fourth interface being used to display tasks in the second multi-task list corresponding to the second split-screen area A2, the second multi-task list including the second task, the fourth interface can be called the multi-task interface of the second split-screen area A2 or the recent task interface of the second split-screen area A2, for example, the interface of the second task and its corresponding application name are displayed in the middle of the fourth interface, and any task in the second multi-task list The fourth interface can display at least part of the tasks in the second multi-task list based on the sliding operation on the fourth interface. The fourth interface can scroll and display multiple tasks in the second multi-task list, so that the user can select the task interface that needs to be switched and displayed in the second split-screen area A2; a fourth operation on the second task in the fourth interface is detected, and the fourth operation is, for example, a click operation on the second task interface in the fourth interface; in response to the fourth operation, the interface of the second task is displayed in the second split-screen area A2.

[0077] Specifically, for example, the user has switched the first split screen area A1 on the left side of the mobile phone to the chat interface of the instant messaging application, that is, the interface of the first task, while the second split screen area A2 on the right side of the mobile phone displays the video interface, that is, the second interface. At this time, if you want to shop online while chatting, you can perform a two-finger upward swipe and hover operation at the bottom of the second split screen area A2, and the multi-task interface corresponding to the second split screen area A2, that is, the fourth interface, will be displayed. The recent tasks corresponding to the second split screen area A2 are displayed in the fourth interface, including the interface of the second task, and the second task is the shopping application. At this time, the user clicks on the interface of the shopping application in the fourth interface, that is, the video interface previously displayed on the right side of the mobile phone can be switched to the interface of the shopping application, while the previous chat interface is still maintained on the left side of the mobile phone. The second multi-task list is only related to the second split screen area A2, and has nothing to do with the first split screen area A1. The second multi-task list is used to manage the tasks corresponding to the second split screen area A2. Therefore, based on the selection of tasks in the second multi-task list, only the interface switching of the tasks displayed in the second split screen area A2 is involved, and it will not affect the first split screen area A1. That is to say, the first multi-task list and the second multi-task list each independently manage tasks corresponding to different split-screen areas. By selecting tasks in the two, the interfaces of tasks displayed in different split-screen areas can be independently switched.

[0078] In the previous embodiment, the user first switches the interface on the left side of the mobile phone to the chat interface by selecting a task in the third interface, and then switches the interface on the right side of the mobile phone to the shopping interface by selecting a task in the fourth interface. This switching sequence is only an example. The embodiment of the present application does not limit the execution order of the above method. For example, Figure 7 As shown, the user can also display the third interface by sliding up and hovering with two fingers at the bottom of the first split screen area A1, and display the fourth interface by sliding up and hovering with two fingers at the bottom of the second split screen area A2. At this time, the user can select the first task in the third interface and the second task in the fourth interface, so that the first split screen area A1 switches from displaying the first interface to displaying the interface of the first task, and switches the second split screen area A2 from displaying the second interface to displaying the interface of the second task.

[0079] In some embodiments, the first operation is a first operation acting on the first split-screen area A1; displaying the third interface includes: displaying the third interface in the first split-screen area A1; the second operation is a second operation acting on the second split-screen area A2; displaying the fourth interface includes: displaying the fourth interface in the second split-screen area A2.

[0080] Specifically, for example, different split-screen areas can be provided with corresponding hot zone positions. Assuming that the hot zone position corresponding to the first split-screen area A1 is the bottom of the first split-screen area A1, the first operation is a specific operation acting on the hot zone corresponding to the first split-screen area A1, and the specific operation is, for example, two-finger swipe up and hover; the hot zone position corresponding to the second split-screen area A2 is the bottom of the second split-screen area A2, and the second operation is a specific operation acting on the hot zone corresponding to the second split-screen area A2, for example, two-finger swipe up and hover. That is to say, when the user performs a two-finger swipe up and hover gesture operation at the bottom of the first split-screen area A1, the mobile phone will be triggered to display the third interface in the first split-screen area A1, and when the user performs a two-finger swipe up and hover gesture operation at the bottom of the second split-screen area A2, the mobile phone will be triggered to display the fourth interface in the second split-screen area A2. On the one hand, setting the operation position of the multi-task interface corresponding to the trigger split-screen area on the corresponding split-screen area can facilitate the user to perform targeted operations; on the other hand, setting the display position of the multi-task interface in the corresponding split-screen area can facilitate intuitive display of the corresponding relationship between the task to be selected and the split-screen area.

[0081] In some embodiments, Figure 8 As shown, the above method also includes: detecting a fifth operation, the fifth operation being, for example, a single-finger upward swiping and hovering operation acting on the bottom of the screen; in response to the fifth operation, displaying a fifth interface, the fifth interface being used to display a third task list, the third multitasking list including all tasks in the first multitasking list and the second multitasking list, the third task list including a combination of the third task and the fourth task and the fifth task; if a sixth operation acting on the combination of the third task and the fourth task in the fifth interface is detected; then, in response to the sixth operation, displaying the interface of the third task in the first split-screen area A1, and displaying the interface of the fourth task in the second split-screen area A2; the interface of the fifth task is displayed in Figure 8 Not shown, based on the sliding operation acting on the fifth interface, the tasks in the fifth interface can be scrolled and displayed. When the interface of the fifth task is displayed in the fifth interface, if the seventh operation acting on the fifth task in the fifth interface is detected; then in response to the seventh operation, the interface of the fifth task is displayed in full screen. The third task list is a global task list, which is used to manage split-screen tasks and full-screen tasks. Split-screen tasks are tasks corresponding to the first split-screen area A1 and the second split-screen area A2, and full-screen tasks are tasks running in a non-split-screen state. The third task and the fourth task are both split-screen tasks, while the fifth task is a full-screen task. Figure 8 The process shown is the process of switching based on the multi-tasking interface in the related art. That is to say, in the embodiment of the present application, in addition to being able to switch tasks in independent split-screen areas through the corresponding multi-tasking interface for different split-screen areas, tasks can also be switched through the global multi-tasking interface, for example, switching to other split-screen combination interfaces or other single application interfaces.

[0082] In some embodiments, before the first split-screen area A1 displays the first interface, the method further includes: displaying an interface of a first task in the first split-screen area A1, and adding the first task to a first multi-task list.

[0083] In some embodiments, before the second split-screen area A2 displays the second interface, the method further includes: displaying an interface of a second task in the second split-screen area A2, and adding the second task to a second multi-task list.

[0084] Specifically, that is to say, the tasks in the first task list come from the tasks displayed in the first split-screen area A1, that is, the first task list is used to manage the recent tasks corresponding to the first split-screen area A1; the tasks in the second task list come from the tasks displayed in the second split-screen area A2, that is, the second task list is used to manage the recent tasks corresponding to the second split-screen area A2.

[0085] In some embodiments, when the interface of the current task displayed in the first split-screen area A1 is switched to the background, the first multi-task list is updated based on the task; when the interface of the current task displayed in the second split-screen area A2 is switched to the background, the second multi-task list is updated based on the task.

[0086] The following is a specific example to illustrate.

[0087] First, the user controls the electronic device to display in split screen. Here, two split screens are taken as an example, that is, the screen of the electronic device is divided into two split screen areas, the first split screen area A1 and the second split screen area A2. In other possible implementations, it can also be divided into more split screen areas. After the split screen, the position and size information of each split screen area are managed and saved by the system split screen service, and are refreshed as the split screen size is adjusted. Fig. 9 As shown, Fig. 9 Only the process of triggering the display of the third interface based on the first split-screen area A1 is illustrated. During the split-screen display process, the bottom gesture hot zone can be divided according to the distribution of the current split-screen areas. For example, the first split-screen area A1 and the second split-screen area A2 are respectively the areas on the left and right sides of the screen, then the bottom of the first split-screen area A1 is divided into its corresponding gesture hot zone, and the bottom of the second split-screen area A2 is divided into its corresponding gesture hot zone. During the split-screen display process, global multi-task management will be triggered, the third multi-task management list will be obtained, and global multi-task management will be performed. The global multi-task management will trigger the first multi-task management and the second multi-task management. The first multi-task management will establish a corresponding first multi-task list for the first split-screen area A1, and the second multi-task management will establish a corresponding second multi-task list for the second split-screen area A2. These two multi-task lists are used to record the application tasks on the corresponding split screens respectively. The global third multi-task list manages all application tasks. As Fig.10As shown, assuming that in the first split screen, the first split screen area A1 displays the interface of the first task, then the first task is added to the first multi-task list, and the second split screen area A2 displays the interface of the second task, then the second task is added to the second multi-task list. At this time, the third multi-task list also includes the first task and the second task. Fig.11 As shown, after the split-screen display, the electronic device detects, for example, a two-finger swipe-up release operation on the bottom of the first split-screen area A1, and in response to the operation, displays the main interface in the first split-screen area A1. The main interface is the interface of the desktop application, and multiple application icons are displayed in the main interface. The electronic device detects a selection operation of an application icon in the main interface of the first split-screen area A1, and in response to the operation, displays the interface of the selected application, such as the first interface, in the first split-screen area A1. Similarly, after the split-screen display, the electronic device detects, for example, a two-finger swipe-up release operation on the bottom of the second split-screen area A2, and in response to the operation, displays the main interface in the second split-screen area A2. The electronic device detects a selection operation of an application icon in the main interface of the second split-screen area A2, and in response to the operation, displays the interface of the selected application, such as the second interface, in the second split-screen area A2. As shown Fig.12 As shown, the applications opened on different split screens will be managed by their own multitasking lists, and the global multitasking list will manage all tasks at the same time. If a two-finger swipe up and hover operation is detected at the bottom of the first split screen area A1, the first multitasking list will be obtained and the multitasking interface corresponding to the first split screen area A1 will be displayed. For the specific process, please refer to Figure 5 Similarly, the second split screen area A2 can also have four types of processes, which can be specifically referred to Figure 6 Similarly, the original system gestures, such as a single-finger upward swipe and hover gesture, can still trigger the global multi-task interface corresponding to the task display obtained from the third task list. For details, please refer to Figure 6 That is to say, after the mobile phone is split, each split screen area can independently return to the desktop and enter the recent task interface through gesture interaction, and the set gesture interaction corresponds to each split screen hot zone; different from the global recent task management, the split screen area independently manages the recent task list, and each split screen area has its own recent task management.

[0088] In addition, the embodiments of the present application do not limit the specific operations of the above-mentioned various gesture operations. Here, a set of gestures for triggering the display of the multitasking interface and triggering the feedback desktop are used as examples. For example, the above-mentioned first operation is a two-finger swipe up and hover operation acting on the bottom of the first split-screen area A1, the above-mentioned third operation is a two-finger swipe up and hover operation acting on the bottom of the second split-screen area A2, and the above-mentioned fifth operation is a single-finger swipe up and hover operation acting on the bottom of the screen. In one possible implementation, for the user, if he swipes up with two fingers and holds the control at the bottom of the left split screen, the multitasking interface of the corresponding left split screen will be displayed, so that the tasks of the left split screen can be switched independently; if he swipes up with two fingers and releases at the bottom of the left split screen, the desktop will be displayed in the left split screen area, so that new applications can be run independently in the left split screen area; if he swipes up with two fingers and holds the control at the bottom of the right split screen, the desktop will be displayed in the right split screen area, so that new applications can be run independently in the right split screen area; if he swipes up with two fingers and holds the control at the bottom of the right split screen, the desktop will be displayed in the right split screen area, so that new applications can be run independently in the right split screen area; if he swipes up with one finger and holds the control at the bottom of any split screen, the global multitasking interface will be displayed; if he swipes up with one finger and releases on a part of the split screen, the desktop will be displayed in full screen.

[0089] In other words, different gestures can be used to distinguish between the split-screen multitasking interface and the global multitasking interface. In addition, different hot zones can also be used to display different types of task interfaces. For example, the bottom area of ​​the screen is divided into a left bottom area, a middle bottom area, and a right bottom area. The first operation is a single-finger swipe up and hover operation on the left bottom area, the third operation is a single-finger swipe up and hover operation on the right bottom area, and the fifth operation is a single-finger swipe up and hover operation on the middle bottom area. The single-finger swipe up and hover operation here is only an example, and can also be replaced by other gesture operations such as a two-finger swipe up and hover operation. In other words, the same gesture operation can be used to trigger the display of a multitasking interface, and different gesture hot zones can be used to distinguish and display different types of multitasking interfaces.

[0090] In some embodiments, the method further includes: displaying part of the content of the application in the picture-in-picture area or the floating area, where the picture-in-picture area or the floating area displays part of the UI drawing content of the application, rather than a reduced interface of the complete application, such as Fig.13 As shown, the video content is displayed in the picture-in-picture area or the floating area. Fig.13The illustrated picture-in-picture area or floating area is located in the first split-screen area A1 for example only, and the picture-in-picture area or floating area can be located at any position. The picture-in-picture area or floating area is not necessarily located in the split-screen state, and can also be a picture-in-picture area or floating area with a full-screen desktop or a full-screen application as the background. The difference between the picture-in-picture area display and the floating area display is that the floating area display function does not require the application to be enabled separately, and the picture-in-picture area display requires the application to be enabled. The above method also includes: detecting an eighth operation acting on the picture-in-picture area or the floating area, the eighth operation is an operation related to the first split-screen area A1, such as a long press on the picture-in-picture area or the floating area and dragging it to the hot zone corresponding to the first split-screen area A1; in response to the eighth operation, the complete content interface of the application is displayed in the first split-screen area A1. It can be understood that if the eighth operation is an operation of long pressing and dragging the picture-in-picture area or the floating area to the hot zone corresponding to the second split-screen area A2, it will trigger the display of the complete content interface of the application in the second split-screen area A2.

[0091] Specifically, if the picture-in-picture area or the floating area is displayed in the full-screen state, a long press operation will trigger the split screen, display the first split-screen area A1 and the second split-screen area A2, and make the picture-in-picture area or the floating area enter the drag state. At this time, if it is dragged to the hot zone corresponding to a certain split-screen area, it will trigger the display of the complete content interface of the application corresponding to the picture-in-picture area or the floating area in the split-screen area. At this time, there is no limitation on the display content of the other split-screen area. For example, the background interface of the picture-in-picture area or the floating area displayed in the full-screen state can be displayed, or a preset interface can be displayed, or another interface of the application corresponding to the picture-in-picture area or the floating area can be displayed. If the picture-in-picture area or the floating area is displayed in the split-screen state, a long press operation will cause the picture-in-picture area or the floating area to enter the drag state. At this time, if it is dragged to the hot zone corresponding to a certain split-screen area, it will trigger the display of the complete content interface of the application corresponding to the picture-in-picture area or the floating area in the split-screen area. At this time, the display content of the other split-screen area can remain unchanged. The picture-in-picture area is the picture-in-picture window, and the floating area is the floating window. Both the picture-in-picture area and the floating area are managed by the system window, and each window corresponds to an application process. For the content displayed in the picture-in-picture area or the floating area, the user can trigger the split screen by a specific gesture operation acting on the area, such as long pressing the picture-in-picture area or the floating area. After the split screen is triggered, the task stack application corresponding to the picture-in-picture area or the floating area will be searched and determined, and then the interface of the corresponding task stack application will be displayed in split screen. For example, the electronic device currently displays the first split screen area A1 on the left and the second split screen area A2 on the right. The floating area of ​​the first split screen area A1 on the left displays the video being played. After the user long presses the floating area and drags the floating area to the hot zone corresponding to the first split screen area A1, the split screen of the floating area will be triggered, that is, the application corresponding to the video displayed in the floating area will be searched, and the complete application interface corresponding to the video will be displayed in the first split screen area A1. In this way, the corresponding application task can be found according to the window corresponding to the picture-in-picture area or the floating area, and the split screen of the corresponding application can be triggered by a specific gesture on the window, thereby improving the convenience of the user when using the split screen display function.

[0092] In some embodiments, Fig.13 As shown, for example, the picture-in-picture area or the floating area is displayed in a split-screen state, and the second split-screen area A2 displays the sixth interface; in response to the eighth operation, the process of displaying the complete content interface of the application in the first split-screen area A1 includes: in response to the eighth operation of long pressing and dragging the picture-in-picture area or the floating area to the hot zone corresponding to the first split-screen area A1, the complete content interface of the application is displayed in the first split-screen area A1, and the sixth interface is displayed in the second split-screen area A2. This method will not affect the content displayed in the split-screen area on the other side.

[0093] In some embodiments, Fig.15As shown, the picture-in-picture area or the floating area can also be displayed in a non-split screen state. For example, when the electronic device is in a non-split screen state and displays the picture-in-picture area or the floating area, an eighth operation of long pressing and dragging the picture-in-picture area or the floating area to the hot zone corresponding to the first split screen area A1 is detected; in response to the eighth operation, the split screen is triggered and the complete content interface of the application is displayed in the first split screen area A1, and the previous non-split screen interface can be displayed in the second split screen area A2.

[0094] like Fig.13 As shown, the embodiment of the present application also provides a display method, including: displaying part of the content of an application in a picture-in-picture area or a floating area; detecting an eighth operation of long pressing the picture-in-picture area or the floating area and dragging it to the hot zone corresponding to the first split-screen area A1; in response to the eighth operation, displaying the complete content interface of the application in the first split-screen area A1. It can be understood that if the eighth operation is an operation of long pressing the picture-in-picture area or the floating area and dragging it to the hot zone corresponding to the second split-screen area A2, it will trigger the display of the complete content interface of the application in the second split-screen area A2. The difference between the display method in this embodiment and the display method in the above embodiment is that the embodiment of the present application does not rely on switching based on a multi-task interface, but is an independent display method based on triggering split screens based on picture-in-picture areas or floating areas. In this way, the corresponding application task can be found according to the window corresponding to the picture-in-picture area or the floating area, and the split screen of the corresponding application can be triggered by a specific gesture on the window, thereby improving the convenience of users when using the split-screen display function.

[0095] In some embodiments, Fig.13 As shown, displaying partial content of an application in a picture-in-picture area or a floating area includes: displaying partial content of an application in the picture-in-picture area or a floating area in a split-screen state, and displaying the sixth interface in the second split-screen area; in response to the eighth operation, the process of displaying the complete content interface of the application in the first split-screen area includes: in response to the eighth operation, displaying the complete content interface of the application in the first split-screen area, and displaying the sixth interface in the second split-screen area.

[0096] In some embodiments, Fig.15 As shown, displaying partial content of an application in a picture-in-picture area or a floating area includes: displaying partial content of an application in the picture-in-picture area or a floating area of ​​a seventh interface; in response to the eighth operation, the process of displaying the complete content interface of the application in the first split-screen area includes: in response to the eighth operation, displaying the complete content interface of the application in the first split-screen area, and displaying the seventh interface in the second split-screen area.

[0097] The embodiment of the present application also provides an electronic device, including: a processor and a memory, the memory is used to store at least one instruction, and when the instruction is loaded and executed by the processor, the electronic device executes the display method in any of the above embodiments. The specific process and principle of the display method can be the same as the above embodiment, and will not be repeated here. The specific structure and principle of the electronic device can be the same as the above embodiment, and will not be repeated here.

[0098] The electronic devices involved in this application may be smart TVs, mobile phones, tablet computers, personal computers (PCs), personal digital assistants (PDAs), smart watches, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, vehicle-mounted devices, drone devices, smart cars, smart speakers, robots, smart glasses, and any other products.

[0099] An embodiment of the present application further provides a computer-readable storage medium, including a program or an instruction. When the program or the instruction runs on a computer, the method in any of the above embodiments is executed.

[0100] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in this application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk), etc.

[0101] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0102] The above are only preferred embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A display method, characterized in that: include: Displaying a first interface in the first split-screen area, and displaying a second interface in the second split-screen area; A first operation is detected; In response to the first operation, displaying a third interface, the third interface being used to display tasks in a first multi-task list corresponding to the first split-screen area, the first multi-task list including a first task; detecting a second operation acting on the first task in the third interface; In response to the second operation, an interface of the first task is displayed in the first split-screen area.

2. The method according to claim 1, characterized in that Also includes: A third operation is detected; In response to the third operation, displaying a fourth interface, wherein the fourth interface is used to display tasks in a second multi-task list corresponding to the second split-screen area, wherein the second multi-task list includes a second task; detecting a fourth operation acting on the second task in the fourth interface; In response to the fourth operation, an interface of the second task is displayed in the second split-screen area.

3. The method according to claim 2, characterized in that The first operation is a first operation acting on the first split-screen area; Displaying the third interface includes: displaying the third interface in the first split-screen area; The second operation is a second operation acting on the second split-screen area; Displaying the fourth interface includes: displaying the fourth interface in the second split-screen area.

4. The method according to claim 2 or 3, characterized in that: Also includes: A fifth operation is detected; In response to the fifth operation, displaying a fifth interface, the fifth interface being used to display a third task list, the third multi-task list including all tasks in the first multi-task list and the second multi-task list, the third task list including a combination of the third task and the fourth task and the fifth task; If a sixth operation acting on a combination of the third task and the fourth task in the fifth interface is detected; In response to the sixth operation, the interface of the third task is displayed in the first split-screen area, and the interface of the fourth task is displayed in the second split-screen area; If a seventh operation acting on the fifth task in the fifth interface is detected; In response to the seventh operation, the interface of the fifth task is displayed in full screen.

5. The method according to any one of claims 1 to 4, characterized in that: Before displaying the first interface in the first split-screen area, the method further includes: The interface of the first task is displayed in the first split-screen area, and the first task is added to the first multi-task list.

6. The method according to any one of claims 2 to 5, characterized in that Before displaying the second interface in the second split-screen area, the method further includes: The interface of the second task is displayed in the second split-screen area, and the second task is added to the second multi-task list.

7. The method according to any one of claims 1 to 6, characterized in that Also includes: Display part of the app content in the picture-in-picture area or floating area; An eighth operation acting on the picture-in-picture area or the floating area is detected; In response to the eighth operation, a complete content interface of the application is displayed in the first split-screen area or the second split-screen area.

8. A display method, characterized in that: include: Display part of the app content in the picture-in-picture area or floating area; An eighth operation acting on the picture-in-picture area or the floating area is detected; In response to the eighth operation, a complete content interface of the application is displayed in the first split-screen area or the second split-screen area.

9. An electronic device, characterized in that: include: A processor and a memory, wherein the memory is used to store at least one instruction, and when the instruction is loaded and executed by the processor, the electronic device executes the method as claimed in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The method comprises a program or an instruction, and when the program or the instruction is run on a computer, the method according to any one of claims 1 to 8 is executed.

Citation Information

Patent Citations

  • Method and device for switching applications in split screen mode and related equipment of method and device

    CN107256129A

  • Split-screen application switching method, device, storage medium and electronic device

    CN109062467A

  • Split-screen application switching method, device, storage medium and electronic device

    CN109062479A

  • Split-screen display operation method and electronic equipment

    CN110244893A

  • Method for switching application and tasks in application and electronic equipment

    CN114461312A

Cited By

  • Display method, electronic device, and storage medium

    EP4715547A1