Display method, electronic device, and storage medium

By introducing a multi-task interface into the split-screen display function, users can switch tasks of a single split-screen area without affecting another split-screen area through specific operations, solving the problem of insufficient convenience of split-screen display function in the prior art, and achieving more efficient task management and switching.

WO2025044516A1PCT designated stage expired Publication Date: 2025-03-06HUAWEI TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/104145
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-09-01
Filing Date
2024-07-08
Publication Date
2025-03-06

AI Technical Summary

Technical Problem

The existing split-screen display function is not convenient enough in some scenarios, making it difficult for users to switch tasks in a single split-screen area without affecting another split-screen area.

Method used

By detecting specific operations (such as sliding and hovering on both fingers) at the bottom of the split screen area, triggering the multi-task interface that displays the corresponding split screen area. In this interface, the user can select the interface to switch to the required task without affecting another split screen area.

Benefits of technology

In the split screen display state, task switching in a single split screen area becomes more convenient, and users can independently manage and switch tasks in each split screen area, improving the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024104145_06032025_PF_FP_ABST
    Figure CN2024104145_06032025_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present application relate to the technical field of electronic devices, and provide a display method, an electronic device, and a storage medium, which can improve the convenience of using a split-screen display function by a user. The display method comprises: displaying a first interface in a first split-screen area, and displaying a second interface in a second split-screen area; detecting a first operation; in response to the first operation, displaying a third interface, wherein the third interface is used for displaying tasks in a first multi-task list corresponding to the first split-screen area, and the first multi-task list comprises a first task; detecting a second operation acting on the first task in the third interface; and in response to the second operation, displaying an interface of the first task in the first split-screen area.
Need to check novelty before this filing date? Find Prior Art

Description

Display method, electronic device, and storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on September 1, 2023, with application number 202311135667.8 and application name “Display Method, Electronic Device and Storage Medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the technical field of electronic devices, and in particular to a display method, electronic device, and storage medium. Background Art

[0003] With the development of electronic devices, more and more electronic devices can meet the needs of users for multitasking. For example, users can use the split-screen display function of foldable screen phones to handle different tasks. However, the current split-screen display function is not convenient enough in some scenarios.

[0004] Summary of the Invention

[0005] In view of this, the present application provides a display method, electronic device and storage medium, which can improve the convenience of users when using the split-screen display function.

[0006] In the first aspect, an embodiment of the present application provides a display method, including: displaying a first interface in a first split-screen area, and displaying a second interface in a second split-screen area; detecting a first operation; displaying a third interface in response to the first operation, the third interface being used to display tasks corresponding to a first multi-task list in the first split-screen area, the first multi-task list including a first task; detecting a second operation acting on the first task in the third interface; and displaying the interface of the first task in the first split-screen area in response to the second operation.

[0007] When the electronic device is in a split-screen display state, the multi-task interface corresponding to the split-screen area on one side can be triggered to be displayed through a first operation. By acting on the selection of a task in the multi-task interface, the split-screen area on one side can be triggered to switch to the interface of the selected task without affecting the split-screen area on the other side. That is, the switching of a single split-screen area is realized based on the multi-task interface, which improves the convenience of users when using the split-screen display function.

[0008] In a possible embodiment, the method also includes: detecting a third operation; in response to the third operation, displaying a fourth interface, the fourth interface being used to display tasks in a second multi-task list corresponding to the second split-screen area, the second multi-task list including the second task; detecting a fourth operation acting on the second task in the fourth interface; in response to the fourth operation, displaying the interface of the second task in the second split-screen area.

[0009] In one possible embodiment, the first operation is a first operation acting on the first split-screen area; displaying the third interface includes: displaying the third interface in the first split-screen area; the second operation is a second operation acting on the second split-screen area; displaying the fourth interface includes: displaying the fourth interface in the second split-screen area.

[0010] In a possible embodiment, the method also includes: detecting a fifth operation; in response to the fifth operation, displaying a fifth interface, the fifth interface being used to display a third task list, the third multitasking list including all tasks in the first multitasking list and the second multitasking list, the third task list including a combination of the third task and the fourth task and the fifth task; if a sixth operation acting on the combination of the third task and the fourth task in the fifth interface is detected; then in response to the sixth operation, displaying the interface of the third task in the first split-screen area, and displaying the interface of the fourth task in the second split-screen area; if a seventh operation acting on the fifth task in the fifth interface is detected; then in response to the seventh operation, displaying the interface of the fifth task in full screen.

[0011] In a possible implementation, before displaying the first interface in the first split-screen area, the method further includes: displaying an interface of a first task in the first split-screen area, and adding the first task to a first multi-task list.

[0012] In a possible implementation, before displaying the second interface in the second split-screen area, the method further includes: displaying an interface of a second task in the second split-screen area, and adding the second task to a second multi-task list.

[0013] In a possible embodiment, the method also includes: displaying partial content of the application in a picture-in-picture area or a floating area; detecting an eighth operation acting on the picture-in-picture area or the floating area; and displaying the complete content interface of the application in the first split-screen area or the second split-screen area in response to the eighth operation.

[0014] In a second aspect, a display method is provided, including: displaying partial content of an application in a picture-in-picture area or a floating area; detecting an eighth operation acting on the picture-in-picture area or the floating area; and displaying the complete content interface of the application in the first split-screen area or the second split-screen area in response to the eighth operation.

[0015] This method can find the corresponding application task according to the corresponding window of the picture-in-picture area or the floating area, and trigger the split screen of the corresponding application through a specific gesture on the window, thereby improving the convenience of users when using the split-screen display function.

[0016] According to a third aspect, an electronic device is provided, comprising: a processor and a memory, wherein the memory is used to store at least one instruction, and when the instruction is loaded and executed by the processor, the electronic device executes the above method.

[0017] In a fourth aspect, a computer-readable storage medium is provided, comprising a program or an instruction. When the program or the instruction is run on a computer, the above method is executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0019] FIG1 is a schematic diagram of a multi-tasking interface of an electronic device in the related art;

[0020] FIG2 is a schematic diagram showing a floating window of an electronic device in the related art;

[0021] FIG3 is a structural block diagram of an electronic device according to an embodiment of the present application;

[0022] FIG4 is a schematic diagram of a software architecture of an electronic device according to an embodiment of the present application;

[0023] FIG5 is a schematic diagram of interface changes of an electronic device according to an embodiment of the present application;

[0024] FIG6 is a schematic diagram of interface changes of another electronic device according to an embodiment of the present application;

[0025] FIG7 is a schematic diagram of interface changes of another electronic device according to an embodiment of the present application;

[0026] FIG8 is a schematic diagram of interface changes of another electronic device in an embodiment of the present application;

[0027] FIG9 is a schematic flow chart of a display method in an embodiment of the present application;

[0028] FIG10 is a schematic diagram showing the relationship between multiple task lists according to an embodiment of the present application;

[0029] FIG11 is a schematic diagram of interface changes of another electronic device according to an embodiment of the present application;

[0030] FIG12 is a schematic diagram of another relationship between multi-task lists in an embodiment of the present application;

[0031] FIG13 is a schematic diagram of interface changes of another electronic device according to an embodiment of the present application;

[0032] FIG14 is a schematic diagram of a process for triggering split screen in an embodiment of the present application;

[0033] FIG15 is a schematic diagram of interface changes of another electronic device in an embodiment of the present application. DETAILED DESCRIPTION

[0034] In order to better understand the technical solution of the present application, the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0035] It should be clear that the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0036] The terms used in the embodiments of the present application are for the purpose of describing specific embodiments only and are not intended to limit the present application. The singular forms "a", "an", "the" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise.

[0037] It should be understood that the term "and / or" as used herein simply describes a relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A alone, A and B together, or B alone. Furthermore, the character " / " in this document generally indicates an "or" relationship between the associated objects.

[0038] Before describing the embodiments of the present application, the related technologies and their technical problems are first described.

[0039] In the related art, when an electronic device is in split-screen state, if a user wants to switch to other task interfaces in the background, the user can open the multi-tasking interface, as shown in Figure 1. In the multi-tasking interface, the user can select the task combination corresponding to the two split-screen areas for switching. However, if the user only wants to switch the task of one split-screen area without changing the task of the other split-screen area, a more complicated process is required, and it is impossible to implement the switching of a single split-screen area based on the multi-tasking interface, resulting in lower convenience for users when using the split-screen display function.

[0040] In addition, in related technologies, as shown in Figure 2, when part of the content of the application is displayed in the form of a picture-in-picture area or a floating area, the user needs a more complicated process to achieve split-screen display for the content, resulting in lower convenience for users when using the split-screen display function.

[0041] In order to solve the problems in the related art, the embodiments of the present application provide the following technical solutions, which are described below.

[0042] FIG3 shows a schematic structural diagram of the electronic device 100 .

[0043] The electronic device 100 may include a processor 110, an internal memory 121, a sensor module 180, a display screen 194, etc. The sensor module 180 may include a touch sensor 180K, etc.

[0044] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0045] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0046] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0047] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0048] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0049] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0050] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0051] The touch sensor 180K is also called a "touch-sensitive device." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a location different from that of the display screen 194.

[0052] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0053] FIG4 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present invention.

[0054] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0055] The application layer can include a series of application packages.

[0056] As shown in FIG4 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

[0057] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0058] As shown in FIG4 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0059] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0060] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0061] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0062] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0063] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0064] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0065] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0066] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0067] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0068] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0069] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0070] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0071] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0072] A 2D graphics engine is a drawing engine for 2D drawings.

[0073] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0074] An embodiment of the present application provides a display method, which may be executed by the electronic device described above. As shown in FIG5 , the method includes: displaying a first interface in a first split-screen area A1, and displaying a second interface in a second split-screen area A2; detecting a first operation, where the first operation is, for example, a single-finger or double-finger swipe-up operation, a single-finger or double-finger swipe-up hover operation, or the like, at the bottom of the first split-screen area A1; displaying a third interface in response to the first operation, where the third interface is used to display tasks in a first multi-task list corresponding to the first split-screen area A1, where the first multi-task list includes the first task, and the third interface may be referred to as a multi-task interface of the first split-screen area A1 or a recent task interface of the first split-screen area A1. For example, the interface of the first task and its corresponding application name are displayed in the middle of the third interface. The tasks in the first multi-task list are recent tasks corresponding to the first split-screen area A1, that is, background tasks corresponding to the first split-screen area A1. The tasks in the first multi-task list may specifically be tasks that have been opened in the first split-screen area A1. The third interface can display at least part of the tasks in the first multi-task list. Based on the sliding operation on the third interface, the third interface can scroll to display multiple tasks in the first multi-task list, so that the user can select the task interface that needs to be switched and displayed in the first split-screen area A1; a second operation acting on the first task in the third interface is detected, and the second operation is, for example, a click operation on the first task interface in the third interface; in response to the second operation, the interface of the first task is displayed in the first split-screen area A1.

[0075] Specifically, taking a specific example, the electronic device is a foldable mobile phone, and the foldable mobile phone is in a left-right split-screen state. The first split-screen area A1 on the left displays the first interface of the browser application, and the second split-screen area A2 on the right displays the second interface of the video playback application. While watching the video through the second interface on the right, the user searches for information through the web interface on the left. At this time, if the user wants to chat with other users without affecting the video viewing, he can perform a two-finger swipe up and hover operation at the bottom of the first split-screen area A1, and the multitasking interface corresponding to the first split-screen area A1, that is, the third interface, will be displayed. The most recent tasks corresponding to the first split-screen area A1 are displayed in the third interface, including the interface of the first task, which is the instant messaging application. At this time, the user clicks on the interface of the instant messaging application in the third interface, which can switch the web interface previously displayed on the left side of the mobile phone to the chat interface of the instant messaging application, while the previous video interface is still maintained on the right side of the mobile phone. The first multi-task list is only related to the first split-screen area A1 and has nothing to do with the second split-screen area A2. The first multi-task list is used to manage the tasks corresponding to the first split-screen area A1. Therefore, the selection of tasks in the first multi-task list only involves the interface switching of the tasks displayed in the first split-screen area A1 and will not affect the second split-screen area A2.

[0076] It should also be noted that the embodiments of the present application are described using a foldable phone with two split screens as an example. However, the embodiments of the present application do not limit the number of split screens. For example, the phone can also be split into three split screen areas, four split screen areas, etc. The first split screen area A1 and the second split screen area A2 in the embodiments of the present application can be any two of an unlimited number of split screens. Furthermore, the electronic devices to which the embodiments of the present application apply are not limited to foldable devices and can also be applied to bar phones, tablets, and the like. Furthermore, when the embodiments of the present application are applied to foldable devices, the foldable devices are not limited to having only one folding axis. For example, they can also be applied to electronic devices that fold three times with two folding axes, or to electronic devices that fold four times with three folding axes. For example, a 3-fold electronic device can correspond to three split screen areas, and a 4-fold electronic device can correspond to four split screen areas. That is, when the electronic device displays multiple split screen areas, in response to a first operation at the bottom of any split screen area, the multitasking interface corresponding to that split screen area can be displayed. Upon selecting a task in the multitasking interface, the split screen area can be switched to display the interface for the selected task.

[0077] In an embodiment of the present application, when the electronic device is in a split-screen display state, a first operation can be used to trigger the display of a multitasking interface corresponding to one side of the split-screen area. By selecting a task in the multitasking interface, the split-screen area on one side can be triggered to switch to the interface of the selected task without affecting the split-screen area on the other side. That is, switching of a single split-screen area is achieved based on the multitasking interface, thereby improving the convenience of the user when using the split-screen display function. In addition, the multitasking interface displayed in the split-screen area is the task corresponding to the split-screen area, which can facilitate the user to select and run the corresponding task in the corresponding split-screen.

[0078] In some embodiments, as shown in Figure 6, the above method also includes: detecting a third operation, the third operation is, for example, a single-finger or double-finger swipe up operation, a single-finger or double-finger swipe up and hover operation, etc. at the bottom of the second split-screen area A2; in response to the third operation, displaying a fourth interface, the fourth interface is used to display tasks corresponding to the second multi-task list of the second split-screen area A2, the second multi-task list includes the second task, the fourth interface can be called the multi-task interface of the second split-screen area A2 or the recent task interface of the second split-screen area A2, for example, the middle of the fourth interface displays the interface of the second task and its corresponding application name, the second multi-task list includes the second task, The tasks in the task list are the most recent tasks corresponding to the second split-screen area A2, that is, the background tasks corresponding to the second split-screen area A2. The fourth interface can display at least part of the tasks in the second multi-task list. Based on the sliding operation on the fourth interface, the fourth interface can scroll and display multiple tasks in the second multi-task list, so that the user can select the task interface that needs to be switched and displayed in the second split-screen area A2; the fourth operation acting on the second task in the fourth interface is detected, and the fourth operation is, for example, a click operation on the second task interface in the fourth interface; in response to the fourth operation, the interface of the second task is displayed in the second split-screen area A2.

[0079] Specifically, for example, a user has switched the first split-screen area A1 on the left side of the phone to the chat interface of an instant messaging app, i.e., the first task interface, while the second split-screen area A2 on the right side of the phone displays a video interface, i.e., the second interface. Now, if a user wants to shop online while chatting, they can swipe up with two fingers at the bottom of the second split-screen area A2 and hover. This will display the multitasking interface corresponding to the second split-screen area A2, i.e., the fourth interface. The fourth interface displays the recent tasks corresponding to the second split-screen area A2, including the interface for the second task, i.e., the shopping app. At this point, the user taps the shopping app interface in the fourth interface to switch the video interface previously displayed on the right side of the phone to the shopping app interface, while the chat interface remains on the left side of the phone. The second multitasking list is only associated with the second split-screen area A2, not the first split-screen area A1. The second multitasking list is used to manage tasks corresponding to the second split-screen area A2. Therefore, selecting a task in the second multitasking list only affects the interface switching of the task displayed in the second split-screen area A2 and does not affect the first split-screen area A1. That is to say, the first multi-task list and the second multi-task list each independently manage tasks corresponding to different split-screen areas. By selecting tasks in the two, the interfaces of tasks displayed in different split-screen areas can be independently switched.

[0080] In the previous embodiment, the user first switches the interface on the left side of the mobile phone to the chat interface by selecting the task in the third interface, and then switches the interface on the right side of the mobile phone to the shopping interface by selecting the task in the fourth interface. This switching order is only an example. The embodiment of the present application does not limit the execution order of the above method. For example, as shown in Figure 7, the user can also display the third interface by swiping up and hovering with two fingers at the bottom of the first split-screen area A1, and display the fourth interface by swiping up and hovering with two fingers at the bottom of the second split-screen area A2. At this time, the user can select the first task in the third interface and the second task in the fourth interface, thereby switching the first split-screen area A1 from displaying the first interface to displaying the interface of the first task, and switching the second split-screen area A2 from displaying the second interface to displaying the interface of the second task.

[0081] In some embodiments, the first operation is a first operation acting on the first split-screen area A1; displaying the third interface includes: displaying the third interface in the first split-screen area A1; the second operation is a second operation acting on the second split-screen area A2; displaying the fourth interface includes: displaying the fourth interface in the second split-screen area A2.

[0082] Specifically, for example, different split-screen areas can be set with corresponding hot zone positions. Assuming that the hot zone position corresponding to the first split-screen area A1 is the bottom of the first split-screen area A1, the first operation is a specific operation acting on the hot zone corresponding to the first split-screen area A1, and the specific operation is, for example, sliding up with two fingers and hovering; the hot zone position corresponding to the second split-screen area A2 is the bottom of the second split-screen area A2, and the second operation is a specific operation acting on the hot zone corresponding to the second split-screen area A2, for example, sliding up with two fingers and hovering. That is, when the user performs a two-finger sliding up and hovering gesture operation at the bottom of the first split-screen area A1, the mobile phone will be triggered to display the third interface in the first split-screen area A1. When the user performs a two-finger sliding up and hovering gesture operation at the bottom of the second split-screen area A2, the mobile phone will be triggered to display the fourth interface in the second split-screen area A2. On the one hand, setting the operation position of the multi-task interface corresponding to the triggering split-screen area on the corresponding split-screen area can facilitate the user to perform targeted operations; on the other hand, setting the display position of the multi-task interface in the corresponding split-screen area can facilitate the intuitive display of the correspondence between the task to be selected and the split-screen area.

[0083] In some embodiments, as shown in FIG8 , the method further includes: detecting a fifth operation, such as a single-finger swipe-up hover operation on the bottom of the screen; displaying a fifth interface in response to the fifth operation, the fifth interface being used to display a third task list, the third multitask list including all tasks in the first multitask list and the second multitask list, the third task list including a combination of the third task and the fourth task, and the fifth task; if a sixth operation is detected on the combination of the third task and the fourth task in the fifth interface; displaying the interface of the third task in the first split-screen area A1 and the interface of the fourth task in the second split-screen area A2 in response to the sixth operation; the interface of the fifth task is not shown in FIG8 ; based on the swipe operation on the fifth interface, the tasks in the fifth interface can be scrolled; when the interface of the fifth task is displayed in the fifth interface, if a seventh operation is detected on the fifth task in the fifth interface; displaying the interface of the fifth task in full screen in response to the seventh operation. The third task list is a global task list used to manage split-screen tasks and full-screen tasks, the split-screen tasks being tasks corresponding to the first split-screen area A1 and the second split-screen area A2, and the full-screen tasks being tasks running in a non-split-screen state. The third and fourth tasks are both split-screen tasks, while the fifth task is a full-screen task. The process shown in Figure 8 is the process of switching based on the multi-tasking interface in the related art. That is, in the embodiment of the present application, in addition to being able to switch tasks in independent split-screen areas through the corresponding multi-tasking interface for different split-screen areas, tasks can also be switched through the global multi-tasking interface, for example, switching to other split-screen combination interfaces or other single application interfaces.

[0084] In some embodiments, before the first split-screen area A1 displays the first interface, the method further includes: displaying an interface of a first task in the first split-screen area A1, and adding the first task to a first multi-task list.

[0085] In some embodiments, before the second split-screen area A2 displays the second interface, the method further includes: displaying an interface of a second task in the second split-screen area A2, and adding the second task to a second multi-task list.

[0086] Specifically, that is to say, the tasks in the first task list come from the tasks displayed in the first split-screen area A1, that is, the first task list is used to manage the recent tasks corresponding to the first split-screen area A1; the tasks in the second task list come from the tasks displayed in the second split-screen area A2, that is, the second task list is used to manage the recent tasks corresponding to the second split-screen area A2.

[0087] In some embodiments, when the interface of the current task displayed in the first split-screen area A1 is switched to the background, the first multi-task list is updated based on the task; when the interface of the current task displayed in the second split-screen area A2 is switched to the background, the second multi-task list is updated based on the task.

[0088] The following is an explanation using a specific example.

[0089] First, the user controls the split-screen display of the electronic device. Here, two split screens are taken as an example, that is, the screen of the electronic device is divided into two split-screen areas, the first split-screen area A1 and the second split-screen area A2. In other possible implementations, it can also be divided into more split-screen areas. After the split screen, the position and size information of each split-screen area are saved and managed by the system split-screen service, and are refreshed as the split-screen size is adjusted. As shown in Figure 9, Figure 9 only illustrates the process of triggering the display of the third interface based on the first split-screen area A1. During the split-screen display process, the bottom gesture hot zone can be divided according to the current distribution of each split-screen area. For example, the first split-screen area A1 and the second split-screen area A2 are the areas on the left and right sides of the screen respectively. The bottom of the first split-screen area A1 is divided into its corresponding gesture hot zone, and the bottom of the second split-screen area A2 is divided into its corresponding gesture hot zone. During the split-screen display process, global multi-tasking management will be triggered, the third multi-tasking management list will be obtained, and global multi-tasking management will be performed. Global multi-tasking management will trigger the first multi-tasking management and the second multi-tasking management. The first multitasking management will establish a corresponding first multitasking list for the first split-screen area A1, and the second multitasking management will establish a corresponding second multitasking list for the second split-screen area A2. These two multitasking lists are used to record the application tasks on the corresponding split screens respectively. The global third multitasking list manages all application tasks. As shown in Figure 10, assuming that during the first split-screen, the first split-screen area A1 displays the interface of the first task, the first task is added to the first multitasking list, and the second split-screen area A2 displays the interface of the second task, then the second task is added to the second multitasking list. At this time, the third multitasking list also includes the first task and the second task. As shown in Figure 11, after the split-screen display, the electronic device detects, for example, a two-finger swipe-up release operation at the bottom of the first split-screen area A1. In response to this operation, the main interface is displayed in the first split-screen area A1. The main interface is the interface of the desktop application, and multiple application icons are displayed in the main interface. The electronic device detects a selection operation of an application icon in the main interface of the first split-screen area A1. In response to this operation, the interface of the selected application, such as the first interface, is displayed in the first split-screen area A1. Similarly, after the split-screen display, the electronic device detects, for example, a two-finger swipe-up release operation on the bottom of the second split-screen area A2, and in response to this operation, displays the main interface in the second split-screen area A2. The electronic device detects a selection operation on an application icon in the main interface of the second split-screen area A2, and in response to this operation, displays the interface of the selected application, such as the second interface, in the second split-screen area A2. As shown in Figure 12, the applications opened on different split-screens will be managed by their respective multitasking lists, and the global multitasking list will manage all tasks at the same time.If a two-finger swipe-up and hover operation is detected at the bottom of the first split-screen area A1, the first multi-task list will be obtained and the multi-task interface corresponding to the first split-screen area A1 will be displayed. For the specific process, please refer to Figure 5 and the records of the corresponding embodiment. Similarly, the second split-screen area A2 can also have four types of processes, and for details, please refer to Figure 6 and the records of the corresponding embodiment. Similarly, the original system gestures, such as the single-finger swipe-up and hover gesture, can still trigger the global multi-task interface corresponding to the task display obtained from the third task list, and for details, please refer to Figure 6 and the records of the corresponding embodiment. In other words, after the mobile phone is split, each split-screen area can independently return to the desktop and enter the recent task interface through gesture interaction. The set gesture interaction corresponds to each split-screen hot zone; different from the global recent task management, the split-screen areas independently manage the recent task list, and each split-screen area has its own recent task management.

[0090] In addition, the embodiments of the present application do not limit the specific operations of the various gesture operations described above. Here, a set of gestures for triggering the display of the multitasking interface and triggering the feedback desktop are used as examples. For example, the first operation described above is a two-finger swipe up and hover operation at the bottom of the first split-screen area A1, the third operation described above is a two-finger swipe up and hover operation at the bottom of the second split-screen area A2, and the fifth operation described above is a single-finger swipe up and hover operation at the bottom of the screen. In one possible implementation, for the user, if he swipes up with two fingers and hovers at the bottom of the left split screen, the multitasking interface of the corresponding left split screen will be displayed, so that the tasks of the left split screen can be switched independently; if he swipes up with two fingers at the bottom of the left split screen and releases it, the desktop will be displayed in the left split screen area, so that new applications can be run independently in the left split screen area; if he swipes up with two fingers and hovers at the bottom of the right split screen, the multitasking interface of the corresponding right split screen will be displayed, so that the tasks of the right split screen can be switched independently; if he swipes up with two fingers at the bottom of the right split screen and releases it, the desktop will be displayed in the right split screen area, so that new applications can be run independently in the right split screen area; if he swipes up with one finger and hovers at the bottom of any split screen, the global multitasking interface will be displayed; if he swipes up with one finger and releases it on part of any split screen, the desktop will be displayed in full screen.

[0091] In other words, different gestures can be used to distinguish between the split-screen multitasking interface and the global multitasking interface. In addition, different hot zones can also be used to display different types of task interfaces. For example, the bottom area of ​​the screen is divided into a left bottom area, a middle bottom area, and a right bottom area. The first operation mentioned above is a single-finger swipe up and hover operation on the left bottom area, the third operation mentioned above is a single-finger swipe up and hover operation on the right bottom area, and the fifth operation mentioned above is a single-finger swipe up and hover operation on the middle bottom area. The single-finger swipe up and hover operation here is only an example, and can also be replaced by other gesture operations such as a two-finger swipe up and hover operation. In other words, the same gesture operation can be used to trigger the display of the multitasking interface, and different gesture hot zones can be used to distinguish and display different types of multitasking interfaces.

[0092] In some embodiments, the method further includes: displaying partial content of an application in a picture-in-picture area or a floating area. The picture-in-picture area or the floating area displays a portion of the application's UI content, rather than a reduced-size interface of the full application. As shown in FIG13 , video content is displayed in the picture-in-picture area or the floating area. The picture-in-picture area or the floating area shown in FIG13 is located in the first split-screen area A1 for example only; the picture-in-picture area or the floating area can be located anywhere. The picture-in-picture area or the floating area does not necessarily need to be located in the split-screen state; it can also be a picture-in-picture area or the floating area with a full-screen desktop or a full-screen application as the background. The difference between displaying in a picture-in-picture area and displaying in a floating area is that the floating area display function does not require separate permission for the application, while displaying in a picture-in-picture area does require permission for the application. The method further includes: detecting an eighth operation on the picture-in-picture area or the floating area, the eighth operation being an operation related to the first split-screen area A1, such as long pressing and dragging the picture-in-picture area or the floating area to the hot zone corresponding to the first split-screen area A1; and in response to the eighth operation, displaying the full content interface of the application in the first split-screen area A1. It can be understood that if the eighth operation is a long press on the picture-in-picture area or the floating area and dragging it to the hot zone corresponding to the second split-screen area A2, it will trigger the display of the complete content interface of the application in the second split-screen area A2.

[0093] Specifically, if the picture-in-picture area or the floating area is displayed in full screen mode, a long press operation will trigger a split screen, displaying the first split screen area A1 and the second split screen area A2, and causing the picture-in-picture area or the floating area to enter a drag state. At this time, if it is dragged to a hot zone corresponding to a split screen area, it will trigger the display of the complete content interface of the application corresponding to the picture-in-picture area or the floating area in the split screen area. At this time, there is no limitation on the display content of the other split screen area. For example, the background interface of the picture-in-picture area or the floating area displayed in full screen mode can be displayed, a preset interface can be displayed, or another interface of the application corresponding to the picture-in-picture area or the floating area can be displayed. If the picture-in-picture area or the floating area is displayed in a split screen mode, a long press operation will cause the picture-in-picture area or the floating area to enter a drag state. At this time, if it is dragged to a hot zone corresponding to a split screen area, it will trigger the display of the complete content interface of the application corresponding to the picture-in-picture area or the floating area in the split screen area. At this time, the display content of the other split screen area can remain unchanged. The picture-in-picture area is the picture-in-picture window, and the floating area is the floating window. The picture-in-picture area and the floating area are both managed by the system window, and each window corresponds to an application process. For the content displayed in the picture-in-picture area or the floating area, the user can trigger the split screen by a specific gesture operation acting on the area, such as long pressing the picture-in-picture area or the floating area. After the split screen is triggered, the task stack application corresponding to the picture-in-picture area or the floating area will be searched and determined, and then the interface of the corresponding task stack application will be displayed in split screen. For example, the electronic device currently displays the first split-screen area A1 on the left and the second split-screen area A2 on the right. The floating area of ​​the first split-screen area A1 on the left displays the video being played. After the user long presses the floating area and drags the floating area to the hot zone corresponding to the first split-screen area A1, the split screen of the floating area will be triggered, that is, the application corresponding to the video displayed in the floating area will be searched, and the complete application interface corresponding to the video will be displayed in the first split-screen area A1. In this way, the corresponding application task can be found according to the window corresponding to the picture-in-picture area or the floating area, and the split screen of the corresponding application can be triggered by a specific gesture on the window, thereby improving the convenience of the user when using the split-screen display function.

[0094] In some embodiments, as shown in FIG13 , for example, a picture-in-picture area or a floating area is displayed in a split-screen state, and the second split-screen area A2 displays the sixth interface; in response to the eighth operation, the process of displaying the complete content interface of the application in the first split-screen area A1 includes: in response to the eighth operation of long pressing and dragging the picture-in-picture area or the floating area to the hot zone corresponding to the first split-screen area A1, the complete content interface of the application is displayed in the first split-screen area A1, and the sixth interface is displayed in the second split-screen area A2. This approach does not affect the content displayed in the split-screen area on the other side.

[0095] In some embodiments, as shown in FIG15 , a picture-in-picture area or a floating area can also be displayed in a non-split-screen state. For example, when the electronic device is in a non-split-screen state and the picture-in-picture area or the floating area is displayed, an eighth operation of long pressing and dragging the picture-in-picture area or the floating area to the hot zone corresponding to the first split-screen area A1 is detected; in response to the eighth operation, the split-screen is triggered and the complete content interface of the application is displayed in the first split-screen area A1, and the previous non-split-screen interface can be displayed in the second split-screen area A2.

[0096] As shown in Figure 13, an embodiment of the present application also provides a display method, including: displaying part of the content of an application in a picture-in-picture area or a floating area; detecting an eighth operation of long pressing the picture-in-picture area or the floating area and dragging it to the hot zone corresponding to the first split-screen area A1; and displaying the complete content interface of the application in the first split-screen area A1 in response to the eighth operation. It can be understood that if the eighth operation is an operation of long pressing the picture-in-picture area or the floating area and dragging it to the hot zone corresponding to the second split-screen area A2, it will trigger the display of the complete content interface of the application in the second split-screen area A2. The difference between the display method in this embodiment and the display method in the above embodiment is that the embodiment of the present application does not rely on switching based on a multi-tasking interface, but is an independent display method based on triggering split screen based on the picture-in-picture area or the floating area. This method can find the corresponding application task according to the window corresponding to the picture-in-picture area or the floating area, and trigger the split screen of the corresponding application through a specific gesture on the window, thereby improving the convenience of the user when using the split-screen display function.

[0097] In some embodiments, as shown in Figure 13, displaying partial content of an application in a picture-in-picture area or a floating area includes: displaying partial content of the application in the picture-in-picture area or the floating area in a split-screen state, and displaying the sixth interface in the second split-screen area; in response to the eighth operation, the process of displaying the complete content interface of the application in the first split-screen area includes: in response to the eighth operation, displaying the complete content interface of the application in the first split-screen area, and displaying the sixth interface in the second split-screen area.

[0098] In some embodiments, as shown in Figure 15, displaying partial content of an application in a picture-in-picture area or a floating area includes: displaying partial content of the application in the picture-in-picture area or the floating area of ​​the seventh interface; in response to the eighth operation, the process of displaying the complete content interface of the application in the first split-screen area includes: in response to the eighth operation, displaying the complete content interface of the application in the first split-screen area, and displaying the seventh interface in the second split-screen area.

[0099] The present application also provides an electronic device including a processor and a memory, wherein the memory is configured to store at least one instruction, which, when loaded and executed by the processor, causes the electronic device to perform the display method described in any of the above embodiments. The specific process and principles of the display method may be the same as those described in the above embodiments and are not further described here. The specific structure and principles of the electronic device may be the same as those described in the above embodiments and are not further described here.

[0100] The electronic devices involved in this application may be any product such as smart TVs, mobile phones, tablet computers, personal computers (PCs), personal digital assistants (PDAs), smart watches, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, vehicle-mounted devices, drone devices, smart cars, smart speakers, robots, smart glasses, etc.

[0101] An embodiment of the present application further provides a computer-readable storage medium, comprising a program or instructions. When the program or instructions are run on a computer, the method in any of the above embodiments is executed.

[0102] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive).

[0103] In the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0104] The above are merely preferred embodiments of the present application and are not intended to limit the present application. Those skilled in the art will readily appreciate that various modifications and variations are possible. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present application shall be included within the scope of protection of the present application.

Claims

1. A display method, characterized in that: include: Displaying a first interface in the first split-screen area, and displaying a second interface in the second split-screen area; A first operation is detected; In response to the first operation, displaying a third interface, the third interface being used to display tasks in a first multi-task list corresponding to the first split-screen area, the first multi-task list including a first task; detecting a second operation acting on the first task in the third interface; In response to the second operation, an interface of the first task is displayed in the first split-screen area.

2. The method according to claim 1, characterized in that Also includes: A third operation is detected; In response to the third operation, displaying a fourth interface, wherein the fourth interface is used to display tasks in a second multi-task list corresponding to the second split-screen area, wherein the second multi-task list includes a second task; detecting a fourth operation acting on the second task in the fourth interface; In response to the fourth operation, an interface of the second task is displayed in the second split-screen area.

3. The method according to claim 2, characterized in that The first operation is a first operation acting on the first split-screen area; Displaying the third interface includes: displaying the third interface in the first split-screen area; The second operation is a second operation acting on the second split-screen area; Displaying the fourth interface includes: displaying the fourth interface in the second split-screen area.

4. The method according to claim 2 or 3, characterized in that: Also includes: A fifth operation is detected; In response to the fifth operation, displaying a fifth interface, the fifth interface being used to display a third task list, the third multi-task list including all tasks in the first multi-task list and the second multi-task list, the third task list including a combination of the third task and the fourth task and the fifth task; If a sixth operation acting on a combination of the third task and the fourth task in the fifth interface is detected; In response to the sixth operation, the interface of the third task is displayed in the first split-screen area, and the interface of the fourth task is displayed in the second split-screen area; If a seventh operation acting on the fifth task in the fifth interface is detected; In response to the seventh operation, the interface of the fifth task is displayed in full screen.

5. The method according to any one of claims 1 to 4, characterized in that: Before displaying the first interface in the first split-screen area, the method further includes: The interface of the first task is displayed in the first split-screen area, and the first task is added to the first multi-task list.

6. The method according to any one of claims 2 to 5, characterized in that Before displaying the second interface in the second split-screen area, the method further includes: The interface of the second task is displayed in the second split-screen area, and the second task is added to the second multi-task list.

7. The method according to any one of claims 1 to 6, characterized in that: Also includes: Display part of the app content in the picture-in-picture area or floating area; An eighth operation acting on the picture-in-picture area or the floating area is detected; In response to the eighth operation, a complete content interface of the application is displayed in the first split-screen area or the second split-screen area.

8. A display method, characterized in that: include: Display part of the app content in the picture-in-picture area or floating area; An eighth operation acting on the picture-in-picture area or the floating area is detected; In response to the eighth operation, a complete content interface of the application is displayed in the first split-screen area or the second split-screen area.

9. An electronic device, characterized in that: include: A processor and a memory, wherein the memory is used to store at least one instruction, and when the instruction is loaded and executed by the processor, the electronic device executes the method as claimed in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The method comprises a program or an instruction, and when the program or the instruction is run on a computer, the method according to any one of claims 1 to 8 is executed.

Citation Information

Patent Citations

  • Display method, electronic device, and storage medium

    CN119556821B

  • Method and device for switching applications in split screen mode and related equipment of method and device

    CN107256129A

  • Split-screen application switching method, device, storage medium and electronic device

    CN109062467A

  • Split-screen application switching method, device, storage medium and electronic device

    CN109062479A

  • Method for switching application and tasks in application and electronic equipment

    CN114461312A