Application display method and related device
By judging and removing the layer of the split screen split line during the layer synthesis stage, the problem of delay hiding or inability to hide when switching to full screen mode is solved, improving the user experience.
Patent Information
- Application Number
- CN202411718929.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-27
- Publication Date
- 2025-04-18
AI Technical Summary
In electronic devices, split-screen splitting lines may be delayed or unable to hide when switching to full-screen mode, resulting in a degradation of user experience.
A new composite layer is generated to display the full screen user interface by determining whether there is a layer with split-screen split line during the layer synthesis stage and removing the layer before the user interface is displayed.
It effectively solves the problem of delays hidden or inability to hide split-screen split-lines, improves the user experience, and ensures that split-screen split-lines are correctly hidden in full-screen mode.
Smart Images

Figure CN119847406A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of wireless communication technology, and in particular to an application display method and related devices. Background Art
[0002] With the development of terminal technology and the maturity of touch technology, the display methods of interfaces are also constantly enriched. In daily life, the demand for the split-screen function of electronic devices is constantly increasing, and electronic devices will use split lines to display the boundary range of different application windows.
[0003] Currently, when users switch from split-screen mode to full-screen mode, such as opening an internal video for full-screen playback or other scenarios where the split line needs to be hidden, the split-screen split line may be delayed or cannot be hidden, and the split-screen split line still appears in the middle of the screen, resulting in a degraded user experience. How to solve the problem of delayed hiding or failure to hide the split-screen split line is a problem that needs to be solved at present. Summary of the invention
[0004] The embodiments of the present application provide an application display method and related devices, which are applied to electronic devices and can solve the problem of delayed hiding or inability to hide the split-screen dividing line.
[0005] In a first aspect, an embodiment of the present application provides an application display method, the method comprising: entering a split-screen mode; displaying a first user interface, the first user interface comprising: a first application interface, a second application interface, and a split-screen dividing line; receiving a first operation of a user, the first operation being used to switch the first application interface to a full-screen display; in response to the first operation, generating a first synthetic layer, and determining whether there is a layer of a split-screen dividing line in the first synthetic layer, and if so, removing the layer of the split-screen dividing line to obtain a second synthetic layer; and displaying a second user interface based on the second synthetic layer, the second user interface comprising the first application interface displayed in full screen. In an embodiment of the present application, when switching from split-screen mode to full-screen display, the electronic device may add a split-screen dividing line because the startup window is abnormal when the application is started in split-screen mode, or because the current scene cannot be correctly distinguished as switching from split-screen mode to full-screen, resulting in the inability to trigger the operation of hiding the split-screen dividing line; the split-screen dividing line should not be displayed in the user interface in full-screen mode, but because the above-mentioned abnormal situation will cause the split-screen dividing line to be abnormal, the present application adds a judgment of the abnormal situation during the layer synthesis stage. If it is judged that the layer containing the split-screen dividing line in the first synthetic layer, it means that the electronic device has an abnormality when processing the split-screen dividing line, then the layer of the split-screen dividing line will be directly removed to obtain the second synthetic layer. By judging the layer of the split-screen dividing line in the layer synthesis stage and removing the layer of the split-screen dividing line before the user interface is displayed, the abnormal situation when the electronic device processes the split-screen dividing line can be effectively handled, thereby solving the problem of delayed hiding or failure to hide the split-screen dividing line.
[0006] In combination with the first aspect, in a possible implementation, the first application interface is used to display the first application, and the second application interface is used to display the second application; after entering the split-screen mode, before displaying the first user interface, the method further includes: detecting the startup mode of the first application, if it is the first startup mode, generating the first user interface based on the content of the first application and the content of the second application, and the first startup mode is the first startup of the first application after entering the split-screen mode. In the embodiment of the present application, the first startup mode is a cold startup, which means that the application is started for the first time after entering the split-screen mode after being completely terminated; during the cold startup, the first application will create a startup window, which is displayed in full screen. At this time, there is no need to add an additional split-screen dividing line to distinguish the boundary of the split screen. After the startup is completed, the application will continue to display other split-screen interfaces; however, the prior art does not judge the above-mentioned cold startup situation, but performs the operation of adding a dividing line when the application is started, resulting in abnormal addition of a dividing line. The method in the embodiment of the present application adds a judgment on the startup mode of the application in the split-screen mode. When the application is cold started, the split-screen dividing line is not added, thereby avoiding the split-screen dividing line in the user interface and causing a decrease in user experience.
[0007] In combination with the first aspect, in a possible implementation, the method further includes: detecting the startup mode of the first application, and if it is the second startup mode, generating a first user interface based on the content of the first application, the content of the second application, and the split-screen dividing line, and the second startup mode is that the first application has been started before entering the split-screen mode. In an embodiment of the present application, the second startup mode is that the application has been started before entering the split-screen mode. Exemplarily, the electronic device directly causes the first application to enter the split-screen mode from the background program. Through the judgment of the application startup mode added by the method, when it is judged that the application is the second startup mode, a split-screen dividing line needs to be added to the user interface. By adding a split-screen dividing line, the screen of the electronic device can be clearly divided into two independent but simultaneously displayed areas. These two areas can run different applications respectively, thereby improving the visibility and processing efficiency when the user uses the application.
[0008] In combination with the first aspect, in a possible implementation, after receiving the first operation of the user and before generating the first synthetic layer, the method further includes: detecting that the size of the first application interface has changed, recalculating the boundary range of the first application interface; if it is determined that the boundary range of the first application interface is full screen and includes a split screen dividing line, hiding the split screen dividing line. In the embodiment of the present application, there are many situations where the interface size changes, for example, such as device rotation, split screen change, full screen change, or adjusting the display ratio of two applications by dragging the dividing line. Since the electronic device may not be able to distinguish whether the boundary range of the first application interface changes due to the switching of the split screen to the full screen, or due to the dragging of the dividing line, the electronic device will not hide the split screen dividing line. In order to address the situation where the split screen dividing line is abnormal due to the inability to distinguish the change in the size of the first application interface, the method adds a judgment on the boundary range of the first application interface each time the interface size changes; if the current boundary range of the first application interface is full screen and includes a split screen dividing line, it means that the electronic device has an abnormality in processing the split screen dividing line, so the split screen dividing line is hidden. This method effectively solves the problem of abnormal split-screen dividing line processing occurring when the application interface changes, which results in delayed hiding of the split-screen dividing line or failure to hide the split-screen dividing line.
[0009] In combination with the first aspect, in a possible implementation, the method includes: the first application interface and the second application interface are interfaces of the same application, or the first application interface and the second application interface are interfaces of different applications. In the embodiment of the present application, the first application interface and the second application interface displayed in the split-screen mode can be interfaces of different applications or interfaces of the same application. By splitting the same application, users can more conveniently switch between different interfaces of the application without frequently exiting and re-entering the application, thereby improving user efficiency.
[0010] In combination with the first aspect, in a possible implementation, the electronic device includes: a graphics synthesizer SF and a window management service WMS module; generating a first synthetic layer, including: the WMS module sends a first notification to SF; SF generates the first synthetic layer based on one or more of the layer of the first application interface, the layer of the second application interface, and the layer of the split-screen dividing line. In the embodiment of the present application, the electronic device uses the graphics synthesizer SF to process the synthetic layer, sends a first notification to SF through the WMS module, and SF starts to generate the first synthetic layer after receiving it; wherein, the first synthetic layer obtained by SF is the layer used for subsequent judgment in the method, and if the judgment result is that the split-screen dividing line needs to be removed, the layer of the split-screen dividing line will be removed from the first synthetic layer to obtain the second synthetic layer. Using SF can synthesize graphic content from different applications and system components into a single frame buffer, so that multiple applications can be displayed on the screen at the same time without interfering with each other. Using SF for layer processing can bring many benefits such as high efficiency, flexibility, and easy integration and expansion.
[0011] In combination with the first aspect, in a possible implementation, removing the layer of the split screen dividing line to obtain a second synthetic layer includes: the WMS module sends a second notification to the SF; the SF removes the layer of the split screen dividing line to obtain the second synthetic layer. In the embodiment of the present application, through the judgment of the addition of the first synthetic layer in the present method, after the judgment result is that the split screen dividing line layer needs to be removed, the electronic device sends a second notification to the SF through the WSM module, and after receiving the notification, the SF removes the layer of the split screen dividing line in the first synthetic layer to obtain the second synthetic layer. The layer of the split screen dividing line is removed by the SF, and then the abnormal split screen dividing line disappears in the subsequent user interface, effectively solving the problem of delayed hiding or inability to hide the split screen dividing line.
[0012] In combination with the first aspect, in a possible implementation, the method includes: the layer of the first application interface, the layer of the second application interface, and the layer of the split-screen dividing line are all independent layers. In the embodiment of the present application, each layer can be drawn, updated, and managed independently, reducing the complexity of interface development. The electronic device can modify and optimize specific layers without affecting other layers; independent layers provide better support for the split-screen function, and users can run two applications on one screen at the same time and adjust their display areas through the split-screen dividing line. In summary, the method improves the flexibility and scalability of the application interface display, and better supports the split-screen function to enhance the user experience.
[0013] In combination with the first aspect, in a possible implementation, the size of the first application interface changes, including: detecting that the first application interface switches to full-screen display, or changing the size of the first application interface by dragging a split-screen dividing line.
[0014] In conjunction with the first aspect, in a possible implementation, receiving the user's first operation includes: receiving a click and lift operation from the user, or receiving a voice input from the user. In the embodiment of the present application, the first operation received by the electronic device is in various forms, which can improve the versatility of the method in different situations.
[0015] In a second aspect, an embodiment of the present application provides an application display device, which includes: an interface display module, which is used to display a first user interface after the device enters a split-screen mode and to display a second user interface based on a second synthetic layer after the device switches to full screen, the first user interface including: a first application interface, a second application interface and a split-screen dividing line; an interface interaction module, which is used to receive a first operation of the user, and the first operation is used to switch the first application interface to full-screen display; a graphics synthesis module, which is used to generate a first synthetic layer and determine whether there is a layer with a split-screen dividing line in the first synthetic layer. If so, remove the layer with the split-screen dividing line to obtain the second synthetic layer.
[0016] In combination with the second aspect, in one possible implementation, the first application interface is used to display the first application, and the second application interface is used to display the second application. The device also includes: a startup mode detection module, which is used to detect the startup mode of the first application after the device enters the split-screen mode and before displaying the first user interface. If it is the first startup mode, the first user interface is generated based on the content of the first application and the content of the second application. The first startup mode is the first startup of the first application after entering the split-screen mode.
[0017] In combination with the second aspect, in a possible implementation method, the device also includes: a boundary range detection module, which is used to detect that the size of the first application interface has changed, recalculate the boundary range of the first application interface, and judge the boundary range of the first application. If it is determined that the boundary range of the first application interface is full screen and includes a split-screen dividing line, the split-screen dividing line is hidden.
[0018] In combination with the second aspect, in a possible implementation method, the startup mode detection module is also used to: detect the startup mode of the first application; if it is the second startup mode, a first user interface is generated based on the content of the first application, the content of the second application and the split-screen dividing line; the second startup mode is that the first application has been started before entering the split-screen mode.
[0019] In conjunction with the second aspect, in a possible implementation manner, the first application interface and the second application interface are interfaces of the same application, or the first application interface and the second application interface are interfaces of different applications, respectively.
[0020] In combination with the second aspect, in a possible implementation method, the graphics synthesis module includes a graphics synthesizer SF and a window management service WMS module, and the graphics synthesis module is specifically used for: the WSM module is used to send a first notification to the SF; the SF is used to receive the first notification and generate a first synthetic layer based on one or more of the layers of the first application interface, the layers of the second application interface, and the layers of the split-screen dividing line.
[0021] In combination with the second aspect, in a possible implementation method, the graphics synthesis module includes a graphics synthesizer SF and a window management service WMS module, and the graphics synthesis module is specifically used for: the WSM module is used to send a second notification to SF; SF is used to receive the second notification and remove the layer of the split-screen dividing line to obtain a second synthetic layer.
[0022] In conjunction with the second aspect, in a possible implementation, the layer of the first application interface, the layer of the second application interface, and the layer of the split-screen dividing line are all independent layers.
[0023] In combination with the second aspect, in a possible implementation, the change in the size of the first application interface includes: detecting that the first application interface is switched to full-screen display, or changing the size of the first application interface by dragging a split-screen dividing line.
[0024] In a third aspect, an embodiment of the present application provides an electronic device, comprising one or more processors and one or more memories; the one or more processors are coupled to the one or more memories, the one or more memories are used to store computer program code, the computer program code comprises computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes an application display method described in the first aspect or any possible implementation method of the first aspect.
[0025] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions, which, when executed on an electronic device, enable the electronic device to execute an application display method as described in the first aspect or any possible implementation of the first aspect.
[0026] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program code. When the computer program is executed, the computer executes an application display method as described in the first aspect or any possible implementation method of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the background technology, the drawings required for use in the embodiments of the present application or the background technology will be described below.
[0028] Figure 1A It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;
[0029] Figure 1B A software structure diagram provided for an embodiment of the present application;
[0030] Figure 2A This is a schematic diagram of a split-screen mode interface of an electronic device provided in an embodiment of the present application;
[0031] Figure 2B This is a schematic diagram of another split-screen mode interface of an electronic device provided in an embodiment of the present application;
[0032] Figure 2C This is a schematic diagram of another split-screen mode interface of an electronic device provided in an embodiment of the present application;
[0033] Figure 2D This is a schematic diagram of another split-screen mode interface of an electronic device provided in an embodiment of the present application;
[0034] Figure 2E This is a schematic diagram of an interface in which a split-screen dividing line of an electronic device is displayed abnormally, provided in an embodiment of the present application;
[0035] Figure 3 This is a flowchart of an application display method provided by an embodiment of the present application;
[0036] Figure 4 is a flowchart of another application display method provided in an embodiment of the present application;
[0037] Figure 5A is a flowchart of another application display method provided in an embodiment of the present application;
[0038] Figure 5B This is a schematic diagram of a process of changing the size of a user interface of an electronic device provided in an embodiment of the present application;
[0039] Figure 6 is a flowchart of another application display method provided in an embodiment of the present application;
[0040] Figure 7 It is a schematic diagram of the structure of an application display device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0041] The terms used in the following application embodiments of the present application are only for the purpose of describing specific application embodiments and are not intended to limit the present application.
[0042] First, some terms in this application are explained to facilitate understanding by those skilled in the art.
[0043] (1) Graphics synthesizer (surfaceflinger, SF)
[0044] It is a system service, which is mainly used to implement functions such as layer creation, control, and management. In the display system of an electronic device, layer synthesis can be achieved through SF. For example, after the application is started, SF can create a layer for the application, so that the application can render based on the layer, or draw frames to obtain the layer to be displayed. In addition, SF also allocates a corresponding cache queue to the application to cache the drawing frame data of the layer rendered by the application. During the operation of the electronic device, SF can obtain the layers to be displayed of each foreground application in the electronic device, and then perform layer synthesis to obtain the image data corresponding to the display interface to be displayed.
[0045] (2) Window Manager Service (WMS)
[0046] WMS is responsible for managing all windows in the system. When an application requests to add a new window, WMS is responsible for adding the window to the screen and deleting it when the window is no longer needed. In addition, WMS is also responsible for updating the display of the window, such as the window's location, size, transparency and other properties. WMS is not only a window manager, but also a transit station for input events. It is responsible for distributing user touch events, key events, etc. to the corresponding window so that the window can respond correctly to the user's operations. Since WMS can know which window in the current system is most suitable to handle an event, it can ensure that the event is correctly distributed to the target window.
[0047] WMS is also responsible for managing the focus of windows. WMS ensures that users can interact with windows correctly by maintaining a list of focused windows. When the focus state of a window changes, WMS will update the focus list in a timely manner and notify the relevant windows to make necessary adjustments.
[0048] (3) Focused Window
[0049] The focus window refers to the window that is currently interacting with the user. This window is responsible for receiving key events (such as physical key input) and touch events from the user. The update process of the focus window involves the WMS module and SF.
[0050] (4) Cold start
[0051] A cold start is when an app is started and there is no background process for the app (for example, when the app is started for the first time, or when the app is restarted after being completely killed). At this point, the system will recreate a new process to assign to the app.
[0052] (5) Parallel Horizons
[0053] It allows two windows within an application to be displayed on the left and right of the screen at the same time without interfering with each other, thereby improving user efficiency. The traditional split-screen function provides split-screen between two applications, while Parallel Vision provides split-screen between two windows within an application. Parallel Vision is more technically complex because it needs to handle the display and interaction of two windows within the same application.
[0054] (6) Bounds
[0055] Bounds refers to the position and size range of a view or window on the screen. Its main function is to determine the position of the view or window on the screen.
[0056] As used in the specification and appended claims of the present application, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also include plural expressions, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more of the listed items. As used in the above-mentioned application embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrase "when determining..." or "if (stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "when (stated condition or event) is detected" or "in response to detecting (stated condition or event)", depending on the context.
[0057] The term "user interface (UI)" in the following embodiments of the present application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device, and finally presented as content that can be recognized by the user. The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.
[0058] The electronic device is a smart terminal device, which can be of various types, and the embodiments of the present application do not limit its specific type. For example, the electronic device can be a mobile phone, and can also include a tablet computer, a desktop computer, a desktop computer with a touch-sensitive surface or a touch panel, a laptop computer (laptop), a handheld computer, a notebook computer, a smart screen, a wearable device (such as a smart watch, a smart bracelet, etc.), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a car machine, a smart headset, a game console, and can also be an Internet of Things (IOT) device or a smart home device such as a smart water heater, a smart lamp, a smart air conditioner, etc.
[0059] Figure 1A A schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of the present application is shown.
[0060] The electronic device 100 may include a processor 101, a memory 102, a wireless communication module 103, a mobile communication module 104, an antenna 103A, an antenna 104A, a power switch 105, a sensor module 106, a focus motor 107, a camera 108, a display screen 109, etc. Among them, the sensor module 106 may include a gyroscope sensor 106A, an acceleration sensor 106B, an ambient light sensor 106C, an image sensor 106D, a distance sensor 106E, etc. Among them, the wireless communication module 103 may include a WLAN communication module, a Bluetooth communication module, etc. The above multiple parts can transmit data through a bus.
[0061] The processor 101 may include one or more processing units, for example, the processor 101 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0062] The memory 102 may be used to store computer executable program codes, and the executable program codes may include instructions. The processor 101 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the memory 102. The memory 102 may include a program storage area and a data storage area. In a specific implementation, the memory 102 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
[0063] The wireless communication function of the electronic device 100 can be implemented through the antenna 103A, the antenna 104A, the mobile communication module 104, the wireless communication module 103, the modem processor and the baseband processor.
[0064] Antenna 103A and antenna 104A can be used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas.
[0065] The mobile communication module 104 can provide wireless communication solutions including 2G / 3G / 4G / 5G etc. applied on the electronic device 100 .
[0066] The wireless communication module 103 can provide wireless communication solutions including wireless local area networks (WLAN), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. for application in the electronic device 100.
[0067] The gyro sensor 106A may be used to determine the motion posture of the electronic device 100 .
[0068] The acceleration sensor 106B can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes).
[0069] The electronic device 100 can realize the shooting function through the ISP, the camera 108, the video codec, the GPU, the display screen 109 and the application processor.
[0070] The electronic device 100 can realize the display function through a GPU, a display screen 109, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 109 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 101 may include one or more GPUs, which execute program instructions to generate or change display information.
[0071] The display screen 109 is used to display images, videos, etc. The display screen 109 includes a display panel. In some embodiments, the electronic device 100 may include 1 or N display screens 109, where N is a positive integer greater than 1.
[0072] The structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0073] Any one or more of the wireless communication module 103 , the mobile communication module 104 , the sensor module 106 , the focus motor 107 , the camera 108 , etc. may be used to detect the current environmental characteristics of the electronic device 100 .
[0074] The display screen 109 is used for a user interface, for example, to recommend shortcuts for payment services.
[0075] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The present application embodiment takes a mobile operating system with a layered architecture as an example to exemplify the software structure of the electronic device 100.
[0076] Figure 1B It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.
[0077] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the mobile operating system is divided into four layers, from top to bottom: application layer, application framework layer / core service layer, system library and runtime, and kernel layer.
[0078] The application layer can include a series of application packages.
[0079] like Figure 1B As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.
[0080] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0081] like Figure 1B As shown, the application framework layer may include window management services, content providers, view systems, phone managers, event managers, notification managers, and the like.
[0082] The window management service is responsible for managing all windows in the system. When an application requests to add a new window, WMS is responsible for adding the window to the screen and removing it when the window is no longer needed. In addition, WMS is also responsible for updating the display of the window, such as the window's location, size, transparency and other properties. WMS is not only a window manager, but also a transfer station for input events. It is responsible for distributing user touch events, key events, etc. to the corresponding window so that the window can respond to user operations correctly.
[0083] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0084] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0085] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including answering, hanging up, etc.).
[0086] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0087] The runtime can refer to all code libraries, frameworks, etc. required for the program to run. For example, for the C language, the runtime includes a series of function libraries required for the C program to run. For the Java language, in addition to the core library, the runtime also includes the virtual machine required for the Java program to run. The above core library may include the function functions that the Java language needs to call.
[0088] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), graphics synthesizer, etc.
[0089] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0090] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0091] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0092] A 2D graphics engine is a drawing engine for 2D drawings.
[0093] The graphics compositor is responsible for managing and rendering all graphical interface surfaces. The graphics compositor can render, synthesize, and display images of the user interface.
[0094] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0095] In the prior art, when an application in an electronic device is in a split-screen mode, the embodiments of the present application do not limit the screen state of the electronic device. For example, the electronic device can be in a horizontal screen state or a vertical screen state, etc. Figure 2A-2E Taking a tablet computer as an example, the split screen mode includes upper and lower split screens (such as Figure 2A ), left and right split screen (such as Figure 2B ) and small window mode (such as Figure 2C ). In the embodiment of the present application, left and right split screen is taken as an example, and the first application is taken as a video software. Figure 2DAs shown, the user interface displays the first application interface, the second application interface and the split screen dividing line. After the user performs the first operation, that is, clicks the switch full screen key 201 to switch the first application interface to the full screen mode, the split screen dividing line may be delayed in hiding or cannot be hidden, and the split screen dividing line still appears in the middle of the screen, affecting the user experience. Figure 2E As shown, after the first application interface is displayed in full screen, the split-screen dividing line is still displayed.
[0096] In view of the above problems, the present application embodiment provides an application display method, see Figure 3 , Figure 3 A schematic flow chart of an application display method provided in an embodiment of the present application can solve the problem that the split screen dividing line is delayed in hiding or cannot be hidden. The method may include the following steps:
[0097] S301. Enter split-screen mode.
[0098] Specifically, the electronic device enters the split-screen mode. The split-screen mode is a function that allows the user to divide the same screen into two or more areas, each area can independently run an application, and the user can view and operate two or more applications at the same time. The embodiment of the present application only elaborates on the case of dividing into two areas. Exemplarily, the split-screen mode includes upper and lower split screens (such as Figure 2A ), left and right split screen (such as Figure 2B ) and small window mode (such as Figure 2C ).
[0099] S302: Display a first user interface.
[0100] Specifically, the electronic device is in split-screen mode and displays a first user interface. The current first user interface includes: a first application interface, a second application interface, and a split-screen dividing line.
[0101] In a possible implementation, the first application interface may be an interface at any position in the first application. The first application interface and the second application interface may be interfaces of the same application (ie, parallel horizons), or the first application interface and the second application interface may be interfaces of different applications.
[0102] S303: Receive a first operation from the user.
[0103] Specifically, a first operation of a user is received, where the first operation is used to switch the first user interface to full screen display. Exemplarily, the first operation may include a user clicking on Figure 2D As shown in the full-screen switch key 201, the first operation can also be that the user uses voice input to switch the first user interface to full-screen display. For example, the electronic device can turn on the voice assistant and receive the user's voice input. The specific implementation method of the first operation is not limited here.
[0104] S304: In response to the first operation, generate a first composite layer.
[0105] Specifically, the electronic device generates a first synthetic layer in response to the first operation, and the first synthetic layer is a layer prepared for full-screen display.
[0106] In a possible implementation, the electronic device includes a graphics synthesizer SF and a window management system, SF receives a first notification sent from a window management service module, and SF generates a first synthetic layer based on one or more of the layers of the first application interface, the second application interface, and the split-screen dividing line. Among them, the application interface is composed of multiple windows, and these windows are arranged and combined according to certain layouts and rules to form a complete user interface. The WMS module adjusts the user interface by managing the windows in the system. When a new window is created or the properties of an existing window change, the WMS module sends this information to the graphics synthesizer SF, which may include the window's position, size, Z-axis order, transparency, visibility, etc.
[0107] S305: Determine whether the first synthesized layer is a layer with a split-screen dividing line.
[0108] Specifically, the embodiment of the present application adds a judgment on the first composite layer. The electronic device generates the first composite layer in response to the first operation, and judges whether there is a layer of a split-screen dividing line in the first composite layer. If there is, the layer of the split-screen dividing line is removed to obtain the second composite layer. The existence of the layer of the split-screen dividing line indicates that an error occurred in the electronic device when processing the split-screen dividing line, so that the split-screen dividing line is not hidden when the full screen is displayed, and then step S305 is executed to remove the layer of the split-screen dividing line; if there is no layer of the split-screen dividing line in the first composite layer, step S306 is executed.
[0109] S306: Remove the layer of the split-screen dividing line to obtain a second composite layer.
[0110] Specifically, if it is determined that the first composite layer has a split screen dividing line layer, the split screen dividing line layer is removed. In the embodiment of the present application, because it is determined that the first application interface to be displayed is in full screen state, the split screen dividing line is not needed at this time, so the split screen dividing line layer is directly removed to avoid the problem of delayed hiding or failure to hide the split screen dividing line.
[0111] In a possible implementation, the electronic device includes a graphics synthesizer SF and a window management system WMS module. The WMS module sends a second notification to the SF. After receiving the second notification, the SF removes the layer of the split-screen dividing line to obtain a second synthesized layer.
[0112] S307: Display a second user interface.
[0113] Specifically, after layer synthesis, a new user interface (i.e., the second user interface) is obtained and the second user interface is displayed. The second user interface is the first application interface displayed in full screen. When the split-screen dividing line is abnormal, the second user interface is displayed based on the second synthesized layer. When no abnormality occurs, the second user interface is displayed based on the first synthesized layer.
[0114] In an embodiment of the present application, when switching from split-screen mode to full-screen display, the electronic device may add a split-screen dividing line because the startup window abnormally adds a split-screen dividing line when the application is started in split-screen mode, or because the current scene cannot be correctly distinguished as a switch from split-screen mode to full-screen, resulting in the inability to trigger the operation of hiding the split-screen dividing line; the split-screen dividing line should not be displayed in the user interface in full-screen mode, but because the above-mentioned abnormal situation will cause the split-screen dividing line to be processed abnormally, the present application adds a judgment of the abnormal situation during the layer synthesis stage. If it is judged that the first synthetic layer contains a layer of a split-screen dividing line, it means that the electronic device has an abnormality when processing the split-screen dividing line, then the layer of the split-screen dividing line will be directly removed to obtain the second synthetic layer. By judging the layer of the split-screen dividing line in the layer synthesis stage and removing the layer of the split-screen dividing line before the user interface is displayed, the abnormal situation when the electronic device processes the split-screen dividing line can be effectively handled, thereby solving the problem of delayed hiding or failure to hide the split-screen dividing line.
[0115] In the prior art, when an electronic device enters split-screen mode, due to different application startup methods, a split-screen dividing line may be abnormally added when the application is started. The embodiment of the present application proposes an application display method based on the different application startup methods.
[0116] See also Figure 4 , Figure 4 A flowchart of another application display method provided in an embodiment of the present application. The method may include the following steps:
[0117] S401. Enter split-screen mode.
[0118] Specifically, the sub-device is in split-screen mode and displays the first user interface. For a detailed description, please refer to the above step S301, which will not be repeated here.
[0119] S402: Detect the startup mode of the first application and determine whether it is the first startup mode.
[0120] Specifically, the embodiment of the present application adds a judgment on the startup method of the first application, detects the startup method of the first application, and if it is the first startup method, generates a first user interface based on the content of the first application and the content of the second application. After the electronic device enters the split-screen mode, it will start the applications and display them on both sides of the split screen. Because the processing method for the application startup method is the same, only the processing when the first application is started is described in detail here. Determine whether the startup method of the first application is the first startup method. The first startup method is a cold start, which means that the application is started for the first time after being completely killed after entering the split-screen mode. During a cold start, the first application will create a startup window, which is displayed in full screen. At this time, there is no need to add an additional split-screen dividing line to distinguish the boundaries of the split screens on both sides. After the startup is completed, the application will continue to display other interfaces. For example, when the electronic device is in a split-screen state, it will first start the first application interface on the left, and then start the second application interface on the right. The above will still be performed during this process. Figure 3 The method in the embodiment of the present invention determines the layer for adding the split screen dividing line. The method avoids the abnormal display of the split screen dividing line in the user interface, which leads to a decrease in user experience. If the first application startup mode is determined to be the first startup mode, step S403 is executed; if the first application startup mode is determined not to be the first startup mode but the second startup mode, step S404 is executed.
[0121] S403, adding a split screen dividing line.
[0122] Specifically, it is determined that the first application startup mode is the second startup mode, and a split-screen dividing line is added; the second startup mode is that the application has been started before entering the split-screen mode, and illustratively, the electronic device directly enables the first application to enter the split-screen mode from the background program. By adding a split-screen dividing line, multitasking can be made more efficient and intuitive, and users can handle multiple tasks on one screen at the same time, such as checking emails, browsing the web, chatting, or watching videos.
[0123] S404: Display a first user interface.
[0124] Specifically, the first user interface is displayed, and the current first user interface includes: a first application interface, a second application interface, and a split screen dividing line. It should be noted that the split screen dividing line on the user interface at this time may be the boundary of the startup window when the first application is cold started, or it may be a split screen dividing line obtained by adding.
[0125] In the embodiment of the present application, the first startup mode is a cold startup, which means that after the application enters the split-screen mode, it is the first startup of the application after the application is completely terminated; during the cold startup, the first application will create a startup window, and the startup window is full screen, and there is no need to add a split-screen dividing line at this time; but the prior art does not judge the above-mentioned cold startup situation, but performs the operation of adding a dividing line when the application is started, resulting in abnormal addition of a dividing line. The method in the embodiment of the present application judges the startup mode of the application in the split-screen mode, and directly displays the first user interface when the first application startup mode is confirmed, and no longer performs the step of adding a split-screen dividing line; it should be noted that the method is to make a judgment in the startup stage of the application entering the split-screen mode before receiving the user's first operation. This method can effectively avoid abnormal addition of split-screen dividing lines during cold startup, solves the problem of abnormal addition of split-screen dividing lines when the application is started when the electronic device is in split-screen mode, and improves the user experience.
[0126] In the prior art, the split screen dividing line is usually draggable. Users can adjust the split screen according to their needs. For example, if a user needs more display space in a certain application, they can simply drag the dividing line in the direction of another application to expand the display area of the application. This flexibility makes the split screen function more practical and convenient. When an electronic device is in a scenario where an application is switched to full screen and the application window changes, the boundary range of the application interface will change. At this time, the electronic device will reset the boundary range of the application, but will not modify the window mode. This may cause the system to be unable to distinguish between the scenarios of switching to full screen (such as Figure 2D-Figure 2E ) and by dragging the splitter to adjust the window boundary range (such as Figure 5B ), which causes the split-screen dividing line to be hidden late or unable to be hidden.
[0127] In view of the above situation, the present application embodiment proposes an application display method, see Figure 5A , Figure 5A A flowchart of another application display method provided in an embodiment of the present application. The method may include the following steps:
[0128] S501: Display a first user interface.
[0129] Specifically, the electronic device is in split-screen mode, and displays the first user interface, and the current first user interface includes: a first application interface, a second application interface, and a split-screen dividing line. For a specific description, refer to the above step S302, and no further details are given here.
[0130] S502: Receive a first operation from a user.
[0131] Specifically, a first operation of the user is received, and the first operation is used to switch the first user interface to full screen display. For a specific description, refer to the above step S303 and no further details are given here.
[0132] S503: Detect that the size of the first application interface has changed, and recalculate the boundary range of the first application interface.
[0133] Specifically, when the electronic device detects a change in the boundary range of the first application interface, it recalculates the boundary range of the first application interface. When the boundary range of the first application interface changes, the displayed user interface needs to be re-layouted, so the introduction range is recalculated. Exemplarily, the electronic device will re-acquire information such as the width, height, and position of the current application interface, and recalculate the new boundary range according to the required size and position.
[0134] S504: Determine whether the boundary range of the first application interface is full screen and includes a split-screen dividing line.
[0135] Specifically, the embodiment of the present application adds a judgment on the change of the boundary range of the first application interface, wherein there are many situations in which the interface size changes, such as device rotation, split-screen change, full-screen change, and adjusting the display ratio of two applications by dragging the dividing line. Since the electronic device may not be able to distinguish whether the boundary range of the first application interface changes due to switching from split screen to full screen or due to dragging the dividing line, the electronic device will not hide the split-screen dividing line. In the embodiment of the present application, a judgment on the change of the boundary range of the first application interface is added. If the current boundary range is full screen and the split-screen dividing line is displayed, it means that the electronic device has not successfully identified the full-screen change, and executes step S505 to hide the split-screen dividing line; otherwise, executes step S506.
[0136] S505: Hide the split screen dividing line.
[0137] Specifically, Figure 3 The display method in is different from the layer method of directly removing the split-screen dividing line. The hiding of the split-screen dividing line in this step is to modify the code part through the WMS module to achieve the hiding of the split-screen dividing line. After the above hiding, the split-screen dividing line will not participate in the subsequent step of generating the first synthetic layer.
[0138] S506: Generate a first composite layer.
[0139] Specifically, the electronic device generates a first synthetic layer, and the first synthetic layer can be used for subsequent use of the above Figure 3 The method removes the layer of the split screen dividing line. For a detailed description, see the above step S304, which will not be described in detail here.
[0140] In the embodiment of the present application, since the electronic device may not be able to distinguish whether the boundary range change of the first application interface is caused by switching from split screen to full screen or by dragging the dividing line, the electronic device will not hide the split screen dividing line. In order to address the situation where the split screen dividing line is abnormal due to the inability to distinguish the change in the size of the first application interface, the method adds a judgment on the boundary range of the first application interface each time the interface size changes; if the current boundary range of the first application interface is full screen and includes the split screen dividing line, it means that the electronic device has an abnormality in processing the split screen dividing line, so the split screen dividing line is hidden. This method effectively solves the problem of abnormal processing of the split screen dividing line when the application interface changes, resulting in delayed hiding or failure to hide the split screen dividing line.
[0141] See also Figure 6 , Figure 6 The electronic device may include an application startup module, a window management service, a window content module, a dividing line module and a layer synthesis module.
[0142] S601: Start the application.
[0143] Specifically, after the electronic device detects the application startup request, it starts the corresponding application.
[0144] S602: Set the startup mode.
[0145] Specifically, the electronic device selects a suitable startup mode according to specific requirements of the application and user experience.
[0146] S603: Add window request.
[0147] Specifically, the application startup module sends a request to add a window to the window management service, and this window is used to display the application content.
[0148] S604: Send configuration.
[0149] Specifically, the window management service sends configuration information to the window content module to prepare for the subsequent display of application content. Before sending the configuration, the above Figure 4 The method described above detects the application startup mode, and if it is the first startup mode, no request for adding a dividing line is required in the configuration sent.
[0150] S605. Add a dividing line view.
[0151] Specifically, the window management service sends a request to add a dividing line view to the window content module, and controls the appearance and position of the dividing line by setting the properties of the dividing line view (such as color, width, height, etc.).
[0152] S606: Display a dividing line.
[0153] Specifically, the window content module sends a display dividing line request to the dividing line module, and the dividing line module sets a display dividing line so that the user can see multiple application content areas.
[0154] S607: Configuration changed.
[0155] Specifically, this step is triggered when the system configuration changes (such as screen orientation, size, etc.).
[0156] S608: Set the boundary range.
[0157] Specifically, when the application interface sends a change, the boundary range will be recalculated. For a detailed description, see the above step S503.
[0158] S609: Hide the dividing line.
[0159] Specifically, it is determined that the current boundary range is full screen and the dividing line is displayed. For a specific determination description, see the above step S504. The window content module sends a request to hide the dividing line to the dividing line module. The dividing line module receives the request and completes the hiding operation.
[0160] S610. Remove the dividing line layer.
[0161] Specifically, the window service module determines that the dividing line should be hidden. For a specific description of the determination, see the above Figure 3 In the described method, the window service module sends a request to the layer synthesis module to remove the dividing line layer, and the layer synthesis module directly removes the dividing line layer from the synthesis when synthesizing the layers of the user interface.
[0162] See also Figure 7 , Figure 7 700 is a schematic diagram of the structure of an application display device 700 provided in an embodiment of the present application, wherein the device comprises: an interface display module 701, configured to display a first user interface after the device enters a split-screen mode and to display a second user interface based on a second synthetic layer after the device switches to a full-screen mode, wherein the first user interface comprises a first application interface, a second application interface and a split-screen dividing line; an interface interaction module 702, configured to receive a first operation of a user, wherein the first operation is configured to switch the first application interface to a full-screen display; a graphics synthesis module 703, configured to generate a first synthetic layer in response to the first operation, and to determine whether there is a layer of a split-screen dividing line in the first synthetic layer, and if so, to remove the layer of the split-screen dividing line to obtain a second synthetic layer;
[0163] In one possible implementation, the graphics synthesis module 703 includes a graphics synthesizer SF and a window management service WMS module, and the graphics synthesis module is specifically used for: the WSM module is used to send a first notification to the SF; the SF is used to receive the first notification and generate a first synthetic layer based on one or more of the layers of the first application interface, the layers of the second application interface, and the layers of the split-screen dividing line.
[0164] In a possible implementation, the graphics synthesis module 703 includes a graphics synthesizer SF and a window management service WMS module. The graphics synthesis module is specifically used for: the WSM module is used to send a second notification to the SF; the SF is used to receive the second notification and remove the layer of the split-screen dividing line to obtain a second synthesized layer.
[0165] In one possible implementation, the first application interface is used to display the first application, and the second application interface is used to display the second application. The device also includes: a startup mode detection module 704, which is used to detect the startup mode of the first application after the device enters the split-screen mode and before displaying the first user interface. If it is the first startup mode, the first user interface is generated based on the content of the first application and the content of the second application. The first startup mode is the first startup of the first application after entering the split-screen mode.
[0166] In one possible implementation, the startup mode detection module 704 is also used to: detect the startup mode of the first application. If it is the second startup mode, a first user interface is generated based on the content of the first application, the content of the second application and the split-screen dividing line. The second startup mode is that the first application has been started before entering the split-screen mode.
[0167] In one possible implementation, the device also includes: a boundary range detection module 705, which is used to detect that the size of the first application interface has changed, recalculate the boundary range of the first application interface, and judge the boundary range of the first application. If it is determined that the boundary range of the first application interface is full screen and includes a split-screen dividing line, the split-screen dividing line is hidden.
[0168] In a possible implementation, the first application interface and the second application interface are interfaces of the same application, or the first application interface and the second application interface are interfaces of different applications.
[0169] In a possible implementation, the layer of the first application interface, the layer of the second application interface, and the layer of the split-screen dividing line are all independent layers.
[0170] In a possible implementation, the change in the size of the first application interface includes: detecting that the first application interface is switched to full-screen display, or changing the size of the first application interface by dragging a split-screen dividing line.
[0171] It should be noted that the functions of the relevant modules in the application display device 700 described in the embodiment of the present application can be referred to in the above Figure 3-Figure 6 The related method embodiments described in will not be repeated here.
[0172] In the above application embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.
[0173] A person skilled in the art can understand that to implement all or part of the processes in the above-mentioned application embodiments, the processes can be completed by a computer program to instruct the relevant hardware, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above-mentioned application embodiments. The aforementioned storage medium includes: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
[0174] The embodiments of the present application are described in detail above. The principles and implementations of the present application are described in detail using specific examples herein. The description of the embodiments of the present application is only used to help understand the method and core idea of the present application. At the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation and application scope. In summary, the content of this specification should not be understood as limiting the present application.
Claims
1. An application display method, characterized in that: Applied to electronic equipment, the method comprises: Enter split screen mode; Displaying a first user interface, the first user interface comprising: a first application interface, a second application interface, and a split-screen dividing line; Receiving a first operation from a user, where the first operation is used to switch the first application interface to full-screen display; In response to the first operation, a first composite layer is generated, and it is determined whether a layer of the split-screen dividing line exists in the first composite layer, and if so, the layer of the split-screen dividing line is removed to obtain a second composite layer; A second user interface is displayed based on the second synthetic layer, where the second user interface includes the first application interface displayed in full screen.
2. The method according to claim 1, characterized in that The first application interface is used to display a first application, and the second application interface is used to display a second application; After entering the split-screen mode and before displaying the first user interface, the method further includes: Detect the startup method of the first application. If it is the first startup method, generate the first user interface based on the content of the first application and the content of the second application. The first startup method is the first startup of the first application after entering the split-screen mode.
3. The method according to claim 2, characterized in that The method further comprises: Detect the startup method of the first application. If it is the second startup method, generate the first user interface based on the content of the first application, the content of the second application and the split-screen dividing line. The second startup method is that the first application has been started before entering the split-screen mode.
4. The method according to any one of claims 1 to 3, characterized in that: After receiving the first operation of the user and before generating the first synthetic layer, the method further includes: Detecting that the size of the first application interface has changed, and recalculating the boundary range of the first application interface; If it is determined that the boundary range of the first application interface is full screen and includes the split-screen dividing line, the split-screen dividing line is hidden.
5. The method according to any one of claims 1 to 4, characterized in that: The first application interface and the second application interface are interfaces of the same application, or the first application interface and the second application interface are interfaces of different applications respectively.
6. The method according to claim 1, characterized in that The electronic device comprises: a graphics synthesizer SF and a window management service WMS module; the generating of the first synthesis layer comprises: sending a first notification to the SF through the WMS module; In response to the first notification, the first composite layer is generated by the SF based on one or more of the layer of the first application interface, the layer of the second application interface, and the layer of the split-screen dividing line.
7. The method according to claim 6, characterized in that Removing the layer of the split-screen dividing line to obtain a second composite layer includes: sending a second notification to the SF through the WMS module; In response to the second notification, the layer of the split-screen dividing line is removed through the SF to obtain the second composite layer.
8. The method according to claim 1 or 2, characterized in that: The layer of the first application interface, the layer of the second application interface, and the layer of the split-screen dividing line are all independent layers.
9. The method according to claim 4, characterized in that The size of the first application interface changes, including: It is detected that the first application interface is switched to full-screen display, or the size of the first application interface is changed by dragging the split-screen dividing line.
10. The method according to any one of claims 1 to 9, characterized in that: The receiving the first operation of the user includes: receiving a click and lift operation of the user, or receiving a voice input of the user.
11. An electronic device, characterized in that: The electronic device comprises: One or more processors and one or more memories; the one or more processors are coupled to the one or more memories, the one or more memories are used to store computer program codes, the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method as described in any one of claims 1 to 10.
12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 10 is implemented.