Graphical interface processing method and graphical interface processing device

Abstract

The present application discloses a method for processing a graphical interface and a device for processing a graphical interface. The method includes: determining multiple applications that display a display interface; generating a prompt box based on the multiple applications, wherein the prompt box includes information representing the multiple applications; obtaining a first operation for the prompt box; and generating a first icon when the first operation meets the preset operation, wherein the multiple applications can be run when the first icon is triggered. The processing method can process the applications installed in the electronic device according to the user's operation, so that multiple applications can be associated with the generated first icon, so that when the first icon is triggered, multiple applications can be directly opened, without the user having to repeat the opening operation multiple times for multiple applications, thereby improving the operating efficiency and user experience.

Description

Technical Field

[0001] The present application relates to the field of graphical interfaces, and in particular to a method and device for processing a graphical interface. Background Art

[0002] Applications installed on electronic devices have corresponding icons. Users can trigger an icon, such as double-clicking it, to launch the corresponding application. Applications running on electronic devices will display their interface on the desktop, enabling interaction with the user. However, currently, when a user triggers an icon, only one application corresponding to that icon can be launched. If a user needs to launch multiple applications, they need to repeatedly trigger multiple applications, which is inefficient and affects the user experience. Summary of the Invention

[0003] This embodiment provides a method for processing a graphical interface, including: determining multiple applications that display a display interface; generating a prompt box based on the multiple applications, wherein the prompt box includes information representing the multiple applications; obtaining a first operation for the prompt box; and generating a first icon when the first operation meets a preset operation, wherein when the first icon is triggered, the multiple applications can be run.

[0004] This embodiment also provides a graphical interface processing device, including: a determination module, which is configured to determine multiple applications that display a display interface; a generation module, which is configured to generate a prompt box based on the multiple applications, wherein the prompt box includes information representing the multiple applications; an acquisition module, which is configured to obtain a first operation for the prompt box; and a processing module, which is configured to generate a first icon when the first operation conforms to a preset operation, wherein when the first icon is triggered, the multiple applications can be run.

[0005] This embodiment further provides an electronic device, including a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the above-mentioned method steps.

[0006] This embodiment further provides a computer-readable storage medium having a computer program / instruction stored thereon. When the computer program / instruction is executed by a processor, the steps of the method described above are implemented.

[0007] This embodiment also provides a computer program product, including a computer program / instruction, which implements the steps of the above method when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 This is a flowchart of a method for processing a graphical interface according to an embodiment of the present application;

[0009] Figure 2 For the embodiment of this application Figure 1 Flowchart of an embodiment of step S10;

[0010] Figure 3 For the embodiment of this application Figure 1 A flowchart of an embodiment of step S40;

[0011] Figure 4 A flowchart of a specific embodiment of the method for processing a graphical interface according to an embodiment of the present application;

[0012] Figure 5 This is a structural block diagram of a graphical interface processing device according to an embodiment of the present application;

[0013] Figure 6 This is a structural block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0014] Various aspects and features of the present application are described herein with reference to the accompanying drawings.

[0015] It should be understood that various modifications may be made to the embodiments of the present application. Therefore, the above description should not be considered as limiting, but merely as an example of an embodiment. Other modifications within the scope and spirit of the present application will occur to those skilled in the art.

[0016] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the present application and, together with the general description of the present application given above and the detailed description of the embodiments given below, serve to explain the principles of the present application.

[0017] These and other characteristics of the present application will become apparent from the following description of a preferred form of embodiment given as a non-limiting example with reference to the accompanying drawings.

[0018] It should also be understood that although the present application has been described with reference to certain specific examples, those skilled in the art will readily be able to implement many other equivalent forms of the present application.

[0019] The above and other aspects, features and advantages of the present application will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

[0020] Specific embodiments of the present application will be described hereinafter with reference to the accompanying drawings; however, it should be understood that the embodiments described are merely examples of the present application and may be implemented in a variety of ways. Familiar and / or repetitive functions and structures are not described in detail to avoid obscuring the present application with unnecessary or redundant details. Therefore, the specific structural and functional details described herein are not intended to be limiting, but rather serve merely as a basis and representative basis for the claims to teach those skilled in the art to variously utilize the present application with substantially any suitable detailed structure.

[0021] This specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may all refer to one or more of the same or different embodiments according to the present application.

[0022] A method for processing a graphical interface in an embodiment of the present application can be applied to an electronic device. The electronic device may be a first electronic device with a display screen, such as smart glasses, computers and other electronic devices. The smart glasses may be virtual reality glasses, augmented reality glasses or mixed reality glasses that can project virtual images. The display screen can receive and display application data, wherein the application data can be stored and run in a first electronic device with a display screen. Alternatively, the electronic device may be a first electronic device without a display screen, the application data can be stored and run in the first electronic device, the second electronic device has a display screen, the first electronic device and the second electronic device are connected, and the second electronic device can receive the application data of the electronic device and display it on the second electronic device.

[0023] In this embodiment, one or more applications can be installed in an electronic device (a first electronic device with a display screen or a first electronic device electrically connected to a second electronic device with a display screen), a user can operate the application to start the application, and the application can be displayed in the first electronic device with a display screen or the second electronic device with a display screen. For example, the first electronic device can be a first pair of smart glasses, which have a display screen and data processing capabilities. The first smart glasses can install and run applications and display the applications on the display screen. The second electronic device can be a second pair of smart glasses, which have no or partial data processing capabilities, are connected to a mobile phone as the first electronic device and interact with the mobile phone, and can display the data processing results of the mobile phone on the display screen of the second smart glasses. The mobile phone can install and run applications and display applications on the second smart glasses.

[0024] In this embodiment, multiple applications with display interfaces that have been displayed are analyzed by checking a database of an electronic device (a first electronic device with a display screen or a first electronic device electrically connected to a second electronic device with a display screen) to determine whether relevant information about the multiple applications displayed has been created in the database, where the relevant information about the multiple applications indicates that multiple applications are being launched simultaneously. For example, the launch commands for multiple applications are stored in a sequential order so that when a launch operation is performed on a single icon, the launch commands for the multiple applications are executed sequentially. If it is determined that the relevant information about the multiple applications with the display interface is not created in the database, a prompt box can be generated based on the multiple applications to prompt the user to perform an operation based on the prompt box. The prompt box includes information representing the multiple applications. The prompt box can be a variety of prompt boxes, such as an icon, a dialog box, and / or a short message. For example, a user can perform a first operation based on the prompt in the prompt box. The first operation can be a series of operations performed by the user on the information prompted by the prompt box, such as dragging, clicking, sliding, etc. For another example, a user can perform a first operation based on the prompt in the prompt box. The first operation can be a series of operations performed by the user on the content of other display areas based on the prompt in the prompt box, such as dragging, clicking, sliding, etc. Furthermore, after the user performs the first operation, the first electronic device obtains the first operation and analyzes the first operation. If the first operation meets the preset operation, a first icon is generated. The first icon is used to enable the corresponding multiple applications to be run when triggered. The first icon can correspond to multiple applications. When the user triggers the first icon, multiple applications can be opened directly without having to repeatedly trigger multiple applications. This improves operating efficiency and user experience.

[0025] The following describes a system using a mobile phone and smart glasses. The mobile phone performs the computational processing, while the smart glasses perform the display processing. The smart glasses have a display that can display the results of the mobile phone processing, obtain user interaction information with the smart glasses, and transmit this interaction information to the mobile phone for processing, and this logic cycle continues. On the mobile phone side, the graphical interface processing method of this application is described in more detail with reference to the accompanying drawings.

[0026] Figure 1 Flowchart of the method for processing the graphical interface of the embodiment of the present application. Figure 1 As shown, the method of the present application includes the following steps:

[0027] S10: Determine a plurality of application programs displaying display interfaces in the electronic device.

[0028] The application has a display interface that can be displayed on the display screen of the smart glasses so that the user can operate the application. For example, when the user opens the main interface (home interface), it is determined that multiple applications with display interfaces are already displayed in the electronic device. For example, determining which multiple applications displayed in the electronic device are specifically which applications can be determined by a command to start the application. Determining that multiple applications with display interfaces are displayed in the electronic device includes determining that the electronic device displays more than or equal to two applications with display interfaces. In some examples, determining that multiple applications with display interfaces are displayed in the electronic device includes determining that the electronic device displays display interfaces of two applications or display interfaces of three applications.

[0029] The multiple applications have already been launched, but related information for the multiple applications may have already been created. For example, if a user repeatedly operates an application icon displayed on the smart glasses to launch the application, multiple applications may be displayed on the desktop of the smart glasses. The electronic device needs to determine the multiple applications whose display interfaces are displayed in order to further operate on the application.

[0030] The relevant information of the multiple applications displayed may have been created in the electronic device or may not have been created yet. The relevant information of the multiple applications that have been created can be recorded so that it can be used more conveniently by the user. For example, if the relevant information of the multiple applications has been created, a corresponding icon can be provided on the desktop displayed by the smart glasses so that the user can operate the icon to start the multiple applications. If the relevant information of the multiple applications displayed has not been created, the subsequent steps are performed to generate a first icon for facilitating the startup of the multiple applications.

[0031] In addition, the application's display interface can be displayed in two-dimensional or three-dimensional form on the smart glasses. The angle of the display interface facing the user can be adjusted, for example, the user can adjust the angle of the application's display interface. The display posture of the application's display interface can be adjusted, for example, the size, shape, angle facing the user, and three-dimensional display effect of the application's display interface, thereby enhancing the display effect.

[0032] S20: Generate a prompt box based on the multiple applications, wherein the prompt box includes information representing the multiple applications.

[0033] The application that displays the display interface can be considered as an application that has been opened, or an application that has not been completely closed. The electronic device can generate a prompt box based on the application that displays the display interface. The information of the multiple applications is compared with the relevant information of the recorded multiple applications. If the result shows that the relevant information of the multiple applications has not been created, a prompt box can be generated based on the application of the display interface. The prompt box includes information representing multiple applications. For example, the prompt box may include a temporary icon, which corresponds to multiple icons of multiple applications. The temporary icon can be formed by splicing multiple icons of multiple applications to prompt the user whether to create the first icon. The prompt box may also include a temporary icon set, which includes multiple icons corresponding to multiple applications, for the user to select certain applications from multiple applications, which correspond to the first icon. These applications are a subset of multiple applications. The prompt box can also be a single text message, which introduces the corresponding application from a concise perspective and prompts the user to perform an operation.

[0034] Smart glasses can have a camera that can capture user input commands, such as using the camera to capture gesture commands, and then operate the prompt box based on the gesture commands. The user operations captured by the camera of the smart glasses are transmitted to the mobile phone for processing, and the results of the processing are displayed on the smart glasses. The mobile phone's sensors, such as the gyroscope, measure the phone's rotation angle. After the phone rotates, the intersection of the emitted ray and the interface displayed by the smart glasses is the position the user intends to control. The user operates the position pointed by the ray on the phone. The user can operate the prompt box based on the operation of the mobile phone.

[0035] S30: Obtain a first operation for the prompt box.

[0036] The user can perform a first operation on the prompt box, for example, dragging the temporary icon displayed in the prompt box to the set area, and the first operation represents the user's intention to create a first icon. For example, a selection operation is performed on certain icons in the temporary icon set displayed in the prompt box, and the selection operation represents the user's intention to create a first icon for the application corresponding to these icons. For example, the user clicks on the option displayed in the prompt box to confirm based on the text information of creating icons for multiple applications prompted by the prompt box, and clicking on the confirm operation represents the user's intention to create the first icon. For example, the prompt box prompts text information of sliding within a predetermined area to create icons for multiple applications, and the user slides within the predetermined area based on the text information in the prompt box, and the sliding operation represents the user's intention to create the first icon for multiple applications. The electronic device can obtain the first operation based on the input data of the first operation. For example, the user drags the prompt box, and the smart glasses transmit the information of the user's dragging operation to the mobile phone. The mobile phone can determine the first operation based on the dragged object and the dragging trajectory.

[0037] In one embodiment, the prompt box may guide the user's operation, such as through text and / or images, so that the user can complete the first operation more standardly.

[0038] S40 , when the first operation conforms to a preset operation, generating a first icon, wherein when the first icon is triggered, multiple application programs can be run.

[0039] Specifically, after obtaining the first operation, the first operation can be compared with the preset operation. The specific comparison method can be implemented according to the type of the first operation. For example, if the first operation is a drag operation, the drag operation can be compared with the preset drag operation recorded in the preset operation. If they are the same, it means that the first operation complies with the preset operation, and then the first icon is generated. The first icon can be recorded, and relevant information of multiple applications corresponding to the first icon is created. After the user triggers the first icon, the corresponding multiple applications can be run, including after the first icon is triggered, its associated multiple applications are started at the same time. In one embodiment, after the user triggers the first icon, multiple applications are started, and the display interface of the multiple started applications is displayed on the display screen of the smart glasses.

[0040] In one example, when a user implements a first operation on a prompt box to operate on multiple displayed applications, the user can operate on prompt boxes corresponding to multiple applications for which relevant information has not yet been created. For example, relevant information of the first application and the second application has not yet been created, and the prompt box may include icon A of the first application and icon B of the second application, and the user can select icon A and icon B. Relevant information of the first application and the second application is created, and a corresponding first icon is generated. The generated first icon indicates that relevant information of multiple applications has been created, and the first icon is recorded. The generated first icon can be an icon synthesized by icon A and icon B. By clicking the first icon, multiple applications are started simultaneously based on the relevant information of multiple applications.

[0041] In one example, a prompt box can be generated for multiple applications that display a display interface. For example, the generated prompt box includes icons of four applications, namely icon A, icon B, icon C, and icon D. The user selects icon A, icon B, and icon C, and detects that the relevant information of the three applications corresponding to icon A, icon B, and icon C has not been created, then a first icon corresponding to icon A, icon B, and icon C is generated accordingly. The first icon can be an icon composed of icon A, icon B, and icon C. By clicking the first icon, the three applications are started simultaneously according to the relevant information of the three applications.

[0042] When the user performs the first operation on the prompt box to operate the displayed multiple applications, if the relevant information of the multiple applications has been created, prompt information can be generated to prompt the user that there is no need to perform the repeated action of generating the first icon.

[0043] The graphical interface processing method of this embodiment can process multiple applications installed in the electronic device according to the user's operation, so that multiple applications can be associated with the generated first icon, so that when the first icon is triggered, multiple applications can be directly opened, and the user no longer needs to repeatedly open multiple applications. The operating efficiency is improved and the user experience is also improved.

[0044] In one embodiment of the present application, the multiple applications correspond to multiple sub-icons respectively, and the prompt box includes information representing the multiple sub-icons.

[0045] Specifically, each sub-icon is associated with a corresponding application. For example, the first sub-icon is associated with the first application, the second sub-icon is associated with the second application, and the third sub-icon is associated with the third application. The prompt box can express the information of the first sub-icon, the second sub-icon and the third sub-icon in a variety of ways. For example, the prompt box can be a temporary icon, which is composed of three sub-icons. By displaying a temporary icon on the smart glasses to express that the relevant information of the multiple applications corresponding to the multiple sub-icons has not yet been created, for example, the above meaning can be expressed by displaying it in a specific position on the display screen. The user can operate on the prompt box to achieve operations on the multiple applications corresponding to the multiple sub-icons.

[0046] In one embodiment of the present application, it is determined that multiple applications displaying a display interface are displayed, such as Figure 2 Shown, including:

[0047] S110, acquiring an image displayed on the desktop;

[0048] S120, determining identity information of corresponding multiple applications based on the image;

[0049] Accordingly, prompt boxes are generated based on multiple applications, including:

[0050] Corresponding temporary icons are generated based on identity information of the plurality of application programs, wherein the temporary icons are not recorded.

[0051] The smart glasses have a display screen with a desktop. When an application is running or has not been completely closed, the application's display interface can be displayed on the desktop. The user can operate the application based on the application's display interface.

[0052] The display interface of each application contains the identity information of the application, such as the application icon, name and other information. By obtaining the image of the desktop of the display screen of the smart glasses, the image includes the display interfaces of multiple applications, and the identity information of the corresponding multiple applications can be determined based on the multiple display interfaces. The electronic device can thus generate temporary icons (i.e., prompt boxes) corresponding to the multiple applications based on the identity information. The temporary icons are not recorded in the electronic device. Specifically, the relevant information of the multiple applications corresponding to the temporary icons has not yet been created.

[0053] The temporary icon can be displayed at a specific location on the display screen of the smart glasses, for example, on the left side of the desktop, and its display features and colors can be distinguished from other icons on the desktop, so that the user can easily identify and operate it.

[0054] In another embodiment of the present application, determining a plurality of applications displaying a display interface includes:

[0055] Acquire first information representing that display interfaces of multiple application programs are displayed on the desktop;

[0056] determining identity information of the corresponding plurality of applications based on the first information;

[0057] Accordingly, prompt boxes are generated based on multiple applications, including:

[0058] Corresponding temporary icons are generated based on identity information of the plurality of application programs, wherein the temporary icons are not recorded.

[0059] Specifically, the mobile phone opens and runs multiple applications, and the display interfaces of multiple applications are displayed on the smart glasses. The mobile phone determines the identity information of multiple applications based on the first information characterizing the operation of multiple applications, such as the startup commands of multiple applications. The first information can be the background information of the application, such as the data flowing in the background of the electronic device during the operation of the application. Based on the first information, the identity information of the application can be determined, and the identity information can uniquely identify the corresponding application. The electronic device can thus generate temporary icons (i.e., prompt boxes) corresponding to multiple applications based on the identity information. The temporary icon is not recorded in the electronic device. Specifically, the relevant information of the multiple applications corresponding to the temporary icon has not yet been created.

[0060] In one embodiment of the present application, when the first operation conforms to the preset operation, a first icon is generated, such as Figure 3 Shown, including:

[0061] S410: When the first operation is an operation of dragging a prompt box into a preset application group of the electronic device, determining that the first operation complies with the preset operation, wherein the prompt box includes a temporary icon.

[0062] In this embodiment, one or more preset application groups may be provided, each of which includes at least one icon. The application group may be displayed on the desktop of the smart glasses and may be operated by the user, such as merging application groups and adjusting icons within the application group. For example, a preset application group may be displayed on the desktop in a bar-like form and include multiple icons, each of which may correspond to one application or multiple applications.

[0063] In addition, the display posture of the preset application group can also be adjusted accordingly. For example, the display posture of the preset application group can be displayed directly facing the user on the desktop of the smart glasses, or it can be displayed at a certain angle to the user's line of sight. Of course, the user can also adjust the display posture of the preset application group to meet the different needs of the user. Similarly, the display interface of the application can also be displayed flexibly, such as neatly arranged on the desktop, or displayed in a specific position on the desktop (such as the right side). Of course, the user can also adjust the posture and viewing angle of the display interface of the application to meet the different viewing needs of the user.

[0064] Temporary icons can be displayed in a temporary application group on the desktop of the smart glasses. The temporary application group can be used to accommodate temporary icons. The display posture of the temporary application group can be adjusted in a similar way to the preset application group.

[0065] The first operation can be a drag operation. After the user drags the temporary icon into the preset application group on the desktop of the smart glasses, it can be converted into a first icon. The first icon can be the same as the temporary icon, except that the temporary icon is contained in the temporary application group, while the first icon is contained in the preset application group. When the temporary icon is dragged to the preset application group, the mobile phone will convert the temporary icon into the first icon and record the first icon. The first icon indicates that relevant information of the corresponding multiple applications has been created. Specifically, the temporary icon can be formed by multiple sub-icons, each sub-icon corresponding to an application. The temporary icon is formed by obtaining multiple sub-icons, shrinking each sub-icon, and evenly arranging the shrunken sub-icons. Before the temporary icon is subjected to the first operation (drag operation), the relevant information of the multiple applications corresponding to it has not been created. After the first operation is performed, the relevant information of the multiple applications corresponding to the first icon is created. This allows the user to operate the converted first icon again, and the corresponding multiple applications can be opened simultaneously, and the display interface of multiple applications is displayed on the desktop.

[0066] S420: Record the temporary icon according to the identity information of the multiple application programs corresponding to the temporary icon.

[0067] Since the temporary icon is not recorded, the relevant information of the corresponding multiple applications is not created. After the user performs the first operation on the temporary icon, the user may be prompted to input information for the first icon, such as instructing the user to input or modify the name of the first icon. After the user determines the name, the input or modified name is used as the name of the multiple applications corresponding to the first icon. This allows the user to determine the multiple applications corresponding to the first icon by name, and clicking the first icon can open the corresponding multiple applications. For example, the multiple applications corresponding to the first icon may include a video social application and a text social application. The user may input "social scene" as the name of the first icon, and the user may click the first icon to simultaneously open the corresponding radio frequency social application and text application for social interaction.

[0068] The first icon is recorded based on the identity information of the multiple applications corresponding to the temporary icons. Based on the identity information of the multiple applications corresponding to the temporary icons, relevant information of the multiple applications is created and the first icon is recorded. After the user triggers the first icon, the multiple applications corresponding to the first icon are opened simultaneously, saving the user the time of performing multiple check-in operations for multiple applications separately, thereby improving operational efficiency.

[0069] In one embodiment of the present application, when it is determined that the first operation meets the preset operation, the method further includes:

[0070] generating a dialog box for collecting user confirmation information input for generating the first icon;

[0071] After obtaining the user confirmation information, the temporary icon is determined as the first icon;

[0072] Based on the user confirmation information, the name and / or graphic of the first icon is adjusted.

[0073] Specifically, after the user performs the first operation, a corresponding dialog box is generated to instruct the user to enter user confirmation information related to the first icon into the dialog box, such as entering the name of the first icon and clicking the OK button to confirm. This can confirm that the user needs to determine the temporary icon as the first icon, and relevant information of multiple applications associated with the first icon is created.

[0074] Based on the user confirmation information, the name and / or graphic of the first icon are adjusted. Specifically, the name of the temporary icon is changed to the name of the first icon input by the user. The graphic of the first icon can also be adjusted, including continuing to use the graphic of the temporary icon or using a newly input graphic.

[0075] The following is an explanation based on a specific embodiment. Every time a user opens or closes an application, the electronic device will check whether the number of currently open applications is greater than or equal to 2. If so, it will check whether there is information in the created information that is exactly the same as the relevant information of the currently open multiple applications, and whether there is an icon that is the same as the recorded icon. For example, if there is no such icon, a temporary application group is formed on the left side of the main interface, and this temporary application group contains a temporary icon. This temporary icon is centered on the size of a regular icon, and is based on the icon graphics of the multiple currently open applications, and is arranged to form an icon of the size of a regular icon after being reduced in size. If the user closes one of the applications, the temporary icon is centered on the size of a regular icon, and is based on the icon graphics of all currently open applications, and is evenly arranged to form an icon of the size of a regular icon after being reduced in size. If the number of currently open applications is less than 2 after closing the application, a temporary icon will not be formed on the left side of the main interface.

[0076] For example, temporary icons corresponding to three applications are displayed on the main interface, but the temporary icons formed are not recorded, that is, the relevant information of the three applications is not created. When the user drags the temporary icon from the temporary application group to other preset application groups, a naming window will be displayed. After the user enters the name and clicks confirm, a first icon will be formed on the main interface. The name displayed on this first icon is the name entered by the user, and the multiple applications associated with the first icon are all currently open applications. Generating the first icon through a user-confirmed operation can avoid the electronic device automatically creating the first icon and causing desktop clutter. The first icon dragged to the preset application group means that the relevant information of multiple applications is created, and their positions and information will be recorded. When the user clicks the first icon, the three applications corresponding to the first icon can be opened at the same time.

[0077] In one embodiment of the present application, determining the plurality of applications displaying the display interface includes: obtaining the runtime of the plurality of applications being displayed together on the desktop;

[0078] Generating a prompt box based on multiple applications includes: determining multiple applications that meet a preset time period condition as target programs based on the running time of the multiple applications; and generating a prompt box based on the target programs.

[0079] Specifically, the running time of each application is calculated after it is started. If the running time is long, it may be that the user needs to use the application frequently and for a long time. In order to make it more convenient for users to operate multiple applications that are frequently used by users in a certain scenario, the running time of multiple applications displayed on the desktop together can be obtained in this embodiment. The running time is the time when multiple applications are displayed together, which may indicate that the user uses multiple applications together in a certain scenario. If it is determined that the running time meets the preset time period condition, multiple applications can be determined as target programs, and a prompt box can be generated based on the target program. The preset time period can be pre-set according to the actual usage needs of the user. For example, if a user runs multiple applications at the same time within 10 minutes, these multiple applications can be stored as a temporary icon.

[0080] In one embodiment of the present application, when the first operation conforms to the preset operation, the method further includes the following steps:

[0081] Get the display interface information of multiple applications corresponding to the prompt box;

[0082] The display interface information is associated with the first icon.

[0083] Specifically, the user can set the display interface of multiple applications corresponding to the prompt box on the smart glasses. The corresponding display interface information is formed based on the user's input, and the display interface information includes at least one of the following information: display content, position, posture, size, shape, etc. The display interface information is obtained, associated with the first icon, the first icon is recorded, and relevant information of multiple applications is created, and the display interface information of each application is created together. After the user triggers the first icon, multiple applications are opened, and the display interfaces of the multiple applications are displayed according to the created display interface information.

[0084] Create display interface information for multiple applications corresponding to the first icon. The display interface information indicates that the display interfaces of the multiple applications are at different angles to the user's line of sight. For example, the display interfaces of the multiple applications generally form a semicircle. After triggering the first icon to open the multiple applications, the display interfaces of the multiple applications are displayed at angles consistent with the created display interface information, thereby creating a three-dimensional display effect.

[0085] In one embodiment of the present application, the method further includes:

[0086] Obtaining a trigger instruction for performing a second operation on the first icon;

[0087] According to the display interface information of the multiple application programs, the display interfaces of the multiple application programs are controlled to be displayed on the desktop.

[0088] Specifically, the first icon is recorded, and information related to the multiple applications corresponding to the first icon is created. This allows the user to trigger the multiple applications corresponding to the first icon when performing a second operation on the first icon, thereby controlling the display interfaces of the multiple applications on the desktop. The second operation can specifically be a click operation, a voice operation, and / or a sliding operation, etc., which are not limited here.

[0089] The smart glasses connected to the mobile phone can execute the graphical interface processing method. On the smart glasses side, the graphical interface processing method includes:

[0090] S50, displaying a display interface of multiple applications;

[0091] S60, displaying a prompt box, wherein the prompt box is generated based on multiple applications and includes information of the multiple applications;

[0092] S70, obtaining a first operation for the prompt box;

[0093] S80, displaying a first icon, where the first icon is generated when the first operation conforms to a preset operation, wherein the first icon displays display interfaces of multiple applications when triggered.

[0094] In one embodiment, a display interface for displaying multiple applications includes:

[0095] Get the image displayed on the desktop;

[0096] Sending the image, where the image is used to determine identity information of the corresponding multiple applications;

[0097] Accordingly, a prompt box is displayed, including:

[0098] A temporary icon is displayed, where the temporary icon is generated based on the identity information of the plurality of application programs, wherein the temporary icon is not recorded.

[0099] In one embodiment, when the first operation conforms to a preset operation, the method further includes:

[0100] Displaying a dialog box for collecting user confirmation information input for generating the first icon;

[0101] After obtaining the user confirmation information, the temporary icon is displayed as the first icon;

[0102] Based on the user confirmation information, the name and / or graphic of the first icon is adjusted.

[0103] In one embodiment, displaying a prompt box includes:

[0104] The prompt box is generated based on the target program, which is determined based on the running time of multiple applications and multiple applications that meet the preset time period conditions. The running time represents the time when multiple applications are displayed on the desktop together.

[0105] In one embodiment, when the first operation conforms to a preset operation, the method further includes:

[0106] Get the display interface information of multiple applications corresponding to the prompt box;

[0107] The display interface information is associated with the first icon.

[0108] In one embodiment, the method further comprises:

[0109] Obtaining a trigger instruction for performing a second operation on the first icon;

[0110] A trigger instruction of the second operation is sent and display interfaces of multiple application programs are displayed, wherein the display interfaces of the multiple application programs are obtained according to display interface information of the multiple application programs.

[0111] In one embodiment, the multiple applications correspond to multiple sub-icons respectively, and the prompt box includes information representing the multiple sub-icons.

[0112] In one embodiment, displaying a prompt box includes:

[0113] A temporary icon is displayed. The temporary icon is generated based on the identity information of multiple applications. The temporary icon is not recorded. The identity information of multiple applications is determined based on the first information. The first information represents that the display interfaces of multiple applications are displayed on the desktop.

[0114] In one embodiment, the first icon is generated when the first operation meets the preset operation, including:

[0115] In a case where the first operation is an operation of dragging the prompt box into a preset application group, determining that the first operation complies with the preset operation, wherein the prompt box includes a temporary icon;

[0116] The first icon is recorded according to the identity information of the multiple application programs corresponding to the temporary icons.

[0117] The above method can also be performed on a first electronic device having a display screen. For example, a mobile phone, tablet, laptop, or other electronic device. The first electronic device can store application data and, after running the application, display the data on the display screen of the first electronic device. The display screen of the first electronic device can display multiple applications using split-screen technology. According to the above method, a first icon can be generated, allowing the user to simultaneously open the corresponding multiple applications when the user subsequently operates the first icon.

[0118] This embodiment also provides a graphical interface processing device, such as Figure 5 Shown, including:

[0119] A determination module 1 configured to determine a plurality of applications that display a display interface;

[0120] A generating module 2 is configured to generate a prompt box based on the multiple applications, wherein the prompt box includes information representing the multiple applications;

[0121] An acquisition module 3 is configured to acquire a first operation for the prompt box;

[0122] The processing module 4 is configured to generate a first icon when the first operation conforms to a preset operation, wherein when the first icon is triggered, multiple application programs can be run.

[0123] In one embodiment of the present application, multiple application programs correspond to multiple sub-icons respectively, and the prompt box includes information representing the multiple sub-icons.

[0124] In one embodiment of the present application, the determination module 1 is further configured to: obtain an image displayed on the desktop; determine the identity information of the corresponding multiple applications based on the image; and accordingly, generate a prompt box based on the multiple applications, including: generating corresponding temporary icons based on the identity information of the multiple applications, wherein the temporary icons are not recorded.

[0125] In one embodiment of the present application, the determination module 1 is further configured to: obtain first information representing display interfaces of multiple applications displayed on the desktop; determine identity information of the corresponding multiple applications based on the first information;

[0126] Accordingly, generating a prompt box based on multiple applications includes: generating corresponding temporary icons based on the identity information of the multiple applications, wherein the temporary icons are not recorded.

[0127] In one embodiment of the present application, the processing module 4 is further configured to: determine that the first operation complies with the preset operation when the first operation is an operation of dragging the prompt box into a preset application group, wherein the prompt box includes a temporary icon;

[0128] The first icon is recorded according to the identity information of the multiple application programs corresponding to the temporary icons.

[0129] In one embodiment of the present application, the processing module 4 is further configured to: when it is determined that the first operation complies with the preset operation, generate a dialog box to collect user confirmation information entered to generate the first icon; after obtaining the user confirmation information, determine the temporary icon as the first icon; and adjust the name and / or graphic of the first icon based on the user confirmation information.

[0130] In one embodiment of the present application, the determination module 1 is configured to: obtain the running time of multiple applications displayed on the desktop together; so that the generation module 2 determines multiple applications that meet the preset time period conditions as target programs based on the running time of the multiple applications; and generate the prompt box based on the target program.

[0131] In one embodiment of the present application, the processing module 4 is further configured to: obtain display interface information of multiple application programs corresponding to the prompt box; and associate the display interface information with the first icon.

[0132] In one embodiment of the present application, the acquisition module 3 is further configured to: obtain a trigger instruction for performing a second operation on the first icon, so that the processing module 4 controls the display interface of multiple applications on the desktop according to the display interface information of the multiple applications.

[0133] The present application also provides an electronic device, such as Figure 6 As shown, it includes a memory 5, a processor and a computer program stored in the memory 5, and the processor 6 executes the computer program to implement the following steps: determining multiple applications that display a display interface; generating a prompt box based on the multiple applications, wherein the prompt box includes information representing the multiple applications; obtaining a first operation for the prompt box; and generating a first icon when the first operation meets the preset operation, wherein when the first icon is triggered, multiple applications can be run.

[0134] In one embodiment of the present application, multiple application programs correspond to multiple sub-icons respectively, and the prompt box includes information representing the multiple sub-icons.

[0135] In one embodiment of the present application, the processor 6 executes a computer program to further implement the following steps: obtaining an image displayed on the desktop; determining the identity information of the corresponding multiple applications based on the image; accordingly, generating a prompt box based on the multiple applications, including: generating corresponding temporary icons based on the identity information of the multiple applications, wherein the temporary icons are not recorded.

[0136] In one embodiment of the present application, the processor 6 executes the computer program to further implement the following steps: obtaining first information representing a display interface of multiple applications displayed on the desktop of the electronic device; determining the identity information of the corresponding multiple applications based on the first information; and generating corresponding temporary icons based on the identity information of the multiple applications, wherein the temporary icons are not recorded.

[0137] In one embodiment of the present application, the processor 6 executes the computer program to further implement the following steps: when the first operation is to drag the prompt box into a preset application group, determine that the first operation complies with the preset operation, wherein the prompt box includes a temporary icon; and record the first icon based on the identity information of multiple applications corresponding to the temporary icon.

[0138] In one embodiment of the present application, the processor 6 executes a computer program to further implement the following steps: generating a dialog box to collect user confirmation information input to generate a first icon; after obtaining the user confirmation information, determining the temporary icon as the first icon; and adjusting the name and / or graphic of the first icon based on the user confirmation information.

[0139] In one embodiment of the present application, the processor 6 executes a computer program to further implement the following steps: obtaining the running time of multiple applications displayed on the desktop; based on the running time of multiple applications, determining multiple applications that meet the preset time period conditions as target programs; and generating the prompt box based on the target program.

[0140] In one embodiment of the present application, the processor 6 executes the computer program to further implement the following steps: obtaining display interface information of multiple applications corresponding to the prompt box; and associating the display interface information with the first icon.

[0141] In one embodiment of the present application, the processor 6 executes a computer program to further implement the following steps: obtaining a trigger instruction for performing a second operation on the first icon; and controlling the display interfaces of multiple applications on the desktop of the electronic device based on the display interface information of the multiple applications.

[0142] An embodiment of the present application also provides a computer-readable storage medium having a computer program / instruction stored thereon, which, when executed by a processor, implements the following steps: determining multiple applications displaying a display interface; generating a prompt box based on the multiple applications, wherein the prompt box includes information representing the multiple applications; obtaining a first operation for the prompt box; and generating a first icon when the first operation meets a preset operation, wherein when the first icon is triggered, multiple applications can be run.

[0143] In one embodiment of the present application, multiple application programs correspond to multiple sub-icons respectively, and the prompt box includes information representing the multiple sub-icons.

[0144] In one embodiment of the present application, the computer program / instructions are executed by a processor to further implement the following steps: obtaining an image displayed on the desktop; determining the identity information of multiple corresponding applications based on the image; and generating corresponding temporary icons based on the identity information of the multiple applications, wherein the temporary icons are not recorded.

[0145] In one embodiment of the present application, the computer program / instructions are executed by the processor to further implement the following steps: obtaining first information representing a display interface of multiple applications displayed on the desktop; determining the identity information of the corresponding multiple applications based on the first information; and generating corresponding temporary icons based on the identity information of the multiple applications, wherein the temporary icons are not recorded.

[0146] In one embodiment of the present application, the computer program / instructions are executed by the processor to further implement the following steps: when the first operation is to drag the prompt box into a preset application group, determine that the first operation complies with the preset operation, wherein the prompt box includes a temporary icon; and record the first icon based on the identity information of multiple applications corresponding to the temporary icon.

[0147] In one embodiment of the present application, the computer program / instructions are executed by a processor to further implement the following steps: generating a dialog box for collecting user confirmation information input for generating the first icon; after obtaining the user confirmation information, determining the temporary icon as the first icon;

[0148] Based on the user confirmation information, the name and / or graphic of the first icon is adjusted.

[0149] In one embodiment of the present application, the computer program / instructions are executed by the processor to further implement the following steps: obtaining the running time of multiple applications displayed on the desktop; based on the running time of multiple applications, determining multiple applications that meet the preset time period conditions as target programs; and generating a prompt box based on the target program.

[0150] In one embodiment of the present application, the computer program / instruction is executed by the processor to further implement the following steps: obtaining display interface information of multiple applications corresponding to the prompt box; and associating the display interface information with the first icon.

[0151] In one embodiment of the present application, the computer program / instruction is executed by the processor to further implement the following steps: obtaining a trigger instruction for performing a second operation on the first icon; and controlling the display interface of multiple applications on the desktop based on the display interface information of the multiple applications.

[0152] An embodiment of the present application also provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the following steps: determining multiple applications displaying a display interface; generating a prompt box based on the multiple applications, wherein the prompt box includes information representing the multiple applications; obtaining a first operation for the prompt box; and generating a first icon when the first operation meets a preset operation, wherein when the first icon is triggered, multiple applications can be run.

[0153] In one embodiment of the present application, multiple application programs correspond to multiple sub-icons respectively, and the prompt box includes information representing the multiple sub-icons.

[0154] In one embodiment of the present application, when the computer program / instructions are executed by the processor, the following steps are further implemented: obtaining an image displayed on the desktop of the electronic device; determining the identity information of the corresponding multiple applications based on the image; and generating corresponding temporary icons based on the identity information of the multiple applications, wherein the temporary icons are not recorded.

[0155] In one embodiment of the present application, when the computer program / instruction is executed by the processor, the following steps are further implemented: obtaining first information representing a display interface of multiple applications displayed on the desktop; determining the identity information of the corresponding multiple applications based on the first information; and generating corresponding temporary icons based on the identity information of the multiple applications, wherein the temporary icons are not recorded.

[0156] In one embodiment of the present application, when the computer program / instruction is executed by the processor, the following steps are further implemented: when the first operation is an operation of dragging the prompt box into a preset application group, determining that the first operation complies with the preset operation, wherein the prompt box includes a temporary icon; and recording the first icon based on the identity information of multiple applications corresponding to the temporary icon.

[0157] In one embodiment of the present application, when the computer program / instructions are executed by the processor, the following steps are further implemented: generating a dialog box to collect user confirmation information input to generate the first icon; after obtaining the user confirmation information, determining the temporary icon as the first icon; and adjusting the name and / or graphic of the first icon based on the user confirmation information.

[0158] In one embodiment of the present application, when the computer program / instruction is executed by the processor, the following steps are further implemented: obtaining the running time of multiple applications displayed on the desktop together; based on the running time of multiple applications, determining multiple applications that meet the preset time period conditions as target programs; and generating a prompt box based on the target program.

[0159] In one embodiment of the present application, when the computer program / instruction is executed by the processor, the following steps are further implemented: obtaining display interface information of multiple applications corresponding to the prompt box; and associating the display interface information with the first icon.

[0160] In one embodiment of the present application, when the computer program / instruction is executed by the processor, the following steps are further implemented: obtaining a trigger instruction for performing a second operation on the first icon; and controlling the display interface of multiple applications on the desktop based on the display interface information of the multiple applications.

[0161] The above embodiments are merely exemplary embodiments of the present application and are not intended to limit the scope of the present application. The scope of protection of the present application is defined by the claims. Those skilled in the art may make various modifications or equivalent substitutions to the present application within the essence and scope of protection of the present application, and such modifications or equivalent substitutions shall also be deemed to fall within the scope of protection of the present application.

Claims

1. A method for processing a graphical interface, applied to a first electronic device, the method comprising: Determining that a second electronic device displays a plurality of applications on a display interface, and the second electronic device is connected to the first electronic device; In response to the relevant information of the multiple applications not being created, based on the multiple applications displayed on the display interface by the second electronic device, generating a prompt box, wherein the prompt box is used to prompt whether to create a first icon, the prompt box includes a temporary icon, the temporary icon represents information of the multiple applications, and the temporary icon is not recorded; in response to opening or closing the application, rechecking the application displayed on the display interface, when the number of the applications is greater than 2, reducing the size of the icon graphics of the multiple applications displayed on the display interface as a basis and arranging them to form the temporary icon; Acquire a first operation for the prompt box from the second electronic device; When the first operation complies with the preset operation, the temporary icon is converted into a first icon displayed on the second electronic device, and the first icon is recorded in the first electronic device, wherein the relevant information representing the multiple applications of the first icon is created so that the multiple applications can be run when the first icon is triggered. 2 . The method according to claim 1 , wherein the multiple applications correspond to multiple sub-icons respectively, and the prompt box includes information representing the multiple sub-icons.

3. The method according to claim 1, wherein determining that the second electronic device displays multiple applications on the display interface comprises: Get the image displayed on the desktop; determining identity information of the corresponding multiple applications based on the image; Accordingly, the step of generating a prompt box based on the plurality of applications displayed on the display interface of the second electronic device includes: Corresponding temporary icons are generated based on the identity information of the multiple application programs.

4. The method according to claim 1, wherein determining that the second electronic device displays multiple applications on a display interface comprises: Acquire first information representing that display interfaces of the plurality of application programs are displayed on the desktop; determining identity information of the corresponding multiple applications based on the first information; Accordingly, the step of generating a prompt box based on the plurality of applications displayed on the display interface of the second electronic device includes: Corresponding temporary icons are generated based on the identity information of the multiple application programs.

5. The method according to claim 1, wherein, when the first operation matches a preset operation, converting the temporary icon into a first icon displayed on the second electronic device and recording the first icon in the first electronic device comprises: In a case where the first operation is an operation of dragging the prompt box into a preset application group, determining that the first operation complies with a preset operation; The temporary icon is converted into a first icon displayed on the second electronic device, and the first icon is recorded in the first electronic device according to the identity information of the multiple application programs corresponding to the temporary icon.

6. The method according to claim 5, wherein, when it is determined that the first operation meets the preset operation, the method further comprises: generating a dialog box for collecting user confirmation information input for generating the first icon; After obtaining the user confirmation information, determining the temporary icon as the first icon; Based on the user confirmation information, the name and / or graphic of the first icon is adjusted.

7. The method according to claim 1, wherein determining that the second electronic device displays multiple applications on the display interface comprises: Obtaining the running time of the multiple applications displayed together on the desktop; The generating of the prompt box based on the plurality of applications displayed on the display interface of the second electronic device includes: determining the plurality of applications that meet a preset time period condition as target applications based on the running time of the plurality of applications; The prompt box is generated based on the target program.

8. The method according to claim 1, wherein, when the first operation conforms to a preset operation, the method further comprises: Obtaining display interface information of the multiple applications corresponding to the prompt boxes; The display interface information is associated with the first icon.

9. The method according to claim 8, further comprising: Obtaining a trigger instruction for performing a second operation on the first icon; According to the display interface information of the multiple application programs, the display interfaces of the multiple application programs are controlled to be displayed on the desktop.

10. A graphical interface processing device, applied to a first electronic device, comprising: a determining module configured to determine that a second electronic device displays a plurality of applications on a display interface, and that the second electronic device is connected to the first electronic device; a generating module configured to, in response to the relevant information of the multiple applications not being created, generate a prompt box based on the multiple applications displayed on the display interface by the second electronic device, wherein the prompt box is used to prompt whether to create a first icon, the prompt box including a temporary icon, the temporary icon representing information of the multiple applications, and the temporary icon is not recorded; in response to opening or closing the application, recheck the application displayed on the display interface, and when the number of the applications is greater than two, reduce the size of the icon graphics of the multiple applications displayed on the display interface as a basis and arrange them to form the temporary icon; an acquisition module configured to acquire a first operation for the prompt box from the second electronic device; A processing module is configured to convert the temporary icon into a first icon displayed on the second electronic device when the first operation conforms to a preset operation, and record the first icon in the first electronic device, wherein the relevant information representing the multiple applications of the first icon is created so that the multiple applications can be run when the first icon is triggered.

11. An electronic device comprising a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the method steps according to any one of claims 1 to 9.

12. A computer-readable storage medium having a computer program / instruction stored thereon, which implements the steps of the method according to any one of claims 1 to 9 when executed by a processor.

13. A computer program product comprising a computer program / instruction, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 9.

Images