Interface processing method and device, electronic equipment and storage medium

Abstract

The invention discloses an interface processing method and device, electronic equipment and a storage medium, and belongs to the technical field of computers. The method comprises the following steps: receiving a first input for a first interface; in response to the first input, displaying at least one function control according to the interface content of the first interface, the at least one function control being associated with the interface content; receiving a second input for a first function control in the at least one function control; and in response to the second input, executing an operation corresponding to the first function control.

Description

Technical Field

[0001] The present application belongs to the field of computer technology, and specifically relates to an interface processing method, device, electronic device and storage medium. Background Art

[0002] With the continuous development of electronic devices, users have an increasing demand for processing the screen display content of electronic devices, such as information retrieval, image editing, text translation, and text extraction.

[0003] However, when performing any of the above operations, the user needs to input multiple times into the electronic device to trigger the electronic device to perform the operation required by the user. Taking information retrieval as an example, when a user browses an article, if the user is interested in event A described in the article and wants to know more about event A, he needs to exit the current page first, then open the browser, enter the relevant retrieval information of event A in the search box of the browser, and then click the search control to trigger the electronic device to retrieve the relevant content of event A. This makes the operation cumbersome. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide an interface processing method, device, electronic device and storage medium, which can avoid tedious operations of users.

[0005] In a first aspect, an embodiment of the present application provides an interface processing method, the method comprising: receiving a first input to a first interface; in response to the first input, displaying at least one function control according to the interface content of the first interface, the at least one function control being associated with the interface content; receiving a second input to a first function control among the at least one function control; and in response to the second input, executing an operation corresponding to the first function control.

[0006] In a second aspect, an embodiment of the present application provides an interface processing device, which includes: a receiving module, a display module, and a processing module. The receiving module is used to receive a first input to a first interface. The display module is used to display at least one function control according to the interface content of the first interface in response to the first input received by the receiving module, and the at least one function control is associated with the interface content. The receiving module is also used to receive a second input to a first function control among the at least one function control displayed by the display module. The processing module is used to perform an operation corresponding to the first function control in response to the second input received by the receiving module.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program / program product, wherein the computer program / program product is stored in a storage medium, and the program / program product is executed by at least one processor to implement the method described in the first aspect.

[0011] In an embodiment of the present application, a first input to a first interface is received; in response to the first input, at least one function control is displayed according to the interface content of the first interface, and the at least one function control is associated with the interface content; a second input to a first function control among the at least one function control is received; in response to the second input, an operation corresponding to the first function control is performed. In this solution, since the electronic device can recommend at least one function control associated with the interface content according to the interface content of the first interface, the user can trigger the electronic device to perform the operation corresponding to the first function control by inputting the first function control among the at least one function control, without the user having to trigger the electronic device to switch to other applications and then perform the operation through other applications, thus avoiding cumbersome operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 This is one of the flow charts of an interface processing method provided in an embodiment of the present application;

[0013] FIG. 2(A) is one of the schematic diagrams of an example of controlling an electronic device to enter a processing state provided by an embodiment of the present application;

[0014] FIG. 2(B) is one of the schematic diagrams of an example of a functional control corresponding to the interface content provided by an embodiment of the present application;

[0015] FIG3(A) is a second schematic diagram of an example of controlling an electronic device to enter a processing state provided by an embodiment of the present application;

[0016] FIG3(B) is a second schematic diagram of an example of a functional control corresponding to the interface content provided by an embodiment of the present application;

[0017] Figure 4 This is a schematic diagram of an example of inputting a function control provided in an embodiment of the present application;

[0018] Figure 5 This is a second flow chart of an interface processing method provided in an embodiment of the present application;

[0019] FIG6(A) is a schematic diagram of an example of a search selection area provided in an embodiment of the present application;

[0020] FIG6(B) is a schematic diagram of an example of selecting interface content provided in an embodiment of the present application;

[0021] FIG6(C) is a third example schematic diagram of a functional control corresponding to the interface content provided by an embodiment of the present application;

[0022] Figure 7 This is a fourth example schematic diagram of a functional control corresponding to the interface content provided by an embodiment of the present application;

[0023] Figure 8 This is a third flow chart of an interface processing method provided in an embodiment of the present application;

[0024] Fig. 9 This is a schematic diagram of an example of displaying operation results on an interactive interface of an AI assistant provided in an embodiment of the present application;

[0025] Fig.10 This is a schematic diagram of an example of processing an operation result provided by an embodiment of the present application;

[0026] Fig.11 is a schematic diagram of an example of a search information input area provided in an embodiment of the present application;

[0027] Fig.12 is a structural schematic diagram of an interface processing device provided in an embodiment of the present application;

[0028] Fig.13 This is one of the hardware structure diagrams of an electronic device provided in an embodiment of the present application;

[0029] Fig.14 This is the second schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0031] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0032] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".

[0033] The interface processing method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0034] The interface processing method in the embodiment of the present application can be applied to the scenario of executing page-related operations.

[0035] In the interface processing method, device, electronic device and storage medium provided in the embodiments of the present application, since the electronic device can recommend at least one function control associated with the interface content based on the interface content of the first interface, the user can trigger the electronic device to perform the operation corresponding to the first function control by inputting the first function control among the at least one function control, without the user having to trigger the electronic device to switch to other applications and then perform the operation through other applications, thereby avoiding tedious operations.

[0036] The execution subject of the interface processing method provided in the embodiment of the present application may be an interface processing device, which may be an electronic device, or a functional module or entity in an electronic device. The technical solution provided in the embodiment of the present application is described below using an electronic device as an example.

[0037] The present application embodiment provides an interface processing method. Figure 1 FIG. 1 is a flow chart of an interface processing method provided by an embodiment of the present application, which can be applied to electronic devices. Figure 1As shown, the interface processing method provided in the embodiment of the present application may include the following steps 201 to 204.

[0038] Step 201: The electronic device receives a first input on a first interface.

[0039] In some embodiments of the present application, the first interface may be any of the following: an article browsing page, an audio playback page, a chat page, or any page that can be displayed by an electronic device. The present application embodiment does not limit this.

[0040] In some embodiments of the present application, the first input is used to process the interface content of the first interface.

[0041] In some embodiments of the present application, the first input includes but is not limited to: a touch input of the user to the first interface through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or a click input, or other feasible input. The specific input can be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0042] In some embodiments of the present application, the above-mentioned specific gesture can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture.

[0043] In some embodiments of the present application, the click input may be a single click input, a double click input, or any number of click inputs, and may also be a long press input or a short press input.

[0044] In some embodiments of the present application, the electronic device may receive a first input from a user on the first interface while displaying the first interface, so as to display at least one functional control according to the interface content of the first interface.

[0045] Step 202: The electronic device displays at least one function control according to the interface content of the first interface in response to the first input.

[0046] In an embodiment of the present application, the at least one functional control is associated with the interface content.

[0047] In some embodiments of the present application, the at least one functional control being associated with the interface content may be understood as: the at least one functional control is used to perform operations related to the interface content.

[0048] In some embodiments of the present application, the above-mentioned interface content may be the global interface content of the first interface (ie, all the interface content of the first interface), or may be partial interface content of the first interface.

[0049] In some embodiments of the present application, the interface content of the first interface may include at least one of the following: text, image, table, link, article information, movie information, ticket purchase information, schedule information, etc. The specific content may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0050] In some embodiments of the present application, when the interface content includes text, the at least one functional control may include at least one of the following: a text search control, a text extraction control, a translation control, a document conversion control, etc. The specific one may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0051] In some examples, the text search control described above is used to search for information related to text.

[0052] In some examples, the text extraction control is used to extract text.

[0053] In some examples, the translation control described above is used to translate text.

[0054] In some examples, the document conversion control described above is used to convert text into a document.

[0055] In some embodiments of the present application, when the interface content includes an image, the at least one functional control may include at least one of the following: an image search control, an image processing control, etc. The specific one may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0056] In some examples, the image search control described above is used to search for information related to an image.

[0057] In some examples, the above-mentioned image search control may include at least one of the following: an image description control, an image source query control, etc. The specific one may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0058] Exemplarily, when the image is an image of a person, the name of the person may be displayed in the control display area of ​​the image description control.

[0059] Exemplarily, when the image is an image of a building, the name of the building may be displayed in the control display area of ​​the image description control.

[0060] In some examples, the image processing controls described above are used to perform image processing on an image.

[0061] In some examples, the image processing control may include at least one of the following: setting image effect control, setting image border control, adjusting image size control, removing image background control, etc. The specific control may be determined according to actual use requirements, and the present application embodiment does not limit this.

[0062] In some embodiments of the present application, when the interface content of the first interface includes a table, the at least one functional control may include: a table search control and a table edit control. The specific control may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0063] In some examples, the table search control described above is used to search for information related to the table.

[0064] In some examples, the table editing control is used to edit the table.

[0065] In some examples, the table editing control may include at least one of the following: insert row control, delete row control, set table style control, etc. The specific one may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0066] In some embodiments of the present application, when the interface content of the first interface includes article information, the at least one functional control may include: article summary control, author introduction query control, etc. The specific control may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0067] In some examples, the article summary control is used to obtain article summary information corresponding to an article.

[0068] In some examples, the author introduction query control is used to obtain relevant introduction information of the author corresponding to the article.

[0069] In some embodiments of the present application, when the interface content of the first interface includes movie information, the at least one functional control may include: movie introduction control, movie box office query control, movie starring information query control, ticket purchase control, etc. The specific control may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0070] In some examples, the movie introduction control is used to obtain the relevant introduction of the movie corresponding to the movie information.

[0071] In some examples, the above-mentioned movie box office query control is used to obtain the box office information of the movie corresponding to the movie information.

[0072] In some examples, the above-mentioned movie starring information query control is used to obtain the starring information of the movie corresponding to the movie information.

[0073] In some examples, the ticket purchase control is used to purchase movie tickets for movies corresponding to the movie information.

[0074] In some embodiments of the present application, when the interface content of the first interface includes ticket purchase information, the at least one functional control may include at least one of the following: a weather query control, an attraction recommendation control, a hotel recommendation control, a schedule creation control, etc. The specific one may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0075] In some examples, the weather query control is used to obtain weather information of the destination corresponding to the ticket purchase information.

[0076] In some examples, the above-mentioned attraction recommendation control is used to obtain attraction information of the destination corresponding to the ticket purchase information.

[0077] In some examples, the hotel recommendation control is used to obtain hotel information of a destination corresponding to the ticket purchase information.

[0078] In some examples, the schedule creation control is used to create a schedule reminder for the schedule corresponding to the ticket purchase information.

[0079] In some embodiments of the present application, when the interface content of the first interface includes schedule information, the at least one functional control may include: a weather query control, a route query control, a schedule creation control, etc. The specific control may be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0080] In some examples, the weather query control is used to obtain weather information of a destination corresponding to the schedule information.

[0081] In some examples, the route query control is used to obtain route planning information for a destination corresponding to the schedule information.

[0082] In some examples, the above-mentioned schedule creation control is used to create a schedule reminder corresponding to the schedule information.

[0083] In some embodiments of the present application, the at least one functional control may further include a collection control for collecting interface content.

[0084] In some embodiments of the present application, the electronic device may display the at least one function control at the bottom of the first interface, or at the top of the first interface. The specific may be determined according to actual use requirements, and the embodiments of the present application are not limited to this.

[0085] In some embodiments of the present application, when the electronic device receives the first input of the user on the first interface, it can enter a processing state. In the processing state, the electronic device can update and display the first interface. The updated first interface includes at least one function control determined by the electronic device based on the interface content of the first interface.

[0086] For example, as shown in Figure 2(A), the electronic device displays an article browsing interface 11, that is, the first interface mentioned above. When the user wants to view the article summary of article A displayed in the article browsing interface 11, the user can long press the article browsing interface 11, that is, the first input mentioned above, so that the electronic device is in a processing state and updates the displayed article browsing interface 11. As shown in Figure 2(B), the article browsing interface 11 includes: an article summary control 12, a translation control 13, an author introduction query control 14 and a collection control 15 (that is, at least one of the above-mentioned functional controls).

[0087] In some embodiments of the present application, the first interface is a conversation interface; the interface content of the first interface includes sharing objects of conversation members; and at least one functional control is determined according to the sharing object.

[0088] In some embodiments of the present application, the above-mentioned sharing object may include at least one of the following: movies, performances, music, restaurants, commodities, etc. The specific one may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0089] In some embodiments of the present application, the interface content of the first interface may include chat information sent by session members, and the chat information is used to indicate the sharing object.

[0090] For example, when the chat message is “I really like the song “Black Cat Sheriff””, the chat message indicates the music “Black Cat Sheriff”.

[0091] In some examples, when the sharing object is a movie, at least one functional control may include at least one of the following: a movie introduction control, a movie box office query control, a movie starring information query control, a ticket purchase control, etc. The specific one may be determined according to actual use requirements, and the present application embodiment does not limit this.

[0092] In some examples, when the sharing object is a performance, at least one functional control may include at least one of the following: a performer query control, a performance introduction control, a ticket purchase control, etc. The specific control may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0093] In some examples, when the sharing object is music, at least one functional control may include at least one of the following: a music search control, a lyrics query control, a music collection control, etc. The specific one may be determined according to actual usage requirements, and the present application embodiment does not limit this. The music search control is used to search for information related to music.

[0094] In some examples, when the sharing object is a product, at least one functional control may include at least one of the following: a product collection control, a product quick payment control, etc. The specific one may be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0095] For example, as shown in FIG3(A), the electronic device displays a chat page 21, i.e., the first interface mentioned above, and the chat page 21 includes movie information sent by the session members, "Let's go to see the movie "Kung Fu Panda" tomorrow." When the user wants to buy movie tickets, the user can long press the chat page 21, i.e., the first input mentioned above, so that the electronic device is in a processing state and updates the displayed chat page 21. As shown in FIG3(B), the chat page 21 includes: a movie introduction control 22, a movie box office query control 23, a movie starring information query control 24 and a ticket purchase control 25 (i.e., at least one of the above-mentioned functional controls).

[0096] Step 203: The electronic device receives a second input to a first function control among at least one function control.

[0097] In some embodiments of the present application, the first functional control is any functional control of at least one functional control.

[0098] In some embodiments of the present application, the second input is used to process the interface content corresponding to the first function control.

[0099] In some embodiments of the present application, the second input includes but is not limited to: a touch input of the user to the first function control through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or a click input, or other feasible input. The specific input can be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0100] Step 204: The electronic device executes an operation corresponding to the first function control in response to the second input.

[0101] In some embodiments of the present application, when the first function control is a text search control, the electronic device can search for information related to the text.

[0102] In this way, users do not need to manually copy text and then switch to other applications to search, which saves users the steps of searching for information related to the text. In addition, since copying input often causes information loss during transmission, the accuracy of search results is also guaranteed.

[0103] In some embodiments of the present application, when the first function control is a text extraction control, the electronic device can perform text extraction on the interface content.

[0104] In some embodiments of the present application, when the first function control is a translation control, the electronic device can translate the interface content.

[0105] In some embodiments of the present application, when the first function control is a document conversion control, the electronic device can call a document application (eg, a Word application) to convert the interface content into a document.

[0106] In some embodiments of the present application, when the first functional control is an image search control, the electronic device can search for information related to the image.

[0107] In some embodiments of the present application, when the first functional control is an image processing control, the electronic device may call an image processing application to process the image to obtain a processed image.

[0108] In some embodiments of the present application, when the first functional control is a table search control, the electronic device can search for information related to the table.

[0109] In some embodiments of the present application, when the first function control is a movie introduction control, the electronic device can obtain the movie title indicated by the movie information, and then search for the movie title to obtain relevant introduction of the movie.

[0110] In some embodiments of the present application, when the first functional control is a ticket purchase control, the electronic device can call a ticket purchase application to display a ticket purchase page corresponding to the movie information.

[0111] In some embodiments of the present application, when the above-mentioned first function control is a weather query control, the electronic device can obtain the destination corresponding to the ticket purchase information, and then search for weather information of the destination corresponding to the ticket purchase information.

[0112] In some embodiments of the present application, when the first function control is a scenic spot recommendation control, the electronic device can obtain the destination corresponding to the ticket purchase information, and then search for scenic spot information of the destination.

[0113] In some embodiments of the present application, when the above-mentioned first function control is a hotel recommendation control, the electronic device can obtain the destination corresponding to the ticket purchase information, and then search for hotel information of the destination.

[0114] In some embodiments of the present application, when the above-mentioned first function control is a schedule creation control, the electronic device can obtain schedule information corresponding to the ticket purchase information, and then create a schedule reminder corresponding to the schedule information.

[0115] In some embodiments of the present application, when the first function control is a route query control, the electronic device can obtain the destination corresponding to the schedule information and then plan the route information of the destination.

[0116] It should be noted that, for detailed steps for the electronic device to execute operations corresponding to other function controls, reference can be made to the relevant description of the electronic device executing operations corresponding to part of the first function controls in the above embodiment, which will not be repeated here.

[0117] For example, in conjunction with Figure 2(B), Figure 4 As shown, when the user wants to view the article summary of article A displayed in the article browsing interface 11, the user can long press the article summary control 12 in the article browsing interface 11 (that is, the second input to the first function control mentioned above), so that the electronic device searches for the summary information of article A.

[0118] In the interface processing method provided in the embodiment of the present application, since the electronic device can recommend at least one function control associated with the interface content based on the interface content of the first interface, the user can trigger the electronic device to perform the operation corresponding to the first function control by inputting the first function control among the at least one function control. There is no need for the user to trigger the electronic device to switch to other applications and then perform the operation through other applications, thus avoiding tedious operations.

[0119] In some embodiments of the present application, Figure 1 ,like Figure 5 As shown, the above step 202 can be specifically implemented through the following step 202a.

[0120] Step 202a: The electronic device determines interface content from the first interface in response to the first input; and displays at least one functional control according to the interface content.

[0121] In some embodiments of the present application, the above-mentioned first input includes a first sub-input and a second sub-input, the first sub-input is used to control the electronic device to enter a processing state, when the electronic device is in the processing state, the first interface includes a processing selection area, and the second sub-input is used to select the interface content to be processed from the processing selection area.

[0122] In some embodiments of the present application, the electronic device enters a processing state in response to a first sub-input to a first interface. In the processing state, the electronic device can update and display the first interface, and the updated first interface includes a processing selection area. The electronic device determines interface content from the first interface in response to a second sub-input to the processing selection area, and displays at least one function control based on the determined interface content.

[0123] In some embodiments of the present application, the second sub-input may be a selection input for the content in the processing selection area, such as a circle selection input, a box selection input, or a line selection input, etc. The specific input may be determined according to actual use requirements, and the present application embodiment does not limit this.

[0124] For example, in combination with FIG. 2(A), as shown in FIG. 6(A), the updated and displayed article browsing interface 11 includes a search selection area 31. When a user wants to view the relevant information of an image 32 in the article browsing interface 11, as shown in FIG. 6(B), the user can circle and input the image 32 in the article browsing interface 11 in the search selection area 31 (i.e., the second sub-input mentioned above), so that the electronic device determines that the interface content is the image 32 selected by the user, and displays the image description control 33 and the image processing control 34 corresponding to the image 32 (i.e., at least one functional control corresponding to the above interface content) as shown in FIG. 6(C). When the user wants to perform background blur processing on the image 32, the user can click the image processing control 34, so that the electronic device performs image processing on the image 32. It should be noted that the dotted boxes in FIG. 6(A), FIG. 6(B), and FIG. 6(C) are only for illustrating the search selection area 31, and are not displayed in the actual interface.

[0125] It should be noted that the detailed steps for the electronic device to display at least one functional control according to the determined interface content can be found in the description of the above step 202, which will not be repeated here.

[0126] In this way, since the user can directly select the interface content that needs to be processed in the first interface, triggering the electronic device to display at least one function control corresponding to the interface content, the selected interface content can be quickly processed through the displayed function control, thereby avoiding tedious operations.

[0127] In some embodiments of the present application, the number of the above-mentioned interface contents is at least two; the "electronic device displays at least one function control according to the interface content of the first interface" in the above-mentioned step 202 can be specifically implemented through the following step 202b.

[0128] Step 202b: For each interface content, when the interface content is in a selected state, the electronic device displays at least one function control corresponding to the interface content.

[0129] It is understandable that when the user selects at least two interface contents, the electronic device can respectively determine at least one functional control corresponding to each interface content. Then the electronic device does not display the at least one functional control corresponding to the at least two interface contents respectively, but displays the at least one functional control corresponding to the interface content in the selected state.

[0130] In some embodiments of the present application, after the electronic device determines at least two interface contents from a first interface in response to a first input, the electronic device can display at least one function control corresponding to a first interface content among the at least two interface contents, and then upon receiving input from a user selecting a second interface content among the at least two interface contents, the electronic device can display at least one function control corresponding to the second interface content.

[0131] In some examples, the first interface content may be a pre-selected interface content among at least two interface contents, or an interface content with a high priority, or any interface content. The specific content may be determined according to actual use requirements, and the present application embodiment does not limit this.

[0132] In this way, since the user can select multiple interface contents to trigger the electronic device to determine at least one function control corresponding to each interface content, the user can process the selected interface contents in turn through at least one function control corresponding to each interface content, thereby avoiding tedious operations.

[0133] In some embodiments of the present application, when the interface content is in a selected state, the electronic device can display at least one function control corresponding to the interface content in the first display area.

[0134] In some examples, the first display area is a display area corresponding to the selected interface content.

[0135] For example, refer to Figure 6(B). Figure 7 As shown, the electronic device can display an image description control 33 and an image processing control 34 corresponding to the image 32 in a display area near the image 32 (ie, the first display area mentioned above).

[0136] In some embodiments of the present application, Figure 1 ,like Figure 8 As shown, after the above step 204, the interface processing method provided in the embodiment of the present application further includes the following step 301.

[0137] Step 301: Display the operation result on the interactive interface of the artificial intelligence (AI) assistant.

[0138] It can be understood that after the electronic device executes the operation corresponding to the first function control, it can display the operation result on the interactive interface of the AI ​​assistant.

[0139] In some embodiments of the present application, the electronic device can perform the operation corresponding to the first function control through the AI ​​model, and after obtaining the operation result, display the operation result on the interactive interface of the AI ​​assistant.

[0140] In some embodiments of the present application, the electronic device may overlay and display the interactive interface of the AI ​​assistant on the first interface.

[0141] In some instances, the electronic device may display a first window on the first interface, wherein the first window includes an interactive interface of the AI ​​assistant.

[0142] In some embodiments of the present application, the electronic device can receive user input on operation results and display the operation results in full screen.

[0143] For example, in conjunction with Figure 2(B), Fig. 9 As shown, after the electronic device searches for and obtains the summary information of article A, it can display a first window 41, in which the first window 41 includes an interactive interface of an AI assistant, and the interactive interface of the AI ​​assistant includes the summary information of article A.

[0144] In this way, since the electronic device performs the operation corresponding to the first function control through the AI ​​model, the accuracy of the operation result can be guaranteed. In particular, searching for information through the AI ​​model avoids the problem of too many search results provided by traditional search engines when searching with traditional search engines, making it difficult for users to find the required information, and causing serious information overload. The present application uses an AI model to effectively filter and sort search results, and summarize the results, so that more accurate search results can be provided, improving the efficiency of information acquisition.

[0145] In some embodiments of the present application, the interface processing method provided in the embodiments of the present application may further include the following steps 401 and 402.

[0146] Step 401: The electronic device receives a third input to the interaction interface of the AI ​​assistant.

[0147] In some embodiments of the present application, the third input is used to process the operation result.

[0148] In some embodiments of the present application, the third input includes but is not limited to: a user's touch input to the interactive interface of the AI ​​assistant through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or a click input, or other feasible input. The specific input can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0149] In some embodiments of the present application, the interactive interface of the above-mentioned AI assistant may include at least one function control displayed according to the operation result, and the above-mentioned third input may be an input to the second function control of the at least one function control.

[0150] It should be noted that, for detailed steps of the electronic device displaying at least one function control according to the operation results, please refer to the description of the electronic device displaying at least one function control according to the interface content of the first interface in the above embodiment, which will not be repeated here.

[0151] In some embodiments of the present application, the interactive interface of the above-mentioned AI assistant may also include a search information input area, which is used to search for information, and the above-mentioned third input may be an input to the search information input area.

[0152] In some embodiments of the present application, the third input may include: input of search information entered by the user in the search information input area, and input of a search control in the search information input area.

[0153] Step 402: The electronic device responds to the third input and processes the operation result according to the instruction information corresponding to the third input.

[0154] In some embodiments of the present application, when the third input is an input to a second function control in at least one function control displayed according to an operation result, the instruction information corresponding to the third input may be: executing the operation corresponding to the second function control on the operation result.

[0155] It should be noted that for detailed steps of the electronic device performing the operation corresponding to the second function control on the operation result, please refer to the description of the electronic device performing the operation corresponding to the first function control on the interface content of the first interface in step 204 of the above embodiment, which will not be repeated here.

[0156] In some embodiments of the present application, when the third input is an input to the search information input area in the interactive interface of the AI ​​assistant, the instruction information corresponding to the third input may be: perform a search operation according to the search information in the search information input area.

[0157] In some embodiments of the present application, when the electronic device receives the third input from the user to the search information input area in the interactive interface of the AI ​​assistant, it can obtain the search information entered by the user in the search information input area, and then perform a search operation based on the search information.

[0158] For example, combining Fig. 9 ,like Fig.10 As shown, the first window 41 may also include a search information input area 51, at least one functional control (an author introduction query control 52 and a text extraction control 53), and a user may input the search information "which scenic spot can ski" (i.e., the third input mentioned above) in the search information input area 51, so that the electronic device can search for a scenic spot where skiing is possible among the 9 scenic spots.

[0159] In this way, since the electronic device can perform a search operation by combining the operation result and the search information input by the user, the flexibility of searching for information is improved.

[0160] In some embodiments of the present application, when in a processing state, after receiving a second sub-input of a user selecting interface content, the electronic device can display the determined interface content and at least one function control determined according to the interface content in the interactive interface of the AI ​​assistant after determining the interface content selected by the user. Then, when the electronic device receives a user input to a first function control in the interactive interface of the AI ​​assistant, it can execute the operation corresponding to the first function control.

[0161] In some embodiments of the present application, in the processing state, the electronic device can update and display the first interface, and the updated first interface can also include a search information input area. The electronic device can receive user input to the search information input area and perform a search operation based on the search information corresponding to the input.

[0162] For example, in conjunction with Figure 2(B), Fig.11 As shown, when in the processing state, the updated article browsing interface 11 may further include: a search information input area 61 .

[0163] In some embodiments of the present application, the above-mentioned search information is related to or unrelated to the interface content of the first interface.

[0164] It can be understood that when the search information is related to the interface content of the first interface, it means that the user wants to search for information related to the interface content of the first interface; when the search information is not related to the interface content of the first interface, it means that the information the user wants to search is not related to the interface content of the first interface.

[0165] In some embodiments of the present application, the above-mentioned search information is information input by the user in the search information input area.

[0166] In some embodiments of the present application, when the electronic device receives user input into the search information input area, it can obtain the search information entered by the user in the search information input area, and then search for information related to the search information and the interface content of the first interface.

[0167] In this way, since the electronic device can perform a search operation in combination with the interface content of the current display interface and the search information input by the user, the flexibility of searching for information is improved.

[0168] In some embodiments of the present application, when the electronic device receives user input into the search information input area, it can obtain the search information entered by the user in the search information input area, and then search for information related to the search information (ie, without referring to the interface content of the first interface).

[0169] In this way, when the electronic device displays any interface, the user can trigger the electronic device to display the search information input area to search for required information, thereby improving the efficiency of searching for information.

[0170] In some embodiments of the present application, when a first audio is played in the background of an electronic device, if the electronic device enters a search state, the first interface after the update display may include an audio recognition control.

[0171] In an embodiment of the present application, the above-mentioned audio recognition control is used to recognize the first audio.

[0172] In some embodiments of the present application, the first audio may be any of the following: a song, a recording, an audio novel, etc. The specific one may be determined according to actual use requirements, and the embodiments of the present application do not limit this.

[0173] It can be understood that when the electronic device enters the search state, if it is detected that the first audio is playing in the background of the electronic device, the electronic device can display the above-mentioned audio recognition control on the first interface after the display is updated.

[0174] In some embodiments of the present application, the electronic device may receive user input to an audio recognition control, recognize a first audio, and display a recognition result of the first audio.

[0175] In some examples, when the first audio is a song, the recognition result of the first audio may include at least one of the following: song title, song author, lyrics corresponding to the song, etc. The specific number may be determined according to actual usage requirements, and the present application embodiment does not limit this.

[0176] In this way, when the electronic device enters the search state, the electronic device can display the audio recognition control on the first interface after updating the display when it detects that the first audio is playing in the background. This makes it easy for the user to obtain relevant information of the first audio, thereby improving the efficiency of the electronic device in recognizing audio.

[0177] It should be noted that the above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0178] It should be noted that the interface processing method provided in the embodiment of the present application can be executed by an interface processing device. In the embodiment of the present application, the interface processing device executing the interface processing method is taken as an example to illustrate the interface processing device provided in the embodiment of the present application.

[0179] Fig.12FIG. 1 shows a possible structural diagram of an interface processing device involved in an embodiment of the present application. Fig.12 As shown, the interface processing device 70 may include: a receiving module 71 , a display module 72 and a processing module 73 .

[0180] The receiving module 71 is used to receive a first input to the first interface.

[0181] A display module 72, configured to display at least one functional control according to the interface content of the first interface in response to the first input received by the receiving module 71, wherein the at least one functional control is associated with the interface content;

[0182] The receiving module 71 is further configured to receive a second input to a first function control among at least one function control displayed by the display module 72;

[0183] The processing module 73 is used to execute the operation corresponding to the first function control in response to the second input received by the receiving module 71.

[0184] An embodiment of the present application provides an interface processing device. Since the interface processing device can recommend at least one function control associated with the interface content based on the interface content of the first interface, the user can trigger the interface processing device to perform an operation corresponding to the first function control by inputting an input to the first function control among the at least one function control. There is no need for the user to trigger the interface processing device to switch to other applications and then perform the operation through other applications, thereby avoiding tedious operations.

[0185] In one possible implementation, the display module 72 is further used to display the operation result on the interactive interface of the AI ​​assistant after the processing module 73 executes the operation corresponding to the first function control in response to the second input.

[0186] In a possible implementation, the receiving module 71 is further configured to receive a third input to the interactive interface of the AI ​​assistant. The processing module 73 is further configured to process the operation result in response to the third input received by the receiving module 71 according to the instruction information corresponding to the third input.

[0187] In a possible implementation, the processing module 73 is further configured to determine interface content from the first interface in response to the first input. The display module 72 is specifically configured to display at least one functional control according to the interface content determined by the processing module 73 .

[0188] In a possible implementation, the number of interface contents is at least two; the display module 72 is specifically configured to display at least one functional control corresponding to each interface content when the interface content is in a selected state.

[0189] In a possible implementation, the first interface is a conversation interface; the interface content of the first interface includes sharing objects of conversation members; and at least one functional control is determined according to the sharing object.

[0190] The interface processing device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (Augmented Reality, AR) / virtual reality (Virtual Reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (Ultra-Mobile Personal Computer, UMPC), a netbook or a personal digital assistant (Personal Digital Assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (Personal Computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0191] The interface processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0192] The interface processing device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.

[0193] Alternatively, if Fig.13 As shown, an embodiment of the present application also provides an electronic device 900, including a processor 901 and a memory 902, wherein the memory 902 stores programs or instructions that can be executed on the processor 901, and when the program or instructions are executed by the processor 901, the various steps of the above-mentioned method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0194] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0195] Fig.14 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0196] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0197] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.14 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0198] The user input unit 107 is used to receive a first input to the first interface;

[0199] The display unit 106 is used to display at least one functional control according to the interface content of the first interface in response to the first input received by the user input unit 107, and the at least one functional control is associated with the interface content;

[0200] The user input unit 107 is further used to receive a second input to a first function control among the at least one function control displayed by the display unit 106;

[0201] The processor 110 is further configured to execute an operation corresponding to the first function control in response to a second input received by the user input unit 107 .

[0202] An embodiment of the present application provides an electronic device. Since the electronic device can recommend at least one function control associated with the interface content of the first interface based on the interface content of the first interface, the user can trigger the electronic device to perform an operation corresponding to the first function control by inputting the first function control among the at least one function control. There is no need for the user to trigger the electronic device to switch to other applications and then perform the operation through other applications, thereby avoiding tedious operations.

[0203] In some embodiments of the present application, the display unit 106 is further used to display the operation result on the interactive interface of the AI ​​assistant after the processor 110 executes the operation corresponding to the first function control in response to the second input.

[0204] In some embodiments of the present application, the user input unit 107 is also used to receive a third input to the interactive interface of the AI ​​assistant.

[0205] The processor 110 is further configured to, in response to a third input received by the user input unit 107, process the operation result according to instruction information corresponding to the third input.

[0206] In some embodiments of the present application, the processor 110 is further configured to determine interface content from the first interface in response to the first input.

[0207] The display unit 106 is specifically configured to display at least one functional control according to the interface content determined by the processing module 73 .

[0208] In some embodiments of the present application, the number of interface contents is at least two; the display unit 106 is specifically used to display at least one functional control corresponding to each interface content when the interface content is in a selected state.

[0209] In some embodiments of the present application, the first interface is a conversation interface; the interface content of the first interface includes sharing objects of conversation members; and at least one functional control is determined according to the sharing object.

[0210] The electronic device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0211] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described again here.

[0212] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0213] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0214] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

[0215] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0216] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0217] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0218] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0219] An embodiment of the present application provides a computer program / program product, which is stored in a storage medium. The program / program product is executed by at least one processor to implement the various processes of the above-mentioned method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0220] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0221] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0222] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An interface processing method, characterized in that: The method comprises: Receiving a first input to a first interface; In response to the first input, display at least one functional control according to the interface content of the first interface, wherein the at least one functional control is associated with the interface content; receiving a second input to a first functional control of the at least one functional control; In response to the second input, an operation corresponding to the first function control is executed.

2. The method according to claim 1, characterized in that After executing the operation corresponding to the first functional control in response to the second input, the method further includes: The operation results are displayed on the interactive interface of the artificial intelligence AI assistant.

3. The method according to claim 2, characterized in that The method further comprises: Receiving a third input to the interactive interface of the AI ​​assistant; In response to the third input, the operation result is processed according to instruction information corresponding to the third input.

4. The method according to claim 1, characterized in that: The step of displaying at least one functional control according to the interface content of the first interface in response to the first input includes: In response to the first input, the interface content is determined from the first interface; and at least one functional control is displayed according to the interface content.

5. The method according to claim 4, characterized in that The number of the interface contents is at least two; The displaying at least one functional control according to the interface content of the first interface includes: For each interface content, when the interface content is in a selected state, at least one functional control corresponding to the interface content is displayed.

6. The method according to claim 1, characterized in that The first interface is a conversation interface; the interface content of the first interface includes the sharing objects of the conversation members; and the at least one functional control is determined according to the sharing objects.

7. An interface processing device, characterized in that: The device comprises: a receiving module, a display module and a processing module; The receiving module is used to receive a first input to the first interface; The display module is configured to display at least one functional control according to the interface content of the first interface in response to the first input received by the receiving module, wherein the at least one functional control is associated with the interface content; The receiving module is further configured to receive a second input to a first function control among the at least one function control displayed by the display module; The processing module is used to execute the operation corresponding to the first function control in response to the second input received by the receiving module.

8. The device according to claim 7, characterized in that The display module is also used to display the operation result on the interactive interface of the artificial intelligence AI assistant after the processing module executes the operation corresponding to the first function control in response to the second input.

9. The device according to claim 8, characterized in that The receiving module is further used to receive a third input to the interactive interface of the AI ​​assistant; The processing module is further configured to, in response to the third input received by the receiving module, process the operation result according to instruction information corresponding to the third input.

10. The device according to claim 7, characterized in that The processing module is further configured to determine the interface content from the first interface in response to the first input; The display module is specifically configured to display at least one functional control according to the interface content determined by the processing module.

11. The device according to claim 10, characterized in that The number of the interface contents is at least two; The display module is specifically used to display at least one functional control corresponding to each interface content when the interface content is in a selected state.

12. The device according to claim 7, characterized in that The first interface is a conversation interface; the interface content of the first interface includes the sharing objects of the conversation members; and the at least one functional control is determined according to the sharing objects.

13. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the interface processing method according to any one of claims 1 to 6 are implemented.

14. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the interface processing method according to any one of claims 1 to 6 are implemented.

15. A computer program product, characterized in that The computer program product is stored in a storage medium, and the program product is executed by at least one processor to implement the steps of the interface processing method according to any one of claims 1 to 6.

Images