Application processing method and device, electronic equipment, storage medium and program product

Abstract

The invention discloses an application processing method and device, electronic equipment, a storage medium and a program product, and belongs to the technical field of artificial intelligence. The method comprises the steps that under the condition that a first page is displayed, first information is acquired through a first model; outputting at least one piece of first operation information based on the first information, and displaying at least one first operation control based on the at least one piece of first operation information; receiving a first input for a second operation control in the at least one first operation control; and in response to the first input, executing an executable operation corresponding to the second operation control.

Description

Technical Field

[0001] The present application belongs to the field of artificial intelligence technology, and specifically relates to an application processing method, device, electronic device, storage medium and program product. Background Art

[0002] Currently, when an electronic device displays an application interface, if a user needs to operate the information in the application interface, for example, when an e-book interface is displayed, if the user needs to view the meaning of uncommon characters in the e-book interface through a browser application, the user can first select the uncommon character and then copy the uncommon character to the browser application to trigger the electronic device to query and process the uncommon character through the browser application to complete the operation required by the user.

[0003] However, since the above method requires multiple steps to complete the operation required by the user, the application processing process is relatively cumbersome and time-consuming, and thus the efficiency of application processing is low. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide an application processing method, device, electronic device, storage medium and program product, which can simplify the process of electronic device processing information in the application, thereby improving the efficiency of electronic device processing information in the application.

[0005] In a first aspect, an embodiment of the present application provides an application processing method, which includes: when displaying a first page, obtaining first information through a first model, the first information including at least one of the following: first intention information, content understanding information, and application type of an application to which the first page belongs, the first intention information representing the operation intention for the first page, and the content understanding information representing the key content of the first page; based on the first information, outputting at least one first operation information, and based on the at least one first operation information, displaying at least one first operation control, one first operation control in the at least one first operation control corresponds to one first operation information, and each first operation information is used to indicate an executable operation in the first page; receiving a first input to a second operation control in the at least one first operation control; and in response to the first input, executing the executable operation corresponding to the second operation control.

[0006] In a second aspect, an embodiment of the present application provides an application processing device, which includes: an acquisition module, a processing module, a receiving module, and an execution module. The acquisition module is used to acquire first information through a first model when displaying a first page, and the first information includes at least one of the following: first intention information, content understanding information, and application type of the application to which the first page belongs, the first intention information represents the operation intention for the first page, and the content understanding information represents the key content of the first page. The processing module is used to output at least one first operation information based on the first information acquired by the acquisition module, and display at least one first operation control based on the at least one first operation information, one first operation control in the at least one first operation control corresponds to one first operation information, and each first operation information is used to indicate an executable operation in the first page. The receiving module is used to receive a first input to a second operation control in the at least one first operation control. The execution module is used to execute the executable operation corresponding to the second operation control in response to the first input received by the receiving module.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0011] In an embodiment of the present application, since the operation intention information, key content of the page and the application type of the application to which the first page belongs can be obtained through the first model analysis, at least one first operation information is output and at least one first operation control corresponding to the at least one first operation information is displayed based on the operation intention information, key content and application type of the page; therefore, when the user needs to operate on certain information in the first page, he can directly input the second operation control in the at least one first operation control, so that the electronic device can directly execute the operation corresponding to the second operation control, which simplifies the electronic device's processing of the information in the first page, thereby improving the efficiency of the electronic device in processing the information in the first page. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 is a flowchart of an application processing method provided by some embodiments of the present application;

[0013] Figure 2 is a flowchart of an application processing method provided by some embodiments of the present application;

[0014] Figure 3 is a flowchart of an application processing method provided by some embodiments of the present application;

[0015] Figure 4 is a schematic diagram of an example of an application processing interface provided by some embodiments of the present application;

[0016] Figure 5 is a flowchart of an application processing method provided by some embodiments of the present application;

[0017] Fig. 6A is a schematic diagram of an example of an interface for selecting an operation provided in some embodiments of the present application;

[0018] Figure 6B is a schematic diagram of an example of an interface for performing operations provided in some embodiments of the present application;

[0019] Figure 6C is a schematic diagram of an example of an interface for displaying operations provided in some embodiments of the present application;

[0020] Figure 7 is a flowchart of an application processing method provided by some embodiments of the present application;

[0021] Fig. 8A is a schematic diagram of an example of an interface for selecting an operation provided in some embodiments of the present application;

[0022] Figure 8B is a schematic diagram of an example of an interface for displaying operations provided in some embodiments of the present application;

[0023] Fig.9A is a schematic diagram of an example of an interface for selecting an operation provided in some embodiments of the present application;

[0024] Fig. 9B is a schematic diagram of an example of an interface for displaying operations provided in some embodiments of the present application;

[0025] Fig. 9C is a schematic diagram of an example of an interface for displaying operations provided in some embodiments of the present application;

[0026] Fig.10 is a schematic diagram of an example of an interface for displaying operations provided in some embodiments of the present application;

[0027] Fig.11 is a structural schematic diagram of an application processing device provided in some embodiments of the present application;

[0028] Fig.12 is a schematic diagram of the hardware structure of an electronic device provided in some embodiments of the present application;

[0029] Fig.13 It is a schematic diagram of the hardware structure of an electronic device provided in some embodiments of the present application. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0031] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0032] The terms "at least one (item)", "at least one of" and the like in the specification and claims of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".

[0033] The following, in conjunction with the accompanying drawings, describes in detail the application operation method, device, electronic device, storage medium and program product provided by the embodiments of the present application through specific embodiments and their application scenarios.

[0034] The application processing method, device, electronic device, storage medium and program product provided in the embodiments of the present application can be applied to a scenario where an application interface is displayed and some information in the application interface needs to be operated through other applications. For example, when a user encounters some obscure nouns while reading a technical article, he wants to query the meaning of the corresponding nouns; or when a user encounters some new English words while reading an English article, he wants to translate the new English words.

[0035] Scenario 1: When a user is reading a technical article in a document application, he encounters some obscure terms and wants to look up the meaning of the terms. Usually, the user can copy the terms through an electronic device. Then, the electronic device is triggered to switch to a browser application and the term is pasted into the input box of the browser application. Finally, the browser application is used to search for the term so that the user can know the meaning of the term.

[0036] Scenario 2: When a user is reading an English article in a document application, he or she encounters some unfamiliar English words and wants to translate the words. Usually, the user can copy the words through an electronic device. Then, the electronic device is triggered to switch to a translation application, and the words are pasted into the input box of the translation application. Finally, the word is translated through the translation application so that the user can know the meaning of the word.

[0037] The execution subject of the application processing method provided in the embodiment of the present application may be an application processing device, and the application processing device may be an electronic device, or a functional module in an electronic device. The technical solution provided in the embodiment of the present application is described below using an electronic device as an example.

[0038] The present application embodiment provides an application processing method. Figure 1 FIG. 1 is a flowchart of an application processing method provided by an embodiment of the present application. Figure 1As shown, the application processing method provided in the embodiment of the present application may include the following steps 201 to 204.

[0039] Step 201: When displaying a first page, the electronic device obtains first information through a first model.

[0040] In an embodiment of the present application, the above-mentioned first information includes at least one of the following: first intention information, content understanding information and application type of the application to which the first page belongs; the first intention information represents the operation intention for the first page, and the content understanding information represents the key content of the first page.

[0041] Optionally, in an embodiment of the present application, the electronic device may run the first application and display the first page based on a user's click input on an application icon of an application corresponding to the first page (hereinafter referred to as the first application).

[0042] Optionally, in an embodiment of the present application, the first page may be any page in the first application.

[0043] Exemplarily, the first page may be a main page or a secondary page of the first application.

[0044] Exemplarily, the first application may be any of the following: a chat application, a video application, an album application, an e-book application, or a document application, etc. The specific application may be determined according to actual usage, and the embodiment of the present application does not limit the application.

[0045] Optionally, in an embodiment of the present application, the first model may be any one of the following: an artificial intelligence (AI) model, a neural network model or a large text model.

[0046] Exemplarily, the first model may be a large text model on the terminal side, that is, a large text model stored in an electronic device, and the large text model is a large language model specifically used for processing and understanding natural language.

[0047] It should be noted that since the terminal-side text model is a large model stored in the electronic device, the terminal-side text model is generally a text model with a small parameter amount. For example, the storage space occupied by the parameter amount of the terminal-side text model is generally 1B, 3B, or 7B. The parameter amount is the number of model parameters in the text model.

[0048] Optionally, in the embodiments of the present application, the natural language refers to a language that evolves naturally with culture, such as Chinese, Russian, Japanese, and English.

[0049] Optionally, in the embodiment of the present application, the first intention information is determined by the first page. That is, each page corresponds to a user operation intention, and different pages may correspond to different user operation intentions.

[0050] Optionally, in the embodiment of the present application, the user operation intention may be that when the user encounters some obscure terms while reading a technical article in a document application, he wants to search for the meaning of the terms through a browser application. In this case, the first intention information may be READING_BROWSER_SEARCH.

[0051] Optionally, in the embodiment of the present application, the user operation intention may be that when the user encounters some uncommon English words while reading an English article in the e-book application, the user wants to translate the English words through the translation application. In this way, the operation intention information may be READING_TRANSLATER_SEARCH.

[0052] Optionally, in an embodiment of the present application, the above-mentioned user operation intention is the operation intention corresponding to the most frequent historical operation behavior in the historical operation behaviors on the first page.

[0053] For example, the user performs the delete operation in the e-book interface twice, the copy operation in the e-book interface once, and searches for nouns by switching browser applications in the e-book interface five times. Then, the user operation intention corresponding to the above e-book interface is that in the e-book interface, the user wants to search for nouns by switching browser applications.

[0054] Optionally, in an embodiment of the present application, after the electronic device obtains the historical operation behavior corresponding to at least one page, the electronic device may store the historical operation behavior corresponding to each of the at least one page through an operation file.

[0055] Exemplarily, the operation file includes a page identifier of each page in the at least one page and a historical operation behavior corresponding to each page.

[0056] Optionally, in an embodiment of the present application, the above-mentioned content understanding information may be one or more.

[0057] Optionally, in an embodiment of the present application, the above-mentioned key content may include at least one of the following: keywords in the first page and a summary text of the page content of the first page.

[0058] Exemplarily, when the first page mentioned above is a document page, the document page displays "Highlights: The first year of the big model era, Scaling Laws is Moore's Law in the big model era, and it is the most worthy direction for research." The intent information corresponding to the document page is to jump to the browser search information, and the content understanding information corresponding to the document page may include "big model", "Highlights big model" and "Scaling Laws".

[0059] The intent information corresponding to the document page is to jump to the translation browser for translation, and the content understanding information corresponding to the document page may include "big model", "Highlights big model" and "Scaling Laws".

[0060] Optionally, in the embodiment of the present application, the above application type may be any of the following: shopping type, financial type, chat type, reading type, etc. The specific application type may be determined according to actual usage, and the embodiment of the present application does not limit the application type.

[0061] Optionally, in an embodiment of the present application, the electronic device may determine a main function of the first application according to the first model, and then determine the application type based on the main function.

[0062] Exemplarily, when the first application is a chat application, the main function of the chat application determined by the first model is instant chatting, so the electronic device can determine that the application type of the chat application is a chat type.

[0063] Exemplarily, when the first application is a shopping application, the main function of the shopping application determined by the first model is shopping, so the electronic device can determine that the application type of the shopping application is a shopping type.

[0064] Optionally, in an embodiment of the present application, the electronic device may determine the application type of the first application according to the application type included in the installation package of the first application.

[0065] Optionally, in an embodiment of the present application, the above-mentioned first information includes first intention information.

[0066] For example, in combination Figure 1 ,like Figure 2 As shown, the above step 201 can be specifically implemented through the following steps 201a and 201b.

[0067] Step 201a: When displaying the first page, the electronic device obtains operation behavior information through the first model.

[0068] In the embodiment of the present application, the above-mentioned operation behavior information represents the historical operation behavior on the first page.

[0069] Optionally, in the embodiment of the present application, the above-mentioned operation behavior information may include at least one of the following: searching through other applications when the first page is displayed; translating through other applications when the first page is displayed; watching videos through other applications when the first page is displayed; shopping through other applications when the first page is displayed; and stock trading through other applications when the first page is displayed. The specific information can be determined according to specific usage requirements, and the embodiment of the present application does not limit it.

[0070] Optionally, in an embodiment of the present application, the electronic device may input at least one historical operation behavior corresponding to the first page and the number of executions of at least one historical operation behavior in the first page into the first model, and then the first model determines the historical operation behavior with the largest number of executions among the at least one historical operation behavior as the operation behavior information corresponding to the first page.

[0071] Optionally, in an embodiment of the present application, the electronic device may obtain the operation behavior information of the first page through the above-mentioned operation behavior information.

[0072] Exemplarily, the electronic device may obtain a page identifier of the first page, determine the first page from the operation file based on the page identifier, and thereby determine the operation behavior information corresponding to the first page.

[0073] For example, the page identifier may include any of the following: Chinese, English, special symbols, images, or emoticons, etc. The specific content may be determined according to actual usage, and the present application embodiment does not limit this.

[0074] Step 201b: The electronic device converts the operation behavior information through the first model to obtain first intention information.

[0075] Optionally, in the embodiment of the present application, the first intent information may be an intent tag.

[0076] Optionally, in an embodiment of the present application, the first model can convert the operation behavior information into the first intention information through a prompt instruction.

[0077] For example, when a user is in the e-book page and is used to copying text and switching back to the main screen to open a browser search, the operation behavior information acquired by the first model is copying text and switching back to the main screen to open a browser search. Then, the first model acquires the first intention information corresponding to the operation behavior information through the prompt instruction.

[0078] As another example, taking the example of a user who is accustomed to copying text on an e-book page, switching back to the desktop, opening a translation software, and searching for translation results, the operation behavior information obtained by the first model is copying text, switching back to the desktop, opening a translation software, and searching for translation results. Then, the first model obtains the first intention information corresponding to the operation behavior information through a prompt instruction.

[0079] In an embodiment of the present application, the electronic device can transform and process the operation behavior information through the first model to obtain the first intention information, thereby determining the operation that the user wants to perform on the first page based on the first intention information, and directly output the operation that the user wants to perform on the first page, thereby improving the accuracy of the electronic device in determining the user's operation intention.

[0080] Optionally, in an embodiment of the present application, the first information includes content understanding information.

[0081] For example, in combination Figure 1 ,like Figure 3 As shown, the above step 201 can be specifically implemented through the following steps 301 to 303.

[0082] Step 301: When displaying a first page, the electronic device obtains the page content of the first page through a first model.

[0083] Optionally, in an embodiment of the present application, the above-mentioned page content may include at least one of the following: natural language, pictures and videos.

[0084] Optionally, in an embodiment of the present application, the electronic device may take a screenshot of the first page, and then input the screenshot into the first model, and the first model converts the screenshot into a text description through optical character recognition (OCR) technology.

[0085] Exemplarily, OCR technology refers to: a process in which an electronic device examines characters printed on paper, determines their shapes by detecting dark and light patterns, and then uses character recognition methods to translate the shapes into computer text; that is, for printed characters, an optical method is used to convert the text in a paper document into a black and white dot matrix image file, and recognition software is used to convert the text in the image into a text format for further editing and processing by word processing software.

[0086] Optionally, in an embodiment of the present application, when the above-mentioned page content includes pictures or videos, the first model can extract semantic information corresponding to the pictures or videos from the pictures or videos through convolution operations, thereby obtaining a text description corresponding to the pictures or videos.

[0087] Step 302: The electronic device identifies and processes the page content through the first model to obtain a type label.

[0088] In the embodiment of the present application, the above type tag represents the type of page content.

[0089] Optionally, in an embodiment of the present application, the above-mentioned type of label may be a Chinese label or an English label.

[0090] Optionally, in an embodiment of the present application, after the first model obtains the page content, the first model may obtain semantic information and language type of the page content, thereby determining the type of the page content and outputting a type label.

[0091] Exemplarily, the first model may compare the language of the page content with the languages ​​stored in the database, thereby determining the language type of the page content.

[0092] Exemplarily, the first model can obtain semantic information of the page content through a convolution operation.

[0093] Step 303: The electronic device performs a first process on the page content based on the type tag to obtain content understanding information.

[0094] In the embodiment of the present application, the first processing includes at least one of the following: keyword extraction and segment summary.

[0095] Optionally, in an embodiment of the present application, the electronic device may perform keyword extraction processing on the page content through the first model to obtain at least one keyword; or, the electronic device may perform segment summary processing on the page content through the first model to obtain at least one segment summary summary.

[0096] Optionally, in an embodiment of the present application, the electronic device performs a first processing on the current screen content, and sends the processed page content, i.e., the above-mentioned content understanding information, to the second model on the server side. This can prevent the server from directly obtaining the original screen content of the electronic device. In the case where the original screen content of the electronic device contains user privacy, since the server obtains partial type or summary content, the leakage of user privacy can be avoided, thereby ensuring the security of data in the electronic device.

[0097] Optionally, in an embodiment of the present application, the first model may extract keywords from the page content using keyword extraction rules corresponding to the type tag to obtain key content.

[0098] Optionally, in an embodiment of the present application, the first processing includes keyword extraction, and the content understanding information includes keywords of the first page.

[0099] Optionally, in an embodiment of the present application, the first processing includes keyword extraction, and the content understanding information includes keywords of the first page.

[0100] Exemplarily, the above step 303 may be implemented specifically through the following step 303a or step 303b.

[0101] Step 303a: When the type tag indicates that the page content is of Chinese text type, the electronic device extracts keywords from at least one specific noun in the page content to obtain key content.

[0102] Optionally, in the embodiment of the present application, the above key content may be one or more, which may be determined according to the number of keywords.

[0103] Optionally, in the embodiment of the present application, the above-mentioned specific nouns may include at least one of the following: uncommon characters, film and television titles, book titles, celebrity names, commodities, brands, etc.

[0104] Optionally, in an embodiment of the present application, when the type tag represents that the page content is a Chinese non-technical text type, the electronic device can segment the page content to obtain at least one phrase, and then traverse each phrase in the at least one phrase to determine the above-mentioned specific nouns from each phrase, and perform keyword extraction to obtain key content.

[0105] Optionally, in an embodiment of the present application, when the type tag represents that the page content is a Chinese technical text type, the electronic device can segment the page content to obtain at least one Chinese phrase, and then traverse each Chinese phrase in the at least one Chinese phrase to determine the Chinese professional technical terms from each Chinese phrase, and perform keyword extraction to obtain key content.

[0106] Optionally, in an embodiment of the present application, the first model may compare the words contained in each Chinese phrase in at least one Chinese phrase with the Chinese professional and technical nouns stored in the database, and then determine the words contained in each Chinese phrase that are identical to the Chinese professional and technical nouns stored in the database as Chinese professional and technical nouns.

[0107] Step 303b: When the type tag indicates that the page content is of English text type, the electronic device extracts keywords from at least one English word in the page content to obtain key content.

[0108] In some embodiments of the present application, the above-mentioned English words may include at least one of the following: new English words, English abbreviations and English professional terms.

[0109] It should be noted that the above-mentioned new English words are English words whose usage frequency in the English language is less than or equal to a preset number threshold.

[0110] Optionally, in an embodiment of the present application, when the type tag represents that the page content is an English non-technical text type, the electronic device can segment the page content to obtain at least one English phrase, and then traverse each English phrase in the at least one English phrase to determine English professional technical terms from each English phrase, and perform keyword extraction to obtain key content.

[0111] Optionally, in an embodiment of the present application, the first model may compare the words contained in each English phrase in at least one English phrase with the English professional and technical nouns stored in the database, and then determine the words contained in each English phrase that are identical to the English professional and technical nouns stored in the database as English professional and technical nouns.

[0112] Optionally, in an embodiment of the present application, when the type tag represents that the page content is an English non-technical text type, the electronic device can segment the page content to obtain at least one English phrase, and then traverse each English phrase in the at least one English phrase to determine the above-mentioned English words from each English phrase, and perform keyword extraction to obtain key content.

[0113] In the embodiment of the present application, the electronic device can obtain at least one keyword through the first model, and determine at least one operation information based on the at least one keyword and the user intention information. That is, the electronic device can predict that the user wants to operate on a certain keyword in the at least one keyword based on the user intention information, and directly output the operation that the user wants to perform on the first page, thereby improving the efficiency of the electronic device in processing the information on the first page.

[0114] Optionally, in an embodiment of the present application, the first processing includes segmented summary and the content understanding information includes summary information of the page content of the first page.

[0115] Exemplarily, the above step 303 may be implemented specifically through the following step 303d or step 303e.

[0116] Step 303d: When the type tag indicates that the page content is of Chinese text type, the electronic device performs content segmentation processing on the page content using paragraph separators to obtain at least one content paragraph, and performs segmented summaries on each content paragraph to obtain key content.

[0117] Optionally, in the embodiment of the present application, the paragraph separator may be a carriage return character.

[0118] Optionally, in an embodiment of the present application, the electronic device may perform a segmented summary on each content paragraph in at least one content paragraph by using a first model to obtain key content.

[0119] Exemplarily, the electronic device may extract the subject, predicate and object of each content paragraph in at least one content paragraph through the first model, generate a segment summary based on the subject, predicate and object, and obtain key content.

[0120] Step 303e: When the type tag indicates that the page content is of English text type, the electronic device segments the page content using punctuation marks to obtain at least one content paragraph, and performs segmented summaries on each content paragraph to obtain key content.

[0121] Optionally, in an embodiment of the present application, the punctuation marks include any of the following: comma, period, semicolon, etc.

[0122] Optionally, in an embodiment of the present application, the electronic device may perform a segmented summary on each content paragraph in at least one content paragraph by using a first model to obtain key content.

[0123] Exemplarily, the electronic device may extract the subject, predicate and object of each content paragraph in at least one content paragraph through the first model, generate a segment summary based on the subject, predicate and object, and obtain key content.

[0124] Optionally, in an embodiment of the present application, the electronic device can obtain a segment summary through the first model, and determine at least one operation information based on the segment summary and the user intention information. That is, the electronic device can predict that the user wants to obtain the segment summary based on the user intention information, and directly output the operation that the user wants to perform on the first page, thereby improving the efficiency of the electronic device in processing the information on the first page.

[0125] Step 202: The electronic device outputs at least one first operation information based on the first information, and displays at least one first operation control based on the at least one first operation information.

[0126] In the embodiment of the present application, one first operation control in the at least one first operation information corresponds to one first operation information, and each first operation information in the at least one first operation information is used to indicate an executable operation in the first page.

[0127] Optionally, in an embodiment of the present application, when the above-mentioned first information includes first intention information and content understanding information, each first operation information in the above-mentioned at least one first operation information is used to indicate an operation that can be performed on the content understanding information based on the operation intention.

[0128] Exemplarily, taking the content understanding information including a keyword and the first intention information being to jump to the browser search information as an example, the first operation information may be to jump to the browser application and search for the keyword.

[0129] Exemplarily, the content understanding information includes a summary text, and the first intention information is to jump to the browser search information as an example, and the first operation information can be to jump to the browser application and search for content related to the summary text.

[0130] Optionally, in an embodiment of the present application, when the first information includes the first intention information and the content understanding information, the quantity of the first operation information is determined by the quantity of the content understanding information.

[0131] Exemplarily, when the content understanding information is one, the number of the at least one first operation information is also one; or, when the content understanding information is two, the number of the at least one first operation information is also two.

[0132] Optionally, in an embodiment of the present application, when the above-mentioned first information includes the above-mentioned application type, each first operation information in the at least one first operation information is used to indicate an executable operation corresponding to the application type.

[0133] Exemplarily, taking the application type of the first application as a document type, the first operation information may include at least one of the following: full-text translation, mind map, and full-text summary, etc.

[0134] Exemplarily, taking the application type of the first application as a shopping type, the first operation information may include at least one of the following: finding similar items and sharing shopping links, etc.

[0135] In an embodiment of the present application, the electronic device can obtain at least one first operation information by performing intent conversion processing on the first information through the second model.

[0136] Optionally, in an embodiment of the present application, the second model may be a model in a server, that is, a model stored in the server.

[0137] Optionally, in an embodiment of the present application, the number of model parameters of the second model is greater than the number of model parameters of the first model.

[0138] Optionally, in the embodiment of the present application, the above model parameters include at least one of the following: convolution layer, pooling function, activation function, cross entropy function and constant, etc. The specific parameters can be determined according to actual usage, and the embodiment of the present application does not limit them.

[0139] Optionally, in an embodiment of the present application, the above-mentioned number of model parameters is the number of model parameters of the model, that is, the number of model parameters of the model.

[0140] Optionally, in an embodiment of the present application, the second model may be any one of the following: an AI model, a neural network model or a large text model.

[0141] Exemplarily, the second model may be a large text model, and the storage space occupied by the number of model parameters of the second model may generally be 30B, 70B, or 130B.

[0142] Optionally, in an embodiment of the present application, when the above-mentioned first information includes first intention information and content understanding information, the above-mentioned second model can convert the first intention information into first operation information, and then add the content understanding information to the operation information to obtain at least one first operation information.

[0143] Exemplarily, the first intention information is reading_browser_search, and the content understanding information includes: big model; the first operation information output by the second model can be: after clicking "big model", run and display the browser application interface, and enter "big model" into the browser input box, and search for "big model".

[0144] As another example, the first intention information is reading_translation software_search, and the content understanding information includes: Scalling Laws; the first operation information output by the second model can be: after clicking "Scalling Laws", run and display the translation application interface, and enter "Scalling Laws" into the input box of the translation application interface, and translate "Scalling Laws".

[0145] Optionally, in an embodiment of the present application, when the above-mentioned first information includes content understanding information, the second model can obtain at least one first operation information according to preset second intention information.

[0146] Exemplarily, the second intention information is reading_browser_search, and the content understanding information includes: big model; the first operation information output by the second model can be: after clicking "big model", run and display the browser application interface, and enter "big model" into the browser input box, and search for "big model".

[0147] Optionally, in an embodiment of the present application, when the above-mentioned first information includes an application type, the second model may determine at least one first operation information corresponding to the application type according to the application type.

[0148] Exemplarily, after the second model determines the application type, the second model may search for at least one application operation information corresponding to the application type from a database, and then use the at least one application operation information as the at least one first operation information.

[0149] In an embodiment of the present application, the electronic device may establish an association relationship between at least one first operation information and at least one control, thereby obtaining the at least one first operation control.

[0150] Optionally, in an embodiment of the present application, the electronic device may display the first area in the first page through a pop-up window, where the first area includes at least one first operation control; or display the first area in a blank area in the first page.

[0151] For example, taking the electronic device as a mobile phone as an example, Figure 4 As shown, the mobile phone displays a first page 10, in which a first area 11 is displayed, and the first area 11 includes a keyword card operation control, a one-key summary control, a mind map operation control and a full-text translation control; the user clicks the keyword card operation control so that the mobile phone can display 4 sub-operation controls, namely: operation control 110, on which the keyword "big model era" is displayed; operation control 111, on which the keyword "algorithm bottleneck" is displayed; operation control 112, on which the keyword "Scaling Laws" is displayed; and operation control 113, on which the keyword "Office Copilot" is displayed.

[0152] Step 203: The electronic device receives a first input to a second operation control in at least one first operation control.

[0153] In the embodiment of the present application, the first input is used to select a second operation control from at least one first operation control.

[0154] In some embodiments of the present application, the above-mentioned first input includes but is not limited to: a click input of the second operation control by the user through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible input, which can be determined according to actual usage requirements and is not limited in the embodiments of the present application.

[0155] In some embodiments of the present application, the above-mentioned specific gesture can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture.

[0156] In some embodiments of the present application, the click input may be a single click input, a double click input, or any number of click inputs, etc., and may also be a long press input or a short press input. For example, the first input may be a single click input of the user to the second operation control.

[0157] Step 204: The electronic device executes the executable operation corresponding to the second operation control in response to the first input.

[0158] Optionally, in an embodiment of the present application, the second operation control may include content understanding information, and the electronic device may perform an operation corresponding to the first operation intention on the content understanding information in response to the first input.

[0159] Optionally, in an embodiment of the present application, the second operation control may include a second operation intention, and the electronic device may perform an operation corresponding to the second operation intention in response to the first input.

[0160] In the application processing method provided in the embodiment of the present application, since the operation intention information, key content of the page and the application type of the application to which the first page belongs can be obtained through the first model analysis, at least one first operation information is output and at least one first operation control corresponding to the at least one first operation information is displayed based on the operation intention information, key content and application type of the page; therefore, when the user needs to operate on a certain information in the first page, the user can directly input the second operation control in the at least one first operation control, so that the electronic device can directly execute the operation corresponding to the second operation control, which simplifies the electronic device's processing process of the information in the first page, thereby improving the efficiency of the electronic device in processing the information in the first page.

[0161] Optionally, in an embodiment of the present application, the second operation control displays content understanding information.

[0162] For example, in combination Figure 1 ,like Figure 5 As shown, the above step 204 can be specifically implemented through the following step 204a.

[0163] Step 204a: The electronic device operates the content understanding information in response to the first input based on the executable operation corresponding to the second operation control.

[0164] In the embodiment of the present application, the electronic device can operate the content understanding information based on the first operation intention.

[0165] Optionally, in an embodiment of the present application, when the electronic device is a foldable electronic device, the electronic device may display the first page in one of the screens and display the operation result in another screen.

[0166] For example, in combination Figure 4 ,like Fig. 6A As shown, taking the first operation intention of jumping to the browser to search as an example, the user can click and input the operation control 113 on which the keyword "Office Copilot" is displayed, such as Figure 6B As shown, the mobile phone runs the browser application and displays the application main interface 12 of the browser application, and copies "Office Copilot" (that is, the above-mentioned content understanding information) into the input box of the browser application main interface 12, as shown in FIG. Figure 6C As shown, a search process is performed on “Office Copilot” through a browser application, and a search result interface 121 is displayed.

[0167] In an embodiment of the present application, the electronic device can directly execute the operation corresponding to the operation intention based on the user's input to the second operation control in at least one operation control; the processing process of the electronic device on the information in the first page is simplified, thereby improving the efficiency of the electronic device in processing the information in the first page.

[0168] Optionally, in an embodiment of the present application, the second operation control displays second operation information, and the second operation information is determined based on the application type.

[0169] For example, in combination Figure 1 ,like Figure 7 As shown, the above step 204 can be specifically implemented through the following step 204b.

[0170] Step 204b: The electronic device executes an operation corresponding to the second operation information in response to the first input.

[0171] In the embodiment of the present application, the electronic device can perform operation prediction processing based on the application type through the second model to obtain second operation information.

[0172] Optionally, in the embodiment of the present application, the above-mentioned second operation information may be one or more.

[0173] In the embodiment of the present application, the second operation information is used to indicate the operations that can be performed on the content of the first page based on the application type.

[0174] Optionally, in an embodiment of the present application, when the electronic device is a foldable electronic device, the electronic device may display the first page in one of the screens and display the operation result in another screen.

[0175] Optionally, in an embodiment of the present application, when the above-mentioned second operation information is a one-key summary, the user can click and input the one-key summary operation control (i.e., the above-mentioned second operation control) so that the electronic device can summarize the interface content in the first page through the second model to obtain the summary content.

[0176] For example, in combination Figure 4 ,like Fig. 8A As shown, the user can click and input the one-key summary control so that the mobile phone can summarize the interface content in the first page 10 through the second model, such as Figure 8B As shown, a one-click summary content "GPT-4 and Office Copilot have made the market boil. The speed of technological iteration in the AI ​​era is surging, and the AI ​​technology revolution will quickly affect everyone's life" is displayed in the second area 14.

[0177] Optionally, in an embodiment of the present application, when the second operation information is to obtain a mind map, the user can click and input the mind map operation control so that the electronic device can extract the outline of each paragraph of the page content of the first page through the second model, and then integrate it into an overall outline to obtain a mind map.

[0178] For example, in combination Figure 4 ,like Fig.9A As shown, users can click on the mind map operation controls, such as Fig. 9B As shown, the mobile phone can display the thinking outline of the page content of the first page in the second area 14; the second area 14 includes a picture control 15, and the user clicks the picture control 15, such as Fig. 9C As shown, the mobile phone can display the mind map.

[0179] Optionally, in an embodiment of the present application, when the second operation information is a full-text translation, the user can click and input the full-text translation control so that the electronic device can segment the full-text of the page content of the first page through the second model and translate each sentence of the text.

[0180] For example, in combination Figure 4 ,like Fig.10 As shown, the first page 10 and the first area 12 are displayed on the left screen 16 of the mobile phone, and the user can click the full-text translation operation control so that the mobile phone can display the Chinese translation corresponding to the page content of the first page on the right screen 17 of the mobile phone.

[0181] In an embodiment of the present application, the electronic device can directly execute operations that can be performed on the content of the first page based on the application type based on the user's input to the second operation control; this simplifies the electronic device's processing of information in the first page, thereby improving the efficiency of the electronic device's processing of information in the first page.

[0182] The above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0183] It should be noted that the application processing method provided in the embodiment of the present application can be executed by an application processing device. In the embodiment of the present application, the application processing device provided in the embodiment of the present application is described by taking the application processing method executed by the application processing device as an example.

[0184] Fig.11 A possible structural diagram of an application processing device involved in an embodiment of the present application is shown. Fig.11 As shown, the application processing device 70 may include: an acquisition module 71 , a processing module 72 , a receiving module 73 and an execution module 74 .

[0185] Among them, the acquisition module 71 is used to acquire the first information through the first model when displaying the first page, and the first information includes at least one of the following: first intention information, content understanding information and application type of the application to which the first page belongs, the first intention information represents the operation intention for the first page, and the content understanding information represents the key content of the first page. The processing module 72 is used to output at least one first operation information based on the first information acquired by the acquisition module, and display at least one first operation control based on the at least one first operation information, one first operation control in the at least one first operation control corresponds to one first operation information, and each first operation information in the at least one first operation information is used to indicate an executable operation in the first page. The receiving module 73 is used to receive a first input to a second operation control in the at least one first operation control. The execution module 74 is used to execute the executable operation corresponding to the second operation control in response to the first input received by the receiving module 73.

[0186] In a possible implementation, the first information includes first intention information. The acquisition module 71 is specifically used to acquire operation behavior information through the first model, where the operation behavior information represents the historical operation behavior on the first page. The processing module 72 is also used to convert the operation behavior information through the first model to obtain the first intention information.

[0187] In a possible implementation, the first information includes content understanding information. The acquisition module 71 is specifically used to acquire the page content of the first page through the first model. The processing module 72 is also used to identify the page content through the first model to obtain a type tag, which represents the type of the page content; and based on the type tag, perform a first processing on the page content to obtain content understanding information, wherein the first processing includes at least one of the following: keyword extraction and segment summary.

[0188] In a possible implementation, the first processing includes keyword extraction, and the content understanding information includes keywords of the first page. The processing module 72 is specifically used to extract keywords from at least one specific noun in the page content to obtain key content when the type tag indicates that the page content is a Chinese text type; or to extract keywords from at least one English word in the page content to obtain key content when the type tag indicates that the page content is an English text type.

[0189] In a possible implementation, the second operation control displays content understanding information. The execution module 74 is specifically configured to, in response to the first input received by the receiving module 73, operate the content understanding information based on the executable operation corresponding to the second operation control.

[0190] In a possible implementation, the second operation control displays second operation information, which is determined based on the application type. The execution module 74 is specifically configured to execute the operation corresponding to the second operation information in response to the first input received by the receiving module 73 .

[0191] An embodiment of the present application provides an application processing device. Since the operation intention information, key content of the page and the application type of the application program to which the first page belongs can be obtained through a first model analysis, at least one first operation information is output and at least one first operation control corresponding to the at least one first operation information is displayed based on the operation intention information, key content and application type of the page. Therefore, when a user needs to operate on a certain information in the first page, he can directly input a second operation control in the at least one first operation control, so that the application processing device can directly execute the operation corresponding to the second operation control, which simplifies the electronic device's processing process of the information in the first page, thereby improving the efficiency of the application processing device in processing the information in the first page.

[0192] The application processing device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0193] The application processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0194] The application processing device provided in the embodiment of the present application can implement each process implemented in the above embodiment. To avoid repetition, it will not be described again here.

[0195] Alternatively, if Fig.12 As shown, an embodiment of the present application also provides an electronic device 90, including a processor 91 and a memory 92, wherein the memory 92 stores programs or instructions that can be executed on the processor 91, and when the program or instructions are executed by the processor 91, the various steps of the above-mentioned application operation method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0196] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0197] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0198] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0199] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0200] The processor 110 is used to obtain first information through a first model when displaying a first page, and the first information includes at least one of the following: first intention information, content understanding information, and application type of the application to which the first page belongs, the first intention information represents the operation intention for the first page, and the content understanding information represents the key content of the first page; based on the first information, at least one first operation information is output, and at least one first operation control is displayed based on the at least one first operation information, one first operation control in the at least one first operation control corresponds to one first operation information, and each first operation information in the at least one first operation information is used to indicate an executable operation in the first page. The user input unit 107 is used to receive a first input to a second operation control in the at least one first operation control. The processor 110 is also used to execute the executable operation corresponding to the second operation control in response to the first input.

[0201] Optionally, in an embodiment of the present application, the first information includes first intent information. The processor 110 is specifically configured to obtain operation behavior information through a first model, where the operation behavior information represents historical operation behavior on the first page; and to convert the operation behavior information through the first model to obtain the first intent information.

[0202] Optionally, in an embodiment of the present application, the first information includes content understanding information. The processor 110 is specifically configured to obtain the page content of the first page through the first model; identify the page content through the first model to obtain a type tag, where the type tag represents the type of the page content; perform a first processing on the page content based on the type tag to obtain content understanding information, where the first processing includes at least one of the following: keyword extraction and segment summary.

[0203] Optionally, in an embodiment of the present application, the first processing includes keyword extraction, and the content understanding information includes keywords of the first page; the processor 110 is specifically used to perform keyword extraction on at least one specific noun in the page content to obtain key content when the type tag represents that the page content is a Chinese text type; or, when the type tag represents that the page content is an English text type, perform keyword extraction on at least one English word in the page content to obtain key content.

[0204] Optionally, in the embodiment of the present application, the second operation control displays content understanding information. The processor 110 is specifically configured to operate the content understanding information based on the executable operation corresponding to the second operation control in response to the first input.

[0205] Optionally, in the embodiment of the present application, the second operation control displays second operation information, and the second operation information is determined based on the application type. The processor 110 is specifically configured to execute an operation corresponding to the second operation information in response to the first input.

[0206] An embodiment of the present application provides an electronic device, which can obtain the operation intention information, key content of the page and the application type of the application to which the first page belongs through a first model analysis, thereby outputting at least one first operation information and displaying at least one first operation control corresponding to the at least one first operation information based on the operation intention information, key content and application type of the page; therefore, when a user needs to operate on certain information in the first page, he can directly input a second operation control in the at least one first operation control, so that the electronic device can directly execute the operation corresponding to the second operation control, which simplifies the electronic device's processing process of the information in the first page, thereby improving the efficiency of the electronic device in processing the information in the first page.

[0207] The electronic device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0208] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described again here.

[0209] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0210] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0211] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

[0212] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0213] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0214] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0215] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0216] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned application processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0217] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0218] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0219] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. An application processing method, It is characterized in that The method comprises: In the case of displaying a first page, first information is acquired through a first model, where the first information includes at least one of the following: first intention information, content understanding information, and an application type of an application to which the first page belongs, the first intention information represents an operation intention for the first page, and the content understanding information represents key content of the first page; Based on the first information, at least one first operation information is output, and based on the at least one first operation information, at least one first operation control is displayed, one first operation control corresponds to one first operation information, and each first operation information is used to indicate an executable operation in the first page; Receiving a first input to a second operation control among the at least one first operation control; In response to the first input, an executable operation corresponding to the second operation control is executed.

2. The method according to claim 1, It is characterized in that The first information includes first intention information; The obtaining of first information through the first model includes: Acquire operation behavior information through the first model, where the operation behavior information represents historical operation behavior on the first page; The operation behavior information is transformed through the first model to obtain the first intention information.

3. The method according to claim 1, It is characterized in that The first information includes content understanding information; The obtaining of first information through the first model includes: Obtaining the page content of the first page through the first model; Using the first model, the page content is identified and processed to obtain a type label, where the type label represents the type of the page content; Based on the type tag, the page content is first processed to obtain the content understanding information, and the first processing includes at least one of the following: keyword extraction and segment summary.

4. The method according to claim 3, It is characterized in that The first processing includes keyword extraction, and the content understanding information includes keywords of the first page; The first processing of the page content based on the type tag to obtain the content understanding information includes: When the type tag indicates that the page content is of Chinese text type, performing keyword extraction on at least one specific noun in the page content to obtain the key content; or In the case where the type tag indicates that the page content is of English text type, keyword extraction is performed on at least one English word in the page content to obtain the key content.

5. The method according to any one of claims 1 to 4, It is characterized in that The second operation control displays the content understanding information; The executing, in response to the first input, an executable operation corresponding to the second operation control includes: In response to the first input, the content understanding information is operated based on the executable operation corresponding to the second operation control.

6. The method according to claim 1, It is characterized in that The second operation control displays second operation information, where the second operation information is determined based on the application type; The executing, in response to the first input, an executable operation corresponding to the second operation control includes: In response to the first input, an operation corresponding to the second operation information is performed.

7. An application processing device, It is characterized in that The application processing device comprises: an acquisition module, a processing module, a receiving module and an execution module; The acquisition module is used to acquire first information through a first model when displaying a first page, wherein the first information includes at least one of the following: first intention information, content understanding information, and an application type of an application to which the first page belongs, wherein the first intention information represents an operation intention on the first page, and the content understanding information represents key content of the first page; The processing module is used to output at least one first operation information based on the first information acquired by the acquisition module, and display at least one first operation control based on the at least one first operation information, one first operation control corresponds to one first operation information, and each first operation information is used to indicate an executable operation in the first page; The receiving module is used to receive a first input of a second operation control in the at least one first operation control; The execution module is used to execute the executable operation corresponding to the second operation control in response to the first input received by the receiving module.

8. The device according to claim 7, It is characterized in that The first information includes first intention information; The acquisition module is specifically configured to acquire operation behavior information through the first model, wherein the operation behavior information represents historical operation behaviors on the first page; The processing module is further used to transform the operation behavior information through the first model to obtain the first intention information.

9. The device according to claim 7, It is characterized in that The first information includes content understanding information; The acquisition module is specifically configured to acquire the page content of the first page through the first model; The processing module is also used to identify the page content through the first model to obtain a type label, wherein the type label represents the type of the page content; and based on the type label, perform a first processing on the page content to obtain the content understanding information, wherein the first processing includes at least one of the following: keyword extraction and segment summary.

10. The device according to claim 9, It is characterized in that The first processing includes keyword extraction, and the content understanding information includes keywords of the first page; The processing module is specifically used to extract keywords from at least one specific noun in the page content to obtain the key content when the type tag indicates that the page content is of Chinese text type; or In the case where the type tag indicates that the page content is of English text type, keyword extraction is performed on at least one English word in the page content to obtain the key content.

11. The device according to any one of claims 7 to 10, It is characterized in that The second operation control displays the content understanding information; The execution module is specifically configured to operate the content understanding information based on the executable operation corresponding to the second operation control in response to the first input received by the receiving module.

12. The device according to claim 7, It is characterized in that The second operation control displays second operation information, where the second operation information is determined based on the application type; The execution module is specifically configured to execute the operation corresponding to the second operation information in response to the first input received by the receiving module.

13. An electronic device, It is characterized in that The invention comprises a processor, a memory and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the application processing method as claimed in any one of claims 1 to 6.

14. A readable storage medium, It is characterized in that The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by the processor, the steps of the application processing method according to any one of claims 1 to 6 are implemented.

15. A computer program product, It is characterized in that The computer program product is stored in a storage medium, and the computer program product is executed by at least one processor to implement the application processing method according to any one of claims 1 to 6.

Images