Fast input method and device and storage medium

Abstract

The invention provides a shortcut input method and device and a storage medium. According to the method, a user does not need to input prompt words, and text information matched with a current application program, a service scene and screen content can be quickly generated according to a currently displayed user interface and chat content, selected by the user, in the user interface.

Description

Technical Field

[0001] The present application relates to the technical field of terminal devices, and in particular to a quick input method, device, and storage medium. Background Art

[0002] With the development of computer technology, electronic devices such as mobile phones and tablets are becoming increasingly popular, and these electronic devices support more and more functions. For example, users can use input method applications (hereinafter referred to as "input methods") installed on electronic devices to input information, reply to messages from others, post comments, take notes, edit email content, search for content, and other operations, thus bringing great convenience to people's lives, studies, and work.

[0003] Currently, in order to facilitate users to quickly input information using input methods, input methods provide an association function (providing the associated context based on the input context). For example, when the user inputs "you", "we", "good", etc. can be provided, thereby facilitating users to quickly input information.

[0004] However, the information quickly input based on the association function is often only related to the context currently input by the user, and has nothing to do with the application currently being used or the content being viewed by the user. Summary of the Invention

[0005] In order to solve the above technical problems, the embodiments of the present application provide a quick input method, device and storage medium, which aim to enable the input method to automatically generate appropriate information based on the currently used application and the content displayed on the screen, so as to improve input efficiency and meet user needs.

[0006] In a first aspect, an embodiment of the present application provides a quick input method for an electronic device. The method comprises: displaying a first interface, the first interface including chat content and a text input box; upon receiving a first operation, displaying a quick input control; upon receiving a second operation on the quick input control, displaying a second interface, the second interface including a first selection box, wherein the chat content is displayed in the first selection box; upon receiving a third operation on the first selection box, displaying a quick content generation control, and displaying the chat content as selected; upon receiving a fourth operation on the quick content generation control, displaying target chat content, wherein the target chat content is associated with the chat content; and upon receiving a fifth operation on the target chat content, displaying the target chat content in the text input box.

[0007] The first interface can be understood as the user interface currently displayed on the display screen of the electronic device. In this application, the first interface is, for example, the interface 10f, or the interface 20f, or the interface 30f mentioned in the following embodiments.

[0008] The text input box is used to display the text content inputted. In the present application, the text input box is, for example, the text input box 10f-1 mentioned in the following embodiment.

[0009] The first operation may be a user operation on the text input box in the first interface, such as clicking on the text input box 10f-1.

[0010] The first operation may also be a user operation to invoke the voice assistant application. For details about the user operation to invoke the voice assistant application, please refer to the description of the following embodiment, which will not be described here.

[0011] The quick input control may be the quick input control 10f-3 described in the following embodiment, or the control 10g-3.

[0012] Among them, the second interface can be the interface 40f, or interface 40f', or interface 40f", or interface 30g mentioned in the following embodiments. For the specific implementation details of the user interface of the electronic device changing from interface 10f to interface 40f, or interface 40f', or interface 40f", or interface 30g, please refer to the description part of the following embodiments and will not be repeated here.

[0013] Among them, the first selection box can be understood as Figure 9b Message boxes M1', M2', etc. are displayed on the middle mask layer.

[0014] The third operation may be a user operation on a select all control displayed on the second interface, such as the select all control 10f-6 or the select all control 10g-5. It is understandable that when the third operation is performed on the select all control, all chat content displayed on the second interface can be selected with one click.

[0015] The third operation may also be a user operation on the first selection box. That is, each time the user clicks on a first selection box on the second interface, it can be regarded as triggering the third operation.

[0016] The quick content generation control may be the generate answer control 10f-10 or the generate answer control 10g-7 mentioned in the following embodiments.

[0017] The target chat content may include any one or more of text, pictures, and documents.

[0018] Therefore, without the user inputting prompts, text information matching the current application, business scenario, and screen content can be quickly generated based on the currently displayed user interface and the chat content in the user interface selected by the user.

[0019] According to the first aspect, after receiving the second operation on the quick input control, the second interface is displayed, including: after receiving the second operation on the quick input control, performing a screenshot operation on the first interface to obtain a first interface screenshot corresponding to the first interface; performing a feature extraction operation on the first interface screenshot to extract the chat content and the message box information corresponding to the chat content included in the first interface screenshot; overlaying the first interface screenshot on the first interface; adding a mask on the first interface screenshot according to the chat content and the message box information corresponding to the chat content to obtain the second interface.

[0020] The first interface screenshot is a full-screen screenshot corresponding to the first interface. For example, when the first interface is 30f, the first screenshot can be understood as a full-screen screenshot corresponding to interface 30f.

[0021] Among them, the message box is, for example, Figure 9b The middle interface 30f corresponds to the message boxes M1, M2, etc. in the screenshot.

[0022] The message box information may include the coordinate information of the message box, the avatar and nickname of the user corresponding to the message box, etc.

[0023] Among them, adding a mask layer on the first interface screenshot can be understood as adding a layer with a certain transparency on the first interface screenshot.

[0024] For the specific implementation details of this aspect, please refer to the following embodiments for Figure 9b The description part is not repeated here.

[0025] According to the first aspect, or any implementation method of the first aspect above, a mask is added to the first interface screenshot based on the chat content and the message box information corresponding to the chat content, including: adding a layer on the first interface screenshot, the layer having a certain transparency; drawing a first selection box on the layer based on the message box information corresponding to the chat content; and displaying the corresponding chat content in the first selection box.

[0026] Among them, the first selection box drawn is, for example, Figure 9b Message boxes M1', M2', etc. are shown.

[0027] For the specific implementation details of this aspect, please refer to the following embodiments for Figure 9b The description part is not repeated here.

[0028] According to the first aspect, or any implementation of the first aspect above, the method also includes: after receiving the fourth operation on the quick content generation control, constructing a prompt based on the chat content in the selected state and the page features of the first interface extracted from the screenshot of the first interface; generating the target chat content according to the prompt.

[0029] The constructed prompts include user prompts and system prompts.

[0030] Among them, the page features are used to determine the application information of the application to which the first interface belongs, and the corresponding business scenario.

[0031] For specific implementation details of this aspect, please refer to the description of steps S110 to S13, or steps S210 to S213, or steps S310 to S313, or steps S408 to S411 in the following embodiments, which will not be repeated here.

[0032] According to the first aspect, or any implementation method of the first aspect above, a prompt is constructed based on the chat content in a selected state and the page features of the first interface extracted from the screenshot of the first interface, including: preprocessing the chat content and page features to obtain a preprocessing result; performing intent recognition processing on the preprocessing result to determine the user intention; constructing a first prompt based on the preprocessing result and the user intention, the first prompt being used to identify the subject of the target chat content to be generated; constructing a second prompt based on the user intention and the page features, the second prompt being used to indicate the creation type corresponding to the target chat content to be generated.

[0033] The first prompt may be understood as the user prompt in the following embodiment, and the second prompt may be understood as the user prompt in the following embodiment.

[0034] For specific implementation details of this aspect, please refer to the description of step S111, step S211, step S311, or step S409 in the following embodiments, which will not be repeated here.

[0035] According to the first aspect, or any implementation of the first aspect above, target chat content is generated based on the prompt, including: based on the first prompt and the second prompt, generating target chat content that matches the topic identified by the first prompt and has a creation type indicated by the second system prompt.

[0036] According to the first aspect, or any implementation method of the first aspect above, the chat content and page features are preprocessed to obtain preprocessing results, including: deleting sensitive information in the chat content, and deleting sensitive information in the page features; or, replacing sensitive information in the chat content, and replacing sensitive information in the page features.

[0037] For specific implementation details of this aspect, please refer to the description of desensitizing the chat content and page features in step S111, or step S211, or step S311, or step S409 in the following embodiments, which will not be repeated here.

[0038] According to the first aspect, or any implementation of the first aspect above, the first input operation is a user operation to wake up the voice assistant application.

[0039] Exemplarily, the user operation of waking up the voice assistant application is, for example, the user long pressing the power button for 1 second, or using a set voice wake-up word to wake up the voice assistant application.

[0040] According to the first aspect, or any implementation method of the first aspect above, after receiving the first operation, a quick input control is displayed, including: after receiving the first operation, an operation window corresponding to the voice assistant application is displayed on the first interface, and the operation window includes a quick input control.

[0041] Among them, the operation window corresponding to the voice assistant application is displayed on the first interface, such as the window 10g-2 mentioned in the following embodiment.

[0042] Regarding the forms of the operation window and the quick input control in this aspect, reference may be made to the window 10g-2 and the control 10g-3 shown in the following embodiment.

[0043] According to the first aspect, or any implementation of the first aspect above, the second interface further includes a select all control, and the third operation on the first selection box is an operation acting on the select all control.

[0044] Illustratively, the second interface in this aspect is, for example, the interface 40f, or the interface 40f', or the interface 40f", or the interface 30g mentioned in the following embodiments.

[0045] Correspondingly, the select all control is, for example, the select all control 10f-6 or the select all control 10g-5.

[0046] For the specific implementation details of this aspect, please refer to the following embodiments for Figure 8a Medium (4), or Figure 10 Medium (2), or Figure 12 Medium (2), or Figure 14 The description of (3) will not be repeated here.

[0047] According to the first aspect, or any implementation of the first aspect above, the first operation is a user operation acting on the text input box; after receiving the first operation, a quick input control is displayed, including: after receiving the first operation, a keyboard corresponding to the input method application is displayed on the first interface, and a quick input control is displayed in the area corresponding to the keyboard.

[0048] For details on the implementation of this aspect, please refer to Figure 8a (1) to Figure 8aThe description of (3) will not be repeated here.

[0049] According to the first aspect, or any implementation of the first aspect above, the second interface further includes a quick input window, the quick input window includes a select all control, and the third operation on the first selection box is an operation acting on the select all control.

[0050] Exemplarily, the second interface in this aspect is, for example, the interface 40f, or the interface 40f', or the interface 40f" in the following embodiments.

[0051] Correspondingly, the quick input window is, for example, W1 mentioned in the following embodiment.

[0052] Correspondingly, the select all control is, for example, the select all control 10f-6.

[0053] For details on the implementation of this aspect, please refer to Figure 8a The description of (4) will not be repeated here.

[0054] According to the first aspect, or any implementation of the first aspect above, the quick input window is a floating window.

[0055] According to the first aspect, or any implementation of the first aspect above, the quick input window further includes a prompt input box, which is used for the user to input a prompt; wherein, after the prompt input by the user is displayed in the prompt input box, the quick content generation control is displayed.

[0056] The prompt input box is, for example, the prompt input box 10f-14 mentioned in the following embodiments.

[0057] The prompt input box for displaying the prompt input by the user is, for example, the prompt input box 10f-14' mentioned in the following embodiment. Correspondingly, the displayed quick content generation control is, for example, the generate answer control 10f-10 displayed in the interface 50f'.

[0058] For details on the implementation of this aspect, please refer to Figure 10 Zhong (2) and Figure 10 The description of (3) will not be repeated here.

[0059] According to the first aspect, or any implementation of the first aspect above, the quick input window further includes a text style selection control, which is used for the user to select the expression style of the target chat content.

[0060] The text style selection control is, for example, the text style selection control 10f-15 or the text style selection control 10f-15' mentioned in the following embodiments.

[0061] For details on the implementation of this aspect, please refer to Figure 12 The description part will not be repeated here.

[0062] In a second aspect, embodiments of the present application provide an electronic device. The electronic device includes: a memory and a processor, the memory and the processor being coupled; the memory storing program instructions, which, when executed by the processor, cause the electronic device to execute instructions of the method of the first aspect or any possible implementation of the first aspect.

[0063] In a third aspect, an embodiment of the present application provides a computer-readable medium for storing a computer program, wherein the computer program includes instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0064] In a fourth aspect, an embodiment of the present application provides a computer program comprising instructions for executing the method in the first aspect or any possible implementation of the first aspect.

[0065] In a fifth aspect, embodiments of the present application provide a chip comprising a processing circuit and transceiver pins. The transceiver pins and the processing circuit communicate with each other via an internal connection path, and the processing circuit executes the method of the first aspect or any possible implementation of the first aspect to control the receive pin to receive a signal and to control the transmit pin to send a signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] Figure 1 This is a schematic diagram of an exemplary quick input scenario;

[0067] Figure 2a and Figure 2b is a schematic diagram illustrating another exemplary quick input scenario;

[0068] Figure 3 is a schematic diagram illustrating another exemplary quick input scenario;

[0069] Figure 4 is a schematic diagram illustrating another exemplary quick input scenario;

[0070] Figure 5 is a schematic diagram illustrating another exemplary quick input scenario;

[0071] Figure 6 Schematic diagram of the hardware structure of an electronic device;

[0072] Figure 7 is a schematic diagram of a software structure of an electronic device shown as an example;

[0073] Figure 8a and Figure 8b is a schematic diagram illustrating another exemplary quick input scenario;

[0074] Figure 9a An exemplary implementation is shown Figure 8a and Figure 8b A timing diagram of the quick input method for the scenario shown;

[0075] Figure 9b This is a schematic diagram showing an exemplary method of setting a mask on an interface;

[0076] Figure 10 is a schematic diagram illustrating another exemplary quick input scenario;

[0077] Figure 11 An exemplary implementation is shown Figure 10 A timing diagram of the quick input method for the scenario shown;

[0078] Figure 12 is a schematic diagram illustrating another exemplary quick input scenario;

[0079] Figure 13 An exemplary implementation is shown Figure 12 A timing diagram of the quick input method for the scenario shown;

[0080] Figure 14 is a schematic diagram illustrating another exemplary quick input scenario;

[0081] Figure 15 An exemplary implementation is shown Figure 14 A timing diagram of the quick input method for the scenario shown. DETAILED DESCRIPTION

[0082] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0083] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0084] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects, rather than to describe a specific order of objects. For example, the terms "first target object" and "second target object" are used to distinguish different objects, rather than to describe a specific order of objects.

[0085] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0086] In the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. For example, "multiple processing units" means two or more processing units; "multiple systems" means two or more systems.

[0087] With the development of computer technology, electronic devices such as mobile phones and tablets are becoming increasingly popular, and these devices support a growing number of functions. For example, they can support the use of instant messaging applications, video applications, live broadcast applications, short video applications, shopping applications, game applications, etc., bringing great convenience to people's lives, studies, and work.

[0088] Currently, users frequently use input methods every day, for example, replying to messages from others and posting to Moments in instant messaging applications (hereinafter referred to as "applications"), posting barrages and comments in video applications, live broadcast applications, and short video applications, and searching for product names in shopping applications.

[0089] In order to facilitate users to quickly input information using the input method, in some embodiments of the present application, the input method provides an association function (providing the associated context based on the input context). Figure 1 The following scenario is used to illustrate this.

[0090] See also Figure 1 In (1), (2), and (3), examples are provided of the chat interfaces between a user account (e.g., Li Si) and his friend Zhang San. It is understandable that interface 10a, interface 20a, and interface 30a are all chat interfaces between the user and Zhang San, except that interface 10a, interface 20a, and interface 30a correspond to chat interfaces when the user uses input methods to input different contents.

[0091] See also Figure 1In (1), for example, in a scenario where a user receives a message sent by Zhang San, such as "You can get off work soon. Have a nice weekend", and is about to use the input method to reply to Zhang San with "You too". When the user operates on the character block in the keyboard area and enters "You" in the text input box 10a-1, the associated area 10a-2 of the input method will display the following texts associated with "You", such as "men", "hao", "de", "shi", "shuo", "zai", "jiu", "jia". If the user wants to reply to Zhang San with "You too", they need to continue to operate on the character blocks in the keyboard input area, such as clicking on the "WXYZ" character block and the "DEF" character block in the keyboard input area of interface 10a in sequence.

[0092] Correspondingly, in response to this user operation, the text displayed in the associated area 10a-2 will be updated to the text displayed in the associated area 10a-2' in interface 20a, such as "ye", "yě shì", "yé", "yè", "yě", "yè", "yè".

[0093] See Figure 1 In (2), for example, when the user clicks on "yě shì" displayed in the associated area 10a-2', in response to this user operation, the selected text "yě shì" will appear in the text input box. That is, the text displayed in the text input box 10a-1 shown in interfaces 10a and 20a will be updated to the text displayed in the text input box 10a-1' in interface 30a.

[0094] In addition, when the text displayed in the text input box 10a-1 is updated to the text displayed in the text input box 10a-1', "shi" will be used as the previous text, and the following texts related to "shi" will be displayed in the associated area. For example Figure 1 As shown in (3), when the chat interface is updated from interface 20a to interface 30a, the associated area will be updated from the associated area 10a-2' shown in interface 20a to the associated area 10a-2" shown in interface 30a, and the displayed text (content) is, for example, ",", "gè", "ō", "ā", "ma", "ya", "de", "wǒ".

[0095] For example, if the user only wants to reply "You too", after the chat interface is updated to interface 30a, the user clicks the "Send" button displayed in interface 30a, and the message "You too" can be sent to Zhang San. The chat interface with Zhang San will also display the message "You too" sent by the user. Although this method speeds up the user's information input speed, such as eliminating the need for quick input word by word, the information quickly input based on the association function is often only related to the previous context of the user's current input, and has no connection with the application (APP) currently being used by the user or the content being viewed. Therefore, it cannot meet the diversified development of information and the user's usage needs.

[0096] It should be understood that Figure 1 The scenario of quick input information is only based on the input context, providing the associated context (text content) as an example. In actual application, based on the input context, the associated context provided can also be a picture, a document, etc.

[0097] In order to meet the diversified development of information and enable the input method to better meet user needs, in some other embodiments of the present application, the input method provides an intelligent assistant. For example, when entering content, the user selects an appropriate creation type and / or enters a prompt describing the content summary, and then uses the input method's built-in artificial intelligence (AI) model to quickly generate the content to be edited.

[0098] See also Figure 2a and Figure 2b , which exemplifies a scenario diagram of an intelligent assistant (local intelligent assistant) based on an input method for quickly inputting information.

[0099] It should be noted that Figure 2a and Figure 2b The interfaces 10b to 100b shown in the figure can be understood as a series of SMS editing interfaces (or SMS chat interfaces) involved in the process of a user using a SMS application to send a SMS message to Zhang San.

[0100] See also Figure 2a In (1), for example, when the user does not operate the character blocks in the keyboard input area of the interface 10b to edit text, the text input box 10b-1 in the interface 10b does not display text content, but only displays a jumping input cursor.

[0101] Continue to see Figure 2a In (1), for example, when the user clicks the smart assistant control 10b-2 provided by the input method in interface 10b, the mobile phone responds to the user operation and the user interface of the mobile phone is updated from interface 10b to interface Figure 2aFor example, the area displaying the smart assistant control 10b-2 may include one or more of the following: a creation type selection control 10b-3, a close smart assistant control 10b-4, a prompt display area 10b-5, and a smart text generation control 10b-6.

[0102] Continue to see Figure 2a In (2), for example, the area where the creation type selection control 10b-3 is located displays "AI Help Writing" and the currently selected creation type, such as "Greeting" and other information.

[0103] It should be noted that in some embodiments of the present application, the smart assistant function is enabled by default. That is, after the user clicks the smart assistant control 10b-2, the selected creation type displayed in the area where the creation type selection control 10b-3 is located is "Greeting Type". That is, the default creation type is "Greeting Type".

[0104] Continue to see Figure 2a In (2), for example, when the user clicks to close the smart assistant control 10b-4, the mobile phone will respond to the user operation and turn off the smart assistant function. Accordingly, the user interface of the mobile phone will be restored from interface 20b to interface 10b.

[0105] Continue to see Figure 2a In (2), for example, when the user clicks the creation type selection control 10b-3, the mobile phone will respond to the user operation and pop up the creation type selection window 10b-7 on the current interface. That is, the user interface of the mobile phone will be updated from interface 20b to Figure 2a Interface 30b shown in (3).

[0106] See also Figure 2a In (3), illustratively, the creation type selection window 10b-7 may include one or more creation type options, such as a greeting option, a friend dynamics option, a daily post option, a script option, a grass-planting option, an evaluation option, a free writing option, a speech option, a meeting minutes option, an email option, a self-introduction option, a praise option, a polishing and rewriting option, an outline writing option, a group notification option, a brainstorming option, a naming option, a slogan option, etc.

[0107] Continue to see Figure 2a In (3), for example, after the user clicks the praise option, the mobile phone responds to the user operation, the praise option will switch to the selected state, and the greeting option will switch to the unselected state, such as Figure 2aAs shown in the interface 40b in (4). That is, the creation type selection window 10b-7 shown in the creation type selection window interface 30b currently displayed in the interface is updated to the creation type selection window 10b-7' shown in the interface 40b. In the creation type selection window 10b-7', the border of the praise option is, for example, bolded and / or highlighted, while the other options are not bolded and / or highlighted.

[0108] See also Figure 2a In (4), for example, when the user clicks the "Cancel" control provided in the creation type selection window 10b-7', the mobile phone will respond to the user operation by closing the creation type selection window 10b-7' and canceling the selection of the praise option. The current creation type continues to remain the default creation type, such as "Greeting Type". Alternatively, the last selected creation type is maintained. For example, when the selected creation type displayed in the area where the creation type selection control 10b-3 is located is "Friends' Dynamics", when the user clicks the praise option in the creation type selection window and then clicks the "Cancel" control, the mobile phone responds to the user operation and closes the creation type selection window. The selected creation type displayed in the area where the creation type selection control 10b-3 is located is still "Friends' Dynamics".

[0109] Continue to see Figure 2a In (4), for example, when the user clicks the "OK" control provided in the creation type selection window 10b-7', the mobile phone responds to the user operation, updates the creation type to the type corresponding to the option selected by the user in the creation type selection window 10b-7', such as "praise type", and closes the creation type selection window 10b-7'. That is, in this case, after closing the creation type selection window 10b-7', the selected creation type displayed in the area where the creation type selection control 10b-3 is located will be updated from "Greeting" to Figure 2a In the interface 50b shown in (5), "Praise" is displayed in the area where the creation type selection control 10b-3' is located.

[0110] Accordingly, the content displayed in the prompt display area will also change according to the selected creation type. For example, if the creation type is "greeting type", the content displayed in the prompt display area 10b-5 will be "greetings to an old friend I haven't seen in a long time". If the creation type is updated to "praise type", the content displayed in the prompt display area 10b-5' will be "praise to an old friend".

[0111] It should be noted that the content displayed by default in the prompt display area is not the prompt input by the user, but prompt information given to the user before the user inputs the prompt, that is, information instructing the user to input the prompt.

[0112] For example, after inputting prompt words such as "confidence" and "brave" in the prompt word display area 10b-5' in the character block of the keyboard area in the user operation interface 50b, the prompt word display area 10b-5' will display the prompt words input by the user, such as Figure 2b As shown in the prompt display area 10b-5" in the interface 60b shown in (1).

[0113] See also Figure 2b In (1), for example, when the prompts "confidence" and "brave" are displayed in the prompt display area 10b-5", if the user clicks the smart text generation control 10b-6, the mobile phone will respond to the user operation and automatically generate text content based on the creation type selected by the user and the prompt input.

[0114] For example, in some embodiments of the present application, in order to display automatically generated text content, after receiving the user's operation on the intelligent text generation control 10b-6, the content displayed in the area below the text input box 10b-1 in the interface 60b will change to Figure 2b (2) shows the content displayed in the area below the text input box 10b-1 in the interface 70b.

[0115] See also Figure 2b In (2), illustratively, the content displayed in the area below the text input box 10b-1 in the interface 70b may include one or more of a back control 10b-8, a close smart assistant control 10b-4, a smart assistant operation area 10b-9, etc. The smart assistant operation area 10b-9 may include one or more of a smart text input box 10b-91, a smart text editing control 10b-92, a smart text style selection control 10b-93, a smart text switching control 10b-94, a smart text switching control 10b-95, a smart text refresh control 10b-96, a smart text insertion control 10b-97, etc.

[0116] Continue to see Figure 2b In (2), for example, when the user interface of the mobile phone is interface 70b, when the user clicks to close the smart assistant control 10b-4, the mobile phone will respond to the user operation and turn off the smart assistant function, and the user interface will also be restored from interface 70b to interface 10b.

[0117] Continue to see Figure 2b In (2), illustratively, when the user clicks the back control 10b-8, the mobile phone displays the interface 60 in response to the user operation.

[0118] Continue to see Figure 2bIn (2), illustratively, the smart text input box 10b-91 displays text content generated according to the selected style displayed in the area where the smart text style selection control 10b-93 is located.

[0119] Continue to see Figure 2b In (2), for example, when there are multiple automatically generated text contents based on the creation type selected by the user and the prompt input, the user clicks the smart text refresh control 10b-96, and the mobile phone responds to the user operation by refreshing the text content displayed in the smart text input box 10b-91, such as refreshing the content displayed in the smart text input box 10b-91 in the interface 70b to "You are always full of confidence and courage, and never back down when facing difficulties. This is really amazing." Figure 2b The content displayed in the smart text input box 10b-91' in the interface 80b shown in (3) is "Courage is a sturdy boat that allows you to raise the sail of confidence, cross the turbulent river, and sail to the other side of success."

[0120] In addition, it should be noted that when there are multiple automatically generated text contents based on the creation type selected by the user and the prompt input, and the text content currently displayed in the smart text input box belongs to the first one, the smart text switch control 10b-94 can be set to gray and set to an unavailable state, while the smart text switch control 10b-95 is set to an available state, as shown in interface 70b.

[0121] Continue to see Figure 2b In (2), for example, when the user clicks the smart text switch control 10b-95, the mobile phone can refresh the text content displayed in the smart text input box 10b-91 in response to the user operation, such as refreshing the content displayed in the smart text input box 10b-91 in the interface 70b to the content displayed in the smart text input box 10b-91'.

[0122] For example, if the content displayed in the smart text input box 10b-91' meets the current creation type and the last text content of the prompt, the smart text switch control 10b-95 is grayed out and set to an unavailable state, such as the smart text switch control 10b-95' shown in interface 80b. Correspondingly, the smart text switch control 10b-94 is set to an available state, such as the smart text switch control 10b-94' shown in interface 80.

[0123] In addition, it should be noted that when the user clicks on the smart text generation control 10b-6 and the smart assistant operation area 10b-9 appears on the current interface, the text content displayed in the smart text input box 10b-91 (or smart text input box 10b-91') is not editable by default. In this case, when the user clicks on the smart text editing control 10b-92, the mobile phone responds to the user operation and the text content displayed in the smart text input box 10b-91 (or smart text input box 10b-91') will switch to an editable state. For example, the cursor will appear at the location where the user clicks, and the keyboard corresponding to the input method will be pulled up.

[0124] For example, in some embodiments of the present application, the text content displayed in the smart text input box 10b-91 (or smart text input box 10b-91') will be switched to an editable state. After pulling up the keyboard corresponding to the input method, the smart assistant operation area 10b-9 displayed in the current interface and the content above the smart assistant operation area 10b-9 can be lifted up by the keyboard.

[0125] For example, in other embodiments of the present application, the text content displayed in the smart text input box 10b-91 (or smart text input box 10b-91') will be switched to an editable state. After pulling up the keyboard corresponding to the input method, the smart assistant operation area 10b-9 can be suspended on the interface 60b in the form of a floating window.

[0126] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0127] See also Figure 2b In (3), for example, taking the case where the user clicks on the smart text insertion control 10b-97 in the interface 80b, after the user clicks on the smart text insertion control 10b-97, the mobile phone will copy and paste the text content displayed in the smart text input box 10b-91' into the text input box 10b-1 in response to the user operation, and turn off the smart assistant function. That is, the interface 80b can be updated to Figure 2b Interface 90b is shown in (4).

[0128] For example, in the text input box 10b-1' in the interface 90b, text content generated based on the intelligent assistant is displayed, such as "Courage is a sturdy boat that allows you to raise the sails of confidence, cross the turbulent river, and sail to the other side of success." If the user clicks the send control 10b-10, the mobile phone will respond to the user operation and send the text content displayed in the text input box 10b-1' to Zhang San in the form of a text message.

[0129] Understandably, after the text message is successfully sent, the content of the text message will appear in the text message chat interface between the user and Zhang San (not shown in the figure).

[0130] Continue to see Figure 2b In (2), for example, when the user clicks the smart text style selection control 10b-93, the mobile phone responds to the user operation and can display the following Figure 2b Interface 100b is shown in (5).

[0131] See also Figure 2b In (5), for example, the interface 100 may include text style selection windows 10b-11, as well as all the content in the interface 70b. The text style selection windows 10b-11 may include one or more text style options, such as one or more of an automatic style option, a formal style option, a humorous style option, and a literary style option. In the embodiment of the present application, the selected text style is set to the automatic style by default.

[0132] In this way, text content related to the current creation type and prompt is generated according to the prompt input by the user and the creation type selected, thereby facilitating the user to quickly input information.

[0133] It should be understood that Figure 2a ,as well as Figure 2b The scenario of quick information input shown only uses the intelligent assistant control 10b-2 for triggering the quick generation of text content as an example. In actual applications, controls for triggering the quick generation of images, documents, etc. can also be provided. Alternatively, the intelligent assistant control 10b-2 can be directly set to trigger the quick generation of one or more properties of text content, images, and documents to better meet the actual user's needs.

[0134] See also Figure 3 , which exemplifies a scenario diagram for quickly inputting information based on a global intelligent assistant.

[0135] It should be noted that compared with Figure 2a and Figure 2b In the embodiment shown, the smart assistant is integrated into the keyboard corresponding to the input method (hereinafter referred to as: local smart assistant, which can be used when the keyboard corresponding to the input method is displayed). Figure 3 The smart assistant in the illustrated embodiment is not integrated into the keyboard corresponding to the input method (hereinafter referred to as: global smart assistant, which can be called up and used in any interface).

[0136] In addition, it should be noted that when using the global intelligent assistant to quickly input information, you can trigger the generation of text content based on the global intelligent assistant, you can trigger the generation of pictures based on the global intelligent assistant, and you can also trigger the generation of documents based on the global intelligent assistant. Figure 1 、 Figure 2a 、 Figure 2b In the interface shown, you can also trigger quick text content, and / or pictures, and / or documents based on the global smart rental and sales. However, the global smart assistant does not need to be specifically set to be displayed in the keyboard area.

[0137] For ease of explanation, the embodiment of the present application takes triggering the generation of pictures based on a global intelligent assistant as an example.

[0138] In addition, it should be noted that Figure 3 The interfaces 10c to 60c shown in the figure can be understood as a series of SMS editing interfaces (or SMS chat interfaces) involved in the process of a user using a SMS application to send a SMS message to Petter.

[0139] See also Figure 3 In (1), for example, after the user receives the text message sent by Petter, in order to further confirm with Petter, the user can press and hold the power button for 1 second, or speak the voice wake-up word of the global intelligent assistant. In response to the user operation, the mobile phone will wake up the global intelligent assistant and display the global intelligent assistant operation window 10c-3 on the current interface. That is, the user interface of the mobile phone will change from interface 10c to Figure 3 Interface 20c shown in (2).

[0140] See also Figure 3 In (2), for example, the global intelligent assistant operation window 10c-3 may include one or more of the prompt information displayed in the dotted box 10c-31, the voice input control 10c-32, the image input control 10c-33, the intelligent information generation control 10c-34, etc.

[0141] The prompt information displayed in the dotted frame 10c-31 can be information that prompts the user to trigger an operation. In actual use, the prompt information in the dotted frame 10c-31 can be any set content and is not limited to the content displayed in the interface 20b.

[0142] It should be noted that the dotted line displayed in the global intelligent assistant operation window 10c-3 is only for illustration. That is, in actual use, the dotted box 10c-31 is not displayed in the global intelligent assistant operation window 10c-3, but the prompt information is directly displayed in the area.

[0143] In addition, it should be noted that the dotted lines shown in other schematic diagrams of the embodiments of the present application are only for illustration purposes, that is, they are not shown in actual use.

[0144] Among them, the voice input control 10c-32 is used to trigger the voice collection operation, that is, after the user operates the voice input control 10c-32, the mobile phone calls the audio module to collect voice.

[0145] Among them, the picture input control 10c-33 is used to trigger the picture collection operation, that is, after the user operates the picture input control 10c-33, the mobile phone calls the camera to collect pictures.

[0146] Continue to see Figure 3 In (2), for example, when the user clicks the voice input control 10c-32, the mobile phone responds to the user operation and calls the audio module. Taking the called audio module as a microphone as an example, after collecting voice data through the microphone, the mobile phone can perform voice-to-text processing on the voice data, obtain the corresponding text content, and display the obtained text content in the global intelligent assistant operation window 10c-3. For example, the obtained text content is displayed in the dotted box 10c-35 in the global intelligent assistant operation window 10c-3. For details, please refer to Figure 3 The global intelligent assistant operation window 10c-3 displayed on the middle (3) interface 30c.

[0147] See also Figure 3 In (3), for example, when the text content obtained by voice-to-text processing is displayed in the dotted box 10c-35, when the user clicks the intelligent information generation control 10c-34, the mobile phone responds to the user operation and can display Figure 3 The interface 40c shown in (4) is shown in FIG. That is, the global intelligent assistant operation window 10c-3 can be changed to the global intelligent assistant operation window 10c-3'.

[0148] See also Figure 3 In (4), for example, the global intelligent assistant operation window 10c-3' displays pictures related to the text content displayed in the dotted box 10c-35, such as picture A, picture B, picture C, and picture D shown in interface 40c. Among them, picture A, picture B, picture C, and picture D are different pictures, but all include elements related to the text content displayed in the dotted box 10c-35.

[0149] In addition, it should be noted that in some embodiments of the present application, after the user clicks the intelligent information generation control 10c-34, the prompt information displayed in the dotted box 10c-31 can be adaptively changed according to the text content displayed in the dotted box 10c-35. For example, when "Create image of tennis with pickles." is displayed in the dotted box 10c-35, the prompt information displayed in the dotted box 10c-31 can be updated to the prompt information in the dotted box 10c-31' to indicate that the completed operation is based on the user instruction (the text content in the dotted box 10c-35).

[0150] Continue to see Figure 3 In (4), for example, the global intelligent assistant operation window 10c-3' may also include a control 10c-36 (used to generate more pictures related to the prompt after being triggered) and a sharing control 10c-37.

[0151] It should be noted that when the global intelligent assistant operation window 10c-3' is displayed, the keyboard corresponding to the input method is folded (or retracted). Therefore, in order to better meet user needs, the global intelligent assistant operation window 10c-3' can also display a keyboard input control 10c-38. Among them, when the user clicks the keyboard input control 10c-38, the mobile phone will pull up the keyboard corresponding to the input method in response to the user operation.

[0152] Continue to see Figure 3 In (4), for example, when the user clicks on the picture 10c-39 (i.e., picture D) displayed in the global intelligent assistant operation window 10c-3', the picture 10c-39 will be in a selected state, for example, the picture 10c-39 shown in the global intelligent assistant operation window 10c-3' is updated to the picture 10c-39' shown in the global intelligent assistant operation window 10c-3".

[0153] See also Figure 3 In (5), for example, when the user clicks the share control 10c-37, the mobile phone responds to the user operation by adding the user-selected picture 10c-39 to the text input box 10c-1 and closing the global smart assistant. For example, the user interface of the mobile phone will be updated from interface 50c to Figure 3 Interface 60c shown in (6).

[0154] Among them, after clicking the sharing control 10c-37, the interface and operations involved in the process of adding the picture 100c-39 to the text input box 10c-1 can be referred to the operation logic of the sharing entrance provided by the application that supports the sharing function installed in the current mobile phone, which will not be repeated here.

[0155] For example, the text input box displaying the picture 10c-39 (such as a thumbnail) can be as follows Figure 3 In (6), a text input box 10c-1' is shown.

[0156] For example, in some embodiments of the present application, to facilitate user operation, when the display image 10c-39 is displayed in the text input box 10c-1', a delete control 10c-4 may also be displayed in the upper right corner of the display image 10c-39. When the user clicks the delete control 10c-4, the mobile phone deletes the display image 10c-39 from the text input box 10c-1' in response to the user operation, i.e., the text input box 10c-1' is restored to the text input box 10c-1.

[0157] For example, when the user clicks the send control 10c-2 in the interface 60c, the mobile phone will send the picture 10c-39 displayed in the text input box 10c-1' to Petter in response to the user operation.

[0158] Understandably, after the message is successfully sent, the picture will appear in the SMS chat interface between the user and Petter (not shown in the figure).

[0159] It should be understood that the above description is only an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment. In actual applications, when the display image 10c-39 is displayed in the text input box 10c-1', the user can also operate the keyboard to input text content in the text input box 10c-1', or switch out the global intelligent assistant again, quickly generate text content based on the global intelligent assistant, and then copy the generated text content to the text input box 10c-1'. In the process of quickly generating text content based on the global intelligent assistant, the user's user instruction (the text content displayed in the dotted box 10c-35) can, for example, indicate that the content to be generated is text content. For other implementation details, please refer to Figure 3 The description of the illustrated embodiment will not be repeated here.

[0160] Therefore, based on the global intelligent assistant, by inputting simple prompts, content related to the prompts can be quickly generated.

[0161] See also Figure 4 , which exemplifies another global intelligent assistant, a schematic diagram of a scenario for quickly inputting information.

[0162] For the sake of convenience, this application embodiment only takes the triggering and generating of text content based on the global intelligent assistant as an example. Figure 4 The scenario shown can also generate pictures and / or documents based on the global intelligent assistant.

[0163] It should be noted that Figure 4 Interfaces 10d to 30d shown in the figure can be understood as user interfaces involved in using a global intelligent assistant when a user uses a video application and watches a video.

[0164] See also Figure 4 In (1), for example, when a user is viewing a sports event and clicks on the discussion content editing area 10d-1, the mobile phone responds to the user operation and pops up a discussion content editing window 10d-2 on the current interface, as shown in FIG. Figure 4 As shown in the interface 20d shown in (2).

[0165] For example, when the user interface of the mobile phone is interface 20d, after the user wakes up the global intelligent assistant or the mobile phone automatically wakes up the global intelligent assistant, the user interface of the mobile phone will display the global intelligent assistant operation window 10d-3. That is, the user interface of the mobile phone will be updated from interface 20d to Figure 4 Interface 30d shown in (3).

[0166] See also Figure 4 In (3), for example, the global intelligent assistant operation window 10d-3 may include one or more of the prompt information displayed in the dotted box 10d-31, the voice input control 10d-32, the image input control 10d-33, the intelligent information generation control 10d-34, etc.

[0167] For example, in some embodiments of the present application, the controls in the global intelligent assistant operation window 10d-3 are the same as the controls in the global intelligent assistant operation window 10c-3. For details on the uses of the controls in the global intelligent assistant operation window 10d-3, please refer to Figure 3 The description of the global intelligent assistant operation window 10c-3 in the illustrated embodiment will not be repeated here.

[0168] Continue to see Figure 4 In (3), for example, when the user clicks the voice input control 10d-32, the mobile phone responds to the user operation and calls the audio module. Still taking the called audio module as a microphone as an example, after collecting voice data through the microphone, the mobile phone can perform voice-to-text processing on the voice data, obtain the corresponding text content, and display the obtained text content in the global intelligent assistant operation window 10d-3. For example, the obtained text content is displayed in the dotted box 10d-35 in the global intelligent assistant operation window, which can be seen in detail. Figure 4 The global intelligent assistant operation window 10c-3' displayed on the middle (4) interface 40d.

[0169] See also Figure 4In (4), for example, when the text content obtained by voice-to-text processing is displayed in the dotted box 10d-35, when the user clicks the intelligent information generation control 10d-34, the mobile phone responds to the user operation and can display Figure 4 Interface 50d shown in (5). That is, the global intelligent assistant operation window 10d-3' can be changed to the global intelligent assistant operation window 10d-3".

[0170] See also Figure 4 In (5), illustratively, the global intelligent assistant operation window 10d-3" displays text content related to the text content displayed in the dotted box 10d-35.

[0171] Continue to see Figure 4 In (5), for example, the global intelligent assistant operation window 10d-3" may also include a control 10d-36 (used to generate more text content related to the prompt after being triggered) and a sharing control 10d-37.

[0172] It should be noted that when the global intelligent assistant operation window 10d-3" is displayed, the keyboard corresponding to the input method is folded (or retracted). Therefore, in order to better meet user needs, the keyboard input control 10d-38 can also be displayed in the global intelligent assistant operation window 10d-3". Among them, when the user clicks the keyboard input control 10d-38, the mobile phone will pull up the keyboard corresponding to the input method in response to the user operation.

[0173] Continue to see Figure 4 In (5), for example, when the user clicks on the text content displayed in the global intelligent assistant operation window 10d-3", such as the second text content, and then clicks on the sharing control 10d-37, the mobile phone responds to the user operation, adds the text content selected by the user to the discussion content editing window, and closes the global intelligent assistant. For example, the user interface of the mobile phone will be updated from interface 50d to Figure 4 The interface 60d shown in (6) is shown in FIG. That is, the discussion content editing window 10d-2 is updated to the style of the discussion content editing window 10d-2'.

[0174] For example, when the user interface of the mobile phone is interface 60d, the user clicks the "Publish" control in the discussion content editing window 10d-2'. In response to the user operation, the mobile phone can publish the comment content to the discussion area of interface 10d (not shown in the figure).

[0175] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment. In actual applications, when the second text content copied from the global intelligent assistant operation window 10d-3" is displayed in the discussion content editing window 10d-2', the user can also add other content in the discussion content editing window 10d-2' based on the controls provided in the current interface (such as "picture", "expression", "time mark", "screenshot stills" and other controls) or keyboard, and / or swap out the global intelligent assistant again, quickly generate a picture based on the global intelligent assistant, and then copy the generated picture to the discussion content editing window 10d-2'.

[0176] Therefore, based on the global intelligent assistant, by inputting simple prompts, content related to the prompts can be quickly generated.

[0177] See also Figure 5 , which exemplifies another global intelligent assistant, a schematic diagram of a scenario for quickly inputting information.

[0178] For the sake of convenience, the embodiment of this application only takes the triggering of viewing document content and generating corresponding text content based on the global intelligent assistant as an example. Figure 5 The scenario shown can also be based on the global intelligent assistant to identify and process the image and / or text content, and then make corresponding responses.

[0179] It should be noted that Figure 5 Interfaces 10e to 30e shown in the figure can be understood as user interfaces involved in using the global intelligent assistant when a user uses a document application to view a PDF document.

[0180] See also Figure 5 In (1), for example, when a user uses a document application to view a PDF (Portable Document Format) file, such as a Pickleball document.pdf, after the user invokes the global intelligent assistant or the mobile phone automatically invokes the global intelligent assistant, the current interface, such as interface 10e, may display the global intelligent assistant operation window 10e-1.

[0181] Continue to see Figure 5 In (1), for example, the global intelligent assistant operation window 10e-1 may include a dotted box 10e-11, a voice input control 10e-13, an image input control 10e-14, an intelligent information generation control 10e-14, and a currently viewed file 10e-12.

[0182] For example, in some embodiments of the present application, the controls in the global intelligent assistant operation window 10e-1, such as the dotted box 10e-11, the voice input control 10e-13, the image input control 10e-14, and the intelligent information generation control 10e-14 are the same as the corresponding controls in the global intelligent assistant operation window 10c-3. For details on the uses of the dotted box 10e-11, the voice input control 10e-13, the image input control 10e-14, and the intelligent information generation control 10e-14, please refer to Figure 3 The description of the global intelligent assistant operation window 10c-3 in the illustrated embodiment will not be repeated here.

[0183] Continue to see Figure 5 In (1), for example, when the user clicks the voice input control 10e-13, the mobile phone responds to the user operation and calls the audio module. Still taking the called audio module as a microphone as an example, after collecting voice data through the microphone, the mobile phone can perform voice-to-text processing on the voice data, obtain the corresponding text content, and display the obtained text content in the global intelligent assistant operation window 10e-1. For example, the obtained text content is displayed in the dotted box 10e-16 in the global intelligent assistant operation window, which can be seen in detail. Figure 5 (2) The global intelligent assistant operation window 10e-1' displayed on the interface 20e.

[0184] See also Figure 5 In (2), for example, when the text content obtained by voice-to-text processing is displayed in the dotted box 10e-16, when the user clicks the intelligent information generation control 10e-14, the mobile phone responds to the user operation and can display Figure 5 Interface 30e shown in (3). That is, the global intelligent assistant operation window 10e-1' can be changed to the global intelligent assistant operation window 10e-1".

[0185] See also Figure 5 In (3), illustratively, the global intelligent assistant operation window 10e-1" displays text content found from the Pickleball document .pdf that is related to the text content displayed in the dotted box 10e-16.

[0186] Continue to see Figure 5 In (3), for example, the global intelligent assistant operation window 10e-1" may also include a sharing control 10e-18 and a copy control 10e-19.

[0187] It should be noted that when the global intelligent assistant operation window 10e-1" is displayed, the keyboard corresponding to the input method is folded (or retracted). Therefore, in order to better meet user needs, the keyboard input control 10e-17 can also be displayed in the global intelligent assistant operation window 10e-1". Among them, when the user clicks the keyboard input control 10e-17, the mobile phone will pull up the keyboard corresponding to the input method in response to the user operation.

[0188] Continue to see Figure 5 In (3), for example, when the user clicks the sharing control 10e-18, the mobile phone responds to the user operation and shares the text content displayed in the dotted box 10e-11' to the target application, such as any application installed in the mobile phone.

[0189] For example, when the user clicks the copy control 10e-19, the mobile phone will copy the text content displayed in the dotted box 10e-11' in response to the user operation. After the user opens the target application, the text content displayed in the dotted box 10e-11' can be pasted to the target location through the paste operation.

[0190] It should be understood that the above description is only an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. In actual applications, based on the global intelligent assistant, relevant pictures can also be found in the document and the found pictures can be pasted to the target location.

[0191] Therefore, based on the global intelligent assistant, by entering simple prompts, you can quickly query and obtain the target answer from the selected document.

[0192] pass Figure 2a 、 Figure 2b 、 Figure 3 、 Figure 4 and Figure 5 As can be seen from the description of the illustrated embodiments, the content generated by the intelligent assistant is often only related to the creation type and / or prompt selected by the user, and is still poorly related to the app the user is currently using or the content being viewed. In other words, it cannot fully meet the user's usage needs.

[0193] In view of this, an embodiment of the present application provides a quick input method, which aims to enable the input method (which can be understood as a local entrance) or voice assistant (which can be understood as a global entrance) to automatically generate appropriate information based on the currently used application and the content displayed on the screen, so as to improve input efficiency and meet user needs.

[0194] In order to better understand the technical solutions provided by the embodiments of the present application, before describing the technical solutions of the embodiments of the present application, the hardware structure of the electronic devices (such as mobile phones, tablet computers, touch-screen PCs, etc.) to which the embodiments of the present application are applicable is first described with reference to the accompanying drawings. Figure 6 Let’s take a mobile phone as an example.

[0195] See also Figure 6 The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0196] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0197] Continue to see Figure 6 Exemplarily, the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (AP), a modem processor (Modem), a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a neural-network processing unit (NPU), etc., which are not listed here one by one and are not limited in this application.

[0198] In some embodiments of the present application, different processing units may be independent devices. That is, each processing unit may be considered a processor. In other embodiments of the present application, different processing units may also be integrated into one or more processors.

[0199] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0200] In addition, the processor 110 may further include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc., which are not listed here one by one and are not limited in this application.

[0201] In addition, processor 110 may also be provided with a memory for storing instructions and data. In some embodiments of the present application, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of processor 110, and thus improves system efficiency.

[0202] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage.

[0203] Among them, the internal memory 121 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function, etc. The data storage area can store data created during the use of the electronic device 100, etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0204] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0205] like Figure 6 As shown, illustratively, the mobile communication module 150 can provide wireless communication solutions including second-generation wireless telephone technology (2G), third-generation mobile communication technology (3G), fourth-generation mobile communication technology (4G), and fifth-generation mobile communication technology (5G) for application on the electronic device 100.

[0206] It should be noted that, in some embodiments of the present application, at least some functional modules of the mobile communication module 150 may be set in the processor 110 .

[0207] In some other embodiments of the present application, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be set in the same device.

[0208] like Figure 6As shown, exemplarily, the wireless communication module 160 can provide wireless communication solutions applied to the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc.

[0209] It should be noted that in some embodiments of the present application, configuration information of applications that support the use of the quick input solution provided by the embodiments of the present application (which can be understood as: whitelist applications) can be configured in the server. In this way, the electronic device 100 can communicate with the server through the mobile communication module 150 or the wireless communication module 160 to obtain the whitelist application from the server to the local electronic device 100, such as the storage data area of the internal memory 121. In this way, the electronic device 100 can automatically and quickly input text content suitable for the current scene based on the quick input method provided by the present application when the currently used application is a whitelist application.

[0210] In addition, it should be noted that the server storing the whitelist application can be a physical server or a motion server.

[0211] Continue to see Figure 6 For example, the audio module 170 may include a speaker 170A, a receiver 170B, a microphone 170C, an earphone jack 170D, and the like.

[0212] Among them, the sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., which are not listed here one by one and are not limited in this application.

[0213] The camera 193 is used to capture still images or videos. The electronic device 100 can implement the shooting function through the ISP, camera 193, video codec, GPU, display 194, and application processor. In some embodiments of the present application, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0214] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments of the present application, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1. The electronic device 100 may implement a display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0215] Furthermore, it should be noted that operating systems run on top of the aforementioned components. Examples include the iOS operating system developed by Apple, the open-source Android operating system developed by Google, and the Windows operating system developed by Microsoft. These operating systems can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture.

[0216] For ease of explanation, the embodiment of the present application takes the Android system with a layered architecture as an example to exemplify the software structure of the electronic device 100.

[0217] It should be noted that although the embodiments of the present application are described using the Android system as an example, its basic principles are also applicable to electronic devices based on operating systems such as iOS or Windows.

[0218] See also Figure 7 , which is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0219] like Figure 7 As shown, the layered architecture of the electronic device 100 divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments of the present application, the Android system is divided into five layers, from top to bottom: the application layer, the application framework layer, the Android runtime (Android runtime) and system library, the hardware abstraction layer (HAL), and the kernel layer.

[0220] The application layer can include a series of application packages. Figure 7 As shown, the application package may include applications such as input method and voice assistant.

[0221] Continue to see Figure 7For example, specifically in the technical solution provided in the embodiment of the present application, the application layer may also include an intelligent processing module (also referred to as: AI module) for implementing the quick input solution provided in the embodiment of the present application, a feature extraction module, a prompt processing module, a text generation module, etc.

[0222] The intelligent processing module, feature extraction module, prompt processing module, and text generation module can be called by applications installed in the application layer, and then use the shortcut input solution to achieve quick information input. For example, they can be called by various input method applications or voice assistants.

[0223] Among them, in the embodiment provided in this application, the intelligent processing module is used to implement functions such as status monitoring, information input, and user interface (UI) processing.

[0224] Among them, in the embodiment provided in this application, the feature extraction module is used to extract text content, page features, etc.

[0225] Among them, in the embodiment provided in the present application, the prompt processing module is used to construct the prompt according to the features prepared in advance by the feature extraction module.

[0226] It should be noted that, in the embodiments provided in this application, prompts may include user prompts and system prompts.

[0227] Among them, in the embodiment provided in this application, the text generation module is used to generate text content according to the prompt.

[0228] In addition, it should be noted that in the embodiments provided in this application, the intelligent processing module, feature extraction module, prompt processing module, and text generation module can be understood as software development kits (SDKs) that provide corresponding functions. That is, in some embodiments of this application, the intelligent processing module can be understood as an AI SDK, the feature extraction module can be understood as a feature extraction SDK (such as a computer vision (CV) SDK), the prompt processing module can be understood as a prompt SDK (Prompt SDK), and the text generation module can be understood as a text generation SDK (in some embodiments, for example, a large language model (LLM) SDK).

[0229] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. In some embodiments of the present application, these programming interfaces and programming frameworks can be described as functions. Figure 7As shown, the application framework layer may include window management services, input method management services, view system, etc.

[0230] Among them, in the embodiment provided by the present application, the window management service can obtain window information so that the intelligent processing module can process according to the window information, such as drawing and updating the UI.

[0231] Among them, in the embodiment provided by the present application, the input method management service can monitor input events so that when the use of the input method application is monitored, the keyboard corresponding to the input method is pulled up so that the user can use the keyboard corresponding to the input method to input information.

[0232] The Android Runtime includes the core library and virtual machine. The Android Runtime is responsible for scheduling and management of the Android system.

[0233] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0234] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0235] The system library can include multiple functional modules, such as a surface manager, media libraries, a 3D graphics processing library (e.g., OpenGL ES), and a 2D graphics engine (e.g., SGL).

[0236] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0237] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0238] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0239] It can be understood that the 2D graphics engine mentioned above is a drawing engine for 2D drawing.

[0240] Among them, the kernel layer is the layer between hardware and software, including various hardware drivers and hardware management. Figure 7As shown, the kernel layer may include display driver, sensor driver, camera driver, power management driver, etc.

[0241] This concludes the introduction to the software structure of the electronic device 100. It is understood that: Figure 7 The layers in the illustrated software structure and the components contained in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.

[0242] by Figure 6 The hardware structure shown and Figure 7 The electronic device with the software structure shown is a mobile phone as an example, and the quick input solution provided in the embodiment of the present application is specifically described with reference to the accompanying drawings.

[0243] See also Figure 8a and Figure 8b , exemplarily illustrates a scenario diagram of quickly inputting information based on the quick input method provided in an embodiment of the present application. Specifically in this embodiment, the quick input method is triggered and called by an input method application installed in the mobile phone.

[0244] It should be noted that Figure 8a and Figure 8b The interfaces 10f to 80f shown in FIG. 8 can be understood as chat interfaces of instant messaging applications.

[0245] For example, in the embodiment of the present application, the chat interface can be understood as an interface that can display chat content and can conduct conversations (send and receive new chat content).

[0246] Exemplarily, in some embodiments of the present application, the chat interface may be an interface in which the user is currently having a conversation (chat) with a certain friend.

[0247] For example, in other embodiments of the application, the chat interface may be the interface of a chat group currently opened by the user.

[0248] For ease of explanation, the embodiment of the present application takes the chat interface as the interface corresponding to the chat group "group chat" as an example for specific explanation.

[0249] See also Figure 8a In (1), for example, in the case of the mobile phone's user interface display interface 10f, when the user clicks the text input box 10f-1, the mobile phone responds to the user operation and, in some embodiments of the present application, calls up the keyboard corresponding to the input method, such as Figure 8a(2) The keyboard 10f-2 shown in the interface 20f, and the position information of the quick input control is determined according to the window information corresponding to the keyboard 10f-2.

[0250] Further, after determining the position information of the quick input control, the quick input control will be displayed at the determined position information. In this embodiment, taking the determined position information as the bottom of the keyboard 10f-2 as an example, the displayed quick input control can be as follows: Figure 8a The quick input control 10f-3 shown in the interface 30f in (3).

[0251] For example, in other embodiments of the present application, when a user clicks on text input box 10f-1, the mobile phone, in response to the user operation, can directly determine the location information of the quick input control based on the window information of keyboard 10f-2 before displaying keyboard 10f-2, and then directly display quick input control 10f-3 when keyboard 10f-2 is displayed. That is, when a user clicks on text input box 10f-1, the mobile phone, in response to the user operation, directly updates the user interface from interface 10f to interface 30f.

[0252] Understandably, in the implementation in which the user interface is directly updated from interface 10f to interface 30f, after the user clicks the text input box 10f-1, the time it takes for the user interface to change is longer than the time required for interface 10f to be updated to interface 20f.

[0253] See also Figure 8a In (3), for example, when multiple chat contents have been displayed in the interface 30f, in order to quickly generate chat content related to the chat content displayed in the interface 30f (which can be one or more of text content, pictures, and documents), the user can enable the quick input function through the quick input control 10f-3 displayed in the interface 30f.

[0254] Continue to see Figure 8a In (3), for example, after the user clicks the quick input control 10f-3, the mobile phone responds to the user operation and can display the following Figure 8a Interface 40f is shown in (4).

[0255] See also Figure 8a In (4), illustratively, the interface 40f may include a display element 10f-9 and a window W1 displayed on the display element 10f-9.

[0256] The display elements 10f - 9 may be understood as interfaces after the interface 30f is processed, and all elements included therein may be the same as the elements included in the interface 30f.

[0257] Optionally, in some embodiments of the present application (processing method 1), the processing performed on the interface 30f is, for example, to add a mask layer (the same size as the interface 30f) on the interface 30f after the user clicks the quick input control 10f-3, and then draw the corresponding message box in the mask layer according to the coordinate information of the message box displaying the chat content in the interface 30f, and display the corresponding chat content in the drawn message box. In this way, the display element 10f-9 in the interface 40f is obtained. For ease of explanation, the subsequent embodiments directly use the mask layer to refer to the display element, that is, the display element 10f-9 can be called the mask layer 10f-9. The mask layer 10f-9' and the mask layer 10g-4 that appear subsequently can also be expressed as display element 10f-9' and display element 10g-4.

[0258] It can be understood that adding a mask layer to the interface 30f can be understood as adding a layer with a certain degree of transparency to the interface 30f. The elements of the interface 30f displayed below this layer cannot be operated by the user, but the elements drawn on this layer, such as the message box mentioned above, can be operated by the user, such as selecting or deselecting.

[0259] Optionally, in other embodiments of the present application (processing method 2), the processing performed on interface 30f is, for example, to first take a full-screen screenshot of interface 30f after the user clicks the quick input control 10f-3, then overlay the full-screen screenshot on interface 30f, and add a mask layer (the same size as interface 30f) on the full-screen screenshot. Then, based on the coordinate information of the message box of each chat content extracted from the full-screen screenshot, the corresponding message box is drawn in the mask layer, and the corresponding chat content is displayed in the drawn message box. In this way, it is ensured that the mask layer 10f-9 will not change during the process of generating content using the quick input function. That is, even if new chat content is received, it will not affect the elements displayed in the mask layer 10f-9.

[0260] Optionally, in other embodiments of the present application (processing method 3), the processing performed on the interface 30f is, for example, to first take a full-screen screenshot of the interface 30f after the user clicks the quick input control 10f-3, and then blur or virtualize the full-screen screenshot, and overlay the processed full-screen screenshot on the interface 30f, and then draw the corresponding message box in the mask layer according to the coordinate information of the message box of each chat content extracted from the full-screen screenshot, and display the corresponding chat content in the drawn message box.

[0261] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0262] Window W1 can be understood as a window corresponding to the quick input function. In some embodiments of the present application, window W1 can be a floating window. That is, window W1 can be displayed at any position of the mask layer 10f-1.

[0263] Continue to see Figure 8a In (4), illustratively, the window W1 may include one or more controls, such as a quick input text display box 10f-5, a select all control 10f-6, a deselect all control 10f-7, a prompt window 10f-8, and the like.

[0264] Continue to see Figure 8a In (4), for example, when the user does not select the chat content in any message box in the interface 40f, the prompt content displayed in the prompt window 10f-8 is, for example, "Please select text content."

[0265] Continue to see Figure 8a In (4), for example, when the user clicks the select all control 10f-6, the mobile phone selects all message boxes displayed in the interface 40f in response to the user operation. In this case, the user interface of the mobile phone can be changed from the interface 40f to Figure 8a As shown in the interface 50f shown in (5).

[0266] In addition, it should be noted that the user can also click on the message box in the interface 40f as needed to select the clicked message box. Understandably, the selected message box will change from the style shown in the interface 40f to the style shown in the interface 50f.

[0267] Furthermore, it should be noted that after any message box displayed in the interface 40f is selected, the window W1 may also display the generate answer control 10f-10. That is, the window W1 may be changed to the style of the window W2 displayed in the interface 50f.

[0268] See also Figure 8a In (5), for example, when the user clicks the generate answer control 10f-10, the mobile phone will generate text content related to the chat content in the selected message box in response to the user operation, and display the generated text content. For example, the interface 50f will become Figure 8a Interface 60f is shown in (6).

[0269] It should be noted that, in the embodiment of the present application, interface 60f can be understood as an interface displaying window W3 on the aforementioned interface 30f. Window W3 can be understood as the changed window W2. Compared to window W2, in window W3, the generated text content is displayed in the quick input text display box 10f-5, such as the quick input text display box 10f-5' in window W3. The Select All control 10f-6 and Deselect All control 10f-7 in window W2 are hidden in window W3 and replaced by a Reselect control 10f-11.

[0270] Optionally, the prompt content displayed in the prompt window 10f-8 will be updated to prompt the user to reselect, such as "Wrong selection? You can reselect" displayed in the prompt window 10f-8'.

[0271] In the case where the user clicks to reselect the control 10f-11, the mobile phone responds to the user operation and the user interface is restored from the interface 60f to the interface 40f.

[0272] Continue to see Figure 8a In (6), for example, when the quick input text display box 10f-5' displays a long text content, a scroll bar 10f-13 may be further displayed in the quick input text display box 10f-5'. That is, the user can slide the text content displayed in the quick input text display box 10f-5' up and down by operating the scroll bar 10f-13, so that the user can view the complete text content.

[0273] Continue to see Figure 8a Medium (6) or Figure 8b In (1), for example, when the generated text content is displayed in the quick input text display box 10f-5', the window W3 may also display an insert control 10f-12. When the user clicks the insert control 10f-12, the mobile phone may copy the text content displayed in the quick input text display box 10f-5' to the text input box 10f-1 in response to the user operation (e.g., Figure 8b (2) as shown in the text input box 10f-1' in the interface 70f.

[0274] It should be noted that the text input box 10f-1 (or text input box 10f-1') can automatically wrap according to the length of the text content.

[0275] In addition, it should be noted that as the text content in the text input box 10f-1' automatically wraps, the area displaying the chat content in the current interface gradually becomes smaller, and the chat content in this area will be pushed up, that is, the chat content at the top will be fixed to the visible area.

[0276] See also Figure 8b In (2), for example, when the user clicks the "Send" button, the mobile phone can send the text content displayed in the text input box 10f-1' to the chat content display area of the current interface, such as the area above the text input box 10f-1, in response to the user operation.

[0277] For example, after the text content displayed in the text input box 10f-1' is sent to the chat content display area of the current interface, the user interface of the mobile phone will change from interface 70f to Figure 8b Interface 80f shown in (3).

[0278] In addition, it should be noted that when the quick input control 10f-3 is displayed, a back control may also be displayed in the current interface, such as the back control 10f-4 in interface 30f. When window W1, window W2, or window W3 is displayed in the current interface, after clicking the back control 10f-4, the mobile phone, in response to the user operation, cancels the display of window W1, window W2, or window W3 in the current interface, for example, the user interface is restored from interface 40f, interface 50f, or interface 60f to interface 30f.

[0279] It should be understood that the above description is merely an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. In actual applications, based on the chat content in the message box selected by the user in interface 40f, not only text content but also images, documents, etc. can be generated.

[0280] The following combination Figure 9a and Figure 9b ,right Figure 8a and Figure 8b The specific processing logic for implementing quick input in the shown scenario is explained.

[0281] See also Figure 9a The quick input method provided in the embodiment of the present application specifically includes:

[0282] S101: The input method management service registers an input method monitor for an input method application.

[0283] For example, in some embodiments of the present application, when an electronic device, such as a mobile phone, is started, the input method application can call the user status monitoring interface / function / method provided in the intelligent processing module and send a registration input method monitoring request to the input method management server.

[0284] Understandably, the input method monitoring request can be used to instruct the input method management server to monitor user operations performed by the user in the user interface of the mobile phone, for example, monitoring the user's click operation or touch operation on the text input box 10f-1 displayed in the user interface of the mobile phone, such as the interface 10f.

[0285] Accordingly, after receiving the input method monitoring registration request, the input method management service may send a monitoring registration receipt to the input method application and register the input method monitoring.

[0286] Understandably, the registration monitoring receipt may be used to indicate that the input method management service has successfully received the registration input method monitoring request sent by the input method application through the status monitoring interface / function / method provided by the intelligent processing module.

[0287] Furthermore, it is also understood that in the embodiment of the present application, the input method application calls the interface / function / method provided by the intelligent processing module for status monitoring to send a registration input method monitoring request to the input method management server. Therefore, the registration monitoring receipt sent by the input method management service can specifically be sent to the intelligent processing module.

[0288] S102: After registering the input method monitoring, the input method management service pops up the keyboard corresponding to the input method when monitoring the user operation on the text input box corresponding to the input method.

[0289] It should be noted that the user operation on the text input box corresponding to the input method, such as the text input box 10f-1 in the interface 10f, can be a click operation, a touch operation, etc.

[0290] In addition, it should be noted that in the technical solution provided in the embodiment of the present application, the input method application can be any input method application installed in the mobile phone, that is, it can be a system input method application (provided by the mobile phone manufacturer) or a third-party input method application (provided by other manufacturers).

[0291] In addition, it should be noted that in the technical solution provided in the embodiment of the present application, the keyboard corresponding to the input method, such as the keyboard 10f-2 in the interface 20f, can be understood as a soft keyboard.

[0292] For the specific implementation logic of the Input Method Manager Service (IMMS) invoking the keyboard corresponding to the input method, please refer to the usage documentation of the Input Method Management Server, Input Method Service (IMS), and Input Method Manager (IMM), which will not be repeated here.

[0293] For example, still taking the text input area clicked by the user as the text input area 10f-1 in the interface 10f, after the input method management service calls up the keyboard 10f-2 corresponding to the input method, the current interface will change from interface 10f to interface 20f.

[0294] S103: When the keyboard corresponding to the input method is displayed, the intelligent processing module obtains the window information of the current interface from the window management service.

[0295] Among them, the window management service is responsible for managing the display and layout of windows. In some embodiments of the present application, the window management service can be understood as a window manager, which is responsible for processing operations such as creating, displaying, hiding, moving, and resizing application windows. Therefore, the intelligent processing module sends a window information acquisition request to the window management service. In response to the request, the window management service can feed back the window information corresponding to the current interface, such as the package name information of the application to which the current interface belongs, and the coordinate information of each control in the interface (such as the coordinate information of each user avatar, message box, text input box, and keyboard in interface 30f) to the intelligent processing module.

[0296] S104: The intelligent processing module determines the location information of the quick input control according to the acquired window information, and transmits the location information to the window management service.

[0297] Specifically, in some embodiments of the present application, the intelligent processing module may determine the position information of the quick input control according to the coordinate information of the keyboard corresponding to the input method.

[0298] Understandably, the quick input control can be understood as an entry for enabling the quick input function provided in the embodiment of the present application, such as the quick input control 10f-3 shown in interface 30f. The description of it as a quick input control in the embodiment of the present application is only for the purpose of better describing the technical solution of the embodiment of the present application and is not intended to limit it.

[0299] For example, in some embodiments of the present application, the intelligent processing module determines the position information of the quick input control based on the coordinate information of the keyboard corresponding to the input method, for example, between the keyboard 10f-2 corresponding to the input method and the text input box 10f-1.

[0300] For example, in some other embodiments of the present application, the intelligent processing module determines the position information of the quick input control based on the coordinate information of the keyboard corresponding to the input method, for example, the position information is located at the bottom of the keyboard 10f-2.

[0301] For example, in other embodiments of the present application, the intelligent processing module determines the position information of the quick input control based on the coordinate information of the keyboard corresponding to the input method, for example, in the form of a floating ball, which appears on the edge of the current interface, such as the right edge or left edge of the current interface.

[0302] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0303] For ease of explanation, the embodiment of the present application takes the position information of the specified quick input control as located at the bottom of the keyboard 10f-2 as an example, that is, the interface of the quick input control 10f-3 is finally displayed, as shown in interface 30f.

[0304] S105: The window management service creates a window for displaying the quick input control according to the location information determined by the intelligent processing module, and displays the quick input control in the created window.

[0305] S106: When a user operation on the quick input control is received, a screenshot of the current interface is taken, and the screenshot of the current interface is transmitted to a feature extraction module.

[0306] It is understandable that the screenshot of the current interface is a full-screen screenshot operation. Figure 8a The screenshot interface 30f mentioned in the illustrated embodiment obtains a full-screen screenshot corresponding to the interface 30f.

[0307] S107, the feature extraction module performs feature extraction processing on the screenshot of the current interface, extracts the text content and page features of the current interface, and transmits the extracted feature information to the intelligent processing module.

[0308] For example, in some embodiments of the present application, the feature extraction module is, for example, a CV SDK, wherein the CV SDK can extract text content contained in the screenshot corresponding to the current interface based on OCR (Optical Character Recognition) technology.

[0309] For example, in some embodiments of the present application, after extracting the text content contained in the screenshot, the feature extraction module can determine the business scenario corresponding to the current interface based on the text content. For example, based on the extracted "group chat," "when was born," "National Day," "CMB or CCB?", "CCB," "What does this mean?", and the user names corresponding to each chat content, such as "Petter," "Alie," "John," etc., the business scenario corresponding to the current interface can be determined to be a chat scenario.

[0310] In addition, the feature extraction module can also process the screenshot based on computer vision and image processing technologies, and then extract the page features of the interface corresponding to the screenshot from the screenshot, such as the coordinate information of the message box corresponding to each chat content, the avatar corresponding to each chat content, the location information of the user name, etc., and can establish a mapping relationship between each message box and the corresponding chat content, avatar, and user name.

[0311] In addition, it should be noted that in some embodiments of the present application, in order to reduce the amount of data processing and increase the speed of feature extraction, the intelligent processing module may only perform feature extraction on the chat content display area.

[0312] For a better understanding, the following Figure 9b Step S107 performed by the feature extraction module is described.

[0313] See also Figure 9b Exemplarily, after the feature extraction module obtains the screenshot corresponding to the current interface, such as the screenshot corresponding to interface 30f, it performs image recognition processing on the screenshot, such as OCR text recognition processing (obtaining text features), and page feature extraction processing, and then obtains the text features and page features included in the screenshot.

[0314] For example, for the screenshot corresponding to interface 30f, the text features extracted by the feature extraction module include, for example, the chat content displayed in message box M1, the chat content displayed in message box M2, the chat content displayed in message box M3, the chat content displayed in message box M4, the chat content displayed in message box M5, etc.

[0315] The page features extracted by the feature extraction module include, for example, a set of coordinate information corresponding to the message box M1, the user name and image corresponding to the message box M1 (the user account name and avatar of the user who sent the chat content in the message box M1), a set of coordinate information corresponding to the message box M2, the user name and image corresponding to the message box M2 (the user account name and avatar of the user who sent the chat content in the message box M2), a set of coordinate information corresponding to the message box M3, the user name and image corresponding to the message box M3 (the user account name and avatar of the user who sent the chat content in the message box M3), a set of coordinate information corresponding to the message box M4, the user name and image corresponding to the message box M4 (the user account name and avatar of the user who sent the chat content in the message box M4), a set of coordinate information corresponding to the message box M5, the user name and image corresponding to the message box M5 (the user account name and avatar of the user who sent the chat content in the message box M5).

[0316] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0317] S108, the intelligent processing module performs masking on the current interface according to the feature information extracted by the feature extraction module, and displays a floating window corresponding to the quick input function on the mask.

[0318] It should be noted that in the embodiment of the present application, masking the current interface can be understood as processing the current interface using processing method 1, processing method 2, or processing method 3 described in the above embodiment.

[0319] For the sake of convenience, this application embodiment takes processing method 2 as an example. Figure 9b Provide specific instructions.

[0320] See also Figure 9b For example, after receiving the feature information extracted by the feature extraction module, the intelligent processing module can first overlay the screenshot corresponding to the current interface. That is, the screenshot corresponding to interface 30f is overlaid on interface 30f, and then a mask is added to the screenshot. Next, based on the feature information extracted by the feature extraction module, each message box included in the screenshot is drawn on the mask, and the corresponding text content, i.e., the chat content, is displayed in the drawn message boxes.

[0321] For example, according to a set of coordinate information of the message box M1, a message box M1' corresponding to the message box M1 is drawn on the mask layer, and the text content extracted from the message box M1 is displayed in the message box M1'.

[0322] For another example, according to a set of coordinate information of the message box M2, a message box M2' corresponding to the message box M2 is drawn on the mask layer, and the text content extracted from the message box M2 is displayed in the message box M2'.

[0323] For another example, according to a set of coordinate information of the message box M3, a message box M3' corresponding to the message box M3 is drawn on the mask layer, and the text content extracted from the message box M3 is displayed in the message box M3'.

[0324] For another example, based on a set of coordinate information of the message box M4, a message box M4' corresponding to the message box M4 is drawn on the mask layer, and the text content extracted from the message box M4 is displayed in the message box M4'.

[0325] For another example, according to a set of coordinate information of the message box M5, a message box M5' corresponding to the message box M5 is drawn on the mask layer, and the text content extracted from the message box M5 is displayed in the message box M5'.

[0326] It should be understood that the above description is merely an example for better understanding the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. In actual applications, the corresponding chat content may not be displayed in the message box drawn in the mask. When the user selects the message box in the mask, the text / image / document generation is triggered. For example, after clicking the Generate Answer control 10f-10, the text content (chat content) corresponding to the selected message box is directly obtained based on the mapping relationship between the feature information fed back by the feature extraction module.

[0327] In addition, it should be understood that since the current chat interface, such as interface 30f, is covered with the full-screen screenshot corresponding to interface 30f, i.e., the size is the same, and the mask is directly added to the entire full-screen screenshot, after the message boxes are drawn in the mask according to the coordinate information of each message box extracted from the full-screen screenshot, the positions of the message boxes displayed in the mask completely overlap with the message boxes in the full-screen screenshot below the mask, such as message box M1' overlaps with message box M1, message box M2' overlaps with message box M2, message box M3' overlaps with message box M3, message box M4' overlaps with message box M4, and message box M5' overlaps with message box M5. In this way, from a visual effect, the same content is displayed in the same position.

[0328] Among them, the floating window corresponding to the quick input function displayed above the mask layer is such as the window W1 displayed in the interface 40f.

[0329] It should be noted that, regarding the message box drawn on the mask, the displayed window W1 can call the UI interface / method / function provided by the intelligent processing module to realize the drawing of these UIs.

[0330] For example, after the intelligent processing module executes step S108, the user interface displayed on the mobile phone is, for example, the interface 40f mentioned in the above embodiment. For a detailed description of the floating window corresponding to the quick input function, please refer to the description of window W1 in the above interface 40f, which will not be repeated here.

[0331] S109: The intelligent processing module displays a text generation control on the current interface in response to the user's selection operation on the content displayed in the mask.

[0332] The user's selection operation on the content displayed in the mask layer is, for example, an operation on the select all control 10f-6 in the interface 40f, or an operation on the five message boxes displayed in the mask layer 10f-9, such as Figure 9b Any one or more of the message boxes M1', M2', M3', M4', and M5' are selected (eg, clicked).

[0333] The text generation control displayed in the current interface is, for example, the generate answer control 10f-10 displayed in the interface 50f.

[0334] Furthermore, in some embodiments of the present application, after a user selects a message box displayed in the overlay, the intelligent processing module will expand the associated content based on the chat content in the selected message box. For example, the sender information corresponding to each chat content will be anonymously completed based on the avatar and nickname (user name).

[0335] It should be noted that, in the embodiment of the present application, anonymous completion based on the avatar and nickname (user name) can be understood as determining the sender of each chat content based on the user name and avatar corresponding to each chat content extracted from the screenshot. Each sender is then assigned a number or identification information to identify the sender. Then, based on the correspondence between each identification information and each sender, and the correspondence between each chat content and each sender, the correspondence between each identification information and each chat content can be established, thereby achieving the ability to identify the relationship between each chat content and the sender without revealing the user's real avatar and name.

[0336] For example, taking the five message boxes displayed in the mask 10f-9 selected by the user as an example, that is, the mask 10f-9 is updated to the mask 10f-9' in the interface 50f, the sender "Petter" of the chat content displayed in the message box M1' and the message box M3' can be identified by "User A", the sender "Alie" of the chat content displayed in the message box M2' and the message box M4' is identified by "User B", and the sender "John" of the chat content displayed in the message box M5' is identified by "User C".

[0337] The final anonymously completed text content (text content after associated content expansion processing) is, for example, "User A: When were you born?", "User B: Eleventh", "User A: China Merchants Bank or CCB?", "User B: CCB", "User C: What does this mean?".

[0338] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0339] Furthermore, in some other embodiments of the present application, the aforementioned related content expansion operation may also be triggered when a user clicks a text generation control displayed in the current interface, such as the answer generation control 10f-10. That is, when the user clicks the answer control 10f-10, the related content expansion operation is first performed, and then step S110 is executed.

[0340] In addition, it should be noted that in order to protect user privacy, the operation of expanding the related content of each chat content based on the avatar and nickname is completed locally on the mobile phone, that is, the recognized avatar, nickname and other user information is not uploaded to the server.

[0341] S110: When the user operates the text generation control, the intelligent processing module sends a prompt construction instruction to the prompt processing module.

[0342] Optionally, in some embodiments of the present application, the prompt construction instruction sent by the intelligent processing module to the prompt processing module carries the chat content in the message box selected in the mask, application information determined based on the page features extracted by the feature extraction module, etc.

[0343] Optionally, in some embodiments of the present application, the chat content in the message box selected in the mask carried in the prompt construction instruction sent by the intelligent processing module to the prompt processing module is specifically the text content after the associated content is expanded (such as anonymous completion, "User A: When were you born?", "User B: Eleventh", "User A: China Merchants Bank or CCB?", "User B: CCB", "User C: What does this mean?").

[0344] For example, in some embodiments of the present application, the determined application information includes, for example, application registration, Avtivity information corresponding to the current interface, and the like.

[0345] S111, the prompt processing module constructs a prompt according to the information carried in the prompt construction instruction, and feeds the constructed prompt back to the intelligent processing module.

[0346] In the embodiment of the present application, in order to ensure that the constructed prompt is valid, the prompt processing module may pre-process the information carried in the prompt construction instruction, such as desensitizing the text content (such as the text content obtained by anonymous completion) and page features.

[0347] Optionally, in some embodiments of the present application, desensitization processing is performed on text content and page features, for example, deleting sensitive words in text content, deleting sensitive features in page features (such as pictures, icons, text, etc.), or replacing these sensitive information.

[0348] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0349] After desensitizing the text content and page features, the desensitized text content can be assembled, for example, into a complete message in chronological order, such as by assembling the corresponding text content in the selected message boxes into a complete message based on the time of receipt. Then, intent recognition processing is performed on the assembled content.

[0350] It is understandable that in some embodiments of the present application, the prompt processing module can call the intention recognition module / model to perform intention recognition processing on the assembled content, and then determine the user intention.

[0351] Finally, after determining the user intent, user prompts can be constructed based on the assembled content and user intent.

[0352] For example, if the assembled content includes "User A: When was he born?", "User B: National Day," "User A: China Merchants Bank or China Construction Bank?", "User B: China Construction Bank," and "User C: What does this mean?", the intent recognition module can first determine the type of each chat content by identifying the content. For example, based on grammar and tone, it can identify "User A: When was he born?", "User A: China Merchants Bank or China Construction Bank?", and "User C: What does this mean?" as question-type sentences, while "User B: National Day" and "User B: China Construction Bank" as statement-type sentences.

[0353] After determining the type of each chat content, the intention recognition module can further identify chat content that belongs to the question type and determine the final question asked. Furthermore, based on the final question asked, the user's intention is determined.

[0354] Illustratively, in some implementations of the present application, when determining the final question to be asked, the timing principle can be followed, that is, the statement of the last question type in the timing sequence is used as the question to be answered, that is, the final question to be asked.

[0355] For example, in other implementations of the present application, when determining the final question to be asked, a complex algorithm can be used to analyze which question-type statements are not closed in the context, i.e., have not received a response (answer), based on the context, and then the unclosed question-type statements are treated as questions to be answered, i.e., the final question to be asked.

[0356] Taking the sentences "User A: When were you born?", "User A: China Merchants Bank or China Construction Bank?" and "User C: What does this mean?" as examples, further analysis shows that the question type identified by the intent recognition module is "User A: When were you born?", "User A: China Merchants Bank or China Construction Bank?" and "User C: What does this mean?".

[0357] Then, the intention recognition module can determine the user intention based on the question. For example, the determined user intention is, for example, "how to answer question C".

[0358] Therefore, after completing the above processing, the prompt processing module can construct the user prompt according to the assembled content and user intention.

[0359] Furthermore, it should be noted that in this embodiment of the present application, the user prompt is determined after processing the chat content in the message box selected by the user in the overlay. It is used to identify or limit the subject of the text content to be generated by the text generation module. In other words, in this embodiment of the present application, the user prompt can be understood as the keyword used by the text generation module to generate text content. In other words, the text generation module derives and expands text content related to the chat content in the selected message box based on the user prompt.

[0360] For example, in some embodiments of the present application, the user prompt (Userprompt) constructed by the prompt processing module may be as follows:

[0361] User prompt{

[0362] User A: When were you born?

[0363] User B: Eleven

[0364] User A: China Merchants Bank or China Construction Bank?

[0365] User B: CCB

[0366] User C: What does this mean?

[0367] How to answer user C's question

[0368] }

[0369] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0370] Furthermore, to make the text content generated based on the prompt more relevant to the current business scenario, the prompt processing module can also generate a system prompt. Specifically, the prompt processing module can determine the type of content to be answered based on the intent recognition module and generate a corresponding system prompt.

[0371] For example, in some embodiments of the present application, system prompts corresponding to different types can be pre-stored in the storage space corresponding to the prompt processing module. In this way, after determining the user's intention, the prompt processing module can search the corresponding storage space for a matching system prompt based on the type of the content to be answered corresponding to the user's intention.

[0372] For example, for question types, a system prompt can be pre-stored: "You are well-versed in history and current events, and are well-educated. Please answer the above questions as objectively and accurately as possible." For writing types, a system prompt can be pre-stored: "You are a professional writer. Based on the information provided, complete a high-quality text output."

[0373] It's also worth noting that if the user's intent is uncertain, the user prompt can be directly assembled text content, and the system prompt defaults to the chat type. For the chat type, a pre-stored message might read, "You are a talkative friend. Please respond to the above message smoothly and coherently, and make the other party want to continue chatting with you."

[0374] In addition, it should be noted that in some embodiments of the present application, as the user uses it, the intention recognition module continuously performs iterative learning. When more types are recognized, the pre-stored system prompts can be expanded according to the recognized types, so as to better adapt to the user's diversified usage needs.

[0375] For example, if the final answer is "What does this mean?" asked by user C, and the chat content is a question, the prompt processing module may determine a system prompt such as "You are well-versed in history and current affairs, and are well-read. Please answer the above question as objectively and accurately as possible." Specifically, the system prompt fed back to the intelligent processing module by the prompt processing module may be as follows:

[0376] System prompt

[0377] You are well-versed in history and knowledge, please answer the above questions as objectively and accurately as possible.

[0378] }

[0379] It should be understood that the above description is merely an example for a better understanding of the technical solution of this embodiment and is not intended to be the sole limitation of this embodiment. In actual applications, system prompts may be pre-defined based on different types, such as "formal," "humorous," or "literary," and this application does not impose any restrictions on this.

[0380] In addition, it should be noted that in actual applications, the system prompts can also be generated in combination with the application information determined by the desensitized page features. That is, when generating the system prompts, not only the type of content to be answered corresponding to the user's intention is considered, but also the application information determined according to the page features (such as the application name), the current corresponding business scenario, etc. are considered. In this way, even if the type of content to be answered corresponding to the user's intention is the same, the system prompts finally generated will be different when the corresponding applications and business scenarios are different. For example, for question-type content to be answered, the system prompts generated for work applications and business scenarios are different from those generated for entertainment applications and business scenarios.

[0381] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0382] For ease of explanation, in this embodiment of the application, the system prompt is determined based on the to-be-answered content corresponding to the user's intent determined by the selected chat content, and the application information and business scenario corresponding to the page features. That is, the system prompt is determined based on the selected chat content and page features, and is used to indicate the creative type to be followed by the text generation model when generating text content.

[0383] S112, the intelligent processing module sends a text generation instruction to the text generation module.

[0384] In an embodiment of the present application, the text generation instruction sent by the intelligent processing module to the text production module may carry, for example, user prompts and system prompts fed back by the prompt processing module.

[0385] For example, the text generation module can parse the following from the text generation instructions:

[0386] User prompt{

[0387] User A: When were you born?

[0388] User B: Eleven

[0389] User A: China Merchants Bank or China Construction Bank?

[0390] User B: CCB

[0391] User C: What does this mean?

[0392] How to answer user C's question

[0393] }

[0394] System prompt

[0395] You are well-versed in history and knowledge, please answer the above questions as objectively and accurately as possible.

[0396] }

[0397] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0398] S113, the text generation module generates text content that meets the user prompt and system prompt requirements according to the prompt carried in the text generation instruction, and feeds the generated text content back to the intelligent processing module.

[0399] Exemplarily, in the embodiments provided in this application, the text generation module is, for example, a Large Language Model (LLM).

[0400] For example, based on the above user prompt, LLM may determine that the answer to be generated is for the text content of "What is the relationship between the birth of a child and China Merchants Bank and China Construction Bank?"

[0401] S114, the intelligent processing module displays the generated text content in the quick input text display box.

[0402] That is, after the user clicks the Generate Answer control in interface 50f, the mobile phone responds to the user operation and executes steps S112 to S114. The corresponding interface changes in this process, for example, the user interface is updated from interface 50f to interface 60f.

[0403] Understandably, after the generated text content is displayed in the quick input text display box, if the user clicks the insert control 10f-12, the mobile phone responds to the user's operation by copying the text content in the quick input text display box 10f-5', pasting the copied text content into the text input box 10f-1, and collapsing the floating window corresponding to the quick input function. For example, when window W3 is collapsed, the user interface updates from interface 60f to interface 70f.

[0404] Therefore, based on the quick input method provided in the embodiment of the present application, information matching the current application and the content displayed on the screen can be quickly generated without the user inputting prompts.

[0405] It should be noted that in the embodiments provided in this application, Figure 9a The shortcut input method provided is for Figure 8a and Figure 8b The scenario shown is a chat scenario using any instant messaging application installed in a mobile phone. In other embodiments of the present application, Figure 9aThe provided quick input method can also be adapted to business scenarios involving other types of applications, such as the discussion forum reply scenario involved in video applications (such as Figure 4 scene shown).

[0406] That is to say, the quick input method provided in the embodiment of the present application can assemble different user prompts and system prompts according to different types of applications, business scenarios, and screen content, and then call the text generation module to generate text content that meets user needs.

[0407] In addition, since the entire process does not require the user to input prompts or select a creation type, it can avoid the situation where the generated text content is not ideal due to inappropriate user input or selection of an inappropriate creation type.

[0408] However, in actual applications, the user may not select all message boxes in the mask 10f-9 through the select all control 10f-6, or the chat content in the selected message box cannot determine the user's intention. This results in the prompt determined based on the text content and page features in the selected message box being inappropriate, and further causes the final generated text content to be unable to match the current APP, business scenario, and screen content, affecting the user experience.

[0409] In view of this, the embodiment of the present application provides a quick input method to solve the above technical problems. Figure 6 The hardware structure shown and Figure 7 The electronic device of the software structure shown is a mobile phone, and the quick input method is triggered by the input method application installed in the mobile phone. Figure 10 The quick input solution provided in the embodiment of the present application is described in detail.

[0410] See also Figure 10 In (1), for example, interface 30f' is similar to interface 30f. Regarding the purpose and usage of the same controls in these two interfaces, please refer to the description of interface 30f in the above embodiment, which will not be repeated here.

[0411] Continue to see Figure 10 In (1), for example, when the user clicks the quick input control 10f-3, the mobile phone responds to the user operation and the user interface of the mobile phone is updated from interface 30f' to Figure 10 Interface 40f' is shown in (2).

[0412] See also Figure 10In (2), for example, interface 40f' is similar to interface 40f. The difference is that, in the embodiment provided by the present application, the floating window corresponding to the quick input function may include not only the quick input text display box 10f-5, the select all control 10f-6, the deselect all control 10f-7, and the prompt window 10f-8, but also a prompt input box 10f-14. That is, in the embodiment of the present application, the floating window displayed on the mask 10f-9 in interface 40f' is window W4.

[0413] The prompt input boxes 10f-14 are used for the user to manually input prompts.

[0414] It should be noted that in some embodiments of the present application, the prompt input box 10f-14 can be an optional option, that is, the user can directly select all the message boxes displayed in the mask 10f-9 through the select all control 10f-6 without entering the prompt in the prompt input box 10f-14, or manually select the message box.

[0415] In addition, it should be noted that before the user enters a prompt in the prompt input box 10f-14, a prompt message such as "Please enter a prompt (optional)" may be displayed in the prompt input box 10f-14 to prompt the user to manually enter a prompt.

[0416] In addition, regarding the purpose of the quick input text display box 10f-5, the select all control 10f-6, the deselect all control 10f-7, and the prompt window 10f-8, the usage can be found in the description of the interface 40f in the above embodiment, and will not be repeated here.

[0417] For example, in some embodiments of the present application, when the user clicks the select all control 10f-6 and selects all the message boxes displayed in the mask 10f-9, the user can use voice input method (focus the cursor on the prompt input box 10f-14, use the voice assistant to recognize the user's voice data, and then convert the corresponding text content as a prompt) or text input method (focus the cursor on the prompt input box 10f-14, pull up the keyboard to enter the corresponding text content as a prompt) to enter the prompt in the prompt input box 10f-14.

[0418] The prompt word entered by the user in the prompt word input box 10f-14 is "What does this mean?", that is, the user interface is Figure 10 Taking the prompt displayed in the prompt input box 10f-14' in the interface 50f' shown in (3) as an example, after the user clicks to generate the answer 10f-10, the mobile phone responds to the user operation and displays the generated text in the quick input text display box 10f-5, as shown in the quick input text display box 10f-5' in the interface 60f.

[0419] Therefore, by constructing the user prompts and system prompts required for the final generated text content based on the message content selected by the user and the prompts entered, it is ensured that the generated text content can not only meet user needs but also be relevant to the current APP, business scenarios and screen content.

[0420] The following combination Figure 11 ,right Figure 10 The specific processing logic for implementing quick input in the shown scenario is explained.

[0421] See also Figure 11 The quick input method provided in the embodiment of the present application specifically includes:

[0422] S201: The input method management service registers an input method monitor for an input method application.

[0423] S202: After registering the input method monitoring, the input method management service pops up the keyboard corresponding to the input method when monitoring the user operation on the text input box corresponding to the input method.

[0424] S203: When the keyboard corresponding to the input method is displayed, the intelligent processing module obtains the window information of the current interface from the window management service.

[0425] S204: The intelligent processing module determines the location information of the quick input control according to the acquired window information, and transmits the location information to the window management service.

[0426] S205: The window management service creates a window for displaying the quick input control according to the location information determined by the intelligent processing module, and displays the quick input control in the created window.

[0427] S206: When a user operation on the quick input control is received, a screenshot of the current interface is taken, and the screenshot of the current interface is transmitted to a feature extraction module.

[0428] S207, the feature extraction module performs feature extraction processing on the screenshot of the current interface, extracts the text content and page features of the current interface, and transmits the extracted feature information to the intelligent processing module.

[0429] It should be noted that steps S201 to S207 in the embodiment of the present application are the same as Figure 9a Steps S101 to S107 in the illustrated embodiment are the same. For specific implementation details, please refer to the description of steps S101 to S107 in the above embodiment, which will not be repeated here.

[0430] S208: The intelligent processing module performs masking on the current interface according to the feature information extracted by the feature extraction module, and displays a floating window corresponding to the quick input function on the mask.

[0431] It should be noted that, in the embodiments provided in this application, the masking process performed on the current interface is the same as Figure 9a The masking process performed in step S108 in the illustrated embodiment is the same. For specific implementation details, please refer to the description of step S108 in the above embodiment, which will not be repeated here.

[0432] Furthermore, it should be noted that, in the embodiment provided herein, the floating window corresponding to the quick input function displayed on the mask is, for example, window W4 displayed in interface 40f'. That is, in the embodiment provided herein, the floating window corresponding to the quick input function includes not only the content in window W1 but also a prompt input box.

[0433] For the relevant introduction of the prompt input box, please refer to the description of the prompt input boxes 10f-14 in the above embodiment, which will not be repeated here.

[0434] S209: The intelligent processing module displays a text generation control on the current interface in response to the user's selection operation on the content displayed in the mask and / or the operation of inputting a prompt in the prompt input box.

[0435] For the sake of convenience, the embodiment of the present application takes the example in which the user selects the content displayed in the mask and enters a prompt in the prompt input box. Figure 10 Interface 50f' is shown in (3).

[0436] Regarding the associated content expansion process performed after the content displayed in the mask is selected, reference may be made to the description of step S109 in the above embodiment, which will not be repeated here.

[0437] S210: When the user operates the text generation control, the intelligent processing module sends a prompt construction instruction to the prompt processing module.

[0438] Understandably, when a prompt is entered in the prompt input box, the prompt construction instruction sent by the intelligent processing module to the prompt processing module will include not only the information and page features selected by the user, but also the prompt entered by the user in the prompt input box.

[0439] S211, the prompt processing module constructs a prompt according to the information carried in the prompt construction instruction, and feeds the constructed prompt back to the intelligent processing module.

[0440] Understandably, after receiving the prompt construction instruction issued by the intelligent processing module, the prompt processing module can also pre-process the information carried in the prompt construction instruction, such as desensitizing the text content and page features. Then, the desensitized content is assembled. Next, the assembled content is processed for intent recognition. Finally, after determining the user intent, a user prompt can be constructed based on the assembled content and user intent, and a system prompt can be constructed based on the page features and user intent.

[0441] For details on how the prompt processing module processes the information carried in the prompt construction instruction, please refer to the description of step S111 in the above embodiment, which will not be repeated here.

[0442] For example, when the user selected the content "User A: When were you born?", "User B: Eleventh", "User A: China Merchants Bank or China Construction Bank?", "User C:?", and the user input the prompt "What does this mean?", and the final question to be answered is how to answer "What does this mean?", the constructed user prompt is, for example:

[0443] User prompt{

[0444] User A: When were you born?

[0445] User B: Eleven

[0446] User A: China Merchants Bank or China Construction Bank?

[0447] User B: CCB

[0448] What does this mean?

[0449] How to answer the question, “What does this mean?”

[0450] }

[0451] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0452] Taking the above user prompt as an example, since the type of content to be answered is a question type, in some embodiments of the present application, the final system prompt may be as follows:

[0453] System prompt

[0454] You are well-versed in history and knowledge, please answer the above questions as objectively and accurately as possible.

[0455] }

[0456] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0457] S212, the intelligent processing module sends a text generation instruction to the text generation module.

[0458] In an embodiment of the present application, the text generation instruction sent by the intelligent processing module to the text production module may carry, for example, user prompts and system prompts fed back by the prompt processing module.

[0459] For example, the text generation module can parse the following from the text generation instructions:

[0460] User prompt{

[0461] User A: When were you born?

[0462] User B: Eleven

[0463] User A: China Merchants Bank or China Construction Bank?

[0464] User B: CCB

[0465] What does this mean?

[0466] How to answer the question, “What does this mean?”

[0467] }

[0468] System prompt

[0469] You are well-versed in history and knowledge, please answer the above questions as objectively and accurately as possible.

[0470] }

[0471] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0472] S213, the text generation module generates text content that meets the user prompt and system prompt requirements according to the prompt carried in the text generation instruction, and feeds the generated text content back to the intelligent processing module.

[0473] S214, the intelligent processing module displays the generated text content in the quick input text display box.

[0474] For specific implementation details of step S213 and step S214, please refer to the description of step S113 and step S114 in the above embodiment, which will not be repeated here.

[0475] Therefore, based on the quick input method provided in the embodiment of the present application, by generating system prompts and user prompts based on the message content selected by the user and the prompt input, as well as the page feature information of the current APP, it is possible to ensure that the generated user prompts and system prompts can not only reflect the user's original intention, but also be relevant to the current APP, business scenario, and screen content. In this way, the text content generated based on the generated user prompts and system prompts can not only meet the user's needs, but also match the current APP, business scenario, and content displayed on the screen, further improving the user experience.

[0476] Furthermore, in order to better enhance the user experience, taking into account different business scenarios and different user speaking styles, in other embodiments of the present application, the quick input method also provides an entry for the user to select a text style. In this way, the user can modify the text style as needed to make the generated text content more meet the user's needs.

[0477] In order to better understand the technical solutions provided by the embodiments of the present application, Figure 6 The hardware structure shown and Figure 7 The electronic device of the software structure shown is a mobile phone, and the quick input method is triggered by the input method application installed in the mobile phone. Figure 12 The quick input solution provided in the embodiment of the present application is described in detail.

[0478] See also Figure 12 In (1), for example, when the user clicks the quick input control 10f-3, the mobile phone responds to the user operation and the user interface of the mobile phone is updated from interface 30f to Figure 12 Interface 40f" shown in (2).

[0479] See also Figure 12 In (2), illustratively, interface 40f" is similar to interface 40f. The difference is that, in the embodiment provided in the present application, the floating window corresponding to the quick input function may include not only the quick input text display box 10f-5, the select all control 10f-6, the deselect all control 10f-7, and the prompt window 10f-8, but also the text style selection control 10f-15. That is, in the embodiment of the present application, the floating window displayed on the mask 10f-9 in interface 40f" is window W5.

[0480] Among them, the text style selection control 10f-15 is used for user operation, and a text style window 10f-16 is popped up on the current interface, such as Figure 12 (3) interface 50f".

[0481] Among them, the purpose of the quick input text display box 10f-5, the select all control 10f-6, the deselect all control 10f-7, and the prompt window 10f-8, and the usage thereof can be referred to the description of the interface 40f in the above embodiment, and will not be repeated here.

[0482] In addition, it is now explained that in some other embodiments of the present application, text style selection controls 10f-15 may also be provided in the interface 40f'.

[0483] For ease of explanation, the embodiment of the present application takes adding text style selection controls 10f-15 to the interface 40f as an example.

[0484] For example, in some embodiments of the present application, when the user clicks the select all control 10f-6 to select all the message boxes on the mask 10f-9 displayed in the interface 40f", and then clicks the text style selection control 10f-15, the user interface will be updated from the interface 40f" to Figure 12 The interface 50f" shown in (3) above shows the text style window 10f-16 displayed on the current interface.

[0485] See also Figure 12 In (3), illustratively, the text style window 10f-16 may include one or more text styles, such as detailed, moderate, concise, etc.

[0486] Continue to see Figure 12 In (3), for example, when the user selects the "moderate" style provided in the text style window 10f-16, the mobile phone responds to the user operation and the user interface is updated from interface 50f" to Figure 12 That is, the text style displayed in the text style selection control 10f-15 will be updated from "detailed" to "moderate", such as the text style selection control 10f-15'.

[0487] After starting with the quick input function, based on Figure 9a In the quick input method provided by the illustrated embodiment, the style of the generated text content is set to detailed by default. For example, after the user sets the text style to "moderate" through the text style selection controls 10f-15 and the text style window 10f-16 provided in the embodiment of the present application, when the user clicks the generate answer control 10d-10, the mobile phone responds to the user operation and generates text content that matches the current APP, business scenario, and screen content and describes the content appropriately according to the content and page features selected by the user, for example Figure 12In the interface 60f' shown in (5), the quick input text display box 10f-5" displays "In China, people sometimes use "CCB" to refer to the birth of a boy, and "CMBC" to refer to the birth of a girl. This statement stems from the idea that boys have more financial burdens when they grow up, such as buying a house and getting married, so they are likened to "Construction Bank" (CCB), while girls are believed to have less financial pressure and are likened to "CMBC" (CMBC).

[0488] For example, after the generated text content is displayed in the quick input text display box, the user can manually modify the text content displayed in the quick input text display box, or can modify the text style again to generate text content that meets the requirements. For example, the user feels that the text content corresponding to the "moderate" style is still too long. In this case, the user can operate the text style selection control and the text style window, reselect the text style, such as the "concise" style, and then click the generate answer control 10f-10 again to generate a more concise text content, such as "This statement stems from the idea that boys have more financial burdens when they grow up, such as buying a house and getting married, so they are likened to "Construction Bank" (CCB), while girls are considered to have less financial pressure and are likened to "China Merchants Bank" (CMBC)."

[0489] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0490] Therefore, by adding a text style selection control, it is convenient for users to adjust the text style according to the actual scenario, thereby ensuring that the generated text content better meets user needs.

[0491] In addition, it should be noted that in other embodiments of the present application, for different APPs, business scenarios, and user expression habits, after the quick input function is started, that is, after the interface 40f is opened through the quick input control, the text style displayed in the text style selection controls 10f-15 can be automatically switched to a text style suitable for the current APP, business scenario, and user expression habits.

[0492] For example, when a user uses an instant messaging app to chat, such as chatting with friends, the text style can be automatically updated to a "simplified" type.

[0493] For example, in a scenario where a user uses an email app to reply to a work email, the text style can be automatically updated to the "detailed" type.

[0494] For example, in a scenario where a user posts a comment using a video APP, the text style can be automatically updated to the "humor" type.

[0495] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0496] The following combination Figure 13 ,right Figure 12 The specific processing logic for implementing quick input in the shown scenario is explained.

[0497] See also Figure 13 The quick input method provided in the embodiment of the present application specifically includes:

[0498] S301: The input method management service registers an input method monitor for the input method application.

[0499] S302: After registering the input method monitoring, the input method management service pops up the keyboard corresponding to the input method when monitoring the user operation on the text input box corresponding to the input method.

[0500] S303: When the keyboard corresponding to the input method is displayed, the intelligent processing module obtains the window information of the current interface from the window management service.

[0501] S304: The intelligent processing module determines the location information of the quick input control according to the acquired window information, and transmits the location information to the window management service.

[0502] S305: The window management service creates a window for displaying the quick input control according to the location information determined by the intelligent processing module, and displays the quick input control in the created window.

[0503] It should be noted that steps S301 to S305 in the embodiment of the present application are the same as Figure 9a Steps S101 to S105 in the illustrated embodiment are the same. For specific implementation details, please refer to the description of steps S101 to S105 in the above embodiment, which will not be repeated here.

[0504] S306: When a user operation on the quick input control is received, a screenshot of the current interface is taken, and the screenshot of the current interface is transmitted to a feature extraction module.

[0505] S307, the feature extraction module performs feature extraction processing on the screenshot of the current interface, extracts the text content and page features of the current interface, and transmits the extracted feature information to the intelligent processing module.

[0506] It should be noted that steps S301 to S307 in the embodiment of the present application are the same as Figure 9aSteps S101 to S107 in the illustrated embodiment are the same. For specific implementation details, please refer to the description of steps S101 to S107 in the above embodiment, which will not be repeated here.

[0507] S308, the intelligent processing module performs masking on the current interface according to the feature information extracted by the feature extraction module, and displays a floating window corresponding to the quick input function on the mask.

[0508] It should be noted that, in the embodiments provided in this application, the masking process performed on the current interface is the same as Figure 9a The masking process performed in step S108 in the illustrated embodiment is the same. For specific implementation details, please refer to the description of step S108 in the above embodiment, which will not be repeated here.

[0509] In addition, it should be noted that, in the embodiment provided in the present application, the floating window corresponding to the quick input function displayed on the mask is, for example, the window W5 displayed in the interface 40f". That is, in the embodiment provided in the present application, the floating window corresponding to the quick input function includes not only the content in the window W1, but also a text style selection control.

[0510] For the related introduction of the text style selection control, please refer to the description of the text style selection control 10f-15 in the above embodiment, which will not be repeated here.

[0511] S309: The intelligent processing module displays a text generation control on the current interface in response to the user's selection operation on the content displayed in the mask.

[0512] S310: When the user operates the text generation control, the intelligent processing module sends a prompt construction instruction to the prompt processing module.

[0513] S311, the prompt processing module constructs a prompt according to the information carried in the prompt construction instruction, and feeds the constructed prompt back to the intelligent processing module.

[0514] It should be noted that steps S309 to S311 in the embodiment of the present application are the same as Figure 9a Steps S109 to S111 in the illustrated embodiment are the same. For specific implementation details, please refer to the description of steps S107 to S111 in the above embodiment, which will not be repeated here.

[0515] S312, the intelligent processing module sends a text generation instruction to the text generation module.

[0516] Among them, after the user clicks on the generate answer control 10f-10, the intelligent processing module sends a prompt construction instruction to the prompt processing module, and after receiving the prompt feedback from the prompt processing module, the intelligent processing module will send a text generation instruction to the text generation module carrying the user prompt, system prompt, and the text style currently displayed in the text style selection control 10f-15.

[0517] Understandably, the text style can be modified at any time after the text style selection control 10f-15 is displayed on the current interface and before the user clicks the generate answer control 10f-10.

[0518] S313, the text generation module generates text content that meets the user prompt, system prompt and selected text style requirements according to the prompt carried in the text generation instruction, and feeds the generated text content back to the intelligent processing module.

[0519] S314, the intelligent processing module displays the generated text content in the quick input text display box.

[0520] For specific implementation details of step S313 and step S314, please refer to the description of step S113 and step S114 in the above embodiment, which will not be repeated here.

[0521] Therefore, based on the quick input method provided in the embodiment of the present application, text content is generated according to the text style selected by the user and the automatically generated prompts, so that the generated text content can not only match the current APP, business scenarios, and screen content, but also be more in line with the user's expression habits, thereby better meeting the user's usage needs and improving the user experience.

[0522] Furthermore, it should be noted that the quick input method provided in the embodiments of the present application is not only applicable to various input method applications. Specifically, the quick input function startup entry, such as the quick input control 10f-3 described in the above embodiment, is associated with the input method keyboard. When the input method keyboard is displayed on the current interface, the quick input control 10f-3 is drawn and displayed based on the window information of the current interface. It can also be used as a global intelligent assistant (voice assistant) to achieve the quick input experience described in the above embodiment.

[0523] In order to better understand this implementation, the following Figure 14 and Figure 15 Describe the usage scenarios and specific implementation logic of the given implementation method.

[0524] See also Figure 14In (1), for example, when the user interface of the mobile phone is interface 10g, when the user presses the power button for 1s or speaks a specified wake-up word, the mobile phone responds to the user operation and wakes up the voice assistant application. Accordingly, the user interface can be updated from interface 10g to Figure 14 Interface 20g shown in (2).

[0525] See also Figure 14 In (2), exemplarily, the window 10g-2 corresponding to the voice assistant application displayed in the interface 20g may include one or more controls, such as a recommendation control (a control on the bottom left side of the window 10g-2, for the user to operate and trigger the operation of entering the recommendation interface corresponding to the voice assistant application), a voice collection control (a control in the middle of the bottom of the window 10g-2, for the user to operate and trigger the operation of voice collection), a personal center control (a control on the bottom right side of the window 10g-2, for the user to operate and trigger the operation of entering the personal center interface corresponding to the voice assistant application), and a control for recommending events to the user, such as the control 10g-3 for triggering the quick input function provided in the embodiment of the present application, a control for triggering viewing Olympic events, etc.

[0526] It should be noted that the control provided in the window 10g-2 for recommending user events may be determined based on multiple factors such as current real-time news, user preferences, currently running applications in the foreground, and current business scenarios.

[0527] For example, in some embodiments of the present application, when the currently running application is a whitelist application and the current business scenario is a whitelist business scenario (such as a scenario involving editing text content), when the voice assistant application is invoked and window 10g-2 is displayed, control 10g-3 may be displayed in window 10g-2. Otherwise, control 10g-3 is not provided.

[0528] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0529] Continue to see Figure 14 In (2), for example, when the user clicks on the control 10g-3, the mobile phone will start the quick input function in response to the user operation, for example, the user interface can be updated from interface 20g to Figure 14 Interface 30g shown in (3).

[0530] See also Figure 14 In (3), illustratively, after the quick input function is started, the interface 20g can be processed using the processing method 1, processing method 2, or processing method 3 described in the above embodiment.

[0531] For the sake of convenience, the present application embodiment still takes the processing method 2 as an example. Regarding the processing method 2, the processing of the interface 20g can be referred to the processing method 2 in the above embodiment. Figure 9b The description of the processing of the interface 30f using the processing method 2 is not repeated here.

[0532] Continue to see Figure 14 In (3), for example, after processing the interface 20g using processing method 2 to obtain the mask layer 10g-4, the select all control 10g-5 and the deselect all control 10g-6 can be displayed on the mask layer 10g-4.

[0533] It should be noted that the select all control 10g-5 in this embodiment has the same function as the select all control 10f-6 in the above embodiment, and the deselect all control 10g-6 has the same function as the deselect all control 10f-7. For specific implementation details, please refer to the description of the select all control 10f-6 and the deselect all control 10f-7 in the above embodiment, which will not be repeated here.

[0534] Continue to see Figure 14 In (3), for example, when the user clicks the select all control 10g-5, the mobile phone selects all the message boxes displayed in the mask 10g-4 in response to the user operation, as shown in FIG. Figure 14 As shown in the mask 10g-4' in the interface 40g shown in (4), the generated answer control 10g-7 is displayed on the current interface.

[0535] See also Figure 14 In (4), illustratively, when the user clicks on the generate answer control 10g-7, the mobile phone generates a prompt according to the content selected by the user in response to the user operation, and generates matching text content according to the generated prompt.

[0536] For example, after the prompt generated based on the content selected by the user generates text content, the user interface will be updated from interface 40g to Figure 14 The interface 50f shown in (5) is shown in FIG. That is, the mask displayed on the current chat interface is cancelled, and the window 10g-2 is updated to the style of the window 10g-2'.

[0537] See also Figure 14 In (5), for example, the window 10g-2' displays a quick input text display box 10g-8 and a copy control 10g-9. The text display content area 10g-8 displays text content generated based on the prompt generated according to the content selected by the user.

[0538] Continue to see Figure 14In (5), for example, when the user clicks the copy control 10g-9, the mobile phone responds to the user operation by copying the text content displayed in the quick input text display box 10g-8, and closes the window 10g-2', and automatically pastes the copied text content into the text input box 10g-1, as shown in FIG. Figure 14 (6) The text input box 10g-1' shown in the interface 60f.

[0539] For example, in some other embodiments of the present application, after a user clicks the copy control 10g-9 to copy the text displayed in the quick input text display box 10g-8, if the user clicks an area outside of window 10g-2' in the current interface, such as the area displaying the chat content, the mobile phone will collapse window 10g-2' in response to the user operation. In other words, the user interface can be restored from interface 50g to interface 10g.

[0540] Exemplarily, when a user long-presses text input box 10g-1 in interface 10g, the phone displays a paste entry in response to the user operation. Exemplarily, when the user clicks the paste entry, the phone pastes the text content copied from quick input text display box 10g-8 into text input box 10g-1 in response to the user operation, i.e., text input box 10g-1 updates text input box 10g-1′.

[0541] It should be understood that the above description is merely an example listed for a better understanding of the technical solution of this embodiment, and is not intended to be the sole limitation on this embodiment.

[0542] As a result, the voice assistant application can be used to quickly input text content, making it applicable to more business scenarios and better meeting the diverse usage needs of users.

[0543] The following combination Figure 15 ,right Figure 14 The specific processing logic for implementing quick input in the shown scenario is explained.

[0544] See also Figure 15 The quick input method provided in the embodiment of the present application specifically includes:

[0545] S401, in response to the operation of invoking the voice assistant application, the voice assistant application is invoked, and the intelligent processing module obtains the window information of the current interface from the window management service.

[0546] For example, the user presses and holds the power button for 1 second, or uses a preset voice wake-up word to wake up the voice assistant application.

[0547] For specific implementation details of the intelligent processing module obtaining the window information of the current interface from the window management service, please refer to the description of step S103 in the above embodiment, which will not be repeated here.

[0548] S402: The intelligent processing module determines the location information of the quick input control according to the acquired window information, and transmits the location information to the window management service.

[0549] S403: The window management service creates a window for displaying the quick input control according to the location information determined by the intelligent processing module, and displays the quick input control in the created window.

[0550] It is understandable that the quick input control in the embodiment of the present application is, for example, the control 10g-3 displayed on the window 10-2 corresponding to the voice assistant application.

[0551] S404: When a user operation on the quick input control is received, a screenshot of the current interface is taken, and the screenshot of the current interface is transmitted to a feature extraction module.

[0552] It is understandable that in the embodiment of the present application, the current interface that is captured is, for example, the chat interface below the layer where window 10g-2 is located, such as interface 10g.

[0553] S405, the feature extraction module performs feature extraction processing on the screenshot of the current interface, extracts the text content and page features of the current interface, and transmits the extracted feature information to the intelligent processing module.

[0554] S406: The intelligent processing module performs masking processing on the current interface according to the feature information extracted by the feature extraction module.

[0555] It should be noted that, in the embodiment of the present application, the masking process performed on the current interface is the same as Figure 9a The masking process performed in step S108 in the illustrated embodiment is the same. For specific implementation details, please refer to the description of step S108 in the above embodiment, which will not be repeated here.

[0556] In addition, it should be noted that after the current interface is masked, corresponding controls for quick input functions, such as a select all control and a deselect all control, may be displayed on the resulting mask.

[0557] For the introduction of the select all control and the deselect all control, please refer to the description of the select all control 10g-5 and the deselect all control 10g-6 in the above embodiment, which will not be repeated here.

[0558] S407: The intelligent processing module displays a text generation control on the current interface in response to the user's selection operation on the content displayed in the mask.

[0559] S408: When the user operates the text generation control, the intelligent processing module sends a prompt construction instruction to the prompt processing module.

[0560] S409: The prompt processing module constructs a prompt according to the information carried in the prompt construction instruction, and feeds the constructed prompt back to the intelligent processing module.

[0561] S410, the intelligent processing module sends a text generation instruction to the text generation module.

[0562] S411, the text generation module generates text content that meets the user prompt and system prompt requirements according to the prompt carried in the text generation instruction, and feeds the generated text content back to the intelligent processing module.

[0563] For specific implementation details of steps S402 to S411, please refer to the description of steps S104 to S113 in the above embodiment, which will not be repeated here.

[0564] S412: The intelligent processing module displays the received text content in the quick input text display box corresponding to the voice assistant application.

[0565] For example, a quick input text display box 10g-8 is displayed in the window 10g-2'.

[0566] For the operation of adding the generated text content to the quick input text display box 10g-8, please refer to Figure 14 In the illustrated embodiment, the user interface is updated from interface 50f to the description portion of interface 60, which will not be described again here.

[0567] Therefore, based on the quick input method provided in the embodiment of the present application, information matching the current application and the content displayed on the screen can be quickly generated without the user inputting prompts.

[0568] In addition, due to the quick input method provided in the embodiment of the present application, there is no need to start the input method application. By using the globally available voice assistant application, text content can be automatically generated, which can be applied to more business scenarios and better meet the diverse usage needs of users.

[0569] In addition, it should be noted that the quick input method implemented by the voice assistant application mentioned above can also provide a prompt input box 10f-14 and / or a text style selection control 10f-15 in the user interface displayed after operating the control 10g-3.

[0570] In addition, it is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0571] In addition, it should be noted that in actual application scenarios, the shortcut input methods provided by the above embodiments implemented by electronic devices can also be executed by a chip system included in the electronic device, wherein the chip system may include a processor. The chip system can be coupled to a memory so that when the chip system is running, it calls the computer program stored in the memory to implement the steps performed by the above electronic device. The processor in the chip system can be an application processor or a processor other than an application processor.

[0572] In addition, an embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the shortcut input method in the above-mentioned embodiment.

[0573] In addition, an embodiment of the present application further provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the above-mentioned related steps to implement the quick input method in the above-mentioned embodiment.

[0574] In addition, an embodiment of the present application also provides a chip (which can also be a component or module), which may include one or more processing circuits and one or more transceiver pins; wherein, the transceiver pins and the processing circuit communicate with each other through an internal connection path, and the processing circuit executes the above-mentioned related method steps to implement the quick input method in the above-mentioned embodiment to control the receiving pin to receive the signal, so as to control the sending pin to send the signal.

[0575] In addition, it can be seen from the above description that the electronic device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0576] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A quick input method, characterized in that: The method comprises: Displaying a first interface, wherein the first interface includes chat content and a text input box; After receiving the first operation, displaying a quick input control; After receiving a second operation on the quick input control, displaying a second interface, the second interface including a first selection box, wherein the chat content is displayed in the first selection box; After receiving a third operation on the first selection box, displaying a quick content generation control and displaying the chat content as selected; After receiving a fourth operation on the quick content generation control, displaying target chat content, the target chat content being associated with the chat content; After receiving the fifth operation on the target chat content, the target chat content is displayed in the text input box.

2. The method according to claim 1, characterized in that After receiving the second operation on the quick input control, displaying the second interface includes: After receiving the second operation on the quick input control, performing a screenshot operation on the first interface to obtain a first interface screenshot corresponding to the first interface; Performing a feature extraction operation on the first interface screenshot to extract the chat content and message box information corresponding to the chat content included in the first interface screenshot; Overlaying the first interface screenshot on the first interface; According to the chat content and the message box information corresponding to the chat content, a mask is added to the first interface screenshot to obtain the second interface.

3. The method according to claim 2, characterized in that The adding a mask on the first interface screenshot according to the chat content and the message box information corresponding to the chat content includes: Adding a layer on the first interface screenshot, wherein the layer has a certain degree of transparency; Drawing the first selection box on the layer according to the message box information corresponding to the chat content; The corresponding chat content is displayed in the first selection box.

4. The method according to claim 3, characterized in that The method further comprises: After receiving the fourth operation on the quick content generation control, constructing a prompt based on the selected chat content and page features of the first interface extracted from the first interface screenshot; The target chat content is generated according to the prompt.

5. The method according to claim 4, characterized in that Constructing a prompt based on the selected chat content and page features of the first interface extracted from the first interface screenshot includes: Preprocessing the chat content and the page features to obtain a preprocessing result; Performing intent recognition processing on the preprocessing results to determine the user's intention; Constructing a first prompt according to the preprocessing result and the user intention, wherein the first prompt is used to identify the subject of the target chat content to be generated; According to the user intention and the page features, a second prompt is constructed, where the second prompt is used to indicate the creation type corresponding to the target chat content to be generated.

6. The method according to claim 5, characterized in that Generating the target chat content according to the prompt includes: According to the first prompt and the second prompt, target chat content is generated, which matches the subject identified by the first prompt and has a creation type indicated by the second system prompt.

7. The method according to claim 5, characterized in that The preprocessing of the chat content and the page features to obtain a preprocessing result includes: Deleting sensitive information from the chat content and deleting sensitive information from the page features; or, Replace sensitive information in the chat content, and replace sensitive information in the page features.

8. The method according to any one of claims 1 to 7, characterized in that The first input operation is a user operation of waking up the voice assistant application.

9. The method according to claim 8, characterized in that After receiving the first operation, displaying the quick input control includes: After receiving the first operation, an operation window corresponding to the voice assistant application is displayed on the first interface, and the operation window includes the shortcut input control.

10. The method according to claim 9, characterized in that The second interface further includes a select all control, and the third operation on the first selection box is an operation acting on the select all control.

11. The method according to any one of claims 1 to 7, characterized in that The first operation is a user operation acting on the text input box; After receiving the first operation, displaying the quick input control includes: After receiving the first operation, a keyboard corresponding to the input method application is displayed on the first interface, and the quick input control is displayed in an area corresponding to the keyboard.

12. The method according to claim 11, characterized in that The second interface further includes a quick input window, the quick input window includes a select all control, and the third operation on the first selection box is an operation acting on the select all control.

13. The method according to claim 12, characterized in that The quick input window is a floating window.

14. The method according to claim 12 or 13, characterized in that The quick input window also includes a prompt input box, which is used for the user to input a prompt; Wherein, after the prompt word input by the user is displayed in the prompt word input box, the quick content generation control is displayed.

15. The method according to claim 12 or 13, characterized in that The quick input window also includes a text style selection control, which is used for allowing the user to select the expression style of the target chat content.

16. An electronic device, characterized in that: The electronic device includes: a memory and a processor, the memory and the processor are coupled; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the shortcut input method according to any one of claims 1 to 15.

17. A computer-readable storage medium, characterized in that The method comprises a computer program, which, when executed on an electronic device, enables the electronic device to execute the shortcut input method according to any one of claims 1 to 15.

Images