Data processing method, device and electronic equipment

Abstract

The embodiment of the present invention provides a data processing method, device and electronic device, wherein the method comprises: receiving a trigger instruction for a screenshot key preset in a keyboard, starting the screenshot function of the input method; determining a target area to be screenshotted, and capturing a target image corresponding to the target area. Thus, a quick screenshot is achieved while the user is inputting using the keyboard; the screenshot operation of the user is simplified, the screenshot efficiency is improved, and the user experience can also be improved.

Description

Technical Field

[0001] The present invention relates to the technical field of input methods, and in particular to a data processing method, device and electronic equipment. Background Art

[0002] With the development of computer technology, electronic devices such as mobile phones and tablet computers are becoming more and more popular, bringing great convenience to people's life, study and work. These electronic devices are usually installed with input method applications (input methods for short), so that users can use the input methods to input information.

[0003] Among them, the input method in the PC (Personal Computer) not only supports users to input information in the input box through the keyboard, but also supports to start various functions such as emoticons, information, voice input, screenshots, etc. in the tool box of the input method through the mouse; so as to realize inputting emoticons, viewing information, voice input, screenshots, etc. When the user uses the keyboard to input, if he wants to use these functions, he needs to switch from the keyboard to the mouse to use these functions, which is cumbersome. Summary of the invention

[0004] The embodiment of the present invention provides a data processing method to simplify the operation of a user using a screenshot function in an input method and improve the efficiency of screenshot.

[0005] Correspondingly, an embodiment of the present invention further provides a data processing device and an electronic device to ensure the implementation and application of the above method.

[0006] In order to solve the above problems, an embodiment of the present invention discloses a data processing method, which is applied to an input method. The input method is deployed in an electronic device, and the electronic device is connected to a keyboard. The method specifically includes: receiving a trigger instruction for a screenshot button preset in the keyboard, starting the screenshot function of the input method; determining a target area to be screenshotted, and capturing a target image corresponding to the target area.

[0007] Optionally, the method further comprises: performing text recognition on the target image, obtaining image text information corresponding to the target image and displaying the information in a preset panel of the input method.

[0008] Optionally, the method further includes: if a screenshot instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, the target image is copied; if a text recognition instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, the step of performing text recognition on the target image, obtaining the image text information corresponding to the target image and displaying it is performed.

[0009] Optionally, the method further comprises: receiving a copy instruction, and copying the image text information.

[0010] Optionally, the method further comprises: receiving a download instruction, and downloading the image text information.

[0011] Optionally, the method further includes: receiving a paste instruction; pasting the target image into an input box where a cursor is located.

[0012] Optionally, the method further includes: receiving a paste instruction; pasting the image text information into an input box where a cursor is located.

[0013] Optionally, the method further comprises: if a cancel instruction is received after determining the target area to be screenshotted, turning off the screenshot function of the input method.

[0014] Optionally, determining the target area to be captured includes: if a trigger instruction for a screenshot button preset in the keyboard is received after the user selects information in the application, determining the area corresponding to the information selected by the user as the target area to be captured.

[0015] Optionally, determining the target area to be captured includes: determining an area corresponding to the full screen as the target area to be captured.

[0016] Optionally, determining the target area to be captured includes: receiving a screenshot area selection instruction; and determining the target area to be captured according to the screenshot area selection instruction.

[0017] Optionally, determining the target area to be captured includes: determining an application where a cursor is located;

[0018] The display area corresponding to the application is determined as the target area to be captured.

[0019] Optionally, determining the target area to be captured further includes: receiving an adjustment instruction for the target area; and updating the target area according to the adjustment instruction.

[0020] An embodiment of the present invention also discloses a data processing device, which is applied to an input method. The input method is deployed in an electronic device, and the electronic device is connected to a keyboard. The device includes: a startup module, which is used to receive a trigger instruction for a screenshot button preset in the keyboard to start the screenshot function of the input method; and a screenshot module, which is used to determine a target area to be screenshotted and capture a target image corresponding to the target area.

[0021] Optionally, the device further comprises: a text display module, configured to perform text recognition on the target image, obtain image text information corresponding to the target image, and display the information in a preset panel of the input method.

[0022] Optionally, the device further includes: an image copying module, which is used for, if a screenshot instruction is received after the target area to be screenshoted is determined, then after the target image corresponding to the target area is captured, copying the target image; and an execution module, which is used for, if a text recognition instruction is received after the target area to be screenshoted is determined, then after the target image corresponding to the target area is captured, performing text recognition on the target image, obtaining image text information corresponding to the target image and displaying the step.

[0023] Optionally, the device further comprises: a text copy module, configured to receive a copy instruction and copy the image text information.

[0024] Optionally, the device further comprises: a text download module, configured to receive a download instruction and download the image text information.

[0025] Optionally, the device further comprises: a first paste instruction receiving module, used for receiving a paste instruction; and a first paste module, used for pasting the target image into the input box where the cursor is located.

[0026] Optionally, the device further comprises: a second paste instruction receiving module, used for receiving a paste instruction; and a second paste module, used for pasting the image text information into the input box where the cursor is located.

[0027] Optionally, the device further comprises: a closing module, configured to close the screenshot function of the input method if a cancel instruction is received after the target area to be screenshot is determined.

[0028] Optionally, the screenshot module includes: a first area determination submodule, which is used to determine the area corresponding to the information selected by the user as the target area to be screenshot if a trigger instruction for a screenshot button preset in the keyboard is received after the user selects information in the application.

[0029] Optionally, the screenshot module includes: a second area determination submodule, used to determine an area corresponding to the full screen as a target area to be screenshotted.

[0030] Optionally, the screenshot module includes: a selection instruction receiving submodule, used to receive a screenshot area selection instruction; and a third area determination submodule, used to determine a target area to be screenshotted according to the screenshot area selection instruction.

[0031] Optionally, the screenshot module includes: a program determination submodule, used to determine the application where the cursor is located; and a fourth area determination submodule, used to determine the display area corresponding to the application as the target area to be screenshotted.

[0032] Optionally, the screenshot module further includes: an adjustment instruction receiving submodule, used for receiving an adjustment instruction for a target area; and a region updating submodule, used for updating the target area according to the adjustment instruction.

[0033] An embodiment of the present invention further discloses a readable storage medium. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute a data processing method as described in any one of the embodiments of the present invention.

[0034] An embodiment of the present invention also discloses an electronic device, comprising a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the following operations: receiving a trigger instruction for a screenshot key preset in a keyboard, and starting the screenshot function of the input method; determining a target area to be screenshotted, and capturing a target image corresponding to the target area.

[0035] Optionally, it also includes instructions for performing the following operations: performing text recognition on the target image, obtaining image text information corresponding to the target image and displaying it in a preset panel of the input method.

[0036] Optionally, it also includes instructions for performing the following operations: if a screenshot instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, the target image is copied; if a text recognition instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, the text recognition of the target image is performed to obtain and display the image text information corresponding to the target image.

[0037] Optionally, it also includes instructions for performing the following operations: receiving a copy instruction, and copying the image text information.

[0038] Optionally, it also includes instructions for performing the following operations: receiving a download instruction, and downloading the image text information.

[0039] Optionally, it also includes instructions for performing the following operations: receiving a paste instruction; pasting the target image into the input box where the cursor is located.

[0040] Optionally, it also includes instructions for performing the following operations: receiving a paste instruction; pasting the image text information into the input box where the cursor is located.

[0041] Optionally, it also includes instructions for performing the following operations: if a cancel instruction is received after the target area to be screenshot is determined, then the screenshot function of the input method is turned off.

[0042] Optionally, determining the target area to be captured includes: if a trigger instruction for a screenshot button preset in the keyboard is received after the user selects information in the application, determining the area corresponding to the information selected by the user as the target area to be captured.

[0043] Optionally, determining the target area to be captured includes: determining an area corresponding to the full screen as the target area to be captured.

[0044] Optionally, determining the target area to be captured includes: receiving a screenshot area selection instruction; and determining the target area to be captured according to the screenshot area selection instruction.

[0045] Optionally, determining the target area to be captured includes: determining an application where a cursor is located; and determining a display area corresponding to the application as the target area to be captured.

[0046] Optionally, determining the target area to be captured further includes: receiving an adjustment instruction for the target area; and updating the target area according to the adjustment instruction.

[0047] The embodiments of the present invention include the following advantages:

[0048] In an embodiment of the present invention, after receiving a trigger instruction for a screenshot button preset in the keyboard, the screenshot function of the input method can be started; after the user selects the area to be screenshotted, the target area to be screenshotted can be determined, and the target image corresponding to the target area can be captured; thereby achieving rapid screenshot while the user is using the keyboard to input; simplifying the user's screenshot operation, improving screenshot efficiency, and also improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 is a flow chart of steps of an embodiment of a data processing method of the present invention;

[0050] Figure 2 is a flowchart of steps of an optional embodiment of a data processing method of the present invention;

[0051] Figure 3 is a flowchart of steps of another optional embodiment of a data processing method of the present invention;

[0052] Figure 4is a flowchart of steps of another optional embodiment of a data processing method of the present invention;

[0053] Figure 5 is a flowchart of steps of another optional embodiment of a data processing method of the present invention;

[0054] Figure 6 is a flowchart of steps of another optional embodiment of a data processing method of the present invention;

[0055] Figure 7 is a flowchart of steps of another data processing method embodiment of the present invention;

[0056] Figure 8 is a flowchart of steps of another optional embodiment of a data processing method of the present invention;

[0057] Fig. 9 is a flowchart of steps of an embodiment of an expression recommendation method of the present invention;

[0058] Fig.10 is a flowchart of an optional embodiment of an expression recommendation method of the present invention;

[0059] Fig.11 is a flowchart of another optional embodiment of the expression recommendation method of the present invention;

[0060] Fig.12 is a flowchart of steps of another optional embodiment of the expression recommendation method of the present invention;

[0061] Fig.13 is a flowchart of steps of another optional embodiment of the expression recommendation method of the present invention;

[0062] Fig.14 is a flowchart of steps of an information recommendation method embodiment of the present invention;

[0063] Fig.15 is a flowchart of steps of an optional embodiment of an information recommendation method of the present invention;

[0064] Fig.16 is a flowchart of another optional embodiment of the information recommendation method of the present invention;

[0065] Fig.17 is a flowchart of steps of another optional embodiment of the information recommendation method of the present invention;

[0066] Fig.18 is a flowchart of steps of another optional embodiment of the information recommendation method of the present invention;

[0067] Fig.19 is a flowchart of a speech input method embodiment of the present invention;

[0068] Fig. 20 is a flowchart of steps of an optional embodiment of a voice input method of the present invention;

[0069] Fig.21 is a flowchart of another optional embodiment of the voice input method of the present invention;

[0070] Fig. 22 is a flowchart of steps of another optional embodiment of the voice input method of the present invention;

[0071] Fig.23 is a structural block diagram of an embodiment of a data processing device of the present invention;

[0072] Fig.24 is a structural block diagram of an optional embodiment of a data processing device of the present invention;

[0073] Fig.25 A structural block diagram of an electronic device for data processing according to an exemplary embodiment;

[0074] Fig.26 It is a structural schematic diagram of an electronic device for data processing according to another exemplary embodiment of the present invention. DETAILED DESCRIPTION

[0075] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0076] The embodiment of the present invention can be applied to an input method, wherein the input method is provided with an intelligent assistant; the function entrance of the intelligent assistant can be provided in the status bar of the input method. Of course, the user can hide and restore the function entrance of the intelligent assistant from the status bar of the input method, and the embodiment of the present invention does not limit this.

[0077] The intelligent assistant has multiple functions, such as information recommendation function, screenshot function, expression recommendation function, news recommendation function, voice function, etc. Among them:

[0078] The information recommendation function can be used to recommend various types of information, such as expressions, phrases, sentences, news information, etc.; the specific settings can be made according to needs.

[0079] The screenshot function can be used to capture an image of the screen.

[0080] The expression recommendation function can be used to recommend various expressions.

[0081] The information recommendation function can be used to recommend various information, and the information can refer to information that can bring value to users in a relatively short period of time because users obtain and use it in a timely manner, such as news, weather information, etc.

[0082] The voice function can be used to execute voice input instructions and display voice input information on the screen.

[0083] In one embodiment of the present invention, the input method can be set in an electronic device, and the electronic device is connected to an external device such as a keyboard. The functions of the input method intelligent assistant can be associated with the keys in the keyboard, so that the user can use the functions in the input method by triggering the keys in the keyboard; thus, when the user uses the keyboard to input information, the user does not need to directly switch back and forth between the keyboard and the mouse to use the functions of the input method, which simplifies the operation of the user using the functions in the input method; and can also improve the user experience.

[0084] In an embodiment of the present invention, preset keys associated with functions in the smart assistant can be selected from the keyboard as needed. In one example, keys that are less frequently used by the user when inputting information using the keyboard can be selected as preset keys and associated with functions in the smart assistant, such as the F1 key, the F2 key, the F3 key, the F4 key, the voice key, etc.

[0085] In one example of the present invention, in order to distinguish the preset keys in the keyboard that are associated with different functions of the smart assistant, the preset key associated with the information recommendation function can be called the information recommendation key; the preset key associated with the screenshot function can be called the screenshot key; the preset key associated with the emoticon recommendation function can be called the emoticon recommendation key; the preset key associated with the information recommendation function can be called the information recommendation key; and the preset key associated with the voice function can be called the voice input key.

[0086] In one example, the preset button associated with each function in the smart assistant can be a button in the keyboard.

[0087] For example, the information recommendation key may be the F1 key on the keyboard;

[0088] The screenshot button can be the F2 key on the keyboard;

[0089] The emoticon recommendation key can be the F3 key on the keyboard;

[0090] The information recommendation button may be the F4 key on the keyboard;

[0091] The voice input button may be a voice button on a keyboard.

[0092] In one example, the preset keys associated with each function in the smart assistant can be a combination of at least two keys in the keyboard.

[0093] For example: the information recommendation key can be the Fn key + F1 key on the keyboard;

[0094] The screenshot button can be the Fn button + F2 button on the keyboard;

[0095] The emoticon recommendation key can be the Fn key + F3 key on the keyboard;

[0096] The information recommendation button can be the Fn button + F4 button on the keyboard;

[0097] The voice input button can be the Fn button + voice button on the keyboard.

[0098] For another example: the information recommendation key may be the Ctrl key + Alt key + F1 key on the keyboard;

[0099] The screenshot button can be the Ctrl key + Alt key + F2 key on the keyboard;

[0100] The recommended emoticon key can be Ctrl+Alt+F3 on the keyboard;

[0101] The information recommendation button can be the Ctrl key + Alt key + F4 key on the keyboard;

[0102] The voice button can be the Ctrl button + Alt button + voice button on the keyboard.

[0103] Among them, when the preset button associated with each function in the smart assistant is a combination of at least two preset buttons in the keyboard, the user can use the corresponding function by triggering at least two preset buttons at the same time.

[0104] Based on the above embodiments, the embodiments of the present invention provide a data processing method, which can activate different functions of the input method according to different preset keys triggered by the user. The details are as follows:

[0105] Reference Figure 1 , shows a flow chart of steps of a data processing method embodiment of the present invention, which may specifically include the following steps:

[0106] Step 102: receiving a trigger instruction for a preset key in the keyboard, and starting a function associated with the preset key in the input method.

[0107] In an embodiment of the present invention, when a user needs to use a function in an input method, a preset key corresponding to the function in the keyboard can be triggered. For example, when a user needs to use the information recommendation function of the input method, an information recommendation key such as the F1 key can be triggered; when a user needs to use the screenshot function of the input method, a screenshot key such as the F2 key can be triggered; when a user needs to use the emoticon recommendation function of the input method, an emoticon recommendation key such as the F3 key can be triggered; when a user needs to use the information recommendation function of the input method, an information recommendation key such as the F4 key can be triggered; when a user needs to use the voice input function of the input method, a voice input key such as the voice key can be triggered, and so on.

[0108] After the user triggers the preset button, the smart assistant can receive a trigger instruction for the preset button, and then start the function associated with the preset button in the input method. For example, when the smart assistant receives a trigger instruction for the information recommendation function, it can start the information recommendation function; when the smart assistant receives a trigger instruction for the screenshot function, it can start the screenshot function; when the smart assistant receives a trigger instruction for the emoticon recommendation function, it can start the emoticon recommendation function; when the smart assistant receives a trigger instruction for the information recommendation function, it can start the information recommendation function; when the smart assistant receives a trigger instruction for the voice input function, it can start the voice input function; and so on.

[0109] In summary, in the embodiment of the present invention, after receiving a trigger instruction for a preset key in the keyboard, the function associated with the preset key in the input method can be started; and different functions of the input method can be started according to different preset keys triggered by the user.

[0110] When the preset button is an information recommendation button, the information recommendation function in the input method can be activated to recommend various types of information to the user; the method can be as follows:

[0111] Reference Figure 2 , shows a flow chart of steps of an optional embodiment of a data processing method of the present invention, which may specifically include the following steps:

[0112] Step 202: receiving a trigger instruction for an information recommendation key in a keyboard, and displaying an information recommendation interface in a preset panel of the input method.

[0113] Step 204: Determine target recommendation information, and display the target recommendation information on the information recommendation interface.

[0114] In an embodiment of the present invention, when a user needs to use an intelligent assistant to make various types of information recommendations, an information recommendation key in the keyboard, such as the F1 key, can be triggered. Correspondingly, the intelligent assistant can receive a trigger instruction for the information recommendation key; if the preset panel of the input method is in a closed state, the preset panel can be started, and the information recommendation interface can be displayed in the preset panel. The preset panel can be an intelligent assistant panel. If the preset panel of the input method is in an open state, the information recommendation interface can be directly displayed in the preset panel.

[0115] In an embodiment of the present invention, target recommendation information can be determined while displaying the information recommendation interface, and the target recommendation information can be displayed on the information recommendation interface. That is to say, the embodiment of the present invention does not limit the execution order of displaying the information recommendation interface in the preset panel of the input method in step 202 and determining the target recommendation information in step 204; determining the target recommendation information in step 204 can be performed after displaying the information recommendation interface in the preset panel of the input method in step 202, or it can be performed at the same time as displaying the information recommendation interface in the preset panel of the input method in step 202.

[0116] The target recommendation information may include multiple categories, such as expressions, phrases, sentences, news information, etc. The category of the recommended information may be set by the input method or may be customized by the user, and the embodiment of the present invention does not limit this.

[0117] Subsequently, the user can select the required target recommendation information from the target recommendation information displayed in the information recommendation interface as needed; and then, when the user is using the keyboard to input information, the user can use the information recommendation function of the input method by triggering the information recommendation button on the keyboard, without having to switch from the keyboard to the mouse and use the mouse to trigger the information recommendation function; this simplifies the operation of the user using the information recommendation function in the input method; and can also improve the user experience.

[0118] In summary, in an embodiment of the present invention, after receiving a trigger instruction for an information recommendation button in a keyboard, an information recommendation interface can be displayed in the preset panel of the input method; and target recommendation information is determined and displayed in the information recommendation interface, so that the user can use the information recommendation function of the input method by triggering the information recommendation button in the keyboard during the process of using the keyboard to input information, without having to switch from the keyboard to the mouse and use the information recommendation function with the mouse; this simplifies the operation of the user using the information recommendation function in the input method, improves the efficiency of using the information recommendation function; and can also improve the user experience.

[0119] Reference Figure 3 , shows a flowchart of another optional embodiment of the information recommendation method of the present invention, which may specifically include the following steps:

[0120] Step 302: When the preset panel is in a closed state, a trigger instruction for an information recommendation key in a keyboard is received, the preset panel of the input method is started, and an information recommendation interface is displayed in the preset panel.

[0121] In one example of the present invention, when the preset panel of the input method is in a closed state, if the user needs to use the information recommendation function of the input method, the information recommendation key in the keyboard can be triggered, such as pressing the F1 key in the keyboard, to enable the information recommendation function of the input method. After the user presses the F1 key in the keyboard, the intelligent assistant can receive the trigger instruction for the information recommendation key in the keyboard, and then can start the intelligent assistant panel and display the information recommendation interface in the intelligent assistant panel.

[0122] Step 304: Obtain recommendation information and user behavior information corresponding to the recommendation information.

[0123] In the embodiment of the present invention, the recommendation information and the user behavior information corresponding to the recommendation information may be obtained from a local database, or may be obtained from a server, and the embodiment of the present invention does not limit this.

[0124] Step 306: Select target recommended information from the acquired recommended information based on the user behavior information corresponding to the recommended information.

[0125] Each category of recommended information may include at least one recommended information. For each category of recommended information, the popularity corresponding to each recommended information in the category can be determined based on the user behavior information of each recommended information in the category. Then, the recommended information in the category can be sorted according to the popularity of each recommended information in the category; and according to the sorting result, the top N1 recommended information with the highest popularity is selected as the target recommended information. N1 is a positive integer and can be set as required, and the embodiment of the present invention does not limit this.

[0126] The recommended information may include multiple categories, such as emoticons, phrases, sentences, news information, etc. For emoticons, phrases, and sentences, the corresponding user behavior information may include usage frequency; the usage frequency may be the usage frequency of users across the entire network. In one example, for emoticons, phrases, and sentences, the usage frequency may be used as the corresponding popularity; and then the N1 emoticons, N1 phrases, and N1 sentences with the highest usage frequency may be used as target recommended information.

[0127] For information, the corresponding user behavior information may include browsing frequency, and the usage frequency may be the browsing frequency of users across the entire network. In one example, for information, the browsing frequency may be used as the corresponding popularity; and then the N1 information with the highest browsing frequency may be used as the target recommendation information.

[0128] Step 308: Display the target recommendation information on the information recommendation interface.

[0129] In one example, various types of target recommendation information may be displayed in the information recommendation interface in sequence according to the type of target recommendation information. The display method of various types of target recommendation information in the information recommendation interface may be set by the input method or may be customized by the user, and the embodiment of the present invention does not limit this.

[0130] When the display mode of various types of target recommendation information in the information recommendation interface is set by the input method, multiple display modes can be set. For example, various types of target recommendation information can be set to be displayed in descending order according to the total popularity; for example, various types of target recommendation information can be set to be displayed in the order of update time, and so on. The total popularity of each type of target recommendation information can be determined based on the popularity of each target recommendation information in the type; for example, for each type of target recommendation information, the corresponding total popularity can be the sum of the popularity of each target recommendation information in the type, or the average popularity, etc.; the embodiment of the present invention does not limit this.

[0131] In summary, in the embodiments of the present invention, recommendation information and user behavior information corresponding to the recommendation information can be obtained, and then target recommendation information can be selected from the obtained recommendation information based on the user behavior information of the recommendation information; and then information can be directly recommended to the user after the user triggers an information recommendation button; without the user having to perform other operations.

[0132] Reference Figure 4 , shows a flow chart of steps of another optional embodiment of a data processing method of the present invention, which may specifically include the following steps:

[0133] Step 402: receiving a trigger instruction for an information recommendation key in a keyboard when the preset panel is in a closed state, starting the preset panel of the input method and displaying an information recommendation interface in the preset panel.

[0134] Step 404: Obtain input association information.

[0135] In an embodiment of the present invention, after the preset panel is started and the information recommendation interface is opened in the preset panel, the intelligent assistant can obtain input-related information. The input-related information may include multiple types, such as interactive information in a chat scene, usage information of other applications, weather information, location information, etc., which are not limited in the embodiment of the present invention. The other applications may refer to applications other than input methods.

[0136] Step 406: Determine target recommendation information according to the input association information.

[0137] The input associated information may be analyzed first; then based on the analysis result, the recommended information with a high degree of association with the input associated information may be searched from the local database or server as the target recommended information. The recommended information may include multiple categories, such as expressions, phrases, sentences, news information, etc.; the top N2 recommended information with the highest degree of association with the input associated information may be searched from the recommended information of each category as the target recommended information. N2 is a positive integer and may be set as required, and the embodiment of the present invention does not limit this.

[0138] Step 408: Display the target recommendation information on the information recommendation interface.

[0139] In one example, various categories of target recommendation information may be displayed in the information recommendation interface in sequence according to the degree of association between the target recommendation information and the input association information. For example, various categories of target recommendation information may be displayed in the information recommendation interface in sequence according to the degree of association between the target recommendation information and the input association information, in descending order. The degree of association between each category of target recommendation information and the input association information may be determined based on the degree of association between each target recommendation information and the input association information in the category. For example, the degree of association between each category of target recommendation information and the input association information may be the sum of the degrees of association between each target recommendation information and the input association information in the category, or the average value of the degrees of association, etc. This is not limited in the embodiments of the present invention.

[0140] In summary, in the embodiments of the present invention, input association information can be obtained, and then target recommended information can be determined based on the input association information; and after the user triggers the information recommendation button, information can be directly recommended to the user without the user performing other operations. In addition, information associated with the user can be recommended to the user to meet the user's personalized needs.

[0141] In addition, after the preset panel is started and the information recommendation interface is displayed in the preset panel, the user behavior information of the input association information and the recommended information can also be obtained at the same time; then the target recommended information can be determined by combining the input association information and the user behavior information. For example, the target recommended information can be determined based on the user behavior information, and then the target recommended information can be filtered using the input association information. For another example, the user behavior information and the input association information can be used as two dimensions of information to jointly determine the target recommended information; the embodiment of the present invention does not limit this, so as to improve the accuracy of information recommendation.

[0142] Reference Figure 5 , shows a flow chart of steps of another optional embodiment of a data processing method of the present invention, which may specifically include the following steps:

[0143] Step 502: If the preset panel is in an open state and an information recommendation interface is displayed therein, the cursor is positioned in an input box of the information recommendation interface.

[0144] In one embodiment of the present invention, the information recommendation interface may be provided with an input box. After the preset panel of the input method is turned on and the information recommendation interface is displayed in the preset panel, the user may enter information in the input box of the information recommendation interface to find recommended information that meets their needs.

[0145] In one embodiment of the present invention, after the preset panel of the input method is in an open state and the information recommendation interface is displayed in the preset panel, the cursor can be positioned in the input box of the information recommendation interface; then the user can directly use the keyboard to enter information in the input box of the information recommendation interface without performing other operations to switch the cursor to the input box of the information recommendation interface.

[0146] Step 504: After the user inputs in the input box of the information recommendation interface, a trigger instruction for the information recommendation button on the keyboard is received.

[0147] Step 506: Obtain input information.

[0148] In an embodiment of the present invention, after the user completes the information input in the input box of the information recommendation interface, the information recommendation button in the keyboard can be triggered to find recommended information that matches the information input in the input box of the information recommendation interface. Correspondingly, the intelligent assistant can receive a trigger instruction for the information recommendation button in the keyboard, and then obtain the information input by the user in the input box of the information recommendation interface, and use the information input by the user in the input box of the information recommendation interface as input information, and then execute steps 508-510. Of course, after receiving the trigger instruction for the information recommendation button in the keyboard, the intelligent assistant can also obtain input-related information, use the input-related information as input information, and then execute steps 508-510.

[0149] In addition, in an embodiment of the present invention, after receiving a trigger instruction for an information recommendation button on the keyboard, the intelligent assistant can also obtain the information and input-related information entered by the user in the input box of the information recommendation interface; then use the information and input-related information entered by the user in the input box of the information recommendation interface as input information, and then execute steps 508-510.

[0150] Step 508: Determine target recommendation information based on the input information.

[0151] In an embodiment of the present invention, a method for determining target recommendation information based on the input information may be: searching for expressions that match the input information. The input information may be matched with keywords and / or subject words and / or tags of each expression, and keywords and / or subject words and / or tags may be searched for expressions that match the input information. The expressions may include at least one of the following: picture expressions, emoji expressions, and emoticons.

[0152] In addition, in the embodiment of the present invention, the input information may also be input into a pre-trained expression generation model to generate an expression matching the input information.

[0153] In an embodiment of the present invention, a method for determining target recommended information based on the input information may be: beautify the input information to obtain a beautified sentence. Among them, a sentence containing the input information may be searched from a local database or server; and the sentence containing the input information may be used as a beautified sentence. Also, a sentence expressing the same meaning as the input information may be searched from a local database or server; and the sentence expressing the same meaning as the input information may be used as a beautified sentence. It is also possible to expand based on the input information to generate a beautified sentence.

[0154] In an embodiment of the present invention, a method for determining target recommended information based on the input information may be: performing association based on the input information to obtain an associated sentence. In which, the input information may be associated with poems, lyrics, hot sentences, etc. that match the input information to obtain an associated sentence.

[0155] In an embodiment of the present invention, a method for determining target recommended information based on the input information may be: translating the input information to obtain text translation information, wherein the input information may be translated into text translation information corresponding to at least one language.

[0156] In an embodiment of the present invention, a method for determining target recommended information based on the input information may be: searching for information associated with the input information. The information may include at least one of the following: hot news, hot words, input statistical information, weather information; of course, other information may also be included, which is not limited in the embodiment of the present invention. In addition, information that may not be associated with the input information may also be searched.

[0157] In an embodiment of the present invention, a method for determining target recommended information according to the input information may be: searching for encyclopedia information of the input information.

[0158] In an embodiment of the present invention, a method for determining target recommended information based on the input information may be: searching for phonetic information of the input information. When the input information is in Chinese, the pinyin corresponding to the input information may be searched; when the input information is in other languages, the phonetic symbols of the corresponding languages ​​may be searched.

[0159] Then, target recommendation information may be generated based on one or more of the expressions, beautified sentences, associative sentences, text translation information, news information, encyclopedia information, and phonetic information.

[0160] Of course, other target recommendation information may also be determined in other ways, which is not limited in the embodiment of the present invention.

[0161] In an embodiment of the present invention, when the input information includes information input by the user in an input box of the information recommendation interface and input-related information, the target recommended information can be determined in combination with the information input by the user in the input box and the input-related information. For example, the target recommended information can be determined based on the information input by the user in the input box; and then the target recommended information can be filtered based on the input-related information. For another example, the information input in the input box of the information recommendation interface and the input-related information can be used as two dimensions of information to jointly determine the target recommended information; this is not limited in the embodiment of the present invention, so as to improve the accuracy of information recommendation.

[0162] Step 510: Display the target recommendation information on the information recommendation interface.

[0163] This step 510 is similar to the above step 308 or step 408 and will not be described again.

[0164] In summary, in an embodiment of the present invention, when the preset panel of the input method is in an open state and the information recommendation interface is displayed therein, the cursor can be positioned in the input box of the information recommendation interface; information can be input in the input box of the information recommendation interface without the user performing other operations, which simplifies user operations and improves input efficiency.

[0165] Secondly, in an embodiment of the present invention, after the user enters information in the input box of the information recommendation interface and triggers the information recommendation button, the intelligent assistant can receive a trigger instruction for the information recommendation button in the keyboard and obtain the input information; then determine the target recommended information based on the input information; thereby facilitating the user to find information that meets their needs and improving the accuracy of information recommendation.

[0166] Reference Figure 6 , shows a flow chart of steps of another optional embodiment of a data processing method of the present invention, which may specifically include the following steps:

[0167] Step 602: If the preset panel is in an open state and an information recommendation interface is displayed therein, after the user selects information in the application, a trigger instruction for an information recommendation button in the keyboard is received.

[0168] In an optional embodiment of the present invention, if the preset panel is in an open state and an information recommendation interface is displayed therein, the user can directly select information by scribbling words in the application interface (i.e., performing a selection operation on the text (which can be achieved through the keyboard, the mouse, or by touching the screen). The application may include an input method and other applications besides the input method.

[0169] Step 604: Obtain information selected by the user, and determine target recommendation information based on the information selected by the user.

[0170] After the user performs a word selection operation in the application, the intelligent assistant can obtain the information selected by the user, and then determine the target recommended information based on the information selected by the user (see step 508). This makes it easier for the user to find information that meets their needs; the user does not need to enter information in the input box of the information recommendation interface, which simplifies the user operation and improves the input efficiency and search efficiency.

[0171] Step 606: Display the target recommendation information on the information recommendation interface.

[0172] This step 606 is similar to the above step 308 and will not be described again here.

[0173] In summary, in the embodiment of the present invention, when the preset panel of the input method is in the open state and the information recommendation interface is displayed in the preset panel, the user can select information in the application; after the user selects information in other applications and triggers the information recommendation button, the intelligent assistant can receive the trigger instruction for the information recommendation button in the keyboard and obtain the information selected by the user; then the information is recommended based on the target selected by the user; thus, it is convenient for the user to find information that meets their needs, and the accuracy of information recommendation is improved. And the user does not need to enter information in the input box of the information recommendation interface, which simplifies the user operation and improves the input efficiency and search efficiency.

[0174] In an optional embodiment of the present invention, after executing steps 302 to 308 or steps 402 to 408, steps 502 to 510 or steps 602 to 606 may be executed. After step 508 or step 606, the target recommendation information displayed in the information recommendation interface of step 308 or step 408 may be updated based on the target recommendation information determined in step 508 or step 606.

[0175] In an optional embodiment of the present invention, the target recommendation information may include at least one of the following: expressions, beautified sentences, associative sentences, text translation information, news information, encyclopedia information, and phonetic information. Regardless of the type of recommendation information, the target recommendation information can be displayed on the screen. The method further includes: after displaying the target recommendation information on the information recommendation interface, receiving a selection instruction; and displaying the target recommendation information corresponding to the selection instruction on the screen. This can not only improve the efficiency of users inputting recommendation information, but also increase the fun of input.

[0176] In an optional embodiment of the present invention, when the target recommendation information is encyclopedia information or news information, the target recommendation information can also be browsed. The method also includes: receiving a browsing instruction, and displaying a detail page of the target recommendation information corresponding to the browsing instruction. Wherein, a browser is provided in the input method, and its built-in browser can be called to open the detail page of the target recommendation information corresponding to the browsing instruction in the preset panel. It is also possible to jump to a third-party browser to open the detail page of the target recommendation information corresponding to the browsing instruction, which is not limited by the embodiment of the present invention.

[0177] When the preset button is a screenshot button, the screenshot function in the input method can be activated to take a screenshot. Furthermore, based on the above embodiment, the embodiment of the present invention further discloses a data processing method, which can realize fast screenshot.

[0178] Reference Figure 7, shows a flow chart of steps of another data processing method embodiment of the present invention, which may specifically include the following steps:

[0179] Step 702: Receive a trigger instruction for a screenshot key preset in the keyboard, and start the screenshot function of the input method.

[0180] Step 704: determine the target area to be captured, and capture the target image corresponding to the target area.

[0181] In an embodiment of the present invention, when a user needs to use a smart assistant to take a screenshot, the user can trigger a screenshot key in the keyboard, such as the F2 key; correspondingly, the smart assistant can receive a trigger instruction for the screenshot key, and then can start the screenshot function therein.

[0182] After the screenshot function of the smart assistant is activated, the target area to be screenshotted can be automatically determined; the area to be screenshotted can also be determined according to the user's operation; for the convenience of subsequent explanation, the area to be screenshotted can be referred to as the target area. Then the target image corresponding to the target area is captured. In this way, the user can activate the screenshot function of the input method by triggering a key on the keyboard to achieve quick screenshot.

[0183] In summary, in an embodiment of the present invention, after receiving a trigger instruction for a screenshot button preset in the keyboard, the screenshot function of the input method can be started; then the target area to be screenshotted is determined, and the target image corresponding to the target area is captured; thereby achieving quick screenshots while the user is using the keyboard to input; simplifying the user's screenshot operation, improving screenshot efficiency, and also improving the user experience.

[0184] In the embodiment of the present invention, there may be multiple opportunities for a user to trigger a screenshot button in a keyboard. Correspondingly, there may be multiple ways for an intelligent assistant to determine a target area to be screenshotted, which may be as follows:

[0185] Among them, after the user selects information such as text or picture in the application, the screenshot button in the keyboard is triggered; in this case, a method for determining the target area to be screenshotted may be: if a trigger instruction for the preset screenshot button in the keyboard is received after the user selects information in the application, the area corresponding to the information selected by the user is determined as the target area to be screenshotted. The application may include an input method, or may include other applications except the input method, which is not limited in the embodiment of the present invention.

[0186] When the user does not select information in the application, one way to determine the target area to be captured can be: determine the area corresponding to the full screen as the target area to be captured. Of course, other preset areas in the screen, such as the left half area, the right half area, the middle area, etc., can also be determined as the target area to be captured.

[0187] When the user has not selected information in the application, a method for determining the target area to be captured may be: determining the application where the cursor is located; and determining the display area corresponding to the application as the target area to be captured.

[0188] When the user has not selected information in the application, after the screenshot function of the input method is started, the user can customize the screenshot area; correspondingly, a method for determining the target area to be screenshotted may be: receiving a screenshot area selection instruction; determining the target area to be screenshotted based on the screenshot area selection instruction.

[0189] In an optional embodiment of the present invention, after determining the target area, the user can also adjust the target area. If the user needs to adjust the target area, the adjustment operation can be performed on the target area; correspondingly, the intelligent assistant can receive the adjustment instruction for the target area; and update the target area according to the adjustment instruction.

[0190] In an embodiment of the present invention, the intelligent assistant may further include an image recognition function, which may be used to perform text recognition on a captured screen image. In one example, a screenshot button may be associated with the image recognition function, so that after the user triggers the screenshot button, not only can a screenshot be taken, but also text recognition can be performed on the captured screen image.

[0191] Reference Figure 8 , shows a flow chart of steps of another optional embodiment of a data processing method of the present invention, which may specifically include the following steps:

[0192] Step 802: Receive a trigger instruction for a screenshot key preset in the keyboard, and start the screenshot function of the input method.

[0193] For example, when a user is inputting text using a keyboard, he or she can press the F2 key on the keyboard to enable the screenshot function of the input method. After the user presses the F2 key on the keyboard, the smart assistant can receive a trigger instruction for the screenshot key preset on the keyboard and start the screenshot function therein.

[0194] Step 804: Determine the target area to be captured.

[0195] The following is an example of user-defined selection of a screenshot area.

[0196] In one example, the user can select the area of ​​the screen to be captured by operating the mouse. Correspondingly, the intelligent assistant can determine the area selected by the user based on the mouse signal, and then determine the area selected by the user as the target area.

[0197] In one example, a user can select an area on the screen that needs to be captured by operating the keyboard. Correspondingly, the intelligent assistant can determine the area selected by the user based on the keyboard signal, and then determine the area selected by the user as the target area.

[0198] In one example, the user can touch the screen to select the area on the screen that needs to be captured. Correspondingly, the intelligent assistant can determine the area selected by the user based on the screen touch signal, and then determine the area selected by the user as the target area.

[0199] In an embodiment of the present invention, after determining the target area to be screenshotted, multiple options may be displayed, such as a screenshot option, a cancel option, and a text recognition option. Among them, the user can capture the target image in the target area by triggering the screenshot option; turn off the screenshot function of the smart assistant by triggering the cancel option; and capture the target image in the target area and perform text recognition on the target image by triggering the text recognition option.

[0200] Among them, the user can trigger any one of the screenshot option, cancel option and text recognition option through the keyboard; the user can also trigger any one of the screenshot option, cancel option and text recognition option through the mouse; the user can also trigger any one of the screenshot option, cancel option and text recognition option by touching the screen; the embodiment of the present invention is not limited to this.

[0201] Step 806: If a screenshot instruction is received after the target area to be screenshotted is determined, a target image corresponding to the target area is captured and the target image is copied.

[0202] When the user triggers the screenshot option, the smart assistant can receive the corresponding screenshot instruction, and then can capture the target image corresponding to the target area and copy the target image.

[0203] After the user performs the paste operation, the method further includes: receiving a paste instruction; pasting the target image into the input box where the cursor is located. If the user does not switch the input box where the cursor is located after triggering the screenshot option, the target image can be pasted into the input box where the cursor is located before the screenshot function is started. If the user switches the input box where the cursor is located after triggering the screenshot option, the target image can be pasted into the input box after the cursor is switched.

[0204] Step 808: If a text recognition instruction is received after the target area to be screenshotted is determined, the target image corresponding to the target area is captured, and text recognition is performed on the target image to obtain the image text information corresponding to the target image and display it in the preset panel of the input method.

[0205] When the user triggers the text recognition option, the smart assistant can receive the corresponding text recognition instruction, and then can capture the target image corresponding to the target area; and perform text recognition on the target image to obtain the image text information corresponding to the target image and display it in the preset panel of the input method. In one example, OCR (Optical Character Recognition) technology can be used to perform text recognition on the target image to obtain the corresponding image text information. The preset panel can be a smart assistant panel.

[0206] In an example of the present invention, the image text information of the target image may be displayed in a preset panel in a layout that is the same as or similar to the image text information in the image.

[0207] In the embodiment of the present invention, after the image text information of the target image is displayed in the preset panel, multiple options such as a copy option and a download option may be displayed. The user may copy the image text information by triggering the copy option, and download the image text information by triggering the download option.

[0208] Among them, the user can trigger any option among the copy option and the download option through the keyboard; can also trigger any option among the copy option and the download option through the mouse; can also trigger any option among the copy option and the download option by touching the screen; the embodiment of the present invention does not limit this.

[0209] After the user triggers the copy option, the intelligent assistant can receive the copy instruction and copy the image text information. The user can then paste the image text information into the input box where the target text information is to be input.

[0210] The method further includes: receiving a paste instruction; pasting the image text information into the input box where the cursor is located. If the user does not switch the input box where the cursor is located after triggering the text recognition option, the image text information can be pasted into the input box where the cursor is located before the smart assistant screenshot function is started. If the user switches the input box where the cursor is located after triggering the text recognition option, the image text information can be pasted into the input box after the cursor is switched.

[0211] In an example of the present invention, after capturing the target image corresponding to the target area in step 808, the target image can also be copied, thereby simultaneously realizing screenshot and image recognition. Therefore, before the user triggers the copy option, the latest copy information in the clipboard is the target image. The method further includes: receiving a paste instruction; pasting the target image into the input box where the cursor is located.

[0212] After the user triggers the download option, the intelligent assistant can receive the download instruction and download the image text information.

[0213] Step 810: If a cancel instruction is received after the target area to be captured is determined, the capture function of the input method is turned off.

[0214] When the user triggers the cancel option, the smart assistant can receive the corresponding cancel instruction, and can then turn off the screenshot function of the input method to cancel the current screenshot. When the user needs to take a screenshot or perform text recognition again, the screenshot button can be triggered again.

[0215] In summary, in the embodiments of the present invention, if a text recognition instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, the steps of performing text recognition on the target image, obtaining and displaying the image text information corresponding to the target image are performed; thereby, after the user starts the screenshot function, the user can directly perform text recognition on the screenshot image without using other tools or other applications to perform text recognition on the screenshot image; this simplifies the user's text recognition operation, improves text recognition efficiency, and can also improve user experience.

[0216] In an optional embodiment of the present invention, preset keys other than keys associated with other functions in the smart assistant can be associated with the image recognition function; that is, the preset key associated with the screenshot function is not the same key as the preset key associated with the image recognition function. Then the smart assistant receives a trigger instruction for the preset key associated with the screenshot function in the keyboard, starts the screenshot function of the input method, determines the target area to be screenshotted, and captures the target image corresponding to the target area. When the smart assistant receives a trigger instruction for the preset key associated with the image recognition function in the keyboard, it starts the image recognition function of the smart assistant, determines the target area to be screenshotted, and captures the target image corresponding to the target area; performs text recognition on the target image, obtains the image text information corresponding to the target image and displays it in the preset panel of the input method. Then, there is no need for the user to select whether to take a screenshot or perform text recognition on the image. Of course, if the smart assistant receives a trigger instruction for the preset key associated with the image recognition function in the keyboard, after capturing the target image corresponding to the target area, the target image can also be copied.

[0217] Among them, when the preset button is an expression recommendation button, the expression recommendation function in the input method can be activated to recommend various expressions to the user.

[0218] Based on the above embodiments, the present invention provides an emoticon recommendation method, which can recommend various emoticons to users. The details are as follows:

[0219] Reference Fig. 9 , shows a flowchart of an embodiment of an expression recommendation method of the present invention, which may specifically include the following steps:

[0220] Step 902: Receive a trigger instruction for an expression recommendation button preset in the keyboard, and display an expression recommendation interface in a preset panel of the input method.

[0221] Step 904: determine a target expression to be recommended, and display the target expression in the expression recommendation interface.

[0222] In an embodiment of the present invention, when a user needs to use an intelligent assistant to recommend emoticons, an emoticon recommendation key in the keyboard, such as the F3 key, can be triggered. Correspondingly, the intelligent assistant can receive a trigger instruction for the emoticon recommendation key; if the preset panel of the input method is in a closed state, the preset panel can be started, and the emoticon recommendation interface can be displayed in the preset panel. The preset panel can be an intelligent assistant panel. If the preset panel of the input method is in an open state, the emoticon recommendation interface can be directly displayed in the preset panel.

[0223] In an embodiment of the present invention, a target expression to be recommended can be determined while displaying an expression recommendation interface, and the target expression can be displayed on the expression recommendation interface. That is, the embodiment of the present invention does not limit the execution order of displaying the expression recommendation interface in the preset panel of the input method in step 902 and determining the target expression to be recommended in step 904; determining the target expression to be recommended in step 904 can be performed after displaying the expression recommendation interface in the preset panel of the input method in step 902, or can be performed simultaneously with displaying the expression recommendation interface in the preset panel of the input method in step 902.

[0224] The target expression may include at least one of the following: picture expressions, emojis, and emoticons.

[0225] Subsequently, the user can select the desired target emoticon from the target emoticons displayed in the emoticon recommendation interface as needed; and then, when the user is using the keyboard to input information, the user can use the emoticon recommendation function of the input method by triggering the emoticon recommendation button on the keyboard, without having to switch from the keyboard to the mouse and use the mouse to trigger the emoticon recommendation function; this simplifies the operation of the user using the emoticon recommendation function in the input method; and can also improve the user experience.

[0226] In summary, in the embodiments of the present invention, after receiving a trigger instruction for an emoticon button preset in the keyboard, an emoticon recommendation interface can be displayed in the preset panel of the input method; and a target emoticon to be recommended is determined, and the target emoticon is displayed in the emoticon recommendation interface, so that the user can use the emoticon recommendation function of the input method by triggering the emoticon recommendation button in the keyboard during the process of using the keyboard to input information, without having to switch from the keyboard to the mouse and use the mouse to trigger the use of the emoticon recommendation function; this simplifies the operation of the user using the emoticon recommendation function in the input method, improves the efficiency of using the emoticon recommendation function; and can also improve the user experience.

[0227] Reference Fig.10 , shows a flowchart of an optional embodiment of an expression recommendation method of the present invention, which may specifically include the following steps:

[0228] Step 1002: receiving a trigger instruction for an expression recommendation button preset in a keyboard when the preset panel is in a closed state, starting the preset panel of the input method and displaying an expression recommendation interface in the preset panel.

[0229] For example, when a user is inputting information using a keyboard, he or she may press the F3 key on the keyboard to enable the emoji recommendation function of the input method. After the user presses the F3 key on the keyboard, the smart assistant may receive a trigger instruction for the emoji recommendation key preset on the keyboard, and then may start the smart assistant panel and display the emoji recommendation interface on the smart assistant panel.

[0230] Step 1004: Obtain the expression and the user behavior information corresponding to the expression.

[0231] In the embodiment of the present invention, the expression and the user behavior information corresponding to the expression can be obtained from a local database, or from a server, and the embodiment of the present invention does not limit this.

[0232] Step 1006: Select a target expression to be recommended from the acquired expressions based on the user behavior information corresponding to the recommended expression.

[0233] Each type of expression may include at least one expression. For each type of target expression, the user behavior information of each expression in the type may be analyzed to determine the popularity of each expression in the type. Then, the expressions in the type may be sorted according to the popularity of each expression in the type; and based on the sorting result, the top N3 expressions with the highest popularity may be selected as the target expressions. N3 is a positive integer and may be set as required, and the embodiment of the present invention does not limit this.

[0234] The user behavior information may include usage frequency, which may be the usage frequency of users across the entire network. In one example, the usage frequency may be used as the heat corresponding to each expression, and the N3 expressions with the highest usage frequency may be used as the target expressions.

[0235] Step 1008: Display the target expression on the expression recommendation interface.

[0236] In one example, various target expressions of different categories can be displayed in the expression recommendation interface in sequence according to the type of the target expression. The display mode of various target expressions of different categories in the expression recommendation interface can be set by the input method or can be customized by the user, which is not limited in the embodiment of the present invention.

[0237] When the display mode of various types of target expressions in the expression recommendation interface is set by the input method, multiple display modes can be set. For example, various types of target expressions can be set to be displayed in descending order according to the total popularity; for example, various types of target expressions can be set to be displayed in the order of update time, and so on. Among them, the total popularity of each type of target expression can be determined based on the popularity of each target expression in the type; for example, for each type of target expression, the corresponding total popularity can be the sum of the popularity of each target expression in the type, or the average popularity, etc.; the embodiment of the present invention does not limit this.

[0238] In summary, in the embodiments of the present invention, expressions and user behavior information corresponding to the expressions can be obtained, and then a target expression can be selected from the obtained expressions based on the user behavior information of the expression; and then after the user triggers an expression recommendation button, expressions can be directly recommended to the user without the user having to perform other operations.

[0239] Reference Fig.11 , shows a flowchart of another optional embodiment of the expression recommendation method of the present invention, which may specifically include the following steps:

[0240] Step 1102: receiving a trigger instruction for an expression recommendation button preset in the keyboard when the preset panel is in a closed state, starting the preset panel of the input method and displaying an expression recommendation interface in the preset panel.

[0241] Step 1104: Obtain input association information.

[0242] In an embodiment of the present invention, after starting the preset panel of the input method and opening the expression recommendation interface in the preset panel, the intelligent assistant can obtain input-related information. The input-related information may include multiple types, such as interactive information in a chat scene, usage information of other applications, weather information, location information, etc., which is not limited in the embodiment of the present invention.

[0243] Step 1106: Determine the target expression based on the input association information.

[0244] The input association information may be analyzed first; then, based on the analysis result, expressions with a high degree of association with the input association information may be searched from a local database or a server as target expressions. The top N4 expressions with the highest degree of association with the input association information may be searched from each type of expression as target expressions. N4 is a positive integer and may be set as required, and the embodiment of the present invention does not limit this.

[0245] Step 1108: Display the target expression on the expression recommendation interface.

[0246] In one example, various categories of target expressions may be displayed in the expression recommendation interface in sequence according to the degree of association between the target expressions and the input associated information. For example, various categories of target expressions may be displayed in the expression recommendation interface in sequence according to the degree of association between the target expressions and the input associated information, in descending order. The degree of association between each category of target expressions and the input associated information may be determined based on the degree of association between each target expression in the category and the input associated information. For example, the degree of association between each category of target expressions and the input associated information may be the sum of the degrees of association between each target expression in the category and the input associated information, or the average value of the degrees of association, etc. This is not limited in the embodiments of the present invention.

[0247] In summary, in the embodiments of the present invention, input association information can be obtained, and then the target expression can be determined according to the input association information; and then, after the user triggers the expression recommendation button, the expression can be directly recommended to the user without the user performing other operations. In addition, information associated with the user can be recommended to the user to meet the user's personalized needs.

[0248] In addition, after starting the preset panel of the input method and displaying the expression recommendation interface in the preset panel, the input association information and the user behavior information of the expression can also be obtained at the same time; then the target expression can be determined by combining the input association information and the user behavior information. For example, the target expression can be determined based on the user behavior information first, and then the target expression can be screened using the input association information. For another example, the user behavior information and the input association information can also be used as two dimensions of information to jointly determine the target expression; the embodiment of the present invention does not limit this to improve the accuracy of expression recommendation.

[0249] Reference Fig.12 , shows a flowchart of another optional embodiment of an expression recommendation method of the present invention, which may specifically include the following steps:

[0250] Step 1202: If the preset panel is in an open state and an expression recommendation interface is displayed therein, the cursor is positioned in an input box of the expression recommendation interface.

[0251] In one embodiment of the present invention, the emoticon recommendation interface may be provided with an input box. If the preset panel of the input method is in an open state and the emoticon recommendation interface is displayed in the preset panel, the user may enter information in the input box of the emoticon recommendation interface to find emoticons that meet their needs.

[0252] In one embodiment of the present invention, after the preset panel of the input method is in an open state and the emoticon recommendation interface is displayed in the preset panel, the cursor can be positioned in the input box of the emoticon recommendation interface; then the user can directly use the keyboard to enter information in the input box of the emoticon recommendation interface without performing other operations to switch the cursor to the input box of the emoticon recommendation interface.

[0253] Step 1204: After the user inputs in the input box of the emoticon recommendation interface, a trigger instruction for an emoticon recommendation button preset in the keyboard is received.

[0254] Step 1206: Obtain input information.

[0255] In an embodiment of the present invention, after the user completes inputting information in the input box of the emoticon recommendation interface, the emoticon recommendation button in the keyboard can be triggered to search for emoticons that match the information input in the input box of the emoticon recommendation interface. Correspondingly, the intelligent assistant can receive a trigger instruction for the emoticon recommendation button preset in the keyboard, and then obtain the information input by the user in the input box of the emoticon recommendation interface, and use the information input by the user in the input box of the emoticon recommendation interface as input information, and then execute steps 1208-1210. Of course, after receiving the trigger instruction for the emoticon recommendation button in the keyboard, the intelligent assistant can also obtain input-related information, use the input-related information as input information, and then execute steps 1208-1210.

[0256] In addition, in an embodiment of the present invention, after receiving a trigger instruction for an emoticon recommendation button in the keyboard, the intelligent assistant can also obtain the information entered by the user in the input box of the emoticon recommendation interface and input-related information; then use the information entered by the user in the input box of the emoticon recommendation interface and input-related information as input information, and then execute steps 1208-1210.

[0257] Step 1208: Determine the target expression based on the input information.

[0258] In an embodiment of the present invention, a method for determining a target expression based on the input information may be: matching the input information with keywords and / or subject words and / or tags of each expression, searching for keywords and / or subject words and / or tags, and finding a target expression that matches the input information.

[0259] In addition, in the embodiment of the present invention, the input information may also be input into a pre-trained expression generation model to generate a target expression matching the input information.

[0260] Of course, the target expression may also be determined in other ways, which are not limited in the embodiment of the present invention.

[0261] In an embodiment of the present invention, when the input information includes information input by the user in an input box of an emoticon recommendation interface and input-related information, the target emoticon can be determined in combination with the information input by the user in the input box and the input-related information. For example, the target emoticon can be determined based on the information input by the user in the input box; and then the target emoticon can be filtered based on the input-related information. For another example, the information input in the input box of the emoticon recommendation interface and the input-related information can be used as two dimensions of information to jointly determine the target emoticon; the embodiment of the present invention does not limit this, so as to improve the accuracy of emoticon recommendation.

[0262] Step 1210: Display the target expression on the expression recommendation interface.

[0263] This step 1210 is similar to the above-mentioned step 1008 or step 1108 and will not be repeated here.

[0264] In summary, in an embodiment of the present invention, when the preset panel of the input method is in an open state and an emoticon recommendation interface is displayed in the preset panel, the cursor can be positioned in the input box of the emoticon recommendation interface; information can be input in the input box of the emoticon recommendation interface without the user performing other operations, which simplifies user operations and improves input efficiency.

[0265] Secondly, in an embodiment of the present invention, after the user enters information in the input box of the emoticon recommendation interface and triggers the emoticon recommendation button, the intelligent assistant can receive a trigger instruction for the emoticon recommendation button preset in the keyboard and obtain the input information; then determine the target emoticon based on the input information; thereby facilitating the user to find emoticons that meet their needs, thereby improving the accuracy of emoticon recommendations.

[0266] Reference Fig.13 , shows a flowchart of another optional embodiment of an expression recommendation method of the present invention, which may specifically include the following steps:

[0267] Step 1302: If the preset panel is in an open state and an emoticon recommendation interface is displayed therein, a trigger instruction for an emoticon recommendation button in the keyboard is received after the user selects information in the application.

[0268] In an optional embodiment of the present invention, if the preset panel is in an open state and an emoticon recommendation interface is displayed therein, the user can directly select information by scribbling words in the application interface (i.e., performing a selection operation on the text (which can be achieved through a keyboard, a mouse, or touch on the screen). The application may include an input method and other applications except the input method.

[0269] Step 1304: Obtain information selected by the user, and determine the target expression based on the information selected by the user.

[0270] After the user performs a word selection operation in the application, the intelligent assistant can obtain the information selected by the user, and then determine the target emoticon based on the information selected by the user (see step 1208). This makes it easier for the user to find emoticons that meet their needs; the user does not need to enter information in the input box of the emoticon recommendation interface, which simplifies the user operation and improves the input efficiency and search efficiency.

[0271] Step 1306: Display the target expression on the expression recommendation interface.

[0272] This step 1306 is similar to the above-mentioned step 1008 or step 1108 and will not be repeated here.

[0273] In summary, in the embodiment of the present invention, when the preset panel of the input method is in the open state and the expression recommendation interface is displayed in the preset panel, the user can select information in the application; after the user selects information in other applications and triggers the expression recommendation button, the intelligent assistant can receive the trigger instruction for the expression recommendation button in the keyboard and obtain the information selected by the user; then determine the target expression according to the user's selection; thereby facilitating the user to find expressions that meet their needs, thereby improving the accuracy of expression recommendation. And the user does not need to enter information in the input box of the expression recommendation interface, which simplifies the user operation and improves the input efficiency and search efficiency.

[0274] In an optional embodiment of the present invention, steps 1202 to 1210 or steps 1302 to 1306 may be executed after executing steps 1002 to 1008 or steps 1102 to 1108; and after step 1210 or step 1306, the target expression displayed in the expression recommendation interface of step 1008 or step 1108 may be updated based on the target expression determined in step 1210 or step 1306.

[0275] In an optional embodiment of the present invention, the method further includes: after displaying the target expression on the expression recommendation interface, receiving a selection instruction; and displaying the target expression corresponding to the selection instruction on the screen. This can not only improve the efficiency of the user's expression input, but also increase the fun of input.

[0276] Among them, when the preset button is an information recommendation button, the information recommendation function in the input method can be activated to recommend various information to the user.

[0277] Based on the above embodiments, the present invention provides an information recommendation method, which can recommend various information to users. The details are as follows:

[0278] Reference Fig.14 , shows a flow chart of steps of an information recommendation method embodiment of the present invention, which may specifically include the following steps:

[0279] Step 1402: Receive a trigger instruction for an information recommendation button preset in the keyboard, and display an information recommendation interface in a preset panel of the input method.

[0280] Step 1404: determine target information to be recommended, and display the target information in the information recommendation interface.

[0281] In an embodiment of the present invention, when a user needs to use an intelligent assistant for information recommendation, an information recommendation key in the keyboard, such as the F4 key, can be triggered. Correspondingly, the intelligent assistant can receive a trigger instruction for the information recommendation key, and if the preset panel of the input method is in a closed state, the preset panel can be started, and the information recommendation interface can be displayed in the preset panel. The preset panel can be an intelligent assistant panel. If the preset panel of the input method is in an open state, the information recommendation interface can be directly displayed in the preset panel.

[0282] In an embodiment of the present invention, while opening the information recommendation interface, the target information to be recommended can be determined, and the target information can be displayed on the information recommendation interface. That is, the embodiment of the present invention does not limit the execution order of displaying the information recommendation interface in the preset panel of the input method in step 1402 and determining the target information in step 1404; determining the target information in step 1404 can be performed after displaying the information recommendation interface in the preset panel of the input method in step 1402, or can be performed simultaneously with displaying the information recommendation interface in the preset panel of the input method in step 1402.

[0283] The target information may include at least one of the following: weather information, input statistics, hot words and hot news, etc.

[0284] Subsequently, the user can select the required target information from the target information displayed in the information recommendation interface as needed; further, when the user is using the keyboard to input information, the user can use the information recommendation function of the input method by triggering the information recommendation button on the keyboard, without having to switch from the keyboard to the mouse and use the mouse to trigger the information recommendation function; this simplifies the operation of the user using the information recommendation function in the input method; and can also improve the user experience.

[0285] In summary, in the embodiments of the present invention, after receiving a trigger instruction for an information information button preset in the keyboard, an information recommendation interface can be displayed in the preset panel of the input method; and target information to be recommended is determined, and the target information information is displayed in the information recommendation interface, so that the user can use the information recommendation function of the input method by triggering the information recommendation button in the keyboard during the process of using the keyboard to input information, without having to switch from the keyboard to the mouse and use the mouse to trigger the use of the information recommendation function; this simplifies the operation of the user using the information recommendation function in the input method, improves the efficiency of using the information recommendation function; and can also improve the user experience.

[0286] Reference Fig.15 , shows a flow chart of steps of an optional embodiment of an information recommendation method of the present invention, which may specifically include the following steps:

[0287] Step 1502: When the preset panel is in a closed state, a trigger instruction for an information recommendation button preset in the keyboard is received, the preset panel of the input method is started, and an information recommendation interface is displayed in the preset panel.

[0288] For example, when a user is inputting information using a keyboard, he or she may press the F4 key on the keyboard to enable the information recommendation function of the input method. After the user presses the F4 key on the keyboard, the smart assistant may receive a trigger instruction for the preset information recommendation key on the keyboard, and then may start the smart assistant panel and display the information recommendation interface on the smart assistant panel.

[0289] Step 1504: Obtain information about the news and user behavior information corresponding to the information.

[0290] In the embodiment of the present invention, the information information and the user behavior information corresponding to the information information can be obtained from a local database, or the information information and the user behavior information corresponding to the information information can be obtained from a server, and the embodiment of the present invention does not limit this.

[0291] Step 1506: Select target information to be recommended from the acquired information based on the user behavior information corresponding to the recommended information.

[0292] Each category of information may include at least one piece of information. For each category of target information, analysis may be performed based on user behavior information of each piece of information in the category to determine the popularity of each piece of information in the category. Then, the information in the category may be sorted according to the popularity of each piece of information in the category; and based on the sorting result, the top N5 pieces of information with the highest popularity may be selected as the target information. N5 is a positive integer and may be set as required, and the embodiment of the present invention does not limit this.

[0293] The user behavior information may include browsing frequency; the browsing frequency may be the browsing frequency of users on the entire network. In one example, the browsing frequency may be used as the popularity corresponding to each information; and then the N5 information with the highest browsing frequency may be used as the target information.

[0294] Step 1508: Display the target information on the information recommendation interface.

[0295] In one example, various types of target information can be displayed in the information recommendation interface in sequence according to the type of target information. The display mode of various types of target information in the information recommendation interface can be set by the input method or customized by the user, which is not limited in the embodiment of the present invention.

[0296] When the display mode of various categories of target information in the information recommendation interface is set by the input method, multiple display modes can be set. For example, various categories of target information can be set to be displayed in descending order of total popularity; for example, various categories of target information can be set to be displayed in the order of update time, and so on. Among them, the total popularity of each category of target information can be determined based on the popularity of each target information in the category; for example, for each category of target information, the corresponding total popularity can be the sum of the popularity of each target information in the category, or the average popularity, etc.; the embodiment of the present invention does not limit this.

[0297] In summary, in the embodiments of the present invention, information information and user behavior information corresponding to the information information can be obtained, and then target information information can be selected from the obtained information based on the user behavior information of the information information; and then after the user triggers an information recommendation button, information can be directly recommended to the user without the user performing other operations.

[0298] Reference Fig.16 , shows a flowchart of another optional embodiment of the information recommendation method of the present invention, which may specifically include the following steps:

[0299] Step 1602: When the preset panel is in a closed state, a trigger instruction for an information recommendation button preset in the keyboard is received, the preset panel of the input method is started, and an information recommendation interface is displayed in the preset panel.

[0300] Step 1604: Obtain input-related information.

[0301] In an embodiment of the present invention, after starting the preset panel of the input method and opening the information recommendation interface in the preset panel, the intelligent assistant can obtain input-related information. The input-related information may include multiple types, such as interactive information in a chat scene, usage information of other applications, weather information, location information, etc., which is not limited in the embodiment of the present invention.

[0302] Step 1606: Determine target information based on the input association information.

[0303] The input related information may be analyzed first; then, based on the analysis result, information with a high degree of correlation with the input related information may be searched from a local database or a server as target information. The first N6 information with the highest degree of correlation with the input related information may be searched from each type of information as target information. N6 is a positive integer and may be set as required, and the embodiment of the present invention does not limit this.

[0304] Step 1608: Display the target information on the information recommendation interface.

[0305] In one example, various categories of target information information may be displayed in the information recommendation interface in sequence according to the degree of association between the various categories of target information information and the input associated information. For example, various categories of target information information may be displayed in the information recommendation interface in sequence according to the degree of association between the various categories of target information information and the input associated information, in order from high to low. The degree of association between each category of target information information and the input associated information may be determined based on the degree of association between each target information information and the input associated information in the category. For example, the degree of association between each category of target information information and the input associated information may be the sum of the degrees of association between each target information information and the input associated information in the category, or the average value of the degrees of association, etc. This is not limited in the embodiments of the present invention.

[0306] In summary, in the embodiments of the present invention, input association information can be obtained, and then target information can be determined based on the input association information; and after the user triggers the information recommendation button, information can be directly recommended to the user without the user performing other operations. In addition, information associated with the user can be recommended to the user to meet the user's personalized needs.

[0307] In addition, after starting the preset panel of the input method and displaying the information recommendation interface in the preset panel, the input-related information and the user behavior information of the information can also be obtained at the same time; then the input-related information and the user behavior information can be combined to determine the target information. For example, the target information can be determined based on the user behavior information, and then the target information can be screened using the input-related information. For another example, the user behavior information and the input-related information can be used as two dimensions of information to jointly determine the target information; the embodiment of the present invention does not limit this to improve the accuracy of information recommendation.

[0308] Reference Fig.17 , shows a flowchart of another optional embodiment of the information recommendation method of the present invention, which may specifically include the following steps:

[0309] Step 1702: If the preset panel is in an open state and an information recommendation interface is displayed therein, the cursor is positioned in an input box of the information recommendation interface.

[0310] In one embodiment of the present invention, the information recommendation interface may be provided with an input box. After the preset panel of the input method is turned on and the information recommendation interface is displayed in the preset panel, the user may enter information in the input box of the information recommendation interface to search for information that meets his or her needs.

[0311] In one embodiment of the present invention, after the preset panel of the input method is in an open state and the information recommendation interface is displayed in the preset panel, the cursor can be positioned in the input box of the information recommendation interface; then the user can directly use the keyboard to enter information in the input box of the information recommendation interface without performing other operations to switch the cursor to the input box of the information recommendation interface.

[0312] Step 1704: After the user inputs in the input box of the information recommendation interface, a trigger instruction for the preset information recommendation button in the keyboard is received.

[0313] Step 1706: Obtain input information.

[0314] In an embodiment of the present invention, after the user completes the information input in the input box of the information recommendation interface, the information recommendation button in the keyboard can be triggered again to find information matching the information input in the input box of the information recommendation interface. Correspondingly, the intelligent assistant can receive a trigger instruction for the preset information recommendation button in the keyboard, and then obtain the information input by the user in the input box of the information recommendation interface, and use the information input by the user in the input box of the information recommendation interface as input information, and then execute steps 1708-1710. Of course, after receiving the trigger instruction for the information recommendation button in the keyboard, the intelligent assistant can also obtain input-related information, use the input-related information as input information, and then execute steps 1708-1710.

[0315] In addition, in an embodiment of the present invention, after receiving a trigger instruction for an information recommendation button on the keyboard, the intelligent assistant can also obtain information entered by the user in the input box of the information recommendation interface and input-related information; then use the information entered by the user in the input box of the information recommendation interface and input-related information as input information, and then execute steps 1708-1710.

[0316] Step 1708: Determine target information based on the input information.

[0317] In an embodiment of the present invention, a method for determining target information based on the input information may be: matching the input information with keywords and / or subject words and / or tags of each information information, searching for keywords and / or subject words and / or tags, and target information matching the input information.

[0318] Of course, the target information may also be determined in other ways, which are not limited in the embodiment of the present invention.

[0319] In an embodiment of the present invention, when the input information includes information input by the user in an input box of the information recommendation interface and input associated information, the target information can be determined in combination with the information input by the user in the input box and the input associated information. For example, the target information can be determined based on the information input by the user in the input box; and then the target information can be filtered based on the input associated information. For another example, the information input in the input box of the information recommendation interface and the input associated information can be used as two dimensions of information to jointly determine the target information; the embodiment of the present invention does not limit this, so as to improve the accuracy of information recommendation.

[0320] Step 1710: Display the target information on the information recommendation interface.

[0321] This step 1710 is similar to the above-mentioned step 1608 or step 1508 and will not be repeated here.

[0322] In summary, in the embodiments of the present invention, after the preset panel of the input method is in an open state and the information recommendation interface is displayed in the preset panel, the cursor can be positioned in the input box of the information recommendation interface; information can be input in the input box of the information recommendation interface without the user performing other operations, which simplifies user operations and improves input efficiency.

[0323] Secondly, in an embodiment of the present invention, after the user enters information in the input box of the information recommendation interface and triggers the information recommendation button, the intelligent assistant can receive a trigger instruction for the information recommendation button preset in the keyboard and obtain the input information; then determine the target information based on the input information; thereby facilitating the user to find information that meets their needs, thereby improving the accuracy of information recommendation.

[0324] Reference Fig.18 , shows a flowchart of another optional embodiment of the information recommendation method of the present invention, which may specifically include the following steps:

[0325] Step 1802: If the preset panel is in an open state and the information recommendation interface is displayed therein, after the user selects information in the application, a trigger instruction for the information recommendation button in the keyboard is received.

[0326] In an optional embodiment of the present invention, if the preset panel is in an open state and an information recommendation interface is displayed therein, the user can directly select information by scribbling words in the application interface (i.e., performing a selection operation on the text (which can be achieved through the keyboard, the mouse, or by touching the screen). The application may include an input method and other applications except the input method.

[0327] Step 1804: Obtain the information selected by the user, and determine the target information based on the information selected by the user.

[0328] After the user performs a word selection operation in the application, the intelligent assistant can obtain the information selected by the user, and then determine the target information based on the information selected by the user (see step 1708). This makes it easier for the user to find information that meets their needs; the user does not need to enter information in the input box of the information recommendation interface, which simplifies the user operation and improves the input efficiency and search efficiency.

[0329] Step 1806: Display the target information on the information recommendation interface.

[0330] This step 1806 is similar to the above-mentioned step 1608 or step 1508 and will not be repeated here.

[0331] In summary, in the embodiment of the present invention, when the preset panel of the input method is in the open state and the information recommendation interface is displayed in the preset panel, the user can select information in the application; after the user selects information in other applications and triggers the information recommendation button, the intelligent assistant can receive the trigger instruction for the information recommendation button in the keyboard and obtain the information selected by the user; then determine the target information according to the user's selection; thereby facilitating the user to find information that meets their needs, thereby improving the accuracy of information recommendation. And the user does not need to enter information in the input box of the information recommendation interface, which simplifies the user operation and improves the input efficiency and search efficiency.

[0332] In an optional embodiment of the present invention, steps 1702 to 1710 or steps 1802 to 1806 may be executed after executing steps 1502 to 1508 or steps 1602 to 1608; and after step 1710 or step 1806, the target information information displayed in the information recommendation interface of step 1508 or step 1608 may be updated based on the target information information determined in step 1710 or step 1806.

[0333] In an optional embodiment of the present invention, the method further includes: receiving a browsing instruction, and displaying a detail page of the target information corresponding to the browsing instruction. Wherein, the input method is provided with a browser, and its built-in browser can be called to open the detail page of the target information corresponding to the browsing instruction in the preset panel. It is also possible to jump to a third-party browser to open the detail page of the target information corresponding to the browsing instruction, which is not limited in the embodiment of the present invention.

[0334] When the preset button is a voice input button, the voice input function in the input method can be activated to perform voice input.

[0335] On the basis of the above embodiment, the embodiment of the present invention further provides a voice input method to implement voice input; the method may be as follows:

[0336] Reference Fig.19 , shows a flow chart of steps of an embodiment of a voice input method of the present invention, which may specifically include the following steps:

[0337] Step 1902: Receive a trigger instruction for a preset voice input key in the keyboard to start the voice input function of the input method.

[0338] Step 1904: Acquire voice data and perform voice recognition on the voice data.

[0339] Step 1906: Perform corresponding operations based on the speech recognition results.

[0340] In an embodiment of the present invention, when a user needs to use an intelligent assistant for voice input (such as voice input instructions, voice input text, etc.), a voice input button in the keyboard, such as a voice key, can be triggered; correspondingly, the intelligent assistant can receive a trigger instruction for the voice input button, and then can start the voice input function therein.

[0341] After the user triggers the voice input button on the keyboard, voice input can be performed; during the process of the user inputting voice, the intelligent assistant can obtain the voice data input by the user, and then perform voice recognition on the voice data, determine the corresponding voice recognition result, and perform the operation corresponding to the voice recognition result. For example, the voice recognition result can be a voice command, and the operation corresponding to the voice command can be performed; for another example, the voice recognition result can be voice text information, and the voice text information can be displayed on the screen, etc.

[0342] In summary, in the embodiments of the present invention, after receiving a trigger instruction for a voice input button preset in the keyboard, the voice input function of the input method can be started; then voice data is obtained and voice recognition is performed on the voice data, and corresponding operations are performed according to the voice recognition results; thereby, when the user uses the keyboard to input information, the voice input function of the input method can be used to perform voice input by triggering the voice input button in the keyboard, without the need to switch from the keyboard to the mouse and use the mouse to trigger the voice input function; this simplifies the operation of the user using the voice input function of the input method, improves the efficiency of using the voice input function; and can also improve the user experience.

[0343] In the embodiment of the present invention, after the voice input function of the input method is started, the user may be allowed to input voice instructions to control other application programs or other input functions; voice input of text information may also be allowed.

[0344] In one example, after the smart assistant obtains the voice data, it can first perform command recognition and text recognition on the voice data. If the voice data is successfully recognized as the corresponding voice command, the corresponding prompt information can be generated and displayed; to prompt the user whether to enter a voice command or enter text. In one example, the prompt information can be displayed in a pop-up window. There are many ways to display prompt information in a pop-up window, such as displaying the text information "Do you want to enter a command?" and displaying the two options of "Yes" and "No". For another example, directly display the two options "Enter command" and "On-screen text". For another example, display "Is it inputting a command or on-screen text?" and display the two options of "Command" and "Text".

[0345] When the user confirms to input the voice command, the corresponding option can be triggered; correspondingly, the input method can receive the first execution information, which can be the confirmation information of executing the operation corresponding to the voice command. At this time, the intelligent assistant can execute the operation corresponding to the voice command.

[0346] When the user confirms to input text, the corresponding option can be triggered; correspondingly, the input method can receive the second execution information, which can be the confirmation information of executing the text information on the screen; and the voice text information corresponding to the voice data can be displayed on the screen. At this time, the intelligent assistant can display the voice text information corresponding to the voice data on the screen.

[0347] The user may trigger an option by using a keyboard, a mouse, or a touch screen; the embodiment of the present invention does not limit this.

[0348] Of course, in order to avoid requiring the user to make a second selection, in the embodiment of the present invention, at least two triggering modes can be set in advance for the voice input button, wherein at least one triggering mode is used to input a voice command, and at least one other triggering mode is used to input text information. For the convenience of subsequent description, the triggering mode for inputting a voice command is referred to as the first triggering mode, and the triggering mode for inputting text information is referred to as the second triggering mode.

[0349] Furthermore, when the user needs to input a voice command, the first triggering method can be used to trigger the voice input button; correspondingly, the triggering instruction for the preset voice input button in the keyboard received by the smart assistant can be the first preset instruction. When the user needs to input text information, the second triggering method can be used to trigger the voice input button; correspondingly, the triggering instruction for the preset voice input button in the keyboard received by the smart assistant can be the second preset instruction.

[0350] The following description takes the use of the first triggering method to trigger the voice input button as an example.

[0351] Reference Fig. 20 , shows a flow chart of steps of an optional embodiment of a voice input method of the present invention, which may specifically include the following steps:

[0352] Step 2002: Receive a trigger instruction for a preset voice input button in the keyboard to start the voice input function of the input method; the trigger instruction is a first preset instruction.

[0353] When the user needs to input a voice command, the voice input button can be triggered by a first triggering mode, wherein the first triggering mode can be set as required, such as long pressing the voice input button, etc., which is not limited in the embodiment of the present invention.

[0354] After the user triggers the voice input button using the first triggering method, the smart assistant can receive the first preset instruction and then start the voice input function.

[0355] In an example of the present invention, when the voice input function is started, a preset panel can be started and a voice command input interface can be displayed in the preset panel to prompt the user to input a voice command.

[0356] In one example of the present invention, while starting the voice input function, a voice command input floating window can also be started; thereby, while prompting the user to input voice commands, interference with the user's use of other applications is reduced.

[0357] Step 2004: Acquire voice data and perform command recognition on the voice data to obtain voice commands.

[0358] The user can input voice data while long pressing the voice input key; while the user is inputting voice data, the intelligent assistant can obtain the voice data, and then perform command recognition on the voice data to determine the corresponding voice command.

[0359] The voice data may be voice enhanced first, and then command recognition may be performed based on the voice data after voice enhancement to improve the accuracy of command recognition. In one example, the voice data after voice enhancement may be input into a command recognition model to obtain a voice command output by the command recognition model.

[0360] The voice instructions may include instructions for controlling other applications, such as instructions for starting other applications, instructions for closing other applications, etc. It may also include instructions for operating in other applications, such as instructions for opening a web page, searching instructions. It may also include instructions for users to operate in the input method, such as instructions for putting preset content on the screen, instructions for switching Chinese / English input, instructions for switching Chinese symbols / English symbols, instructions for starting the information recommendation function, instructions for starting the screenshot function, instructions for starting the emoticon recommendation function, instructions for starting the information recommendation function, etc.

[0361] Among them, preset contents can be pre-set, and voice commands corresponding to each preset content on the upper screen can be set; for example, the preset content "If life were just like the first sight, why would the autumn wind make the painted fan sad" can correspond to the voice command "If life were just like the first sight". Another example is the preset content "Do not be happy with things, do not be sad with yourself", and the corresponding voice command can be "Yueyang Tower Inscription" and so on.

[0362] Step 2006: Execute the operation corresponding to the voice instruction.

[0363] Then you can perform the operations corresponding to the voice commands.

[0364] For example, if the voice data is "open the browser", the intelligent assistant will recognize the voice command as: the browser startup command, which can start the user's default browser.

[0365] For another example, if the voice data is "open ** document", the intelligent assistant will recognize the voice command as: the ** document start command, which can start the ** document.

[0366] For another example, if the voice data is "search ***** web page", the smart assistant can recognize the voice command as: the command to open the ***** web page. If there is a browser currently open, the smart assistant can open the ***** web page in the browser. If there is no browser currently open, the smart assistant can start the default browser and open the web page in the browser. In addition, the input method is provided with a browser, and its built-in browser can be called to open the web page in the preset panel.

[0367] For another example, if the voice data is "Yueyang Tower Inscription", the smart assistant can recognize the voice command as the screen display command: "Do not be happy with things nor sad with yourself", and display the corresponding preset content "Do not be happy with things nor sad with yourself" on the screen.

[0368] For another example, if the voice data is "recommend emoticons", the intelligent assistant can recognize the voice command as: the start command of the emoticon recommendation function, and can open the emoticon recommendation interface in the preset panel.

[0369] In summary, in an embodiment of the present invention, after receiving a first preset instruction for a preset voice input button in the keyboard, the voice input function of the input method can be started, and then voice data can be obtained and instruction recognition can be performed on the voice data to obtain a voice instruction and execute the operation corresponding to the voice instruction, thereby realizing the voice input instruction.

[0370] Secondly, the voice command includes at least one of the following: a start command for other applications, a close command for other applications, an open command for a web page, a search command, a screen display command for preset content, a start command for the information recommendation function, a start command for the screenshot function, a start command for the emoticon recommendation function, and a start command for the information recommendation function; thereby, not only can voice control of other applications be achieved, but voice operations can also be performed in other applications and input methods.

[0371] The following description takes the use of the second triggering method to trigger the voice input button as an example.

[0372] Reference Fig.21 , shows a flow chart of another optional embodiment of the voice input method of the present invention, which may specifically include the following steps:

[0373] Step 2102: Receive a trigger instruction for a preset voice input button in the keyboard to start the voice input function of the input method; the trigger instruction is a second preset instruction.

[0374] When the user needs to input text by voice, the second triggering mode can be used to trigger the voice input button. The second triggering mode can be set according to the requirements, such as double-clicking the voice input button, etc., which is not limited in the embodiment of the present invention.

[0375] After the user triggers the voice input button using the second trigger method, the smart assistant can receive the second preset instruction and then start the voice input function.

[0376] In an example of the present invention, when the voice input function is started, a preset panel can be started and a voice text input interface can be displayed in the preset panel to prompt the user to input text by voice.

[0377] In one example of the present invention, while starting the voice input function, a voice text input floating window can also be started; thereby, while prompting the user to perform voice input text, interference with the user's use of other applications is reduced.

[0378] Step 2104: Acquire voice data and perform text recognition on the voice data to obtain voice text information.

[0379] Among them, the user can input voice data after double-clicking the voice input key; during the process of the user inputting voice data, the intelligent assistant can obtain the voice data, and then perform text recognition on the voice data to determine the corresponding voice text information.

[0380] The voice data may be voice enhanced first, and then text recognition may be performed based on the voice data after voice enhancement to improve the accuracy of command recognition. In one example, the voice data after voice enhancement may be input into a text recognition model to obtain voice text information output by the command recognition model.

[0381] In one example, a user can set the language of the voice data he wants to input in the voice-to-text input interface, and then the intelligent assistant can perform text recognition on the voice data input by the user according to the language set by the user to obtain the voice-to-text information corresponding to the language set by the user.

[0382] Step 2106: Display the voice text information on the screen.

[0383] Then the recognized voice text information can be displayed on the screen in the input box where the cursor is located, thereby realizing voice input of text.

[0384] In summary, in an embodiment of the present invention, after receiving a second preset instruction for a preset voice input button in the keyboard, the voice input function of the input method can be started, and then voice data can be obtained and text recognition can be performed on the voice data to obtain voice text information and display the voice text information on the screen; thereby realizing voice input while displaying the voice input text on the screen.

[0385] Reference Fig. 22 , shows a flowchart of another optional embodiment of a voice input method of the present invention, which may specifically include the following steps:

[0386] Step 2202: Receive a trigger instruction for a preset voice input button in the keyboard to start the voice input function of the input method; the trigger instruction is a second preset instruction.

[0387] Step 2204: Acquire voice data and perform text recognition on the voice data to obtain voice text information.

[0388] Steps 2202 to 2204 are similar to the above-mentioned steps 2102 to 2104 and will not be repeated here.

[0389] Step 2206: Translate the speech text information obtained by text recognition to obtain speech translation information.

[0390] In the embodiment of the present invention, after performing text recognition on the voice data to obtain voice text information, the voice text information can be translated to obtain voice translation information.

[0391] In one example, the intelligent assistant can determine the top M languages ​​most frequently used by users; then the speech text information obtained by text recognition can be translated into speech translation information corresponding to other M-1 (or M) languages ​​other than the language corresponding to the speech text information. Wherein, M is a positive integer and can be set as required, and the embodiment of the present invention does not limit this.

[0392] In one example, the user can set the target language in the voice-to-text input interface, and then the intelligent assistant can translate the voice-to-text information into voice translation information corresponding to the target language; the target language can be one or more, and the embodiment of the present invention is not limited to this.

[0393] Step 2208: Display the voice translation information on the screen.

[0394] In summary, in an embodiment of the present invention, after receiving a second preset instruction for a preset voice input button in the keyboard, the voice input function of the input method can be started, and then voice data can be acquired and text recognition can be performed on the voice data to obtain voice text information; the voice text information can then be translated to obtain voice translation information and the voice translation information can be displayed on the screen; thereby realizing voice input while displaying the translation text corresponding to the voice input text on the screen.

[0395] Of course, in an embodiment of the present invention, more other functions such as a search function can be set in the input method intelligent assistant as needed, and preset keys in the keyboard can be associated with other set functions; thereby facilitating users to quickly use these other functions by triggering the preset keys in the keyboard; this is not limited in the embodiment of the present invention.

[0396] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0397] Reference Fig.23 , shows a structural block diagram of an embodiment of a data processing device of the present invention, wherein the data processing device is applied to an input method, the input method is deployed in an electronic device, the electronic device is connected to a keyboard, and the device may specifically include the following modules:

[0398] A starting module 2302, configured to receive a trigger instruction for a screenshot key preset in the keyboard, and start the screenshot function of the input method;

[0399] The screenshot module 2304 is used to determine a target area to be screenshotted and capture a target image corresponding to the target area.

[0400] Reference Fig.24 , showing a structural block diagram of an optional embodiment of a data processing device of the present invention.

[0401] In an optional embodiment of the present invention, the data processing device is applied to an input method, the input method is deployed in an electronic device, the electronic device is connected to a keyboard, and the device may specifically include the following modules:

[0402] A starting module 2402, configured to receive a trigger instruction for a screenshot key preset in the keyboard, and start the screenshot function of the input method;

[0403] The screenshot module 2404 is used to determine a target area to be screenshotted and capture a target image corresponding to the target area.

[0404] In an embodiment of the present invention, the device may further include:

[0405] The text display module 2406 is used to perform text recognition on the target image, obtain image text information corresponding to the target image, and display it in the preset panel of the input method.

[0406] In an embodiment of the present invention, the device further comprises:

[0407] An image copying module 2408, configured to copy a target image corresponding to the target area after capturing the target image if a screenshot instruction is received after the target area to be screenshotted is determined;

[0408] The execution module 2410 is used to, if a text recognition instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, execute the step of performing text recognition on the target image, obtaining the image text information corresponding to the target image and displaying it.

[0409] In an embodiment of the present invention, the device may further include:

[0410] The text copy module 2412 is used to receive a copy instruction and copy the image text information.

[0411] In an embodiment of the present invention, the device further includes:

[0412] The text download module 2414 is used to receive a download instruction and download the image text information.

[0413] In an embodiment of the present invention, the device may further include:

[0414] A first paste instruction receiving module 2416, used for receiving a paste instruction;

[0415] The first pasting module 2418 is used to paste the target image into the input box where the cursor is located.

[0416] In an embodiment of the present invention, the device may further include:

[0417] The second paste instruction receiving module 2420 is used to receive a paste instruction;

[0418] The second pasting module 2422 is used to paste the image text information into the input box where the cursor is located.

[0419] In an embodiment of the present invention, the device may further include:

[0420] The closing module 2424 is used to close the screenshot function of the input method if a cancel instruction is received after the target area to be screenshot is determined.

[0421] In the embodiment of the present invention, the screen capture module 2404 may include:

[0422] The first area determination submodule 240402 is used to determine the area corresponding to the information selected by the user as the target area to be captured if a trigger instruction for a screenshot key preset in the keyboard is received after the user selects information in the application.

[0423] In the embodiment of the present invention, the screen capture module 2404 may include:

[0424] The second area determination submodule 240404 is used to determine the area corresponding to the full screen as the target area to be captured.

[0425] In the embodiment of the present invention, the screen capture module 2404 may include:

[0426] The selection instruction receiving submodule 240406 is used to receive the screenshot area selection instruction;

[0427] The third area determination submodule 240408 is used to determine the target area to be captured according to the screenshot area selection instruction.

[0428] In the embodiment of the present invention, the screen capture module 2404 may include:

[0429] The program determination submodule 240410 is used to determine the application where the cursor is located;

[0430] The fourth area determination submodule 240412 is used to determine the display area corresponding to the application as the target area to be captured.

[0431] In the embodiment of the present invention, the screen capture module 2404 may further include:

[0432] The adjustment instruction receiving submodule 240414 is used to receive the adjustment instruction for the target area;

[0433] The area update submodule 240416 is used to update the target area according to the adjustment instruction.

[0434] In summary, in the embodiments of the present invention, after receiving a trigger instruction for a screenshot button preset in the keyboard, the screenshot function of the input method can be started; after the user selects the area to be screenshotted, the target area to be screenshotted can be determined, and the target image corresponding to the target area can be captured; thereby achieving quick screenshots while the user is using the keyboard to input; simplifying the user's screenshot operation, improving screenshot efficiency, and also improving the user experience.

[0435] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0436] Fig.25 2 is a block diagram of an electronic device 2500 for data processing according to an exemplary embodiment. For example, the electronic device 2500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0437] Reference Fig.25 , the electronic device 2500 may include one or more of the following components: a processing component 2502 , a memory 2504 , a power component 2506 , a multimedia component 2508 , an audio component 2510 , an input / output (I / O) interface 2512 , a sensor component 2514 , and a communication component 2516 .

[0438] The processing component 2502 generally controls the overall operation of the electronic device 2500, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 2502 may include one or more processors 2520 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 2502 may include one or more modules to facilitate the interaction between the processing component 2502 and other components. For example, the processing component 2502 may include a multimedia module to facilitate the interaction between the multimedia component 2508 and the processing component 2502.

[0439] The memory 2504 is configured to store various types of data to support operations on the electronic device 2500. Examples of such data include instructions for any application or method operating on the electronic device 2500, contact data, phone book data, messages, pictures, videos, etc. The memory 2504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0440] The power component 2506 provides power to the various components of the electronic device 2500. The power component 2506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 2500.

[0441] The multimedia component 2508 includes a screen that provides an output interface between the electronic device 2500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 2508 includes a front camera and / or a rear camera. When the electronic device 2500 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0442] The audio component 2510 is configured to output and / or input audio signals. For example, the audio component 2510 includes a microphone (MIC), and when the electronic device 2500 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 2504 or sent via the communication component 2516. In some embodiments, the audio component 2510 also includes a speaker for outputting audio signals.

[0443] I / O interface 2512 provides an interface between processing component 2502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, start buttons, and lock buttons.

[0444] The sensor assembly 2514 includes one or more sensors for providing various aspects of status assessment for the electronic device 2500. For example, the sensor assembly 2514 can detect the open / closed state of the electronic device 2500, the relative positioning of components, such as the display and keypad of the electronic device 2500, and the sensor assembly 2514 can also detect the position change of the electronic device 2500 or a component of the electronic device 2500, the presence or absence of user contact with the electronic device 2500, the orientation or acceleration / deceleration of the electronic device 2500, and the temperature change of the electronic device 2500. The sensor assembly 2514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 2514 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 2514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0445] The communication component 2516 is configured to facilitate wired or wireless communication between the electronic device 2500 and other devices. The electronic device 2500 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 2516 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 2516 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0446] In an exemplary embodiment, the electronic device 2500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0447] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 2504 including instructions, and the instructions can be executed by the processor 2520 of the electronic device 2500 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0448] A non-temporary computer-readable storage medium, when the instructions in the storage medium are executed by the processor of an electronic device, enables the electronic device to execute a data processing method, the method comprising: receiving a trigger instruction for a screenshot key preset in a keyboard, starting the screenshot function of the input method; determining a target area to be screenshotted, and capturing a target image corresponding to the target area.

[0449] Optionally, the method further comprises: performing text recognition on the target image, obtaining image text information corresponding to the target image and displaying the information in a preset panel of the input method.

[0450] Optionally, the method further includes: if a screenshot instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, the target image is copied; if a text recognition instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, the step of performing text recognition on the target image, obtaining the image text information corresponding to the target image and displaying it is performed.

[0451] Optionally, the method further comprises: receiving a copy instruction, and copying the image text information.

[0452] Optionally, the method further comprises: receiving a download instruction, and downloading the image text information.

[0453] Optionally, the method further includes: receiving a paste instruction; pasting the target image into an input box where a cursor is located.

[0454] Optionally, the method further includes: receiving a paste instruction; pasting the image text information into an input box where a cursor is located.

[0455] Optionally, the method further comprises: if a cancel instruction is received after determining the target area to be screenshotted, turning off the screenshot function of the input method.

[0456] Optionally, determining the target area to be captured includes: if a trigger instruction for a screenshot button preset in the keyboard is received after the user selects information in the application, determining the area corresponding to the information selected by the user as the target area to be captured.

[0457] Optionally, determining the target area to be captured includes: determining an area corresponding to the full screen as the target area to be captured.

[0458] Optionally, determining the target area to be captured includes: receiving a screenshot area selection instruction; and determining the target area to be captured according to the screenshot area selection instruction.

[0459] Optionally, determining the target area to be captured includes: determining an application where a cursor is located;

[0460] The display area corresponding to the application is determined as the target area to be captured.

[0461] Optionally, determining the target area to be captured further includes: receiving an adjustment instruction for the target area; and updating the target area according to the adjustment instruction.

[0462] Fig.26 2 is a schematic diagram of the structure of an electronic device 2600 for data processing according to another exemplary embodiment of the present invention. The electronic device 2600 may be a server, which may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 2622 (for example, one or more processors) and memory 2632, and one or more storage media 2630 (for example, one or more mass storage devices) storing application programs 2642 or data 2644. Among them, the memory 2632 and the storage medium 2630 may be temporary storage or permanent storage. The program stored in the storage medium 2630 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations in the server. Furthermore, the central processor 2622 may be configured to communicate with the storage medium 2630 and execute a series of instruction operations in the storage medium 2630 on the server.

[0463] The server may also include one or more power supplies 2626, one or more wired or wireless network interfaces 2650, one or more input and output interfaces 2658, one or more keyboards 2656, and / or, one or more operating systems 2641, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

[0464] In an exemplary embodiment, the server is configured to execute one or more programs including instructions for performing the following operations by one or more central processors 2622: receiving a trigger instruction for a screenshot key preset in the keyboard to activate the screenshot function of the input method; determining a target area to be screenshotted and capturing a target image corresponding to the target area.

[0465] Optionally, it also includes instructions for performing the following operations: performing text recognition on the target image, obtaining image text information corresponding to the target image and displaying it in a preset panel of the input method.

[0466] Optionally, it also includes instructions for performing the following operations: if a screenshot instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, the target image is copied; if a text recognition instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, the text recognition of the target image is performed to obtain and display the image text information corresponding to the target image.

[0467] Optionally, it also includes instructions for performing the following operations: receiving a copy instruction, and copying the image text information.

[0468] Optionally, it also includes instructions for performing the following operations: receiving a download instruction, and downloading the image text information.

[0469] Optionally, it also includes instructions for performing the following operations: receiving a paste instruction; pasting the target image into the input box where the cursor is located.

[0470] Optionally, it also includes instructions for performing the following operations: receiving a paste instruction; pasting the image text information into the input box where the cursor is located.

[0471] Optionally, it also includes instructions for performing the following operations: if a cancel instruction is received after the target area to be screenshot is determined, then the screenshot function of the input method is turned off.

[0472] Optionally, determining the target area to be captured includes: if a trigger instruction for a screenshot button preset in the keyboard is received after the user selects information in the application, determining the area corresponding to the information selected by the user as the target area to be captured.

[0473] Optionally, determining the target area to be captured includes: determining an area corresponding to the full screen as the target area to be captured.

[0474] Optionally, determining the target area to be captured includes: receiving a screenshot area selection instruction; and determining the target area to be captured according to the screenshot area selection instruction.

[0475] Optionally, determining the target area to be captured includes: determining an application where a cursor is located; and determining a display area corresponding to the application as the target area to be captured.

[0476] Optionally, determining the target area to be captured further includes: receiving an adjustment instruction for the target area; and updating the target area according to the adjustment instruction.

[0477] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0478] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0479] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0480] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0481] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0482] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0483] The data processing method, the data processing device and the electronic device provided by the present invention are introduced in detail above. The principle and implementation mode of the present invention are explained by using specific examples in this article. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation mode and the scope of application. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A data processing method, characterized in that: Applied to an input method, the input method is deployed in an electronic device, the electronic device is connected to a keyboard, and the method includes: In response to the user triggering the preset screenshot key in the keyboard: Receiving a trigger instruction for the screenshot button, and starting the screenshot function of the input method; Determining a target area to be captured; wherein, if a trigger instruction for the capture button is received after the user selects information in the application, the area corresponding to the information selected by the user is determined as the target area to be captured; receiving an adjustment instruction for the target area, and updating the target area; Display screenshot option, cancel option and text recognition option; receiving a screenshot instruction for the screenshot option, capturing a target image corresponding to the target area; or receiving a cancel instruction for the cancel option, closing the screenshot function of the input method; or receiving a text recognition instruction for the text recognition option, capturing a target image corresponding to the target area, performing text recognition on the target image, obtaining image text information corresponding to the target image, and displaying the image text information in a preset panel of the input method according to the same or similar layout of the image text information in the target image; The screenshot button is a preset button associated with the screenshot function, and the screenshot function is used to capture an image of the screen; Displays the copy option; receiving a copy instruction for the copy option, and copying the image text information; A paste instruction is received, and the image text information is pasted into the input box where the cursor is located before the screen capture function is started, or the image text information is pasted into the input box after the cursor is switched.

2. The method according to claim 1, characterized in that The method further comprises: If a screenshot instruction is received after determining the target area to be screenshotted, after capturing the target image corresponding to the target area, copying the target image; If a text recognition instruction is received after determining the target area to be screenshotted, then after capturing the target image corresponding to the target area, the step of performing text recognition on the target image to obtain and display the image text information corresponding to the target image is executed.

3. The method according to claim 2, characterized in that The method further comprises: A download instruction is received to download the image text information.

4. The method according to claim 1, characterized in that: The method further comprises: Receive paste instructions; Paste the target image into the input box where the cursor is located.

5. The method according to claim 1, characterized in that Determining the target area to be captured includes: The area corresponding to the full screen is determined as the target area to be captured.

6. The method according to claim 1, characterized in that Determining the target area to be captured includes: Receive screenshot area selection instructions; According to the screenshot area selection instruction, a target area to be screenshotted is determined.

7. The method according to claim 1, characterized in that Determining the target area to be captured includes: Determine the application where the cursor is located; The display area corresponding to the application is determined as the target area to be captured.

8. The method according to claim 1, characterized in that: The step of determining the target area to be captured also includes: receiving adjustment instructions for the target area; The target area is updated according to the adjustment instruction.

9. A data processing device, characterized in that: Applied to an input method, the input method is deployed in an electronic device, the electronic device is connected to a keyboard, and the device comprises: A starting module, configured to respond to a user triggering a preset screenshot key in the keyboard, receive a trigger instruction for the screenshot key, and start the screenshot function of the input method; The screenshot module is used to determine the target area to be screenshotted; wherein, if a trigger instruction for a screenshot button preset in the keyboard is received after the user selects information in the application, the area corresponding to the information selected by the user is determined as the target area to be screenshotted; an adjustment instruction for the target area is received to update the target area; a screenshot option, a cancel option and a text recognition option are displayed; a screenshot instruction for the screenshot option is received to capture a target image corresponding to the target area; or a cancel instruction for the cancel option is received to turn off the screenshot function of the input method; or a text recognition instruction for the text recognition option is received to capture the target area The invention relates to a method for detecting a target image corresponding to a domain, and performing text recognition on the target image to obtain image text information corresponding to the target image, and displaying the image text information in a preset panel of the input method according to a layout that is the same or similar to that of the image text information in the target image; the screenshot button is a preset button associated with the screenshot function, and the screenshot function is used to capture an image of the screen; displaying a copy option; receiving a copy instruction for the copy option to copy the image text information; receiving a paste instruction to paste the image text information into an input box where a cursor is located before the screenshot function is started, or to paste the image text information into an input box after the cursor is switched.

10. The device according to claim 9, characterized in that The device also includes: An image copying module, configured to copy the target image after capturing the target image corresponding to the target area if a screenshot instruction is received after the target area to be screenshotted is determined; An execution module is used to, if a text recognition instruction is received after the target area to be screenshotted is determined, then after the target image corresponding to the target area is captured, execute the steps of performing text recognition on the target image, obtaining the image text information corresponding to the target image and displaying it.

11. The device according to claim 10, characterized in that The device also includes: The text download module is used to receive a download instruction and download the image text information.

12. The device according to claim 9, characterized in that The device also includes: A first paste instruction receiving module, used for receiving a paste instruction; The first pasting module is used to paste the target image into the input box where the cursor is located.

13. The device according to claim 9, characterized in that The screenshot module includes: The second area determination submodule is used to determine the area corresponding to the full screen as the target area to be captured.

14. The device according to claim 9, characterized in that The screenshot module includes: A selection instruction receiving submodule is used to receive a screenshot area selection instruction; The third area determination submodule is used to determine the target area to be screenshotted according to the screenshot area selection instruction.

15. The device according to claim 9, characterized in that The screenshot module includes: The program determination submodule is used to determine the application where the cursor is located; The fourth area determination submodule is used to determine the display area corresponding to the application as the target area to be captured.

16. The device according to claim 9, characterized in that The screenshot module also includes: An adjustment instruction receiving submodule, used for receiving an adjustment instruction for a target area; The area updating submodule is used to update the target area according to the adjustment instruction.

17. An electronic device, characterized in that: The system comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, wherein the one or more programs include instructions for performing the following operations: In response to the user triggering the preset screenshot key in the keyboard: Receiving a trigger instruction for the screenshot button, and starting the screenshot function of the input method; Determining a target area to be captured; wherein, if a trigger instruction for the capture button is received after the user selects information in the application, the area corresponding to the information selected by the user is determined as the target area to be captured; receiving an adjustment instruction for the target area, and updating the target area; Display screenshot option, cancel option and text recognition option; receiving a screenshot instruction for the screenshot option, capturing a target image corresponding to the target area; or receiving a cancel instruction for the cancel option, closing the screenshot function of the input method; or receiving a text recognition instruction for the text recognition option, capturing a target image corresponding to the target area, performing text recognition on the target image, obtaining image text information corresponding to the target image, and displaying the image text information in a preset panel of the input method according to the same or similar layout of the image text information in the target image; The screenshot button is a preset button associated with the screenshot function, and the screenshot function is used to capture an image of the screen; Displays the copy option; receiving a copy instruction for the copy option, and copying the image text information; A paste instruction is received, and the image text information is pasted into the input box where the cursor is located before the screen capture function is started, or the image text information is pasted into the input box after the cursor is switched.

18. The electronic device according to claim 17, characterized in that: Execute the data processing method as described in any one of method claims 2-8.

19. A readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the data processing method as described in any one of method claims 1-8.

Images