Information input method and information input device

Abstract

The present application discloses an information input method and an information input device, belonging to the field of communication technology, wherein the information input method comprises: receiving a first input when a virtual keyboard is displayed; determining an input area within the display range of the virtual keyboard in response to the first input; receiving a second input in the input area; and generating corresponding target picture information in response to the second input.

Description

Technical Field

[0001] The present application belongs to the field of communication technology, and specifically relates to an information input method and an information input device. Background Art

[0002] In the related art, the input of electronic devices such as mobile phones relies on a virtual keyboard, on which virtual keys are arranged, and the user inputs by touching the virtual keys.

[0003] When inputting some special content, such as mathematical formulas, different formulas have different structures, such as semicolons, exponentiations, square roots, derivatives, subscripts, etc., which makes it difficult to input formula content through the virtual keyboard. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide an information input method and an information input device, which can quickly and accurately input special content such as mathematical formulas through a virtual keyboard.

[0005] In a first aspect, an embodiment of the present application provides an information input method, comprising:

[0006] In case the virtual keyboard is displayed, receiving a first input;

[0007] In response to the first input, determining an input area within a display range of the virtual keyboard;

[0008] receiving a second input in the input area;

[0009] In response to the second input, corresponding target picture information is generated.

[0010] In a second aspect, an embodiment of the present application provides an information input device, including:

[0011] A receiving unit, configured to receive a first input when the virtual keyboard is displayed;

[0012] a switching unit, configured to determine an input area within a display range of the virtual keyboard in response to a first input;

[0013] The receiving unit is further used to receive a second input in the input area;

[0014] The generating unit is used to generate corresponding target picture information in response to the second input.

[0015] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method of the first aspect.

[0016] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method of the first aspect are implemented.

[0017] In a fifth aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the steps of the method of the first aspect.

[0018] In the embodiment of the present application, when the virtual keyboard is displayed, that is, when the user is inputting content, such as chatting through a chat software or editing a document, a first input is received. Specifically, the first input can be a shortcut operation defined by the user or an input program, such as double-clicking the virtual keyboard, triple-clicking the virtual keyboard, drawing a circle on the virtual keyboard, or handwriting two overlapping circles on the virtual chuck, etc., which is not limited in the embodiment of the present application.

[0019] After receiving the first input, the input area is determined within the display range of the virtual keyboard, that is, the area inside the virtual keyboard is switched to the special area. It can be understood that after the inside of the virtual keyboard is switched to the input area, the display mode inside the virtual keyboard can be adjusted to the display mode corresponding to the input area, or the display mode of the original virtual keyboard can be retained, but special display marks are performed based on the display mode of the original virtual keyboard, such as displaying a border around the virtual keyboard.

[0020] After the input area is determined, the second input is received through the input area. The second input can be a user's drawing input, handwriting input or selection input, which is not limited in this application. The user can use the second input to input or select the content to be input in the input area by handwriting, drawing or selecting from a preset template. After receiving the second input, the input program automatically converts the input result into the target image information and outputs it.

[0021] For example, the user draws two overlapping circles on the virtual keyboard with his finger, thereby calling out the input area on the virtual keyboard. After the output area is determined, the user writes a mathematical formula in the input area. The formula can be any type of formula. In addition to the mathematical formula, the user can also write annotations, explanations, or draw images of explanations. After the user input is completed, if the user presses the confirmation button, or if no subsequent handwriting input is received within 3 seconds, the target image information is generated based on the trace of the user's handwriting input. The target image information can be directly sent by the chat software or inserted into the document the user is editing.

[0022] The embodiment of the present application switches the interaction mode of the virtual keyboard so that the user can freely input content, and the content can be content unrelated to the preset keys of the virtual keyboard, including formulas, pictures, etc., thereby realizing quick input of formulas without calling external formula editing software. On the one hand, the convenience of special symbols and mathematical formulas is improved. On the other hand, in the scenario where users communicate through chat software, the communication efficiency of special content such as mathematical formulas can be improved, which can improve the experience of inputting special content such as mathematical formulas through the virtual keyboard. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 One of the flow charts of the information input method according to an embodiment of the present application is shown;

[0024] Figure 2 One of the schematic diagrams of the operation interface according to an embodiment of the present application is shown;

[0025] Figure 3 A second flowchart of the information input method according to an embodiment of the present application is shown;

[0026] Figure 4 A schematic diagram showing first picture information according to an embodiment of the present application is shown;

[0027] Figure 5 A second schematic diagram of an operation interface according to an embodiment of the present application is shown;

[0028] Figure 6 A structural block diagram of an information input device according to an embodiment of the present application is shown;

[0029] Figure 7 A structural block diagram of an electronic device according to an embodiment of the present application is shown;

[0030] Figure 8 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0032] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0033] The information input method and information input device provided in the embodiments of the present application are described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0034] In some embodiments of the present application, a method for inputting information is provided. Figure 1 FIG. 1 shows one of the flow charts of the information input method according to an embodiment of the present application. Figure 1 As shown, the method includes:

[0035] Step 102, receiving a first input when the virtual keyboard is displayed;

[0036] Step 104, in response to the first input, determining an input area within the display range of the virtual keyboard;

[0037] Step 106, receiving a second input in the input area;

[0038] Step 108: Generate corresponding target image information in response to the second input.

[0039] In the embodiment of the present application, when the virtual keyboard is displayed, that is, when the user is inputting content, such as chatting through a chat software or editing a document, a first input is received. Specifically, the first input can be a shortcut operation defined by the user or an input program, such as double-clicking the virtual keyboard, triple-clicking the virtual keyboard, drawing a circle on the virtual keyboard, or handwriting two overlapping circles on the virtual chuck, etc., which is not limited in the embodiment of the present application.

[0040] After receiving the first input, the input area is determined within the display range of the virtual keyboard, that is, the area inside the virtual keyboard is switched to the special area. It can be understood that after the inside of the virtual keyboard is switched to the input area, the display mode inside the virtual keyboard can be adjusted to the display mode corresponding to the input area, or the display mode of the original virtual keyboard can be retained, but special display marks are performed based on the display mode of the original virtual keyboard, such as displaying a border around the virtual keyboard.

[0041] After the input area is determined, the second input is received through the input area. The second input can be a user's drawing input, handwriting input or selection input, which is not limited in this application. The user can use the second input to input or select the content to be input in the input area by handwriting, drawing or selecting from a preset template. After receiving the second input, the input program automatically converts the input result into the target image information and outputs it.

[0042] For example, the user draws two overlapping circles on the virtual keyboard with his finger, thereby calling out the input area on the virtual keyboard. After the output area is determined, the user writes a mathematical formula in the input area. The formula can be any type of formula. In addition to the mathematical formula, the user can also write annotations, explanations, or draw images of explanations. After the user input is completed, if the user presses the confirmation button, or if no subsequent handwriting input is received within 3 seconds, the target image information is generated based on the trace of the user's handwriting input. The target image information can be directly sent by the chat software or inserted into the document the user is editing.

[0043] The embodiment of the present application switches the interaction mode of the virtual keyboard so that the user can freely input content, and the content can be content unrelated to the preset keys of the virtual keyboard, including formulas, pictures, etc., thereby realizing quick input of formulas without calling external formula editing software. On the one hand, the convenience of special symbols and mathematical formulas is improved. On the other hand, in the scenario where users communicate through chat software, the communication efficiency of special content such as mathematical formulas can be improved, which can improve the experience of inputting special content such as mathematical formulas through the virtual keyboard.

[0044] In some embodiments of the present application, the second input is a handwriting input, the input area includes a first handwriting input area, and receiving the second input through the input area includes:

[0045] A handwriting input is received in the first handwriting input area.

[0046] In the embodiment of the present application, the user inputs information by handwriting in the first handwriting input area. Specifically, Figure 2 FIG. 1 shows one of the schematic diagrams of the operation interface according to an embodiment of the present application. Figure 2 As shown, after the user determines the area of ​​the virtual keyboard as the first handwriting input area through the first input, the user can "write" the information he wants to input in the first handwriting input area by means of fingers, stylus, etc. Figure 2 For example, the user wants to enter the formula: a 2 +b 2 =c 2, you can directly write the formula in the first handwriting input area to complete the input of the formula, thereby improving the experience of entering special content such as mathematical formulas through the virtual keyboard.

[0047] In some embodiments of the present application, Figure 3 The second flowchart of the information input method according to the embodiment of the present application is shown, wherein the handwriting input includes a first handwriting input, such as Figure 3 As shown, according to the second input, the corresponding target image information is generated, including:

[0048] Step 302, in response to a first handwriting input, generating and displaying first image data corresponding to the first handwriting input in a first handwriting input area;

[0049] Step 304, generating first picture information according to the first image data;

[0050] Step 306: Generate target picture information according to the first picture information.

[0051] In the embodiment of the present application, first, according to the input track (handwriting stroke) of the first handwriting input, the track of the first handwriting input is displayed in the first handwriting input area according to the input track, and the position, length, depth and other information of the track are recorded and formed into the first image data. Figure 2 As shown, the user writes down the formula: a 2 +b 2 =c 2 , then in the first handwriting input area, following each stroke of the user, the corresponding handwriting is displayed, and finally the image information is formed and displayed in the first input area.

[0052] Wherein, when the first input area does not change the display mode of the original virtual keyboard, the first image area can be displayed superimposed with the virtual keyboard, as shown in FIG. Figure 2 shown.

[0053] Furthermore, after the user completes the handwriting input, the formed first image data is saved as the first picture information. Specifically, Figure 4 FIG. 1 is a schematic diagram showing first picture information according to an embodiment of the present application. Figure 4 As shown, when the first picture information is saved, only the user's "handwriting" is retained and formed into a picture formed according to the user's handwriting, which is the first picture information. The final target picture is determined by the first picture information, and the user can send the target picture in the chat window or insert the target picture into the document being edited, thereby realizing fast and convenient input of mathematical formulas.

[0054] In some embodiments of the present application, the handwriting input further includes a second handwriting input, the input area further includes a second handwriting input area, and the method further includes:

[0055] receiving a third input;

[0056] In response to a third input, switching the first handwriting input area to a second handwriting input area;

[0057] receiving a second handwriting input in the second handwriting input area;

[0058] In response to the second handwriting input, generating and displaying second image data corresponding to the second handwriting input in the second handwriting input area;

[0059] generating second picture information according to the second image data;

[0060] Generating target picture information according to the first picture information includes:

[0061] The first picture information and the second picture information are concatenated to obtain target picture information.

[0062] In an embodiment of the present application, the input area also includes a second handwriting input area, and the user can switch the current first handwriting input area to the second handwriting input area through a third input. Specifically, in some cases, such as when handwriting input of a more complex formula, due to the large length of the formula and the small screen of the mobile phone, it may be difficult to write down the entire formula in one input area. In this case, the user can write down the first part of the formula in the current first handwriting input area, and then switch the first handwriting input area to the next second handwriting input area through a third input, and write down the remaining second part of the formula in the second handwriting input area.

[0063] After the user has handwritten the two parts of the formula, the first picture information corresponding to the first handwriting input area and the second picture information corresponding to the second handwriting input area are generated respectively. According to the two picture information recording the two parts of the formula, the first picture information and the second picture information are spliced ​​in the order in which they are written, so as to obtain the target picture information that finally displays the complete formula.

[0064] It can be understood that there can be multiple second handwriting input areas, that is, when the user cannot write a complete formula within the range of two input areas, he can also switch to the third handwriting input area, the fourth handwriting input area, and so on through the third input until the user can complete the required formula.

[0065] Specifically, Figure 5 The second schematic diagram of the operation interface according to the embodiment of the present application is shown as follows: Figure 5As shown, the user needs to enter the formula:

[0066]

[0067] Since the formula is long, the above formula is divided into two parts. The first part is (x+a) n The first part is the formula part, and the second part is the remaining formula part. After the user enters the first part in the first handwriting input area, he slides left in the first handwriting input area, and the input area switches to the second handwriting input area. The user enters the remaining second part in the second handwriting input area, and finally includes the target picture information that forms a complete formula.

[0068] In some embodiments of the present application, before receiving the second input through the virtual keyboard, the method further includes:

[0069] receiving a fourth input; determining a corresponding information template in response to the fourth input; and

[0070] In response to the second input, corresponding target image information is generated, including:

[0071] In response to the second input, corresponding data information is determined; the information template is filled with the data information to obtain corresponding template data; and target image information is generated according to the template data.

[0072] In the embodiment of the present application, corresponding information templates, such as icon templates, formula templates, etc., can be pre-stored according to the user's input habits. When the user needs to input complex information, the pre-stored corresponding information template can be called out through the fourth input, wherein the information template includes at least one data unit that can be filled in.

[0073] After determining the correct information template, the user can input specific data information through the second input, and fill the data information into the data unit of the information template according to the set mapping rules or the mapping rules selected by the user, thereby obtaining the template data generated based on the information template after the user fills in, and generating the target image information according to the template data.

[0074] For example, the user can select a data unit in the information template by touching, clicking the cursor, etc., and then fill in the data information by inputting on the virtual keyboard or by handwriting. In some embodiments, the user can also handwrite multiple values ​​and separate them with a separator between the values ​​to quickly input multiple formula parameters at one time. For example, for the equation: a 2 +b 2 =c 2, the user hand-writes and inputs the following numbers: 3|4|5, which means a=3, b=4, c=5. Among them, "|" is a preset separator, and it can be understood that the user can freely set the form of the separator.

[0075] The embodiments of the present application pre-store information templates of complex information that users may need to input. For example, for users who frequently input formulas, templates of various common formulas may be pre-stored, such as trigonometric function formulas, summation formulas, Fourier series formulas, etc. After selecting the information template, the second input is further used to fill in the data units in the information template to complete the input, thereby improving the experience of inputting special content such as mathematical formulas through a virtual keyboard.

[0076] In some embodiments of the present application, the fourth input is a voice input, the information template is a formula template, and in response to the fourth input, determining the corresponding information template includes:

[0077] Perform speech recognition on the speech input to obtain the formula type corresponding to the speech input;

[0078] In the pre-stored formula template library, search for the formula template corresponding to the formula type.

[0079] In an embodiment of the present application, the user can use voice input to "say" the type of formula to be input. After the system receives the voice input through a microphone or other sound pickup device, it uses a voice recognition algorithm to recognize the semantics in the voice input, thereby determining the type of formula the user wishes to input. After determining the type of formula, the corresponding formula template can be found in the pre-stored formula template library and displayed. Among them, each parameter in the formula template is a data unit, and the user can further fill in the data unit in the formula template through a second input to complete the input of the formula.

[0080] For example, when the user orally says "Fourier series formula", the formula template of the Fourier series formula is directly displayed above the virtual keyboard. After the user confirms the template, he fills in the parameter quantities to complete the input of the formula.

[0081] In the embodiment of the present application, the public name is input by voice, so that the corresponding formula panel is displayed. On the one hand, it can improve the efficiency of the user in inputting formulas. On the other hand, displaying the formula template can also prompt the user to the specific form of the formula, avoiding the situation where the user makes "wrong" formulas when writing them by hand, and can improve the experience of entering special content such as mathematical formulas through the virtual keyboard.

[0082] In some embodiments of the present application, after generating the corresponding target image information, the information input method further includes:

[0083] receiving a fifth input;

[0084] In response to the fifth input, the target picture information is modified.

[0085] In the embodiment of the present application, after the target image information is determined, the target image information can be further edited through the fifth input. Specifically, after the input track (handwriting) of the user's handwriting input is saved as the target image information, if the user finds an error or needs to add new content, the previous operation can be returned to the editable state. In the editable state, the handwriting in the target image can be modified or deleted, and the user can also add new content based on the original image data, thereby realizing the free editing and input of special content such as formulas.

[0086] Among them, if you are currently in a chat interface, and there is a picture message that has been sent in the chat interface, such as picture information of a formula, you can display the corresponding formula in the current handwriting input area by, for example, long pressing the picture information, so as to facilitate further editing.

[0087] In some embodiments of the present application, an information input device is provided. Figure 6 A structural block diagram of an information input device according to an embodiment of the present application is shown. Figure 6 As shown, the information input device 600 includes:

[0088] The receiving unit 602 is configured to receive a first input when the virtual keyboard is displayed;

[0089] A switching unit 604, configured to determine an input area within a display range of the virtual keyboard in response to the first input;

[0090] The receiving unit 602 is further configured to receive a second input in the input area;

[0091] The generating unit 606 is configured to generate corresponding target picture information in response to the second input.

[0092] In the embodiment of the present application, when the virtual keyboard is displayed, that is, when the user is inputting content, such as chatting through a chat software or editing a document, a first input is received. Specifically, the first input can be a shortcut operation defined by the user or an input program, such as double-clicking the virtual keyboard, triple-clicking the virtual keyboard, drawing a circle on the virtual keyboard, or handwriting two overlapping circles on the virtual chuck, etc., which is not limited in the embodiment of the present application.

[0093] After receiving the first input, the input area is determined within the display range of the virtual keyboard, that is, the area inside the virtual keyboard is switched to the special area. It can be understood that after the inside of the virtual keyboard is switched to the input area, the display mode inside the virtual keyboard can be adjusted to the display mode corresponding to the input area, or the display mode of the original virtual keyboard can be retained, but special display marks are performed based on the display mode of the original virtual keyboard, such as displaying a border around the virtual keyboard.

[0094] After the input area is determined, the second input is received through the input area. The second input can be a user's drawing input, handwriting input or selection input, which is not limited in this application. The user can use the second input to input or select the content to be input in the input area by handwriting, drawing or selecting from a preset template. After receiving the second input, the input program automatically converts the input result into the target image information and outputs it.

[0095] For example, the user draws two overlapping circles on the virtual keyboard with his finger, thereby calling out the input area on the virtual keyboard. After the output area is determined, the user writes a mathematical formula in the input area. The formula can be any type of formula. In addition to the mathematical formula, the user can also write annotations, explanations, or draw images of explanations. After the user input is completed, if the user presses the confirmation button, or if no subsequent handwriting input is received within 3 seconds, the target image information is generated based on the trace of the user's handwriting input. The target image information can be directly sent by the chat software or inserted into the document the user is editing.

[0096] The embodiment of the present application switches the interaction mode of the virtual keyboard so that the user can freely input content, and the content can be content unrelated to the preset keys of the virtual keyboard, including formulas, pictures, etc., thereby realizing quick input of formulas without calling external formula editing software. On the one hand, the convenience of special symbols and mathematical formulas is improved. On the other hand, in the scenario where users communicate through chat software, the communication efficiency of special content such as mathematical formulas is improved, which can improve the experience of inputting special content such as mathematical formulas through the virtual keyboard.

[0097] In some embodiments of the present application, the second input is a handwriting input, the input area includes a first handwriting input area, and the receiving unit 602 is used to receive the handwriting input in the first handwriting input area.

[0098] In the embodiment of the present application, the user inputs information by handwriting in the first handwriting input area. Specifically, Figure 2 FIG. 1 shows one of the schematic diagrams of the operation interface according to an embodiment of the present application. Figure 2As shown, after the user determines the area of ​​the virtual keyboard as the first handwriting input area through the first input, the user can "write" the information he wants to input in the first handwriting input area by means of fingers, stylus, etc. Figure 2 For example, the user wants to enter the formula: a 2 +b 2 =c 2 , you can directly write the formula in the first handwriting input area to complete the input of the formula, thereby improving the experience of entering special content such as mathematical formulas through the virtual keyboard.

[0099] In some embodiments of the present application, the handwriting input includes a first handwriting input, and the generating unit 606 is further configured to:

[0100] In response to a first handwriting input, generating and displaying first image data corresponding to the first handwriting input in a first handwriting input area;

[0101] generating first picture information according to the first image data;

[0102] Generate target picture information according to the first picture information.

[0103] In the embodiment of the present application, first, according to the input track (handwriting stroke) of the first handwriting input, the track of the first handwriting input is displayed in the first handwriting input area according to the input track, and the position, length, depth and other information of the track are recorded and formed into the first image data. Figure 2 As shown, the user writes down the formula: a 2 +b 2 =c 2 , then in the first handwriting input area, following each stroke of the user, the corresponding handwriting is displayed, and finally the image information is formed and displayed in the first input area.

[0104] Wherein, when the first input area does not change the display mode of the original virtual keyboard, the first image area can be displayed superimposed with the virtual keyboard, as shown in FIG. Figure 2 shown.

[0105] Furthermore, after the user completes the handwriting input, the formed first image data is saved as the first picture information. Specifically, Figure 4 FIG. 1 is a schematic diagram showing first picture information according to an embodiment of the present application. Figure 4 As shown, when the first picture information is saved, only the user's "handwriting" is retained and formed into a picture formed according to the user's handwriting, which is the first picture information. The final target picture is determined by the first picture information, and the user can send the target picture in the chat window or insert the target picture into the document being edited, thereby realizing fast and convenient input of mathematical formulas.

[0106] In some embodiments of the present application, the handwriting input further includes a second handwriting input, the input area further includes a second handwriting input area, and the receiving unit 602 is further configured to receive a third input;

[0107] The switching unit 604 is further configured to switch the first handwriting input area to a second handwriting input area in response to a third input;

[0108] The receiving unit 602 is further configured to receive a second handwriting input in the second handwriting input area;

[0109] The generating unit 606 is further configured to generate and display second image data corresponding to the second handwriting input in the second handwriting input area in response to the second handwriting input;

[0110] generating second picture information according to the second image data;

[0111] The first picture information and the second picture information are concatenated to obtain target picture information.

[0112] In an embodiment of the present application, the input area also includes a second handwriting input area, and the user can switch the current first handwriting input area to the second handwriting input area through a third input. Specifically, in some cases, such as when handwriting input of a more complex formula, due to the large length of the formula and the small screen of the mobile phone, it may be difficult to write down the entire formula in one input area. In this case, the user can write down the first part of the formula in the current first handwriting input area, and then switch the first handwriting input area to the next second handwriting input area through a third input, and write down the remaining second part of the formula in the second handwriting input area.

[0113] After the user has handwritten the two parts of the formula, the first picture information corresponding to the first handwriting input area and the second picture information corresponding to the second handwriting input area are generated respectively. According to the two picture information recording the two parts of the formula, the first picture information and the second picture information are spliced ​​in the order in which they are written, so as to obtain the target picture information that finally displays the complete formula.

[0114] It can be understood that there can be multiple second handwriting input areas, that is, when the user cannot write a complete formula within the range of two input areas, he can also switch to the third handwriting input area, the fourth handwriting input area, and so on through the third input until the user can complete the required formula.

[0115] Specifically, Figure 5 The second schematic diagram of the operation interface according to the embodiment of the present application is shown as follows: Figure 5 As shown, the user needs to enter the formula:

[0116]

[0117] Since the formula is long, the above formula is divided into two parts. The first part is (x+a) n The first part is the formula part, and the second part is the remaining formula part. After the user enters the first part in the first handwriting input area, he slides left in the first handwriting input area, and the input area switches to the second handwriting input area. The user enters the remaining second part in the second handwriting input area, and finally includes the target picture information that forms a complete formula.

[0118] In some embodiments of the present application, the receiving unit 602 is further configured to receive a fourth input;

[0119] The information input device 600 further includes:

[0120] The determination unit 608 is used to determine the corresponding information template in response to the fourth input; determine the corresponding data information in response to the second input; fill the information template with the data information to obtain the corresponding template data; and generate the target image information according to the template data.

[0121] In the embodiment of the present application, corresponding information templates, such as icon templates, formula templates, etc., can be pre-stored according to the user's input habits. When the user needs to input complex information, the pre-stored corresponding information template can be called out through the fourth input, wherein the information template includes at least one data unit that can be filled in.

[0122] After determining the correct information template, the user can input specific data information through the second input, and fill the data information into the data unit of the information template according to the set mapping rules or the mapping rules selected by the user, thereby obtaining the template data generated based on the information template after the user fills in, and generating the target image information according to the template data.

[0123] The embodiments of the present application pre-store information templates of complex information that users may need to input. For example, for users who frequently input formulas, templates of various common formulas may be pre-stored, such as trigonometric function formulas, summation formulas, Fourier series formulas, etc. After selecting the information template, the second input is further used to fill in the data units in the information template to complete the input, thereby improving the experience of inputting special content such as mathematical formulas through a virtual keyboard.

[0124] In some embodiments of the present application, the fourth input is voice input, the information template is a formula template, and the determination unit 608 is also used to perform voice recognition on the voice input to obtain the formula type corresponding to the voice input; and search for the formula template corresponding to the formula type in the pre-stored formula template library.

[0125] In an embodiment of the present application, the user can use voice input to "say" the type of formula to be input. After the system receives the voice input through a microphone or other sound pickup device, it uses a voice recognition algorithm to recognize the semantics in the voice input, thereby determining the type of formula the user wishes to input. After determining the type of formula, the corresponding formula template can be found in the pre-stored formula template library and displayed. Among them, each parameter in the formula template is a data unit, and the user can further fill in the data unit in the formula template through a second input to complete the input of the formula.

[0126] For example, when the user orally says "Fourier series formula", the formula template of the Fourier series formula is directly displayed above the virtual keyboard. After the user confirms the template, he fills in the parameter quantities to complete the input of the formula.

[0127] In the embodiment of the present application, the public name is input by voice, so that the corresponding formula panel is displayed. On the one hand, it can improve the efficiency of the user in inputting formulas. On the other hand, displaying the formula template can also prompt the user to the specific form of the formula, avoiding the situation where the user makes "wrong" formulas when writing them by hand, and can improve the experience of entering special content such as mathematical formulas through the virtual keyboard.

[0128] In some embodiments of the present application, the receiving unit 602 is further configured to receive a fifth input;

[0129] The generating unit 606 is further configured to modify the target picture information in response to the fifth input.

[0130] In the embodiment of the present application, after the target image information is determined, the target image information can be further edited through the fifth input. Specifically, after the input track (handwriting) of the user's handwriting input is saved as the target image information, if the user finds an error or needs to add new content, the previous operation can be returned to the editable state. In the editable state, the handwriting in the target image can be modified or deleted, and the user can also add new content based on the original image data, thereby realizing the free editing and input of special content such as formulas.

[0131] The information input device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0132] The information input device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0133] The information input device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.

[0134] Optionally, the embodiment of the present application further provides an electronic device 700, Figure 7 A structural block diagram of an electronic device according to an embodiment of the present application is shown. Figure 7 As shown, it includes a processor 702, a memory 704, and a program or instruction stored in the memory 704 and executable on the processor 702. When the program or instruction is executed by the processor 702, each process of the above-mentioned method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0135] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0136] Figure 8 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0137] The electronic device 2000 includes but is not limited to: a radio frequency unit 2001, a network module 2002, an audio output unit 2003, an input unit 2004, a sensor 2005, a display unit 2006, a user input unit 2007, an interface unit 2008, a memory 2009, and a processor 2010 and other components.

[0138] Those skilled in the art will appreciate that the electronic device 2000 may further include a power source 2011 (such as a battery) for supplying power to various components. The power source 2011 may be logically connected to the processor 2010 via a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 8 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0139] The user input unit 2007 is used to receive a first input when the virtual keyboard is displayed;

[0140] The processor 2010 is configured to determine an input area within a display range of the virtual keyboard in response to the first input;

[0141] The user input unit 2007 is also used to receive a second input in the input area;

[0142] The processor 2010 is further configured to generate corresponding target image information in response to the second input.

[0143] Optionally, the second input is a handwriting input, the input area includes a first handwriting input area, and the user input unit 2007 is further configured to receive a handwriting input in the first handwriting input area.

[0144] Optionally, the handwriting input includes a first handwriting input, and the processor 2010 is further used to generate and display first image data corresponding to the first handwriting input in a first handwriting input area in response to the first handwriting input; generate first picture information according to the first image data; and generate target picture information according to the first picture information.

[0145] Optionally, the handwriting input further includes a second handwriting input, and the input area further includes a second handwriting input area;

[0146] The user input unit 2007 is also used to receive a third input;

[0147] Processor 2010 is also used to switch the first handwriting input area to the second handwriting input area in response to a third input; receive a second handwriting input in the second handwriting input area; generate and display second image data corresponding to the second handwriting input in the second handwriting input area in response to the second handwriting input; generate second picture information based on the second image data; and splice the first picture information and the second picture information to obtain target picture information.

[0148] Optionally, the user input unit 2007 is further used to receive a fourth input;

[0149] Processor 2010 is also used to determine the corresponding information template in response to the fourth input; and determine the corresponding data information in response to the second input; fill the information template with the data information to obtain the corresponding template data; and generate target image information according to the template data.

[0150] Optionally, the fourth input is voice input, and the information template is a formula template. The processor 2010 is also used to perform voice recognition on the voice input to obtain the formula type corresponding to the voice input; and search for the formula template corresponding to the formula type in the pre-stored formula template library.

[0151] Optionally, the user input unit 2007 is further configured to receive a fifth input;

[0152] The processor 2010 is further configured to modify the target picture information in response to a fifth input.

[0153] It should be understood that in an embodiment of the present application, the input unit 2004 may include a graphics processor (GPU) 5082 and a microphone 5084, and the graphics processor 5082 processes image data of static pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode.

[0154] The display unit 2006 may include a display panel 5122, which may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 2007 includes a touch panel 5142 and other input devices 5144. The touch panel 5142 is also called a touch screen. The touch panel 5142 may include two parts: a touch detection device and a touch controller. Other input devices 5144 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail here. The memory 2009 may be used to store software programs and various data, including but not limited to applications and operating systems. The processor 2010 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and applications, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 2010.

[0155] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0156] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0157] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0158] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0159] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0160] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0161] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A method for inputting information, characterized in that: include: In case the virtual keyboard is displayed, receiving a first input; In response to a first input, determining an input area within a display range of the virtual keyboard; receiving a second input in the input area; In response to the second input, generating corresponding target picture information; The second input is a handwriting input, the input area includes a first handwriting input area, the handwriting input includes a first handwriting input, and the generating corresponding target image information in response to the second input includes: In response to the first handwriting input, generating and displaying first image data corresponding to the first handwriting input in the first handwriting input area; generating first picture information according to the first image data; generating the target picture information according to the first picture information; After generating the corresponding target image information, the information input method further includes: receiving a fifth input; In response to the fifth input, modifying the target image information specifically includes: if the user is currently in a chat interface, and the target image information that has been sent exists in the chat interface, in response to the user long pressing the target image information, displaying the input track corresponding to the target image information in the current handwriting input area, so that the user can edit the input track; The handwriting input further includes a second handwriting input, the input area further includes a second handwriting input area, and the method further includes: receiving a third input; In response to the third input, switching the first handwriting input area to the second handwriting input area, wherein the first handwriting input area and the second handwriting input area are different areas; receiving the second handwriting input in the second handwriting input area; In response to the second handwriting input, generating and displaying second image data corresponding to the second handwriting input in the second handwriting input area; generating second picture information according to the second image data; The generating the target picture information according to the first picture information includes: The first picture information and the second picture information are concatenated to obtain the target picture information.

2. The information input method according to claim 1, characterized in that: Receiving a second input in the input area includes: The handwriting input is received in the first handwriting input area, where content of the handwriting input includes a formula.

3. The information input method according to claim 1, characterized in that: Before receiving the second input through the virtual keyboard, the method further includes: receiving a fourth input; In response to the fourth input, determining a corresponding information template; and The step of generating corresponding target image information in response to the second input includes: In response to the second input, determining corresponding data information; Filling the information template with the data information to obtain corresponding template data; The target image information is generated according to the template data.

4. The information input method according to claim 3, characterized in that: The fourth input is a voice input, the information template is a formula template, and the determining the corresponding information template in response to the fourth input includes: Performing voice recognition on the voice input to obtain a formula type corresponding to the voice input; In the pre-stored formula template library, search for the formula template corresponding to the formula type.

5. An information input device, characterized in that: include: A receiving unit, configured to receive a first input when the virtual keyboard is displayed; a switching unit, configured to determine an input area within a display range of the virtual keyboard in response to a first input; The receiving unit is further configured to receive a second input in the input area; A generating unit, configured to generate corresponding target image information in response to the second input; The second input is a handwriting input, the input area includes a first handwriting input area, the handwriting input includes a first handwriting input, and the generating unit is further used for: In response to the first handwriting input, generating and displaying first image data corresponding to the first handwriting input in the first handwriting input area; generating first picture information according to the first image data; generating the target picture information according to the first picture information; The receiving unit is further configured to receive a fifth input; The generating unit is further configured to modify the target image information in response to the fifth input, specifically comprising: if the user is currently in a chat interface, and the target image information that has been sent exists in the chat interface, in response to the user long pressing the target image information, displaying the input track corresponding to the target image information in the current handwriting input area, so that the user can edit the input track; The handwriting input further includes a second handwriting input, and the input area further includes a second handwriting input area; The receiving unit is further configured to receive a third input; The switching unit is further configured to switch the first handwriting input area to the second handwriting input area in response to the third input, wherein the first handwriting input area and the second handwriting input area are different areas; The receiving unit is further configured to receive the second handwriting input in the second handwriting input area; The generating unit is further configured to generate and display second image data corresponding to the second handwriting input in the second handwriting input area in response to the second handwriting input; and generate second picture information according to the second image data; The first picture information and the second picture information are concatenated to obtain the target picture information.

6. The information input device according to claim 5, characterized in that: The receiving unit is also used for: The handwriting input is received in the first handwriting input area, where content of the handwriting input includes a formula.

7. The information input device according to claim 5, characterized in that: The receiving unit is further configured to receive a fourth input; The information input device also includes: A determination unit is used to determine the corresponding information template in response to the fourth input; determine the corresponding data information in response to the second input; fill the information template with the data information to obtain the corresponding template data; and generate the target image information according to the template data.

8. The information input device according to claim 7, characterized in that: The fourth input is a voice input, the information template is a formula template, and the determination unit is further used for: Performing voice recognition on the voice input to obtain a formula type corresponding to the voice input; In the pre-stored formula template library, search for the formula template corresponding to the formula type.

Images