Input information processing method, device and equipment

Abstract

The invention relates to the technical field of computers, and discloses an input information processing method, device and equipment. The method comprises the following steps: receiving and displaying handwriting input by a user, and obtaining the handwriting and position information displayed by the handwriting; obtaining text information corresponding to the handwriting according to the handwriting; acquiring an image corresponding to the text information; and removing the handwriting, and displaying the image at a position corresponding to the position information. Through visual presentation of multi-modal information fusion, personalized information expression and image-text combination, the problems of diversification and enrichment of information expression are solved. According to the method, more diversified information expression modes are provided, so that a user can convey and display own thoughts, viewpoints and creativity in a freer, more visual and more creative mode.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an input information processing method, device and equipment. Background Art

[0002] With the advent of the digital age, users' demand for more natural, intuitive and flexible input methods is increasing. User handwriting input is universal and important in various fields. For example, commonly used touch screens can accept and display text, numbers, symbols, graphics and other content input by users' handwriting.

[0003] However, currently, the information input by users is generally displayed to users intuitively, and it is not possible to provide diversified and enriched content based on the information input by users. Summary of the invention

[0004] The implementation methods of the present application mainly solve the problem of diversifying and enriching the expression of user input information.

[0005] In order to solve the above technical problems, a technical solution adopted in the implementation mode of the present application is: to provide an input information processing method, including: receiving and displaying handwriting input by a user, obtaining the handwriting and the position information of the handwriting display; obtaining the text information corresponding to the handwriting according to the handwriting; obtaining the image corresponding to the text information; removing the handwriting, and displaying the image at the position corresponding to the position information.

[0006] Optionally, the receiving and displaying of handwriting input by the user, and obtaining the handwriting and the position information of the handwriting display, include: receiving the handwriting input by the user, and displaying the handwriting in real time; when the handwriting is not detected within a first preset time, determining that the handwriting input by the user is in a completed state, obtaining all the handwriting from the last completed state to the current completed state, and obtaining the position information of all the handwriting displayed on the screen.

[0007] Optionally, obtaining text information corresponding to the handwriting based on the handwriting includes: obtaining the system language of a device; performing handwriting recognition based on the handwriting to obtain text information corresponding to the handwriting; matching the text information with the system language to obtain the degree of matching between the language to which the text information belongs and the system language; when the degree of matching is greater than a preset threshold, determining that the text information matches the system language, and using the text information as the text information corresponding to the handwriting; when the degree of matching is less than or equal to the preset threshold, prompting the user to confirm the input language type, and obtaining the text information corresponding to the handwriting based on the language type confirmed by the user.

[0008] Optionally, obtaining the image corresponding to the text information includes: obtaining a prompt word corresponding to the text information based on the text information; generating an image associated with the text information based on the prompt word; obtaining the number and size of the images; and obtaining the images of a corresponding number and size based on the number and size.

[0009] Optionally, when the trigger time for displaying the image at the position corresponding to the position information is greater than a second preset time, the method further includes: displaying prompt information in a prompt box corresponding to the position information according to the position information; when the operation of displaying the image at the position corresponding to the position information is triggered, executing the steps of removing the handwriting and displaying the image at the position corresponding to the position information, and removing the prompt box at the same time.

[0010] In order to solve the above technical problems, another technical solution adopted in the implementation mode of the present application is: to provide an input information processing device, including: a handwriting acquisition module, used to receive and display handwriting input by a user, and obtain the handwriting and the position information of the handwriting display; a text information acquisition module, used to obtain the text information corresponding to the handwriting according to the handwriting; an image acquisition module, used to obtain the image corresponding to the text information; an image display module, used to remove the handwriting and display the image at the position corresponding to the position information.

[0011] Optionally, the handwriting acquisition module is specifically used to: receive handwriting input by the user and display the handwriting in real time; when the handwriting is not detected within a first preset time, determine that the handwriting input by the user is in a completed state, obtain all handwriting from the last completed state to the current completed state, and obtain the position information of all handwriting displayed on the screen.

[0012] Optionally, the text information acquisition module is specifically used to: acquire the system language of the device; perform handwriting recognition based on the handwriting to obtain text information corresponding to the handwriting; match the text information with the system language to obtain the degree of matching between the language to which the text information belongs and the system language; when the degree of matching is greater than a preset threshold, it is determined that the text information matches the system language, and the text information is used as the text information corresponding to the handwriting; when the degree of matching is less than or equal to the preset threshold, the user is prompted to confirm the input language type, and the text information corresponding to the handwriting is acquired according to the language type confirmed by the user.

[0013] Optionally, the image acquisition module is specifically used to: acquire a prompt word corresponding to the text information according to the text information; generate an image associated with the text information according to the prompt word; acquire the number and size of the images; and obtain the images of a corresponding number and size according to the number and size.

[0014] To solve the above technical problems, another technical solution adopted in the implementation mode of the present application is: to provide an input information processing device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the input information processing method as described above.

[0015] Different from the related art, the embodiments of the present application provide an input information processing method, device and equipment, which receives and displays the handwriting input by the user, obtains the handwriting and the position information of the handwriting display; obtains the text information corresponding to the handwriting according to the handwriting; obtains the image corresponding to the text information; removes the handwriting, and displays the image at the position corresponding to the position information. The input information processing method, device and equipment provided by the embodiments of the present application realize the fusion of multimodal information by converting the user's handwriting input into text information and obtaining related images; in addition, the handwriting input by the user contains the personalized characteristics of the user, allowing the user to express his unique style and personality through handwriting input, thereby making the information expression more diversified; furthermore, the text information of the handwriting input by the user is combined with the related image and displayed at the corresponding position, providing a visual presentation method combining text and images, making the information more attractive and readable. In general, the implementation method of the present application solves the problem of diversified and enriched information expression through multimodal information fusion, personalized information expression and visual presentation combining text and images. It provides more diverse ways of expressing information, allowing users to convey and display their thoughts, opinions and ideas in a more free, intuitive and creative way. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] One or more embodiments are exemplarily described by corresponding drawings, which do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and the figures in the drawings do not constitute proportional limitations unless otherwise stated.

[0017] Figure 1 It is a schematic diagram of an application scenario provided by an embodiment of the present application;

[0018] Figure 2 is a flow chart of an input information processing method provided by an embodiment of the present application;

[0019] Figure 3 is a flow chart of a method for obtaining text information corresponding to the handwriting according to the handwriting in an embodiment of the present application;

[0020] Figure 4 is a structural diagram of an input information processing device provided in an embodiment of the present application;

[0021] Figure 5 It is a schematic diagram of the hardware structure of the input information processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0023] It should be noted that, if there is no conflict, the various features in the embodiments of the present application can be combined with each other, all within the scope of protection of the present application. In addition, although the functional modules are divided in the device schematic diagram and the logical order is shown in the flow chart, in some cases, the steps shown or described can be performed in a different order than the module division in the device schematic diagram or the order in the flow chart.

[0024] Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.

[0025] The input information processing method, device and equipment disclosed in the embodiments of the present application mainly obtain the text information of the handwriting by the user through recognizing the handwriting input, obtain the image corresponding to the handwriting according to the text information, and finally display the image corresponding to the handwriting to the user. Therefore, in addition to being able to intuitively display the content of the handwriting input by the user, the content of the handwriting can also be reflected in the form of an image, making the expression of the input information diversified and enriched. In addition, in the scenario of interactive applications, by displaying the intuitive feedback of the image, the user can confirm the correctness of the input content, thereby improving the accuracy and efficiency of the interaction; moreover, by displaying images related to their handwriting to the user, a personalized display effect can be provided, which improves the user's interaction effect and satisfaction, all of which are conducive to the user's better interaction with the system.

[0026] See also Figure 1 , Figure 1It is a schematic diagram of an application scenario provided by an embodiment of the present application, and the input information processing method and device of the embodiment of the present application can be applied to the application scenario. The application scenario includes: a touch input display device 10, a network connection device 20 and a cloud server 30. The touch input display device 10 is connected to the cloud server 30 via the network connection device 20. The touch input display device 10 provides an interactive surface for the user to write directly, and the touch input display device 10 can capture the user's handwriting and display it on the screen. The touch input display device 10 can specifically be a tablet computer, a smart phone, an electronic whiteboard, or other device that can be written, has pressure and tilt sensing functions, and can accurately capture the user's handwriting. In addition to supporting direct writing by the user, the touch input display device 10 also supports input through a stylus. When the touch input display device 10 is a smart terminal device such as a tablet computer or a smart phone, it can execute handwriting recognition and image processing algorithms, such as receiving and displaying the handwriting input by the user, obtaining the handwriting and the position information of the handwriting display; obtaining the text information corresponding to the handwriting according to the handwriting; obtaining the image corresponding to the text information; removing the handwriting, and displaying the image at the position corresponding to the position information. When the touch input display device 10 is an electronic whiteboard or a touch screen display, it can capture the user's handwriting and display the handwriting on the screen, and access the cloud server 30 through the network connection device 20, such as obtaining the OpenAI service from the cloud server 30, and using the OpenAI service for natural language processing, for example, the user can write mathematical equations or text descriptions, and then use the OpenAI natural language processing model to convert it into text, and then use the image processing function of the OpenAI service to convert the text into an image, the image includes pictures and / or videos, and return the image to the electronic whiteboard or touch screen display through the network connection device 20, and display the image on the electronic whiteboard or touch screen display. Among them, the OpenAI service can be deployed by the user himself or by a third party. The network connection device 20 includes but is not limited to wireless / wired routers, cellular network devices, Ethernet switches, etc.

[0027] In some application scenarios, the digital pen and the virtual whiteboard can be used as a touch input display device 10. For example, in a virtual meeting, participants can communicate remotely through video conferencing software, and using the virtual whiteboard, participants can use a digital pen to write, just like on a real whiteboard. When the participant writes on the virtual whiteboard, the digital pen captures the shape and position information of the handwriting; then, the method converts the handwriting into text, such as recording the ideas or decisions discussed in the meeting into text; next, the system obtains images related to the text, such as schematic diagrams or flow charts related to the topic of discussion; finally, the handwriting is removed and replaced with an image corresponding to the input position of the participant. The text converted from the handwriting can be displayed or not displayed according to application requirements. As a result, participants can see the relevant images of their writing in the real-time meeting. This method provides better visualization support and promotes more effective remote collaboration and understanding.

[0028] In some application scenarios, the touch display screen is a touch input display device 10. For example, in a teaching scenario, a teacher writes the word "banana" on the touch display screen, and the touch display screen captures the teacher's handwriting and displays it on the screen. The touch input display device establishes a connection with the cloud server through a network connection device. The OpenAI service is deployed in the cloud server, which has the ability of natural language processing and image processing. The handwritten word "banana" will be transmitted to the cloud server, and the text conversion is performed through the natural language processing model of OpenAI. The OpenAI service converts the handwritten word into the text form of "banana". After obtaining the text form of "banana", the cloud server uses the image processing function to convert the text into a corresponding image, that is, a picture of a banana, which can be achieved by using image recognition, image generation, or an image database related to bananas. The generated banana picture is returned to the touch input display device through the network connection device and displayed to the students on the screen. The students can see in real time that their handwritten word "banana" has been converted into an image of a banana. As a result, teachers can directly handwrite words on the touch input display device, allowing students to understand and remember the meaning of words more intuitively. This teaching method can stimulate students' interest while helping them to establish a connection between words and images. It also provides an interactive and engaging teaching method, allowing students to participate more actively in class. By converting handwritten content into image presentation, students can better understand and remember what they have learned, and deepen their understanding and cognition of knowledge.

[0029] In combination with the above application scenarios, the input information processing method and device of this specification are described below through specific embodiments.

[0030] See also Figure 2 , Figure 2is a flow chart of an input information processing method provided by an embodiment of the present application. Figure 2 As shown, the method includes:

[0031] S101, receiving and displaying handwriting input by a user, and acquiring the handwriting and position information of the handwriting display.

[0032] Handwriting refers to the handwriting input by the user. The user can use a touch screen, a drawing tablet or other input device to write directly with a finger or write content with a stylus in the input area, and convert it into digital handwriting data, which may include information such as the shape, position, and pressure of the strokes. These handwriting data can be captured and processed and displayed on the screen, and the corresponding position information can be obtained at the same time. The position information refers to the position of the handwriting on the display screen. The position of the handwriting can be obtained by obtaining the coordinate information of the touch event. The coordinate information can be the pixel coordinates relative to the upper left corner of the screen or the upper left corner of the input area. The position information can also be a position within a preset range around the handwriting, which can be obtained according to the size of the input area and the position of the handwriting input by the user.

[0033] It is known that when a user inputs handwriting, there may be incoherent writing, which may cause the acquired handwriting writing time information to become complicated. If the time when the user inputs the handwriting cannot be accurately determined, this will affect the accuracy of the acquired handwriting. Optionally, the receiving and displaying of the handwriting input by the user, and obtaining the handwriting and the position information of the handwriting display, include: receiving the handwriting input by the user, and displaying the handwriting in real time; when the handwriting is not detected within a first preset time, determining that the handwriting input by the user is in a completed state, obtaining all the handwriting from the last completed state to the current completed state, and obtaining the position information of all the handwriting displayed on the screen. Among them, a user input interface can be created, including an input area for receiving the user's handwriting input and displaying the handwriting in real time; monitoring the stylus movement event or touch event, and capturing the coordinate information of the event, which coordinates represent the position of the user's input handwriting on the input area; when the event coordinates are captured, they are added to the handwriting data structure for storing the user's handwriting information; a timer is started, which is triggered when no new handwriting input is detected within a preset time; when the timer is triggered, it is determined that the handwriting input by the user is in a completed state, at which time it can be considered that the user has completed a handwriting input; all handwriting data between the last completed state and the current completed state are obtained, and these data can be stored in the handwriting data structure; all the obtained handwriting data are used for subsequent processing, such as saving, analyzing or identifying. At the same time, the coordinate information in the handwriting data can be used to determine the display position of all handwriting on the screen, which can be the coordinates relative to the input area or the screen, or the normalized coordinate values.

[0034] In some embodiments, there are multiple users inputting their own handwriting. In this embodiment, the text corresponding to the handwriting can be obtained according to the handwriting input by different users, and then the image corresponding to the text can be obtained, and finally the image corresponding to the content of the handwriting input by different users can be displayed. Among them, how to correctly distinguish the handwriting input by different users is crucial to the subsequent process of obtaining text and image. For example, in a classroom, teachers and students can use an interactive whiteboard for teaching and learning, and write text or English words on the whiteboard. For example, a teacher reports an English word dictation, and at least two students participate in the word dictation. At this time, there are at least two students' input handwriting on the whiteboard. The input handwriting of different students can be identified by using a user identifier. Specifically, a unique user identifier is assigned to each student. When a student inputs handwriting, the handwriting event is associated with the corresponding student identifier. By maintaining the mapping relationship between the student identifier and the handwriting in the system, the input of different students can be distinguished and tracked. The handwriting can also be distinguished according to the order of students' interactions. For example, when a teacher calls a student for dictation, their handwriting can be recorded and distinguished in sequence according to the order of the students, so that the handwriting can be identified and distinguished according to the order of the students.

[0035] S102: Acquire text information corresponding to the handwriting according to the handwriting.

[0036] Handwriting recognition technology can be used to convert handwritten handwriting into recognizable text. For example, using machine learning or deep learning algorithms, a model is trained to recognize and transcribe handwriting. The model can learn the patterns of English letters, pinyin, numbers, Chinese characters, and common words, and convert handwriting into corresponding text. Specifically, a handwriting dataset is collected, which includes samples of various English letters, pinyin, numbers, Chinese characters and common words. These data can be collected by a handwriting tablet, touch screen or other handwriting input device. Then, the data is preprocessed, such as denoising, normalization or standardization, to prepare the data for model training; feature extraction is performed to extract useful features from the handwriting data for model learning. Common handwriting features include stroke direction, speed, pressure, etc. These features can be extracted using signal processing or image processing technology; data is annotated, and the corresponding text is manually annotated for the handwriting data, that is, each handwriting sample is associated with its corresponding text label, which will be used in the supervised learning process of model training; the next step is model selection and training. According to the complexity of the task and the size of the dataset, an appropriate machine learning or deep learning model is selected, such as support vector machine (SVM), random forest (Random Forest), convolutional neural network (CNN) or recurrent neural network (RNN), etc., use the labeled handwriting data to train the model, and iteratively optimize the model parameters so that it can accurately recognize and transcribe handwriting; perform model evaluation, that is, use a reserved validation set or cross-validation technology to evaluate the performance of the model, common evaluation indicators include accuracy, recall rate, F1 value, etc.; then perform model optimization and parameter adjustment, that is, according to the evaluation results, optimize and adjust the model to improve the performance of the model, which involves adjusting the model's hyperparameters, increasing the amount of data, introducing regularization technology, etc.; finally, apply the model, use the trained model to recognize and transcribe new handwriting data, and convert the handwriting into corresponding text output.

[0037] In some embodiments, Figure 3 As shown, the step of obtaining text information corresponding to the handwriting according to the handwriting includes:

[0038] S1021. Obtain the system language of the device. Depending on the application environment and development platform, the corresponding API or library can be used to obtain the system language of the device. For example, in Python, the locale module can be used to obtain the system language setting.

[0039] S1022: Perform handwriting recognition according to the handwriting to obtain text information corresponding to the handwriting. The above method can be used to obtain text information corresponding to the handwriting.

[0040] S1023, matching the text information with the system language to obtain the degree of matching between the language to which the text information belongs and the system language. Match the recognized text information with the system language of the device. A string matching algorithm or a language recognition library may be used to determine the language to which the text information belongs. Then, the degree of matching between the text information and the system language is calculated, and the specific method depends on the selected matching algorithm.

[0041] Among them, using a string matching algorithm to determine the language to which the text information belongs may include: collecting representative text sample data, each language should contain enough samples, these samples may be words, phrases, sentences or paragraphs, preferably covering common vocabulary and grammatical structures in the language. Extracting features from the language sample data for language identification, the features may include character frequency, character combination frequency, word frequency, etc., and appropriate features may be selected according to requirements. Constructing a language model, for each language, a language model is constructed using the extracted features, and these models may be constructed using statistical methods or machine learning-based methods. Training the model, using the prepared language sample data, each language model is trained. Text matching and judgment, for a given text information, the extracted features are used to calculate the similarity or matching degree between it and each language model, and different similarity measurement methods (such as cosine similarity, etc.) may be used to compare the similarity between the text and the language model. Finally, according to the matching degree, the most similar language model is selected, and the text information is divided into corresponding language categories. A threshold may be set to determine whether the matching degree is high enough, or the language with the highest matching degree may be selected as the prediction result.

[0042] S1024: When the matching degree is greater than a preset threshold, it is determined that the text information matches the system language, and the text information is used as the text information corresponding to the handwriting.

[0043] S1025. When the matching degree is less than or equal to the preset threshold, prompt the user to confirm the input language type, and obtain text information corresponding to the handwriting according to the language type confirmed by the user.

[0044] A preset matching degree threshold may be set according to the requirements. An initial matching degree threshold may be set according to factors such as the length of the text information and the similarity of the languages. For example, for longer text information, a lower threshold may be set to tolerate more differences. For shorter text information, a higher threshold may be set to require a higher matching degree.

[0045] According to the matching degree and the preset threshold, it is determined whether the text information matches the system language. If the matching degree is greater than the preset threshold, it is determined that the text information matches the system language and is used as the text information of the handwriting. If the matching degree is less than or equal to the preset threshold, the user is prompted to confirm the input language type, and the handwriting text information is obtained according to the language type confirmed by the user. Prompting the user to confirm the input language type means that the user tells the language type of the handwriting input, such as Chinese or English.

[0046] In this embodiment, after determining that the text information matches the system language, it can be more certainly regarded as the text information corresponding to the handwriting, which helps to improve the accuracy and reliability of input and supports applications in a multi-language environment.

[0047] S103: Acquire an image corresponding to the text information.

[0048] The corresponding image is obtained according to the content and meaning of the text information. Specifically, the required image theme and type can be determined according to the content and meaning of the text information; an image search engine or image library can be used to search according to the keywords of the text information, and the keywords and related descriptions can be used to describe the image as accurately as possible; the found image can also be edited and customized, including cropping, resizing, adding text or graphics, etc., to make it more consistent with the text information.

[0049] In some embodiments, the obtaining of the image corresponding to the text information includes: obtaining the prompt word corresponding to the text information according to the text information; generating the image associated with the text information according to the prompt word; obtaining the number and size of the image; and obtaining the corresponding number and size of the image according to the number and size. Among them, keywords, subject words or description words can be extracted as prompt words, and these prompt words are used for subsequent image search or generation. Using the prompt word as a search condition, the image associated with the text information is obtained through an image search engine (such as using the prompt word to search and select images related to the text information) or an image generation technology (such as generating images associated with the text information according to the prompt word). Among them, the number and size of the required images are also determined, and according to the determined number and size, an appropriate number of images are selected from the generated or searched images, and their sizes are adjusted as needed. Among them, when obtaining the number and size of the images, the number and size can be determined according to the prompt word. The number of images corresponding to each prompt word can be determined according to the characteristics and meaning of the prompt word. For example, if the prompt word is a different season, one image can be selected for each season, so the number of images will match the number of seasons. The image size corresponding to each prompt word may also be determined according to the specific content and purpose of the prompt word. For example, if the prompt word is a thumbnail of a web page, a smaller image size may be required; if the prompt word is a printed poster, a larger image size may be required.

[0050] In this embodiment, by determining the number and size of images according to the prompt words, the image display requirements and goals can be better met, thereby ensuring that key information is effectively conveyed.

[0051] S104: remove the handwriting, and display the image at a position corresponding to the position information.

[0052] Image processing technology can be used to process the handwriting in the image to remove them. Finally, the processed image is displayed at the corresponding position according to the extracted position information.

[0053] The input information processing method provided in the embodiment of the present application can present the input information in a more intuitive way by generating images related to the input handwriting, making it easier for readers or viewers to understand and absorb the content. Visual information can supplement and enhance the expression of handwriting and provide a more comprehensive way of communication. In addition, through the use of images, a richer and more diverse user experience can be provided. Images can bring more sensory satisfaction and fun to readers, making the content more vivid, interactive and interesting, and enhancing the user's experience of the content.

[0054] In some embodiments, when the trigger time for displaying the image at the position corresponding to the position information is greater than a second preset time, the method further includes: displaying a prompt message in a prompt box corresponding to the position information according to the position information; when the operation of displaying the image at the position corresponding to the position information is triggered, performing the steps of removing the handwriting and displaying the image at the position corresponding to the position information, and removing the prompt box at the same time. If the image is not displayed normally within a period of time, a prompt message can be displayed on the screen, such as prompting the user to wait. When the image can be displayed normally on the screen, the prompt message disappears and the corresponding image is displayed. In this way, user-friendly interaction and feedback can be provided to enhance the user experience.

[0055] See also Figure 4 , Figure 4 Schematic diagram of the structure of an input information processing device provided in an embodiment of the present application. Figure 4 As shown, the input information processing device 40 includes:

[0056] The handwriting acquisition module 41 is used to receive and display the handwriting input by the user, and to acquire the handwriting and the position information of the handwriting display; the text information acquisition module 42 is used to acquire the text information corresponding to the handwriting based on the handwriting; the image acquisition module 43 is used to acquire the image corresponding to the text information; the image display module 44 is used to remove the handwriting and display the image at the position corresponding to the position information.

[0057] Among them, the handwriting acquisition module 41 is specifically used to: receive the handwriting input by the user and display the handwriting in real time; when the handwriting is not detected within the first preset time, determine that the handwriting input by the user is in a completed state, obtain all handwriting from the last completed state to the current completed state, and obtain the position information of all handwriting displayed on the screen.

[0058] The text information acquisition module 42 is specifically used to: acquire the system language of the device; perform handwriting recognition based on the handwriting to obtain text information corresponding to the handwriting; match the text information with the system language to obtain the degree of matching between the language to which the text information belongs and the system language; when the degree of matching is greater than a preset threshold, it is determined that the text information matches the system language, and the text information is used as the text information corresponding to the handwriting; when the degree of matching is less than or equal to the preset threshold, the user is prompted to confirm the input language type, and the text information corresponding to the handwriting is acquired according to the language type confirmed by the user.

[0059] The image acquisition module 43 is specifically used to: acquire the prompt word corresponding to the text information according to the text information; generate an image associated with the text information according to the prompt word; acquire the number and size of the images; and obtain the corresponding number and size of the images according to the number and size.

[0060] It should be noted that the above-mentioned input information processing device can execute the input information processing method provided in the embodiment of the present application, and has the corresponding functional modules and beneficial effects of the execution method. For technical details not fully described in the embodiment of the input information processing device, please refer to the input information processing method provided in the embodiment of the present application.

[0061] Figure 5 is a schematic diagram of the hardware structure of the input information processing device 50 provided in the embodiment of the present application, such as Figure 5 As shown, the input information processing device 50 includes:

[0062] One or more processors 51 and memory 52, Figure 5 A processor 51 is taken as an example. The processor 51 and the memory 52 may be connected via a bus or other means. Figure 5 The example of connecting through bus is taken in the following.

[0063] The memory 52 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules, such as program instructions / modules corresponding to the input information processing method in the embodiment of the present application. The processor 51 executes various functional applications and data processing of the input information processing device by running the non-volatile software programs, instructions and modules stored in the memory 52, that is, implements the input information processing method in the above method embodiment.

[0064] The memory 52 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required by at least one function; the data storage area may store data created according to the use of the input information processing device, etc. In addition, the memory 52 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 52 may optionally include a memory remotely arranged relative to the processor 51, and these remote memories may be connected to the input information processing device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0065] The one or more modules are stored in the memory 52, and when executed by the one or more processors 51, the input information processing method in any of the above method embodiments is executed.

[0066] The above-mentioned product can execute the method provided in the embodiment of the present application, and has the functional modules and beneficial effects corresponding to the execution method. For technical details not fully described in this embodiment, please refer to the method provided in the embodiment of the present application.

[0067] The input information processing device of the embodiment of the present application exists in various forms, including but not limited to: LED all-in-one machine, personal computer, tablet computer, smart phone, digital board and drawing board, etc.

[0068] The embodiment of the present application provides a non-volatile computer-readable storage medium, wherein the non-volatile computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, such as Figure 5 A processor 51 in the embodiment may enable the one or more processors to execute the input information processing method in any of the above method embodiments.

[0069] An embodiment of the present application provides a computer program product, which includes a computer program stored on a non-volatile computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by the input information processing device, the input information processing device is enabled to execute the input information processing method in any of the above-mentioned method embodiments.

[0070] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0071] Through the description of the above implementation methods, ordinary technicians in this field can clearly understand that each implementation method can be implemented by means of software plus a general hardware platform, and of course, it can also be implemented by hardware. Ordinary technicians in this field can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0072] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Under the concept of the present application, the technical features in the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other changes in different aspects of the present application as described above, which are not provided in detail for the sake of simplicity. Although the present application has been described in detail with reference to the aforementioned embodiments, a person of ordinary skill in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features can be replaced by equivalents. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for processing input information, characterized in that: include: Receive and display handwriting input by the user, and obtain the handwriting and the position information of the handwriting display; Acquire text information corresponding to the handwriting according to the handwriting; Obtaining an image corresponding to the text information; The handwriting is removed, and the image is displayed at the position corresponding to the position information.

2. The input information processing method according to claim 1, characterized in that: The receiving and displaying of handwriting input by the user, and obtaining the handwriting and the position information of the handwriting display, comprises: Receiving handwriting input by a user and displaying the handwriting in real time; When the handwriting is not detected within the first preset time, the handwriting input by the user is determined to be in a completed state, all handwritings from the last completed state to the current completed state are obtained, and the position information of all handwritings displayed on the screen is obtained.

3. The input information processing method according to claim 1, characterized in that: The step of obtaining text information corresponding to the handwriting according to the handwriting includes: Get the system language of the device; Perform handwriting recognition according to the handwriting to obtain text information corresponding to the handwriting; Matching the text information with the system language to obtain a matching degree between the language to which the text information belongs and the system language; When the matching degree is greater than a preset threshold, it is determined that the text information matches the system language, and the text information is used as the text information corresponding to the handwriting; When the matching degree is less than or equal to the preset threshold, the user is prompted to confirm the input language type, and text information corresponding to the handwriting is obtained according to the language type confirmed by the user.

4. The input information processing method according to any one of claims 1 to 3, characterized in that: The obtaining of the image corresponding to the text information includes: Acquire a prompt word corresponding to the text information according to the text information; generating an image associated with the text information according to the prompt word; Obtaining the number and size of the images; According to the number and the size, a corresponding number and a corresponding size of the images are obtained.

5. The method according to claim 4, characterized in that When the trigger time for displaying the image at the position corresponding to the position information is greater than a second preset time, the method further includes: According to the location information, display prompt information in a prompt box corresponding to the location information; When the operation of displaying the image at the position corresponding to the position information is triggered, the steps of removing the handwriting and displaying the image at the position corresponding to the position information are performed, and the prompt box is removed at the same time.

6. An input information processing device, characterized in that: include: A handwriting acquisition module, used for receiving and displaying handwriting input by a user, and acquiring the handwriting and the position information of the handwriting display; A text information acquisition module, used for acquiring text information corresponding to the handwriting according to the handwriting; An image acquisition module, used to acquire an image corresponding to the text information; An image display module is used to remove the handwriting and display the image at a position corresponding to the position information.

7. The input information processing device according to claim 6, characterized in that: The handwriting acquisition module is specifically used for: Receiving handwriting input by a user and displaying the handwriting in real time; When the handwriting is not detected within the first preset time, the handwriting input by the user is determined to be in a completed state, all handwritings from the last completed state to the current completed state are obtained, and the position information of all handwritings displayed on the screen is obtained.

8. The input information processing device according to claim 6, characterized in that: The text information acquisition module is specifically used for: Get the system language of the device; Perform handwriting recognition according to the handwriting to obtain text information corresponding to the handwriting; Matching the text information with the system language to obtain a matching degree between the language to which the text information belongs and the system language; When the matching degree is greater than a preset threshold, it is determined that the text information matches the system language, and the text information is used as the text information corresponding to the handwriting; When the matching degree is less than or equal to the preset threshold, the user is prompted to confirm the input language type, and text information corresponding to the handwriting is obtained according to the language type confirmed by the user.

9. The input information processing device according to any one of claims 6 to 8, characterized in that: The image acquisition module is specifically used for: Acquire a prompt word corresponding to the text information according to the text information; generating an image associated with the text information according to the prompt word; Obtaining the number and size of the images; According to the number and the size, a corresponding number and a corresponding size of the images are obtained.

10. An input information processing device, characterized in that: include: at least one processor; as well as, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the input information processing method according to any one of claims 1 to 5.

Images