English grammar-based grammar error correction method, intelligent pen, terminal equipment and medium

Abstract

The invention is suitable for the technical field of grammar error correction, and provides a grammar error correction method based on English grammar, an intelligent pen, terminal equipment and a medium, and the method comprises the steps: firstly responding to a writing start instruction, obtaining writing content image information by using a camera, and then according to the writing content image information and an optical character recognition algorithm, obtaining a grammar error correction result; according to the method, writing text information is generated, grammar analysis result information is generated according to the writing text information and a natural language processing algorithm, error correction suggestion information is generated according to the grammar analysis result information after accommodation, and finally the error correction suggestion information is sent to a display screen to be displayed. According to the method, the English grammar errors in the handwritten text can be efficiently recognized, immediate feedback is provided, the use experience of a user is remarkably improved, the writing quality and the writing efficiency are both improved, the efficiency and convenience of English grammar learning and writing are greatly improved, and by combining the high convenience of the intelligent pen, the use experience of the user is improved. And better handwriting experience is created for the user.

Description

Technical Field

[0001] The present application relates to the technical field of grammar correction, and in particular to a grammar correction method based on English grammar, a smart pen, a terminal device and a medium. Background Art

[0002] At present, traditional English grammar learning and error correction methods cannot meet the needs of modern education. They lack the ability to effectively recognize and process handwritten texts, find it difficult to provide instant feedback, and have a poor user experience, which needs further improvement. Summary of the invention

[0003] Based on this, the embodiments of the present application provide a grammar correction method based on English grammar, a smart pen, a terminal device and a medium to solve the problem of poor user experience in the prior art.

[0004] In a first aspect, an embodiment of the present application provides a grammar correction method based on English grammar, the method comprising:

[0005] In response to a writing start instruction, obtaining writing content image information based on a preset camera;

[0006] Generate writing text information according to the writing content image information and a preset optical character recognition algorithm;

[0007] Generate grammar analysis result information according to the written text information and a preset natural language processing algorithm;

[0008] Generating error correction suggestion information according to the grammatical analysis result information;

[0009] The error correction suggestion information is sent to a display screen for display.

[0010] Compared with the prior art, the beneficial effects are as follows: the grammar correction method based on English grammar provided in the embodiment of the present application, the terminal device can first respond to the writing start instruction, use the camera to obtain the writing content image information, and then quickly generate the writing text information according to the writing content image information and the optical character recognition algorithm, and then accurately generate the grammar analysis result information according to the writing text information and the natural language processing algorithm, and then effectively generate the correction suggestion information according to the grammar analysis result information, and finally send the correction suggestion information to the display screen for display, so as to realize the effective recognition and instant feedback of the English grammar errors in the handwritten text, effectively improve the user experience, and solve the current problem of poor user experience to a certain extent.

[0011] In a second aspect, an embodiment of the present application provides a smart pen, the smart pen comprising:

[0012] A writing content image information acquisition module: used to acquire writing content image information based on a preset camera in response to a writing start instruction;

[0013] A writing text information generating module: used to generate writing text information according to the writing content image information and a preset optical character recognition algorithm;

[0014] A syntax analysis result information generating module: used to generate syntax analysis result information according to the written text information and a preset natural language processing algorithm;

[0015] An error correction suggestion information generating module is used to generate error correction suggestion information according to the grammar analysis result information;

[0016] Error correction suggestion information sending module: used to send the error correction suggestion information to the display screen for display.

[0017] In a third aspect, an embodiment of the present application provides a terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method of the first aspect described above when executing the computer program.

[0018] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method of the first aspect described above are implemented.

[0019] It can be understood that the beneficial effects of the second to fourth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art are briefly introduced below.

[0021] Figure 1 It is a flowchart of a grammar error correction method provided by an embodiment of the present application;

[0022] Figure 2 is a schematic diagram of a smart pen provided in an embodiment of the present application;

[0023] Figure 3 It is a flowchart before step S100 in the grammar error correction method provided in one embodiment of the present application;

[0024] Figure 4 is a flowchart of step S300 in the grammar error correction method provided in one embodiment of the present application;

[0025] Figure 5is a flowchart of step S400 in the grammar error correction method provided in one embodiment of the present application;

[0026] Figure 6 is a module block diagram of a smart pen provided in one embodiment of the present application;

[0027] Figure 7 It is a schematic diagram of a terminal device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0028] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0029] In the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0030] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0031] In order to illustrate the technical solution described in this application, a specific embodiment is provided below for illustration.

[0032] See also Figure 1 , Figure 1 1 is a flow chart of a grammar correction method based on English grammar provided in an embodiment of the present application. In this embodiment, the grammar correction method is executed by a terminal device. It is understandable that the types of terminal devices include but are not limited to mobile phones, tablet computers, notebook computers, ultra-mobile personal computers (Ultra-Mobile Personal Computer, UMPC), netbooks, personal digital assistants (Personal Digital Assistant, PDA), etc., and the embodiments of the present application do not impose any restrictions on the specific types of terminal devices.

[0033] See also Figure 1 The grammar error correction method provided in the embodiment of the present application includes but is not limited to the following steps:

[0034] In S100 , in response to a writing start instruction, image information of writing content is acquired based on a preset camera.

[0035] Specifically, the terminal device can first respond to the writing start instruction and obtain the writing content image information based on the preset camera, wherein the writing start instruction is used to describe the start of writing using the smart pen, and the writing content image information is used to describe the image obtained by the camera shooting the writing content.

[0036] Without loss of generality, see Figure 2 The grammar correction method can be applied to an intelligent English grammar correction pen, i.e., a smart pen; the smart pen includes a charging port, a display screen, a camera, and a wireless device, wherein the body of the smart pen can be an ergonomically designed body, and a sensor for detecting writing movements, such as a gyroscope or an acceleration sensor, is pre-installed in the body of the smart pen; a high-performance processor for real-time data processing and a rechargeable battery that can be charged through a USB interface can be pre-installed in the body of the smart pen; the camera of the smart pen can be a miniature camera for capturing written content, and the camera can ensure high-precision image acquisition; the display screen of the smart pen can be a small LED display screen for instantly displaying English grammar correction suggestions; the wireless device of the smart pen can support Wi-Fi or Bluetooth connection, and it should be noted that the type and position of the display screen and the communication protocol of the wireless device can be adjusted according to specific needs and costs to optimize user experience and product performance.

[0037] In some possible implementations, to improve the correctness of syntax correction, see Figure 3 Before step S100, the method further includes but is not limited to the following steps:

[0038] In S101, historical writing image information is acquired based on a camera.

[0039] Specifically, the terminal device can first obtain historical writing image information based on a camera, wherein the historical writing image information is used to describe an image obtained by photographing the user's historical writing content using a camera. For example, the user can use a camera to photograph a handwritten English text to obtain historical writing image information.

[0040] In S102, a plurality of historical writing word information is generated according to the historical writing image information and an optical character recognition algorithm.

[0041] Specifically, after the terminal device obtains the historical writing image information, the terminal device can use an optical character recognition (OCR) algorithm to extract and recognize words from the historical writing image information to generate multiple historical writing word information, wherein the historical writing word information is used to describe a single English letter in the historical writing image information.

[0042] In S103, for each piece of historically written word information: the historically written word information is associated with the standard word information to generate font association set information.

[0043] Specifically, after the terminal device generates multiple historical written word information, the terminal device can perform this processing for each historical written word information: associate the historical written word information with the standard word information, generate font association set information, and thus realize the association of the user's personalized handwritten English letters with standard English letters.

[0044] In S104, the font association set information is uploaded to a preset writing font storage library.

[0045] Specifically, after the terminal device generates the font association set information, the terminal device may upload the font association set information to a preset writing font repository, wherein the writing font repository is used to store the font association set information.

[0046] In S200, written text information is generated according to the written content image information and a preset optical character recognition algorithm.

[0047] Specifically, after the terminal device acquires the written content image information, the terminal device can use an optical character recognition algorithm to perform word extraction and recognition processing on the written content image information to generate written text information.

[0048] In S300, grammar analysis result information is generated according to the written text information and a preset natural language processing algorithm.

[0049] Specifically, after the terminal device generates written text information, the terminal device can generate grammatical analysis result information based on the written text information and a preset natural language processing algorithm, wherein the grammatical analysis result information includes grammatical error information or grammatical correctness information, the grammatical error information is used to describe whether the user's written content contains English grammatical errors, and the grammatical correctness information is used to describe whether the user's written content contains English grammatical errors.

[0050] In some possible implementations, in order to generate accurate syntax analysis result information, see Figure 4 Step S300 includes but is not limited to the following steps:

[0051] In S310, based on a preset natural language processing algorithm, it is determined whether the written text information complies with preset English grammar rules.

[0052] Specifically, after the terminal device generates written text information, the terminal device can determine whether the written text information conforms to preset English grammar rules based on a preset natural language processing (NLP) algorithm, thereby adapting to different English grammar requirements and application scenarios, where English grammar rules are used to describe the grammatical rules of English.

[0053] In S320, if the written text information complies with the English grammatical rules, grammatically correct information is generated, and the writing start instruction is executed again, and the writing content image information is obtained based on the preset camera. Otherwise, based on the writing font storage library, the written text information is corrected according to the font association set information to generate review text information.

[0054] Specifically, if the written text information conforms to the English grammatical rules, the terminal device can generate grammatically correct information and execute the above step S100 again; if the written text information does not conform to the English grammatical rules, the terminal device can correct the written text information based on the writing font repository and the font association set information, and generate review text information, thereby correcting the written text information with recognition errors, wherein the review text information is used to describe the written text information after correction.

[0055] In S330, based on a natural language processing algorithm, it is determined whether the reviewed text information complies with English grammar rules.

[0056] Specifically, after the terminal device reviews the text information, the terminal device can determine whether the reviewed text information complies with English grammar rules based on a natural language processing algorithm.

[0057] In S340, if the reviewed text information complies with English grammar rules, grammatically correct information is generated, and the writing start instruction is executed again to obtain the writing content image information based on the preset camera, otherwise grammatically incorrect information is generated.

[0058] Specifically, if the reviewed text information complies with English grammar rules, the terminal device can generate grammatically correct information and execute the above step S100 again. Otherwise, the terminal device can generate grammatically incorrect information, thereby ensuring that data processing can be reduced as much as possible during the writing process, and only when it is preliminarily determined that there are English grammatical errors in the written content, it intervenes to determine whether English grammar actually exists, thereby improving the real-time and accuracy of English grammar correction.

[0059] In S400, error correction suggestion information is generated according to the syntax analysis result information.

[0060] Specifically, after the terminal device generates the grammatical analysis result information, the terminal device may generate error correction suggestion information according to the grammatical analysis result information, wherein the error correction suggestion information is used to describe modification suggestions for written content with English grammatical errors.

[0061] In some possible implementations, to generate error correction suggestion information, see Figure 5 If a syntax error message is generated, step S400 includes but is not limited to the following steps:

[0062] In S410, previous text information is obtained.

[0063] Specifically, after the terminal device generates grammatical analysis result information, the terminal device can obtain previous text information, where the previous text information is used to describe the written text before the written text information, thereby ensuring that the understanding and grammatical correction of the current written text are accurate and based on the above context.

[0064] In S420, error correction text information is generated according to the previous text information, the written text information and English grammar rules.

[0065] Specifically, after the terminal device obtains the previous text information, the terminal device can determine the English grammatical errors in the written text information based on the previous text information and the written text information based on English grammar rules, and then use English grammar rules to modify the erroneous content and generate error correction text information, wherein the error correction text information is used to describe the written text information after the grammatically incorrect content is corrected.

[0066] In S430, error correction suggestion information is generated according to the error correction text information.

[0067] Specifically, after the terminal device generates the error correction text information, the terminal device can generate error correction suggestion information based on the error correction text information. For example, the terminal device can determine that the error correction text information is error correction suggestion information. The terminal device can also comprehensively generate error correction suggestion information based on the error correction text information and the written text information, so that the user can simultaneously know the content of the grammatical error and how to modify the erroneous content.

[0068] In S500, the error correction suggestion information is sent to a display screen for display.

[0069] Specifically, after the terminal device generates the correction suggestion information, the terminal device can send the correction suggestion information to the display screen of the smart pen for display, thereby instantly feeding back the grammatically incorrect content through the display screen, or simultaneously feeding back the grammatically incorrect content and how to modify the incorrect content through the display screen.

[0070] In some possible implementations, in order to improve the user experience, after step S500, the method further includes but is not limited to the following steps:

[0071] In S510, the error correction suggestion information is sent to a designated mobile device.

[0072] Specifically, after the terminal device sends the error correction suggestion information to the display screen for display, the terminal device can send the error correction suggestion information to a designated mobile device, so that the user can view the detailed grammatical analysis and error correction records through the mobile device, where the mobile device can be the user's mobile phone.

[0073] The implementation principle of the grammar correction method based on English grammar in the embodiment of the present application is as follows: the terminal device can first respond to the writing start instruction, use the camera to obtain the image information of the writing content, and then quickly generate the writing text information according to the writing content image information and the optical character recognition algorithm, and then accurately generate the grammar analysis result information according to the writing text information and the natural language processing algorithm, and then effectively generate the correction suggestion information according to the grammar analysis result information, and finally send the correction suggestion information to the display screen for display, so as to realize the effective recognition and instant feedback of the English grammar errors in the handwritten text, and effectively improve the user's usage experience.

[0074] It should be noted that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0075] The embodiment of the present application also provides a smart pen. For the convenience of description, only the parts related to the present application are shown, such as Figure 6 As shown, the smart pen 60 includes:

[0076] The writing content image information acquisition module 61 is used to acquire the writing content image information based on a preset camera in response to a writing start instruction;

[0077] The writing text information generating module 62 is used to generate writing text information according to the writing content image information and the preset optical character recognition algorithm;

[0078] Syntax analysis result information generating module 63: used to generate syntax analysis result information according to the written text information and a preset natural language processing algorithm;

[0079] The error correction suggestion information generating module 64 is used to generate error correction suggestion information according to the grammatical analysis result information;

[0080] The error correction suggestion information sending module 65 is used to send the error correction suggestion information to the display screen for display.

[0081] Optionally, the smart pen 60 further includes:

[0082] Historical writing image information acquisition module: used to acquire historical writing image information based on a camera;

[0083] A historical writing word information generation module: used to generate a plurality of historical writing word information according to the historical writing image information and the optical character recognition algorithm;

[0084] A font association set information generation module: used for associating the historical writing word information with the standard word information for each historical writing word information to generate font association set information;

[0085] Font association set information uploading module: used to upload font association set information to a preset writing font storage library.

[0086] Optionally, the grammatical analysis result information includes grammatical error information or grammatical correctness information; the grammatical analysis result information generating module 63 includes:

[0087] English grammar rule judgment submodule: used to judge whether the written text information conforms to the preset English grammar rules based on the preset natural language processing algorithm;

[0088] A submodule for generating rechecked text information: used for generating grammatically correct information if the written text information conforms to English grammatical rules, and executing again in response to the writing start instruction, obtaining the image information of the written content based on the preset camera, otherwise correcting the written text information based on the writing font storage library and the font association set information to generate rechecked text information;

[0089] Recheck text information judgment submodule: used to judge whether the recheck text information conforms to English grammar rules based on natural language processing algorithm;

[0090] The grammatical error information generation submodule is used to generate grammatical correctness information if the reviewed text information conforms to the English grammatical rules, and execute again in response to the writing start instruction, based on the preset camera, to obtain the writing content image information, otherwise generate grammatical error information.

[0091] Optionally, if grammatical error information is generated, the above-mentioned error correction suggestion information generation module 64 includes

[0092] A preceding text information acquisition submodule: used to acquire preceding text information, wherein the preceding text information is used to describe the written text located before the written text information;

[0093] Error correction text information generation submodule: used to generate error correction text information based on previous text information, written text information and English grammar rules;

[0094] Error correction suggestion information generation submodule: used to generate error correction suggestion information based on error correction text information.

[0095] Optionally, the smart pen 60 further includes:

[0096] Error correction suggestion information sending module: used to send error correction suggestion information to the specified mobile device.

[0097] It should be noted that the information interaction, execution process and other contents between the above-mentioned modules are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0098] The present application also provides a terminal device, such as Figure 7 As shown, the terminal device 70 of this embodiment includes: a processor 71, a memory 72, and a computer program 73 stored in the memory 72 and executable on the processor 71. When the processor 71 executes the computer program 73, the steps in the above-mentioned grammar error correction method embodiment are implemented, for example Figure 1 Steps S100 to S500 shown; or, when the processor 71 executes the computer program 73, the functions of each module in the above device are realized, for example Figure 6 The functions of the modules 61 to 65 are shown.

[0099] The terminal device 70 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server, and the terminal device 70 includes but is not limited to a processor 71 and a memory 72. Those skilled in the art will appreciate that Figure 7 It is only an example of the terminal device 70 and does not constitute a limitation of the terminal device 70. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the terminal device 70 may also include input and output devices, network access devices, buses, etc.

[0100] Among them, the processor 71 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.; the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0101] The memory 72 may be an internal storage unit of the terminal device 70, such as a hard disk or memory of the terminal device 70, or the memory 72 may be an external storage device of the terminal device 70, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the terminal device 70; further, the memory 72 may also include both an internal storage unit and an external storage device of the terminal device 70, and the memory 72 may also store a computer program 73 and other programs and data required by the terminal device 70, and the memory 72 may also be used to temporarily store data that has been output or is to be output.

[0102] One embodiment of the present application also provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the steps of each of the above method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc.; the computer-readable medium may include: any entity or device that can carry computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc.

[0103] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, all equivalent changes made according to the methods, principles, and structures of the present application should be included in the protection scope of the present application.

Claims

1. A grammar correction method based on English grammar, characterized in that: The method comprises: In response to a writing start instruction, obtaining writing content image information based on a preset camera; Generate writing text information according to the writing content image information and a preset optical character recognition algorithm; Generate grammar analysis result information according to the written text information and a preset natural language processing algorithm; Generating error correction suggestion information according to the grammatical analysis result information; The error correction suggestion information is sent to a display screen for display.

2. The method according to claim 1, characterized in that Before acquiring writing content image information based on a preset camera in response to the writing start instruction, the method further includes: Based on the camera, historical writing image information is obtained; generating a plurality of historical writing word information according to the historical writing image information and the optical character recognition algorithm; For each of the historically written word information: associating the historically written word information with the standard word information to generate font association set information; The font association set information is uploaded to a preset writing font storage library.

3. The method according to claim 2, characterized in that The grammatical analysis result information includes grammatical error information or grammatical correctness information; the grammatical analysis result information is generated according to the written text information and a preset natural language processing algorithm, including: Based on a preset natural language processing algorithm, determining whether the written text information conforms to preset English grammar rules; If the written text information conforms to the English grammar rules, the grammatically correct information is generated, and the response to the writing start instruction is executed again, and the written content image information is obtained based on the preset camera; otherwise, based on the writing font storage library, the written text information is corrected according to the font association set information to generate the rechecked text information; Based on the natural language processing algorithm, determining whether the reviewed text information complies with the English grammar rules; If the reviewed text information complies with the English grammar rules, the grammatically correct information is generated, and the response to the writing start instruction is executed again to obtain the writing content image information based on the preset camera, otherwise the grammatically incorrect information is generated.

4. The method according to claim 3, characterized in that If the grammatical error information is generated, generating error correction suggestion information according to the grammatical analysis result information includes: Acquire preceding text information, wherein the preceding text information is used to describe the written text located before the written text information; Generate error correction text information according to the preceding text information, the written text information and the English grammar rules; Generate error correction suggestion information based on the error correction text information.

5. The method according to claim 4, characterized in that After generating error correction suggestion information according to the error correction text information, the method further includes: The error correction suggestion information is sent to a designated mobile device.

6. A smart pen, characterized in that: The smart pen comprises: A writing content image information acquisition module: used to acquire writing content image information based on a preset camera in response to a writing start instruction; A writing text information generating module: used to generate writing text information according to the writing content image information and a preset optical character recognition algorithm; A syntax analysis result information generating module: used to generate syntax analysis result information according to the written text information and a preset natural language processing algorithm; An error correction suggestion information generating module is used to generate error correction suggestion information according to the grammar analysis result information; Error correction suggestion information sending module: used to send the error correction suggestion information to the display screen for display.

7. The smart pen according to claim 6, characterized in that: The smart pen also includes: A historical writing image information acquisition module: used to acquire historical writing image information based on the camera; A historical writing word information generation module: used to generate a plurality of historical writing word information according to the historical writing image information and the optical character recognition algorithm; A font association set information generating module: for each of the historical written word information: associating the historical written word information with the standard word information to generate font association set information; The font association set information uploading module is used to upload the font association set information to a preset writing font storage library.

8. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 5 are implemented.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images