Handwriting input method, device, system, electronic device and storage medium

Abstract

The present application proposes a handwriting input method, device, system, electronic device and storage medium, which can allow the user to write at any position on the device display screen. When the current writing cycle is detected to be completed, the handwriting information corresponding to the current writing cycle is converted into text to obtain text content, and the text content can be inserted at the target position of the content displayed on the device display screen to realize handwriting input of text content. Applying the above scheme to ink screen devices not only avoids the delay and ghosting problems caused by the low screen display refresh rate of the ink screen device, but also allows writing at any position on the device display screen of the ink screen device, which provides convenience for users to edit text on the ink screen device.

Description

Technical Field

[0001] The present application relates to the field of handwriting input, and in particular to a handwriting input method, device, system, electronic device and storage medium. Background Art

[0002] There are many types of ink screen devices on the market. Due to their advantages such as eye protection and low energy consumption, ink screen devices have been widely used.

[0003] Based on the e-ink screen device, users can perform text editing operations. However, due to the low refresh rate of the screen display of the e-ink screen device, using the keyboard to edit text on the e-ink screen device will cause delays and ghosting, which basically cannot meet the user's editing needs; when editing text on the e-ink screen device by writing, although the delay and ghosting problems caused by the low refresh rate of the screen display of the e-ink screen device can be avoided, it is limited by the input method and can only be input in the local area specified by the input method, which also cannot meet the user's editing needs.

[0004] Therefore, it is necessary to study a text editing solution based on ink screen devices to meet the needs of users. Summary of the invention

[0005] Based on the above requirements, the present application proposes a handwriting input method, device, system, electronic device and storage medium. The method can be used to overcome the problem that the ink screen device in the prior art cannot meet the user's text note editing needs.

[0006] The technical solutions proposed in this application are as follows:

[0007] In a first aspect, the present application provides a handwriting input method, comprising:

[0008] Acquire handwriting information generated based on a writing operation detected at any position of a device display screen;

[0009] If it is detected that the current writing cycle is over, text recognition is performed on all handwriting information acquired in the current writing cycle to obtain text content;

[0010] The text content is inserted at a target position of the content displayed on the device display screen.

[0011] Optionally, the handwriting input method further includes:

[0012] When the device display screen enters the writing mode, if the device display screen displays an input keyboard, the input keyboard is controlled to be hidden, or the input keyboard is controlled to be invalid.

[0013] Optionally, the handwriting input method further includes:

[0014] When the device display screen enters writing mode, if the device display screen does not display a positioning cursor, a virtual positioning cursor is generated at a preset position or a position selected by the user, and the position of the virtual positioning cursor is used as the target position; if the device display screen displays a positioning cursor, the position of the positioning cursor is used as the target position.

[0015] Optionally, the handwriting input method further includes:

[0016] In response to a preset operation, entering an erasing mode;

[0017] In the erasing mode, in response to a detected erasing operation, an erasing object corresponding to the erasing operation is deleted; the erasing operation includes a writing operation that covers the erasing object;

[0018] The erased object includes handwriting information acquired in the current writing cycle, or text content displayed on the device display screen.

[0019] Optionally, the handwriting input method further includes:

[0020] In the erasing mode, in response to a detected erasing release operation, exiting the erasing mode;

[0021] The erasing release operation includes a writing operation that does not cover the erasing object.

[0022] Optionally, whether the current writing cycle is finished is determined by the following process:

[0023] In the current writing cycle, detect writing pauses and record the duration of the writing pauses;

[0024] Determine whether the writing pause duration reaches a preset pause duration threshold;

[0025] When a writing pause is detected and the writing pause duration reaches a preset pause duration threshold, it is determined that the current writing cycle ends.

[0026] Optionally, the handwriting input method further includes:

[0027] Get the pause duration between characters when the user writes continuously within the historical duration;

[0028] The pause duration threshold is updated based on the pause duration between characters when the user writes continuously within the historical duration.

[0029] Optionally, performing text recognition on all handwriting information acquired in the current writing cycle to obtain text content includes:

[0030] Determine the writing area on the device display screen corresponding to all the handwriting information acquired in the current writing cycle;

[0031] Text recognition is performed based on the handwriting information in the writing area to obtain text content.

[0032] Optionally, determining the writing area on the device display screen corresponding to all the handwriting information acquired in the current writing cycle includes:

[0033] From the device display screen, the minimum bounding box area of ​​all the handwriting information corresponding to the current writing cycle is determined as the writing area.

[0034] In a second aspect, the present application provides a handwriting input device, comprising:

[0035] An acquisition module, used to acquire handwriting information generated based on a writing operation detected at any position of a device display screen;

[0036] A recognition module is used to perform text recognition on all handwriting information acquired in the current writing cycle to obtain text content if it is detected that the current writing cycle ends;

[0037] The inserting module is used to insert the text content at the target position of the content displayed on the device display screen.

[0038] In a third aspect, the present application provides an electronic device, including:

[0039] Memory and processor;

[0040] Wherein, the memory is used to store programs;

[0041] The processor is used to implement the handwriting input method as described in any one of the first aspects by running the program in the memory.

[0042] In a fourth aspect, the present application provides a handwriting input system, comprising a stylus and the electronic device described in the third aspect.

[0043] In a fifth aspect, the present application provides a storage medium, comprising: a computer program is stored on the storage medium, and when the computer program is executed by a processor, each step of the handwriting input method as claimed in any claim in the first aspect is implemented.

[0044] The handwriting input method, device, system, electronic device and storage medium of the present application enable the user to write at any position on the device display screen. After detecting that the current writing cycle is completed, the handwriting information corresponding to the current writing cycle is converted into text to obtain text content. The text content can be inserted at the target position of the display content on the device display screen to realize handwriting input of text content. The above scheme supports users to write at any position on the device display screen, which provides convenience for users to edit text on the device display screen. On the other hand, the recognition of the written content in the above scheme is triggered based on the end of the writing cycle. When the writing cycle ends, all the written content in the writing cycle can be recognized and displayed on the screen. Therefore, the method supports users to write continuously within the writing cycle, thereby further improving the user's editing efficiency.

[0045] Applying the above solution to ink screen devices not only avoids the delay and ghosting problems caused by the low screen refresh rate of the ink screen device, but also enables writing at any position on the device display screen of the ink screen device, and supports users to write continuously, providing convenience for users to edit text on the ink screen device. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0047] Figure 1 It is a flowchart of a handwriting input method provided in an embodiment of the present application;

[0048] Figure 2 This is a display schematic diagram of a device display screen provided in an embodiment of the present application;

[0049] Figure 3 is another display schematic diagram of a device display screen provided in an embodiment of the present application;

[0050] Figure 4 This is a schematic diagram of a process for deleting an erased object provided in an embodiment of the present application;

[0051] Figure 5 It is a display schematic diagram corresponding to the device display screen during the erasing operation provided in an embodiment of the present application;

[0052] Figure 6 It is a display schematic diagram corresponding to the device display screen after the erasure is completed provided in the embodiment of the present application;

[0053] Figure 7 This is another display schematic diagram corresponding to the device display screen after the erasure is completed provided in the embodiment of the present application;

[0054] Figure 8 It is a flowchart of determining whether the current writing cycle is finished provided by an embodiment of the present application;

[0055] Fig. 9 It is a flowchart of performing text recognition on all handwriting information acquired in the current writing cycle provided by an embodiment of the present application;

[0056] Fig.10 It is a display schematic diagram of determining the writing area of ​​the current writing cycle provided by an embodiment of the present application;

[0057] Fig.11 is a structural schematic diagram of a handwriting input device provided in an embodiment of the present application;

[0058] Fig.12 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application;

[0059] Fig.13 It is a structural diagram of a handwriting input system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The technical solution of the embodiment of the present application is applicable to the application scenario of handwriting input. By adopting the technical solution of the embodiment of the present application, text can be written and converted to text at any position on the device display screen, thereby providing convenience for users to edit text on the device display screen. Exemplarily, the above-mentioned device display screen includes the display screen of an ink screen device, and the above-mentioned device display screen also includes the display screen of any other device with handwriting function, such as the display screen of a smart phone, a tablet computer and other devices.

[0061] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0062] This embodiment provides a handwriting input method. Figure 1 As shown, the method includes:

[0063] S101. Obtain handwriting information generated based on a writing operation detected at any position on a device display screen.

[0064] The above-mentioned writing operation refers to the operation of writing text on the device display screen through a writing device or a finger. When writing, the writing device used is different based on the type of device display screen. For example, if the device display screen is an ink screen, an electromagnetic pen can be used as a writing device; if the device display screen is a capacitive screen, a capacitive pen can be used as a writing device. In the case where the device display screen is a capacitive screen, a writing device can be omitted and fingers can be used for direct handwriting.

[0065] When writing is performed on the device display screen based on a writing device or a finger, contact with the device display screen will generate an electrical signal, and the device display screen can capture the electrical signal. The device where the device display screen is located can convert the electrical signal into a coordinate point in the coordinate system of the device display screen, and then draw the coordinate point into writing handwriting information, and display the writing handwriting information on the device display screen. Exemplarily, if the device display screen is an ink screen and the stylus is an electromagnetic pen, during the writing operation, the ink screen acquires the electrical signal generated by the contact between the electromagnetic pen and the ink screen during the writing operation in real time, and then converts the electrical signal into a coordinate point, and draws the black handwriting information based on the coordinate point, and displays it on the handwriting control of the device where the device display screen is located, that is, on the ink screen.

[0066] When the device display screen enters writing mode, the handwriting control inside the application layer of the device where the device display screen is located switches to full-screen mode, so that the writing signal corresponding to the writing operation can be obtained at any position on the device display screen, and writing can be performed at any position on the device display screen, providing convenience for users to edit text on the device display screen.

[0067] Specifically, an operation for entering the writing mode can be pre-set, and in response to the operation, the device display screen enters the writing mode. In the embodiments of the present application, the specific content of the operation for entering the writing mode is not limited, as long as the operation for entering the writing mode can be detected by the device where the device display screen is located. Exemplarily, using a writing device or pressing the device display screen with a finger for a preset time interval, such as 2 seconds, can be used as an operation for entering the writing mode; a writing operation control button can also be set on the device where the device display screen is located, such as on the side or back of the device, and operating the control button can be used as an operation for entering the writing mode; writing can also be controlled by voice, and when the corresponding voice content, such as "entering handwriting mode", is detected, it can be used as an operation for entering the writing mode, and so on.

[0068] In addition, a menu bar is generally provided on the device display screen, including a variety of editing options, such as text editing options such as font size setting, font setting, bold setting, etc., as well as close option, minimize option, delete option, insert picture option, etc. In order to prevent the user from accidentally touching the editing option in the menu bar during the writing operation, illustratively, when the device display screen enters the writing mode, the triggering time of the editing option in the menu bar in the writing mode can be appropriately extended. For example, when the device display screen enters the writing mode, an editing option in the menu bar is pressed by a finger or a writing device and the pressing time reaches a preset time, such as 3 seconds, before the operation corresponding to the pressed editing option in the menu bar is executed;

[0069] Exemplarily, in another optional embodiment, in order to prevent the editing option in the menu bar from being accidentally touched during the writing operation, it can be set that the editing option in the menu bar cannot be triggered when the device display screen enters the writing mode, and the editing option in the menu bar can be triggered and executed when the device display screen exits the writing mode. When the user wants to use the editing option in the menu bar, he needs to exit the writing mode first;

[0070] Exemplarily, in another optional embodiment, in order to avoid accidental touching of the editing options in the menu bar during the writing operation, a menu bar sub-mode can be set in the writing mode, and an entry operation to enter the menu bar sub-mode can be set, such as pressing the menu bar with a finger or a writing device and pressing for a preset time, such as pressing for 3 seconds. In response to the operation, the device display screen enters the menu bar sub-mode. In the menu bar sub-mode, the editing options in the menu bar can be triggered and executed. After detecting that the editing option operation in the menu bar is completed, or if no editing option operation of the menu bar is detected within a preset time, the menu bar sub-mode is automatically exited and the writing mode is returned.

[0071] In this embodiment, the language and font corresponding to the writing operation are not limited, as long as the handwriting information generated by the writing operation can be recognized and converted based on text recognition technology.

[0072] S102: If it is detected that the current writing cycle ends, text recognition is performed on all handwriting information acquired in the current writing cycle to obtain text content.

[0073] The writing operation of the user on the device display screen can be divided into at least one writing cycle. The writing cycle can be a set fixed-length cycle, or a writing cycle that is flexibly determined according to the start and stop of the user's writing. For example, the writing cycle can be determined as a fixed-length cycle, or the interval between detecting the user starting writing and ending writing can be determined as a writing cycle.

[0074] When a writing cycle is over, text recognition can be performed on all the written notes obtained in the writing cycle to obtain recognized handwriting information, that is, text content. For example, all the handwriting information obtained in the current writing cycle can be sent to a text recognition engine, and the handwriting information can be recognized and converted based on the text recognition engine to obtain text content.

[0075] For example, the handwriting information may be recognized and converted based on existing text recognition technology, such as optical character recognition (OCR) technology.

[0076] In the embodiment of the present application, if the interval between when the user starts writing and when the user stops writing is determined as a writing cycle, the writing cycle can be determined based on the user's writing habits. During the writing operation, if the user pauses and the user pauses for a long time, it can be determined that a writing cycle has ended, and all written notes obtained in the writing cycle are subjected to text recognition.

[0077] After the recognition of the handwriting information is completed, the corresponding handwriting information is deleted to avoid repeated recognition and improve the recognition rate. For example, the handwriting information that has been recognized can be deleted by calling a specific clearing function.

[0078] S103: Insert the text content at the target position of the display content on the device display screen.

[0079] The above-mentioned display content refers to the content displayed on the device display screen, and may include all the content displayed on the device display screen. The above-mentioned target position refers to the specific position where the positioning cursor is located in the display content. In this embodiment, after obtaining the text content, the text content can be inserted into the position where the positioning cursor is located in the display content of the device display screen.

[0080] Based on the above introduction, it can be seen that the user can write at any position on the device display screen. After detecting that the current writing cycle is completed, the handwriting information corresponding to the current writing cycle is converted into text to obtain text content. The text content can be inserted at the target position of the display content on the device display screen to realize handwriting input of text content. The above scheme supports users to write at any position on the device display screen, which provides convenience for users to edit text on the device display screen. On the other hand, the recognition of written content in the above scheme is triggered based on the end of the writing cycle. When the writing cycle ends, all written content within the writing cycle can be recognized and displayed on the screen. Therefore, this method supports users to write continuously within the writing cycle, thereby further improving user editing efficiency.

[0081] Applying the above solution to ink screen devices not only avoids the delay and ghosting problems caused by the low screen refresh rate of the ink screen device, but also enables writing at any position on the device display screen of the ink screen device, and supports users to write continuously, providing convenience for users to edit text on the ink screen device.

[0082] Exemplarily, another embodiment of the present application discloses that the above-mentioned handwriting input method further includes:

[0083] When the device display screen enters the writing mode, if the device display screen displays an input keyboard, the input keyboard is controlled to be hidden, or the input keyboard is controlled to be invalid.

[0084] Specifically, input method software is generally installed in the device, which may be the input method software that comes with the device or installed third-party software. In the embodiment of the present application, after the device display screen enters the handwriting mode, the device display screen may display the input keyboard corresponding to the input method software. When performing full-screen handwriting, the input keyboard corresponding to the input method software may be accidentally touched, causing the device display screen to receive erroneous information. Therefore, in this embodiment, when the device display screen enters the writing mode, the input keyboard corresponding to the input method software can be hidden, or the input keyboard corresponding to the input method software can be controlled to be invalid.

[0085] It should be noted that the input keyboard corresponding to the input method software is controlled to be disabled. Although the input keyboard is disabled and cannot be clicked, the device display screen will still display the input keyboard. When the user is writing, the existence of the input keyboard will still affect the user's writing operation. Therefore, in this embodiment, it is preferred to hide the input keyboard corresponding to the input method software.

[0086] In this embodiment, the input keyboard is hidden or controlled to be invalid, which effectively avoids the situation where the user accidentally touches the input keyboard during the writing operation, causing the device display screen to receive erroneous information, thereby improving the efficiency of text input during the writing process.

[0087] Exemplarily, another embodiment of the present application discloses a handwriting input method, further comprising:

[0088] When the device display screen enters writing mode, if the device display screen does not display a positioning cursor, a virtual positioning cursor is generated at a preset position or a position selected by the user, and the position of the virtual positioning cursor is used as the target position; if the device display screen displays a positioning cursor, the position of the positioning cursor is used as the target position.

[0089] Due to the settings of the input method software itself, there is a certain correlation between the input keyboard and the positioning cursor. When the input keyboard is hidden or the input keyboard is controlled to fail, the positioning cursor may be hidden or invalid, or it may not be hidden or invalid. Therefore, in this embodiment, when the device display screen enters the writing mode, it is necessary to detect whether the positioning cursor is hidden or invalid. If it is detected that the positioning cursor is hidden or invalid, a virtual positioning cursor can be generated, and the position of the virtual positioning cursor is used as the target position. If it is detected that the positioning cursor is displayed normally and is not hidden or invalid, the position of the positioning cursor is used as the target position.

[0090] The position where the virtual positioning cursor is generated may be a position selected by the user, that is, a position pressed by the user with a finger or a writing device; the position where the virtual positioning cursor is generated may also be a preset position, which may be the starting position or the ending position of the displayed content, etc., which is not limited in this embodiment. Exemplarily, when the device display screen enters the writing mode, after detecting that the positioning cursor is hidden or invalid, if it is detected that the user selects any position in the displayed content, the virtual positioning cursor is generated at the arbitrary position selected by the user; if it is detected that the user does not select any position in the displayed content, the virtual positioning cursor may be generated at the preset position, or the virtual positioning cursor may not be generated until the user selects any position in the displayed content, and the virtual positioning cursor is generated at the arbitrary position selected by the user.

[0091] Exemplarily, the virtual positioning cursor constructed in the writing mode of this embodiment is an inputtable area forged in the positioning layer of the device. The virtual positioning cursor has the same function as the positioning cursor, and both are used to display the position of the text content to be inserted. When the virtual positioning cursor is displayed on the device display screen, it can be a regularly flashing vertical line or a regularly flashing horizontal line. The device display screen can also display the virtual positioning cursor in other forms. As long as the virtual positioning cursor can display the position of the text content to be inserted, this embodiment does not make specific restrictions.

[0092] For example, Figure 2 In the device display screen shown, the content corresponding to area A is the display content, and the vertical line B in area A is the virtual positioning cursor. The position of the virtual positioning cursor determines the target text for inserting the text content. Figure 2 In the device display screen shown in FIG. 1 , the text corresponding to area C is the handwriting information corresponding to a writing cycle in the writing mode. After the writing cycle is detected to be over, the handwriting information is subjected to text recognition, and the obtained text content is inserted into the position where the vertical line B is located. The display content of the device display screen after the insertion is completed is as shown in FIG. Figure 3 As shown. Among them, Figure 2 and Figure 3The text shown is only used as an example to illustrate the insertion position of the text content and does not have any limitation on this application.

[0093] In an embodiment of the present application, when the positioning cursor is hidden or invalid, a virtual positioning cursor with the same function as the positioning cursor is constructed, thereby avoiding the situation where text content cannot be inserted due to the positioning cursor being hidden or invalid when the device display screen enters the writing mode, thereby ensuring that the writing operation can be carried out normally.

[0094] For example, Figure 4 As shown, another embodiment of the present application discloses a handwriting input method, further comprising:

[0095] S401. In response to a preset operation, enter an erasing mode.

[0096] The above-mentioned preset operation refers to the operation of entering the erase mode. Exemplarily, the preset operation may be pressing the device display screen with a finger or a stylus for a preset time, for example, after pressing the device display screen with a finger or a stylus for 2 seconds, the device display screen enters the erase mode.

[0097] In response to the above preset operation, the device display screen enters the erase mode.

[0098] S402: In the erasing mode, in response to a detected erasing operation, deleting an erasing object corresponding to the erasing operation.

[0099] When the device display screen enters the erase mode, the user can perform an erase operation. In response to the erase operation performed by the user, the device where the device display screen is located deletes the erase object. The above erase operation can be set as needed, as long as the device can determine the erase object based on the user's erase operation, and this embodiment does not limit it.

[0100] Exemplarily, the erasing operation includes a writing operation that covers the erasing object, a writing operation that draws a closed figure to surround the erasing object, and an operation of directly erasing using the erasing end of a writing device. Among them, the writing operation that covers the erasing object includes using a writing device or a finger to draw a line across the erasing object. The device can determine the writing handwriting information covered by the line drawn by the writing device or the finger as the erasing object, and delete the part of the writing handwriting information; the writing operation that draws a closed figure to surround the erasing object includes drawing a rectangular, circular or irregular closed figure to enclose the erasing object. The device display screen can detect the closed figure, determine the writing handwriting information in the closed figure as the erasing object, and delete the part of the writing handwriting information. Generally, the cap end of a stylus pen has an erasing function. Therefore, the operation of directly erasing using the erasing end of a writing device is also an operation of directly erasing the erasing object using the erasing end of a stylus pen.

[0101] In addition, the erasing object is the handwriting information obtained in the current writing cycle, or the text content displayed on the device display screen. In other words, the handwriting information obtained in the current writing cycle and the text content displayed on the device display screen can be deleted by the above-mentioned erasing operation in the erasing mode.

[0102] For example, if the user finds that there are writing errors in the handwriting information corresponding to the current writing cycle during the writing operation, the user can perform a preset operation, such as pressing the device display screen with the stylus tip for 2 seconds, and the device display screen enters the erasing mode. After the device display screen enters the erasing mode, the user determines the content of the writing error, that is, the erasing object, and uses the stylus tip to draw a line across the erasing object. The device where the device display screen is located can determine that the handwriting information covered by the line drawn by the stylus tip is the erasing object, and delete the part of the handwriting information.

[0103] Further, exemplarily, if the user finds that the converted text content is wrong during the writing operation, the preset operation can be performed, such as pressing the device display screen with the stylus tip for 2 seconds, and the device display screen enters the erase mode. After the device display screen enters the erase mode, the user determines the wrong content written, that is, the erase object, and uses the stylus tip to draw a line across the erase object. The device can then determine that the text content covered by the line drawn by the stylus tip is the erase object, and delete the part of the writing handwriting information. In addition, in addition to deleting the erase object in the text content in the form of the erase mode, since the text content has completed the recognition conversion and is editable text, the writing mode can be exited to facilitate calling up the input keyboard, and the delete option in the input keyboard can be used to delete the erase object. If there is a delete option in the menu bar, the delete option in the menu bar can also be called to delete the erase object.

[0104] It should also be noted that when the device display enters the erasing mode from the writing mode, the current writing cycle is paused but not ended, and the handwriting information corresponding to the current writing cycle is not subjected to text recognition until the erasing mode is exited and the writing mode is resumed, at which point the current writing cycle is resumed. When the current writing cycle is detected to have ended, all handwriting information corresponding to the current writing cycle is subjected to text recognition.

[0105] In an embodiment of the present application, a method is provided for erasing handwriting information acquired in the current writing cycle, or text content displayed on the device display screen. Once a user discovers erroneous writing during the writing operation, it can be deleted in time, which provides convenience for the user and ensures the accuracy of the content edited by the user.

[0106] Exemplarily, another embodiment of the present application discloses a handwriting input method, further comprising:

[0107] In the erase mode, in response to detecting a release erase operation, the erase mode is exited.

[0108] Specifically, the erasing release operation refers to a pre-set operation for exiting the erasing mode. When the erasing is completed, the user can perform the erasing release operation, and the device display screen responds to the detected erasing release operation to exit the erasing mode.

[0109] Exemplarily, the erasing release operation includes a writing operation that does not cover the erased object. Specifically, after the erasing is completed, the user can continue the writing operation in a blank area without text on the device display screen to avoid covering other text. When it is detected that the user continues the writing operation in a blank area without text on the device display screen, that is, the writing operation does not cover the erased object, the erasing mode is exited.

[0110] Furthermore, in an achievable embodiment, in the erasing mode, the writing operation that covers the erasing object can be regarded as the erasing operation, and the writing operation that does not cover the erasing object can be regarded as the un-erasing operation. That is, after entering the erasing mode, if the note information corresponding to the writing operation covers the erasing object, the erasing object will be deleted, and if the writing operation is performed in a blank area without any text, it means exiting the erasing mode.

[0111] For example, in the erasing mode, if the writing operation that covers the erasing object is regarded as the erasing operation, and the writing operation that does not cover the erasing object is regarded as the un-erasing operation, it is necessary to Figure 5 If the handwriting information corresponding to area D is deleted as the erasing object, the tip of the stylus can be used to draw a line in area D to cover the erasing object, such as Figure 5 As shown by the straight line E in the figure. The device where the device display screen is located determines the handwriting information detected and covered by the line as an erasure object, deletes the erasure object, and obtains Figure 6 Device display shown. Figure 6 In the device display screen shown, when a writing operation is detected in a blank area without any text, the device display screen exits the erase mode.

[0112] In the erasing mode, if the writing operation that covers the erased object is regarded as the erase operation, and the writing operation that does not cover the erased object is regarded as the un-erasing operation, it is necessary to Figure 5 If you want to delete the text content corresponding to area G as the erasing object, you can use the tip of the stylus to draw a line in area G to cover the erasing object, such as Figure 5As shown by the straight line H in the figure. The device where the device display screen is located determines the handwriting information detected and covered by the line as an erasure object, deletes the erasure object, and obtains Figure 7 Device display shown.

[0113] in, Figure 5 , Figure 6 and Figure 7 The text shown is only used as an example to illustrate the erasure of text and does not have any limitation effect on the present application.

[0114] In an embodiment of the present application, a method for quickly exiting the erasing mode is proposed so that the user can continue the writing operation, which is helpful to improve the user's writing speed.

[0115] For example, Figure 8 As shown, another embodiment of the present application discloses that whether the current writing cycle is finished is determined by the following processing:

[0116] S801. In the current writing cycle, detect writing pauses and record the duration of the writing pauses.

[0117] The above-mentioned writing pause refers to the pause after the user writes each character when writing continuously; the above-mentioned writing pause duration refers to the pause duration after the user writes each character when writing continuously.

[0118] S802: Determine whether the writing pause duration reaches a preset pause duration threshold.

[0119] The above-mentioned preset pause duration threshold is a preset threshold time.

[0120] Exemplarily, when it is detected that the user lifts the pen, timing starts. When the timing time reaches a preset pause duration threshold, if the pen is still not detected, it means that the writing pause duration reaches the preset pause duration threshold.

[0121] Exemplarily, the initial pause duration threshold can be set by the user, or it can be written before the device leaves the factory. Specifically, when the user uses the device display screen for writing operations for the first time, the user can set a pause duration threshold by himself; or, the user does not use the self-setting method, but uses the pause duration threshold preset when the device leaves the factory. When determining the pause duration threshold preset at the factory, multiple people can be selected to conduct a writing experiment, determine the average pause duration during the writing experiment, write the average pause duration into the device, and determine it as the pause duration threshold preset when the device leaves the factory. During the user's writing process, the pause duration threshold can be continuously modified based on the user's writing speed to obtain a pause duration threshold that matches the user's writing habits.

[0122] Detect whether the pause time after writing each character reaches a preset pause time threshold when the user writes continuously.

[0123] S803: When a writing pause is detected and the writing pause duration reaches a preset pause duration threshold, it is determined that the current writing cycle ends.

[0124] If a writing pause is detected and the duration of the writing pause reaches the preset pause duration threshold, it means that the user has stopped writing and the current writing cycle ends. All writing handwriting information obtained in the current writing cycle is subjected to text recognition to obtain text content so that the text content can be inserted into the target position of the device display screen.

[0125] In this embodiment, based on the user's writing habits, the writing operation is divided into multiple writing cycles for separate recognition. This can not only improve the writing speed and avoid the problem of slowing down the user's writing speed caused by the recognition method of recognizing one word at a time, but also reduce the pressure on the recognition engine when recognizing all the handwriting information generated by a writing operation, thereby improving the text conversion efficiency.

[0126] Exemplarily, another embodiment of the present application discloses a handwriting input method, further comprising:

[0127] Obtain the pause duration between characters when the user writes continuously within the historical duration; and update the pause duration threshold based on the pause duration between characters when the user writes continuously within the historical duration.

[0128] The writing speed of users is different in different time periods. For example, when the user just starts writing, the writing speed may be faster, and after the user has been writing for a while, the writing speed will gradually decrease. If a fixed pause duration threshold is always maintained, when the user's writing speed decreases, it may be mistakenly considered that the writing operation has stopped when the user has not stopped writing, and the current writing cycle ends and text recognition begins, affecting the user's writing; when the user's writing speed increases, it may cause the time to detect whether the current writing cycle has ended to be too long, thereby reducing the user's writing speed. Therefore, the pause duration threshold should be corrected by the pause duration between characters when the user writes continuously, so that the pause duration threshold matches the pause duration between characters when the user writes continuously.

[0129] Specifically, the pause time between characters when the user writes continuously within a period of time can be obtained. The process of determining the pause time between characters is as follows:

[0130] When the user is writing continuously, the timing starts when the user lifts the pen and ends when the user puts the pen down. The timing duration between the user lifting the pen and putting the pen down is used as the pause duration between characters when the user is writing continuously.

[0131] When it is detected that the pause time between characters when the user is writing continuously is gradually increasing, it means that the interval between the user's pen lifting and pen putting down is increasing, and the user's writing speed is slowing down. The pause time threshold can be appropriately increased; when it is detected that the pause time between characters when the user is writing continuously is gradually decreasing, it means that the interval between the user's pen lifting and pen putting down is decreasing, and the user's writing speed is speeding up. The pause time threshold can be appropriately decreased.

[0132] The embodiments of the present application can correct the pause time threshold based on the pause time between characters when the user writes continuously, so that the pause time threshold matches the pause time between characters when the user writes continuously, avoiding the situation where the pause time threshold is too long or too short and affects the user's writing, thereby improving the convenience of the user's writing process.

[0133] For example, Fig. 9 As shown, another embodiment of the present application discloses that the text content is obtained by performing text recognition on all handwriting information obtained in the current writing cycle, including:

[0134] S901. Determine the writing area on the device display screen corresponding to all the handwriting information acquired in the current writing cycle.

[0135] Specifically, when a writing operation is performed on the device display screen based on a writing device or a finger, contact with the device display screen generates an electrical signal, and the device where the device display screen is located can convert the electrical signal into a coordinate point in the device display screen coordinate system, and generate writing handwriting information based on the coordinate point to be displayed on the device display screen. Based on this, in an achievable embodiment, the enclosing box area of ​​all writing handwriting information corresponding to the current writing cycle can be determined according to the coordinates of the writing handwriting information in the device display screen coordinate system as the writing area.

[0136] S902: Perform text recognition based on the handwriting information in the writing area to obtain text content.

[0137] In the prior art, when handwriting information is recognized, the handwriting information is placed in a blank document the size of a device display screen, and a recognition engine is used to recognize the entire document. The recognition area is large and the recognition speed is slow.

[0138] In an embodiment of the present application, the purpose of determining the writing area is to perform text recognition only on the handwriting information within the writing area. With such a setting, the blank area outside the writing area can be cut off, so that the recognition engine only performs text recognition on the writing area where the handwriting information is located, thereby reducing the recognition time.

[0139] Exemplarily, another embodiment of the present application discloses that determining the writing area corresponding to all the handwriting information acquired in the current writing cycle on the device display screen includes:

[0140] From the device display screen, the minimum bounding box area of ​​all the handwriting information corresponding to the current writing cycle is determined as the writing area.

[0141] Specifically, based on the coordinates of the handwriting information in the coordinate system of the device display screen, the minimum enclosing frame area of ​​all handwriting information corresponding to the current writing cycle can be determined as the writing area.

[0142] For example, Fig.10 As shown, in the device display screen coordinate system XOY, among all the coordinate points of all the handwriting information corresponding to the current writing cycle, the first coordinate point T1 with the largest horizontal coordinate, the second coordinate point T2 with the smallest horizontal coordinate, the third coordinate point T3 with the largest vertical coordinate, and the fourth coordinate point T4 with the smallest vertical coordinate can be determined. The rectangular area formed by the line passing through the first coordinate point T1 and parallel to the y-axis, the line passing through the second coordinate point T2 and parallel to the y-axis, the line passing through the third coordinate point T3 and parallel to the x-axis, and the line passing through the fourth coordinate point T4 and parallel to the x-axis is used as the writing area corresponding to the current writing process. Among them, Fig.10 The text shown is only used as an example to illustrate the determination of the writing area and does not have any limiting effect on the present application.

[0143] In an embodiment of the present application, the minimum enclosing box area of ​​all handwriting information corresponding to the current writing cycle is used as the writing area, so that the blank area in the writing area is minimized, further reducing the recognition time.

[0144] Corresponding to the above-mentioned handwriting input method, the present application embodiment also discloses a handwriting input device, see Fig.11 As shown, the device comprises:

[0145] The acquisition module 100 is used to acquire handwriting information generated based on a writing operation detected at any position of the device display screen;

[0146] The recognition module 110 is used to perform text recognition on all handwriting information acquired in the current writing cycle to obtain text content if it is detected that the current writing cycle ends;

[0147] The inserting module 120 is used to insert the text content at the target position of the content displayed on the device display screen.

[0148] The handwriting input device of the present application allows the user to write at any position on the device display screen. The acquisition module 100 acquires the handwriting information generated based on the writing operation detected at any position on the device display screen. After the recognition module 110 detects that the current writing cycle is completed, it performs text conversion on the handwriting information corresponding to the current writing cycle to obtain the text content. The insertion module 120 inserts the text content at the target position of the content displayed on the device display screen to implement handwriting input of the text content. The above scheme supports users to write at any position on the device display screen, providing convenience for users to edit text on the device display screen. On the other hand, the recognition of the written content in the above scheme is triggered based on the end of the writing cycle. When the writing cycle ends, all the written content in the writing cycle can be recognized and displayed on the screen. Therefore, this method supports users to write continuously within the writing cycle, thereby further improving the user's editing efficiency.

[0149] Applying the above solution to ink screen devices not only avoids the delay and ghosting problems caused by the low screen refresh rate of the ink screen device, but also enables writing at any position on the device display screen of the ink screen device, and supports users to write continuously, providing convenience for users to edit text on the ink screen device.

[0150] Optionally, in another embodiment of the present application, the handwriting input device further includes:

[0151] The keyboard processing module is used for controlling the input keyboard to be hidden or disabled if the device display screen displays an input keyboard when the device display screen enters a writing mode.

[0152] Optionally, in another embodiment of the present application, the handwriting input device further includes:

[0153] A positioning cursor processing module is used to generate a virtual positioning cursor at a preset position or a position selected by a user when the device display screen enters a writing mode, if the device display screen does not display a positioning cursor, and use the position of the virtual positioning cursor as the target position; if the device display screen displays a positioning cursor, use the position of the positioning cursor as the target position.

[0154] Optionally, in another embodiment of the present application, the handwriting input device further includes:

[0155] A first response module, configured to enter an erasure mode in response to a preset operation;

[0156] An erasing module, configured to, in an erasing mode, delete an erasing object corresponding to a detected erasing operation in response to the erasing operation; the erasing operation includes a writing operation that covers the erasing object;

[0157] The erased object includes handwriting information acquired in the current writing cycle, or text content displayed on the device display screen.

[0158] Optionally, in another embodiment of the present application, the handwriting input device further includes:

[0159] A second response module is used for exiting the erasing mode in response to a detected erasing release operation in the erasing mode;

[0160] The erasing release operation includes a writing operation that does not cover the erasing object.

[0161] Optionally, in another embodiment of the present application, the handwriting input device further includes:

[0162] A pause detection module, used to detect writing pauses and record the duration of writing pauses in the current writing cycle;

[0163] A judgment module, used to judge whether the writing pause duration reaches a preset pause duration threshold;

[0164] The determination module is used to determine that the current writing cycle ends when a writing pause is detected and the writing pause duration reaches a preset pause duration threshold.

[0165] Optionally, in another embodiment of the present application, the handwriting input device further includes:

[0166] The pause acquisition module acquires the pause duration between characters when the user writes continuously within the historical duration;

[0167] The updating module is used to update the pause duration threshold based on the pause duration between characters when the user writes continuously within a historical duration.

[0168] Optionally, in another embodiment of the present application, the identification module 110 includes:

[0169] A determination unit, used to determine the writing area corresponding to all the handwriting information acquired in the current writing cycle on the device display screen;

[0170] The recognition unit is used to perform text recognition based on the handwriting information in the writing area to obtain text content.

[0171] Optionally, in another embodiment of the present application, when the determination unit determines the writing area corresponding to all the handwriting information acquired in the current writing cycle on the device display screen, it is specifically used to:

[0172] From the device display screen, the minimum bounding box area of ​​all the handwriting information corresponding to the current writing cycle is determined as the writing area.

[0173] Specifically, for the specific working contents of each unit of the above-mentioned handwriting input method, please refer to the contents of the above-mentioned method embodiment, which will not be repeated here.

[0174] Another embodiment of the present application also provides an electronic device, see Fig.12 As shown, the device includes:

[0175] Memory 200 and processor 210;

[0176] The memory 200 is connected to the processor 210 and is used to store programs;

[0177] The processor 210 is used to implement the handwriting input method disclosed in any of the above embodiments by running the program stored in the memory 200.

[0178] Specifically, the electronic device may further include: a bus, a communication interface 220 , an input device 230 and an output device 240 .

[0179] The processor 210, the memory 200, the communication interface 220, the input device 230 and the output device 240 are connected to each other via a bus.

[0180] A bus may include a pathway that transfers information between components of a computer system.

[0181] The processor 210 may be a general-purpose processor, such as a general-purpose central processing unit (CPU), a microprocessor, etc., or an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application. It may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0182] The processor 210 may include a main processor, and may also include a baseband chip, a modem, and the like.

[0183] The memory 200 stores a program for executing the technical solution of the present application, and may also store an operating system and other key services. Specifically, the program may include a program code, and the program code includes computer operation instructions. More specifically, the memory 200 may include a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM), other types of dynamic storage devices that can store information and instructions, a disk storage, a flash, and the like.

[0184] The input device 230 may include a device for receiving data and information input by a user, such as a keyboard, a mouse, a camera, a scanner, a light pen, a voice input device, a touch screen, a pedometer, or a gravity sensor.

[0185] Output device 240 may include devices that allow information to be output to a user, such as a display screen, printer, speaker, etc.

[0186] The communication interface 220 may include any transceiver or the like to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Network (WLAN), etc.

[0187] The processor 210 executes the program stored in the memory 200 and calls other devices, which can be used to implement the various steps of the handwriting input method provided in the above embodiments of the present application.

[0188] Another embodiment of the present application also provides a handwriting input system, such as Fig.13 As shown, the handwriting input system includes the electronic device 300 of the above embodiment, and a stylus 310. When the user uses the stylus 310 to perform a writing operation, when the stylus 310 contacts the electronic device 300, the stylus 310 establishes a connection with the electronic device 300, generates an electrical signal on the device display screen of the electronic device 300, and the electronic device 300 converts the electrical signal into a coordinate point, draws the handwriting information based on the coordinate point, and displays it on the device display screen of the electronic device 300.

[0189] Another embodiment of the present application further provides a storage medium having a computer program stored thereon. When the computer program is executed by a processor, each step of the handwriting input method provided in any of the above embodiments is implemented.

[0190] Specifically, the specific working contents of each part of the above-mentioned electronic device and handwriting input system, as well as the specific processing contents of the computer program on the above-mentioned storage medium when being executed by the processor, can all be found in the contents of each embodiment of the above-mentioned handwriting input method, and will not be repeated here.

[0191] For the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0192] It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0193] The steps in the methods of each embodiment of the present application can be adjusted in order, combined and deleted according to actual needs, and the technical features recorded in each embodiment can be replaced or combined.

[0194] The modules and sub-modules in the devices and terminals of the various embodiments of the present application can be combined, divided and deleted according to actual needs.

[0195] In the several embodiments provided in the present application, it should be understood that the disclosed terminals, devices and methods can be implemented in other ways. For example, the terminal embodiments described above are only schematic, for example, the division of modules or submodules is only a logical function division, and there may be other division methods in actual implementation, for example, multiple submodules or modules can be combined or integrated into another module, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.

[0196] The modules or submodules described as separate components may or may not be physically separated, and the components of the modules or submodules may or may not be physical modules or submodules, that is, they may be located in one place, or they may be distributed on multiple network modules or submodules. Some or all of the modules or submodules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0197] In addition, each functional module or submodule in each embodiment of the present application may be integrated into one processing module, or each module or submodule may exist physically separately, or two or more modules or submodules may be integrated into one module. The above-mentioned integrated modules or submodules may be implemented in the form of hardware or in the form of software functional modules or submodules.

[0198] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0199] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly by hardware, software units executed by a processor, or a combination of the two. The software units may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0200] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0201] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A handwriting input method, characterized in that: include: When the device display screen enters the writing mode, if the device display screen displays an input keyboard, the input keyboard is controlled to be hidden, or the input keyboard is controlled to be invalid; if the device display screen does not display a positioning cursor, a virtual positioning cursor is generated at a preset position or a position selected by the user, and the position of the virtual positioning cursor is used as the target position; if the device display screen displays a positioning cursor, the position of the positioning cursor is used as the target position; Acquire handwriting information generated based on a writing operation detected at any position of a device display screen; If it is detected that the current writing cycle ends, text recognition is performed on all handwriting information acquired in the current writing cycle to obtain text content; wherein the writing cycle includes the interval between when the user starts writing and when the user ends writing; Inserting the text content at the target position of the content displayed on the device display screen; Whether the current writing cycle is finished is determined by the following process: Get the pause duration between characters when the user writes continuously within the historical duration; Determining a pause duration threshold based on the pause duration between characters when the user continuously writes within a historical duration; and detecting writing pauses and recording the writing pause duration within a current writing cycle; Determining whether the writing pause duration reaches the pause duration threshold; When a writing pause is detected and the writing pause duration reaches the pause duration threshold, it is determined that the current writing cycle ends.

2. The method according to claim 1, characterized in that: Also includes: In response to a preset operation, entering an erasing mode; In the erasing mode, in response to a detected erasing operation, an erasing object corresponding to the erasing operation is deleted; the erasing operation includes a writing operation that covers the erasing object; The erased object includes handwriting information acquired in the current writing cycle, or text content displayed on the device display screen.

3. The method according to claim 2, characterized in that Also includes: In the erasing mode, in response to a detected erasing release operation, exiting the erasing mode; The erasing release operation includes a writing operation that does not cover the erasing object.

4. The method according to claim 1, characterized in that The text recognition is performed on all handwriting information acquired in the current writing cycle to obtain text content, including: Determine the writing area on the device display screen corresponding to all the handwriting information acquired in the current writing cycle; Text recognition is performed based on the handwriting information in the writing area to obtain text content.

5. The method according to claim 4, characterized in that The step of determining the writing area on the device display screen corresponding to all the handwriting information acquired in the current writing cycle includes: From the device display screen, the minimum bounding box area of ​​all the handwriting information corresponding to the current writing cycle is determined as the writing area.

6. A handwriting input device, characterized in that: include: A keyboard processing module, configured to, when the device display screen enters a writing mode, if the device display screen displays an input keyboard, control the input keyboard to be hidden, or control the input keyboard to be invalid; A positioning cursor processing module, for generating a virtual positioning cursor at a preset position or a position selected by a user if the device display screen does not display a positioning cursor, and using the position of the virtual positioning cursor as a target position; and for using the position of the positioning cursor as a target position if the device display screen displays a positioning cursor; An acquisition module, used to acquire handwriting information generated based on a writing operation detected at any position of a device display screen; A recognition module, which is used to perform text recognition on all handwriting information acquired in the current writing cycle to obtain text content if it is detected that the current writing cycle ends; wherein the writing cycle includes the interval between when the user starts writing and when the user ends writing; An inserting module, used for inserting the text content at the target position of the content displayed on the device display screen; A pause acquisition module is used to obtain the pause duration between characters when the user writes continuously within the historical duration; An updating module, configured to determine a pause duration threshold based on a pause duration between characters when the user continuously writes within a historical duration; A pause detection module, used to detect writing pauses and record the duration of writing pauses in the current writing cycle; A judging module, used to judge whether the writing pause duration reaches the pause duration threshold; The determination module is used to determine that the current writing cycle ends when a writing pause is detected and the writing pause duration reaches the pause duration threshold.

7. An electronic device, characterized in that: include: Memory and processor; Wherein, the memory is used to store programs; The processor is used to implement the handwriting input method according to any one of claims 1 to 5 by running the program in the memory.

8. A handwriting input system, characterized in that: The invention comprises a stylus pen and the electronic device as claimed in claim 7.

9. A storage medium, characterized in that: include: The storage medium stores a computer program, and when the computer program is executed by the processor, each step of the handwriting input method according to any one of claims 1 to 5 is implemented.

Images