Method and device for recognizing writing operation, electronic device, medium and writing device

Abstract

The application discloses a writing operation recognition method and device, electronic equipment, medium and writing equipment, and belongs to the technical field of computers. The method comprises the following steps: identifying whether a pen-down event exists through a first sensing module; if the pen-down event exists, storing pen trajectory position information and timestamp information in association to obtain an association storage result; identifying whether a label signal exists through a second sensing module; if the label signal is identified, determining that the writing is valid, and determining the starting position of the valid writing according to the timestamp information of the identified label signal and the association storage result. The technical scheme can solve the problem of continuous writing caused by the fact that the stylus is determined to be in the writing state after the user completes the writing and the pen lifting height is low, can realize real-time detection of whether the stylus contacts the screen, can truly display the pen trajectory generated when the stylus contacts the screen, can avoid the problem of recognizing the pen trajectory as continuous writing caused by the low pen lifting height, and can improve the recognition accuracy of the stylus writing trajectory.

Description

Technical Field

[0001] This application belongs to the technical field of touch screens, and particularly relates to a recognition method, device, electronic device, medium and writing device for writing operations. Background Art

[0002] With the development of infrared technology, more and more touch products have been created based on infrared touch technology, such as single-point infrared screens, virtual two-point infrared screens, and infrared multi-touch screens. The characteristics of infrared touch screens, such as being durable, having a fast response speed, saving space, and being easy to communicate, make them widely used in many scenarios. It can be understood that in any scenario with a signal display screen, an infrared touch screen can be used to achieve touch interaction between people and the screen.

[0003] Nowadays, infrared touch technology uses an infrared array布满 in the X and Y directions to detect and locate the position of the user's touch operation. An infrared touch screen is equipped with a circuit board frame in front of the display. The circuit board arranges infrared emitting tubes and infrared receiving tubes on the four sides of the screen, intersecting to form an infrared grid. When the user clicks the screen with a stylus, the stylus will block two or more infrared rays in the X and Y directions passing through that position, thereby determining the click position.

[0004] In current infrared touch technology, after the user completes a stroke of writing, for example, the first horizontal line of the character "two", if the pen-lifting height is low before writing the second horizontal line, since the infrared light is still in the blocked state, the system determines that the stylus is still in the writing state, resulting in a relatively serious problem of connected strokes. Therefore, how to solve the problems of low writing accuracy and poor recognition accuracy is a technical problem that urgently needs to be solved for infrared touch technology to be more widely applied in production and life. Summary of the Invention

[0005] Embodiments of this application provide a recognition method, device, electronic device, medium and writing device for writing operations, aiming to solve the problem of connected strokes in the prior art where the stylus is determined to still be in the writing state due to a low pen-lifting height after the user completes writing. It can detect in real time whether the stylus touches the screen, truly display the handwriting generated when the stylus touches the screen, avoid the problem of being recognized as a connected stroke trajectory due to a low pen-lifting height, and improve the recognition accuracy of the handwriting of the stylus.

[0006] In the first aspect, embodiments of this application provide a recognition method for writing operations, and the method includes:

[0007] Identifying whether there is a pen-down event through the collected data of the first sensing module;

[0008] If a pen stroke event exists, the pen stroke location information and timestamp information are associated and stored to obtain the associated storage result;

[0009] The presence of tag signals is identified by collecting data from the second sensing module;

[0010] If a tag signal is detected, it is determined to be a valid write, and the starting position of the valid write is determined based on the timestamp information of the detected tag signal and the associated storage result.

[0011] Furthermore, after determining the valid starting position of writing based on the timestamp information of the identified tag signal and the associated storage result, the method further includes:

[0012] The first sensing module identifies whether a pen-lifting event exists.

[0013] If a pen-lifting event occurs, the writing operation is considered complete.

[0014] If there is no pen-lifting event, the second sensing module will identify whether the label signal has disappeared.

[0015] If the tag signal disappears and does not recover within a preset time period, the writing operation is considered to have ended.

[0016] Furthermore, after determining that the writing operation has ended, the method also includes:

[0017] Identify the last occurrence timestamp of the tag signal;

[0018] The termination position of valid writing is determined based on the last occurrence timestamp.

[0019] Furthermore, the tag signal transmitting module is an RFID tag;

[0020] Accordingly, based on the timestamp information of the identified tag signal and the associated storage result, the starting position of the valid writing is determined, including:

[0021] The start time of the effective writing is determined based on the timestamp information of the identified tag signal and the preset response duration.

[0022] The starting position of the valid writing is determined based on the start time of the valid writing and the associated storage result.

[0023] Furthermore, the first sensing module is an infrared beam sensing module.

[0024] Furthermore, after identifying the presence of a tag signal through the second sensing module, the method further includes:

[0025] If no tag signal is detected, the storage of handwriting position information and timestamp information will be stopped when a pen lift event occurs.

[0026] Secondly, embodiments of this application provide a writing operation recognition device, the device being configured on a display device for receiving writing operations from the writing device; the writing device is provided with a tag signal emitting module, the tag signal emitting module emitting a tag signal when the writing device is in contact with the display device, and not emitting a tag signal when the writing device is detached from the display device; the device includes:

[0027] The pen stroke event recognition unit is used to identify whether a pen stroke event exists by using the data collected by the first sensing module;

[0028] The associated storage result generation unit is used to associate and store the handwriting position information and timestamp information if a pen stroke event exists, and obtain the associated storage result.

[0029] The tag signal recognition unit is used to identify the presence of tag signals through the data collected by the second sensing module;

[0030] The start position determination unit is used to determine that if a tag signal is detected, it is valid writing, and to determine the start position of valid writing based on the timestamp information of the detected tag signal and the associated storage result.

[0031] Furthermore, the device further includes: a writing operation recognition unit; the writing operation recognition unit is used for:

[0032] The first sensing module identifies whether a pen-lifting event exists.

[0033] If a pen-lifting event occurs, the writing operation is considered complete.

[0034] If there is no pen-lifting event, the second sensing module will identify whether the label signal has disappeared.

[0035] If the tag signal disappears and does not recover within a preset time period, the writing operation is considered to have ended.

[0036] Furthermore, the device also includes:

[0037] A timestamp recognition unit is used to identify the last occurrence timestamp of the tag signal through the second sensing module;

[0038] The end position determination unit is used to determine the end position of valid writing based on the last occurrence timestamp.

[0039] Furthermore, the tag signal transmitting module is an RFID tag;

[0040] Accordingly, the starting position determination unit includes:

[0041] The writing operation time determination subunit determines the start time of the effective writing based on the timestamp information of the identified tag signal and the preset response duration.

[0042] The writing operation position determination subunit determines the starting position of the valid writing based on the start time of the valid writing and the associated storage result.

[0043] Furthermore, the first sensing module is an infrared beam sensing module.

[0044] Furthermore, the device also includes:

[0045] The information storage unit is used to stop storing handwriting position information and timestamp information when a pen lifting event occurs if no tag signal is detected.

[0046] Thirdly, embodiments of this application provide an electronic device including a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the method described in the first aspect.

[0047] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.

[0048] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.

[0049] Sixthly, embodiments of this application provide a writing device, the writing device including an RFID tag and a short-circuit circuit including the RFID tag; wherein, the short-circuit circuit of the RFID tag is used to turn off the short circuit when the pen tip of the writing device touches another object, and to turn on the short circuit when the pen tip of the writing device does not touch another object.

[0050] In this embodiment, the method is executed by a display device, which receives writing operations from the writing device. The writing device is equipped with a tag signal emitting module, which emits a tag signal when the writing device contacts the display device and does not emit a tag signal when the writing device is separated from the display device. The presence of a pen-dropping event is identified by data collected by a first sensing module. If a pen-dropping event exists, the pen position information and timestamp information are associated and stored to obtain an association storage result. The presence of a tag signal is identified by data collected by a second sensing module. If a tag signal is detected, it is determined to be valid writing, and the starting position of the valid writing is determined based on the timestamp information of the detected tag signal and the association storage result. This writing operation recognition method solves the problem of continuous writing caused by low pen lifting height after the user finishes writing, which is common in existing technologies. It enables real-time detection of whether the pen has touched the screen, accurately displaying the pen marks generated when the pen touches the screen, avoiding the problem of identifying continuous strokes due to low pen lifting height, and improving the recognition accuracy of pen writing. Attached Figure Description

[0051] Figure 1 This is a flowchart illustrating the writing operation recognition method provided in Embodiment 1 of this application;

[0052] Figure 2 This is a flowchart illustrating the writing operation recognition method provided in Embodiment 2 of this application;

[0053] Figure 3 This is a flowchart illustrating the writing operation recognition method provided in Embodiment 3 of this application;

[0054] Figure 4 This is a flowchart illustrating the writing operation recognition method provided in Embodiment 4 of this application;

[0055] Figure 5 This is a flowchart illustrating the writing operation recognition method provided in Embodiment 5 of this application;

[0056] Figure 6 This is a schematic diagram of the writing operation recognition device provided in Embodiment Six of this application;

[0057] Figure 7 This is a schematic diagram of the structure of the electronic device provided in Embodiment 7 of this application;

[0058] Figure 8 This is a schematic diagram of the writing device provided in Embodiment 10 of this application. Detailed Implementation

[0059] To make the objectives, technical solutions, and advantages of this application clearer, specific embodiments of this application will be described in further detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely for explaining this application and not for limiting it. It should also be noted that, for ease of description, only the parts relevant to this application are shown in the drawings, not all of them. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe operations (or steps) as sequential processes, many of these operations can be performed in parallel, concurrently, or simultaneously. Furthermore, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but may also have additional steps not included in the drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0060] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0061] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0062] The following description, in conjunction with the accompanying drawings, details the writing operation recognition method, apparatus, electronic device, medium, and writing device provided in this application through specific embodiments and application scenarios.

[0063] In existing infrared touch recognition technology using a stylus, the infrared touchscreen utilizes a densely packed matrix of infrared rays in the horizontal and vertical directions to detect and locate the touch point. When a user touches the screen with a stylus, the stylus blocks the horizontal and vertical infrared rays passing through that location, thus allowing the system to determine the touch point's position on the screen. An infrared touchscreen is a highly integrated electronic circuit product. It contains a complete integrated control circuit, a set of high-precision, anti-interference infrared emitters, and a set of infrared receivers, cross-mounted in two opposite directions on a highly integrated circuit board, forming an invisible infrared grating. The intelligent control system embedded in the control circuit continuously emits pulses to the diodes, forming an infrared polarized beam grating. When the stylus enters the grating, it blocks the beam. The intelligent control system detects the change in light loss and transmits signals to the control system to confirm the X-axis and Y-axis coordinate values.

[0064] A problem with existing technology is that the stylus tip blocks infrared light even before the stylus actually touches the screen. This is because the infrared matrix is ​​positioned above the screen at a certain distance. When writing, the stylus tip blocks infrared light when it reaches this distance. The intelligent control system detects this change in light loss and transmits a signal to the control system, generating X and Y coordinate values ​​as if writing has occurred. This results in the plotting of the stroke, leading to a "lifting" effect. Similarly, when writing ends and the stylus is lifted, the intelligent control system only detects the change in light loss when the stylus tip leaves the infrared matrix, and then stops generating X and Y coordinate values. However, because the infrared matrix is ​​at a distance from the screen, plotting of the stroke within this distance is also displayed, resulting in a "continuous stroke" effect when the stylus is lifted.

[0065] This solution is based on RFID identification technology. The entire device is equipped with an RFID reader, while the stylus pen carries an RFID tag. The RFID reader identifies whether the pen is in contact with the screen by checking for ID information. To address the issue of RFID's long recognition distance and the possibility of the pen being detected even when not in contact with the screen, a trigger mechanism is added to the pen tip, as shown in the diagram. This mechanism includes a normally closed tactile switch and an RFID tag. The RFID tag contains a tag antenna, an RFID tag IC, and a short-circuit switch. The tag antenna is connected to the RFID tag IC, which is connected to the short-circuit switch; the short-circuit switch is a mechanical switch. Under normal conditions, the short-circuit switch is closed, short-circuiting the RFID tag IC and rendering it inoperable. When triggered by the pen tip trigger mechanism, the short-circuit switch is pressed, opening the switch and allowing the tag to enter normal operating mode. The application scenario can be a user operating an infrared touchscreen with a stylus pen. Specifically, the infrared touchscreen can be an interactive intelligent panel.

[0066] When a user operates the infrared touchscreen with a stylus, i.e., a pen-drop event occurs, the system first checks whether the touch recognition ID has been read (since the reporting delay of a pen-drop event is greater than the RFID reading delay, the system can directly determine whether an ID already exists when triggering a pen-drop event). If an ID has been read, the reporting data for approximately 17ms before the ID is generated is drawn. This 17ms is the reading delay of the RFID reader; different readers have different delays and require specific adjustments. Similarly, if a pen-lift signal is detected, only the reporting data before the ID signal is lost is drawn; reporting data generated without an ID is not drawn. If no ID is read, the pen is drawn from the coordinates of the reporting point at the start of the pen-drop event. If a pen-lift signal is detected, drawing of reporting data stops. If no pen-lift event is detected, but the ID signal is lost, a 20ms delay is made to check again whether there is still no ID. If there is still no ID, it means the pen has been lifted, but the lifting height is too low to trigger the Up event. In this case, only the reporting data with an ID is drawn. The 20ms delay here is a hysteresis filter to prevent the handwriting from being interrupted due to the probabilistic loss of IDs during the handwriting drawing process. The 20ms delay is also an engineering debugging value, which should be adjusted according to the system characteristics of different projects.

[0067] Previous technologies required an RF switch to disconnect the antenna, resulting in high hardware costs and the need for an additional battery to power the RF switch, making it not a passive pen. This solution, based on RFID technology, incorporates a mechanical switch into the RFID tag to control the tag's IC operation, truly achieving zero writing height for the passive pen. Furthermore, the short-circuit switch uses a conventional mechanical switch, which is open under normal operating conditions, minimizing its impact on the tag's RF characteristics.

[0068] Example 1

[0069] Figure 1 This is a flowchart illustrating the writing operation recognition method provided in Embodiment 1 of this application. The method is executed by a display device, which receives writing operations from the writing device. The writing device is equipped with a tag signal emitting module, which emits a tag signal when the writing device is in contact with the display device, and does not emit a tag signal when the writing device is detached from the display device. Figure 1 As shown, the specific steps include the following:

[0070] S101, identifies whether a pen stroke event exists by collecting data from the first sensing module.

[0071] Firstly, this solution can be implemented in scenarios where users operate an infrared touchscreen using a stylus. Specifically, the infrared touchscreen can be an all-in-one conference machine or a drawing tablet, etc. After the infrared touchscreen reads the stylus's tag ID, it displays different handwriting based on the user's operation. It will not recognize any other actions performed by the stylus after the user lifts it, nor will it display handwriting caused by any other object touching the touchscreen besides the stylus.

[0072] Based on the above usage scenarios, it is understood that the subject of this application can be the infrared touch screen or an electronic device that integrates an infrared touch screen, without further limitations here.

[0073] In this scheme, the method is executed by a display device, which is used to receive writing operations from the writing device; the writing device is equipped with a tag signal emitting module, which emits a tag signal when the writing device is in contact with the display device, and does not emit a tag signal when the writing device is separated from the display device.

[0074] The display device can be an infrared touchscreen, a smart mobile device, or a computer screen. In this solution, an infrared touchscreen can be used as the display device; specifically, it can be an all-in-one conference machine or a drawing tablet. The writing device can be a stylus or the user's finger. In this solution, a stylus with an RFID tag can be used as the writing device. This approach offers the advantage of accurate recognition of pen strokes and lifting actions, avoiding issues like cursive writing and stroke flicking, and improving the accuracy of the user's writing.

[0075] The receiving process can be described as follows: when the writing device blocks the infrared light emitted by the infrared emitter of the display device, the intensity of the infrared light received by the receiving tube changes. The controller can determine where the touch has occurred by understanding the changes in the infrared light reception, and thus display the writing handwriting on the display device.

[0076] In this embodiment, the collected data can be the coordinates of the blocked infrared light. Since an infrared matrix is ​​set above the display screen, the infrared light is blocked when the stylus touches the screen. The controller can determine that a touch event has occurred by recognizing the weakening or disappearance of the received infrared light, and thus generate X-axis and Y-axis coordinate values. Specifically, the X-axis and Y-axis coordinate values ​​are determined by pre-defined coordinate system rules. For example, the center of the screen is designated as the origin O(0,0), the unit length is defined as 1mm, the positive X-axis direction is defined as due east, and the positive Y-axis direction is defined as due north. If the touch point is 1cm east of the origin, the touch coordinates are (10,0), denoted as A1.

[0077] A pen-writing event is an event that occurs after a user makes a pen-writing motion when operating the infrared touchscreen with a stylus. For example, if a user wants to take notes on the infrared touchscreen, a pen-writing event occurs when the pen touches the screen.

[0078] The presence of a stylus stroke can be identified using infrared light. When the stylus approaches the display screen, it blocks the infrared light between the infrared transmitter and receiver, causing the infrared light received by the receiver to weaken or disappear. The controller can then collect this data to determine that a stylus stroke has occurred. The infrared transmitter and receiver can be positioned vertically and horizontally opposite each other in front of the display screen, forming a horizontal and vertical infrared grid about 1 millimeter in front of the screen.

[0079] S102, if a pen stroke event exists, the pen stroke location information and timestamp information are associated and stored to obtain the associated storage result.

[0080] Handwriting location information can be obtained by detecting and locating the user's touch using a densely packed infrared matrix in the X and Y directions, and then displaying the specific note location using coordinates, including absolute coordinates, relative coordinates, and relative polar coordinates. In this solution, absolute coordinates can be used. For example, the center of the screen can be designated as the origin O(0,0), the unit length can be defined as 1mm, the positive X-axis direction can be defined as due east, and the positive Y-axis direction can be defined as due north. If the pen stroke occurs 1cm east of the origin, the coordinates are (10,0), denoted as A2.

[0081] Timestamp information is data generated using digital signature technology. The signed object includes original document information, signature parameters, and signature time, including self-created timestamps and legally valid timestamps. In this scheme, legally valid timestamps can be used, accurate to the second. The representation format can be year-month-day-hour-minute-second. For example, if the time of writing is 10:45:39 on September 2, 2022, then the timestamp can be represented as 2022-9-2-10-45-39. The associated storage result can be the product obtained by associating and storing the handwriting location information and timestamp information through a processor and memory.

[0082] The association and storage of handwriting position information and timestamp information can be performed by the processor and memory. After the processor associates the handwriting position information and timestamp information in real time, it stores the association result in the memory through the system bus so that the starting position of the valid writing can be determined next.

[0083] S103, identify the presence of tag signals by collecting data from the second sensing module.

[0084] The collected data can be the stylus's tag ID. Since each stylus has a different tag ID, when the stylus touches the screen, the RFID reader will collect the stylus's tag ID, and this tag ID can be used as the collected data.

[0085] Tag signals can be tools that carry messages to determine whether a stylus tag ID has been detected by identifying the tag ID of the stylus through radio frequency identification technology. They include light signals, sound signals, and electrical signals. In this solution, they can be represented by electrical signals. For example, the voltage amplitude of the electrical signal can be used to represent logic 0 and 1, where 0 indicates that the tag ID of the stylus has not been detected, and 1 indicates that the tag ID of the stylus has been detected.

[0086] The presence of a tag signal can be identified using an RFID reader. Since the stylus is equipped with an RFID tag, a short-circuit switch is set inside the RFID tag. Under normal conditions, the short-circuit switch is closed, and the RFID tag IC is short-circuited and cannot work. When the pen tip touches the infrared touch screen, the short-circuit switch is opened, the tag enters normal working mode, and the tag signal is identified.

[0087] S104, if a tag signal is detected, it is determined to be a valid write, and the starting position of the valid write is determined based on the timestamp information of the detected tag signal and the associated storage result.

[0088] The effective starting position of writing can be the point where the user writes on the infrared touch screen with a stylus, or it can be represented by absolute coordinates. For example, the effective starting position of writing can be represented by the letter B, and the representation method is: B(X1, Y1).

[0089] The writing operation can be the action that occurs when a user uses a stylus to write, click, and swipe on an infrared touch screen. The starting position of this operation is determined by recognizing the timestamp information of the tag signal and the associated storage result.

[0090] The timestamp information of the tag signal can be identified by a photosensitive sensor. When the stylus touches the infrared touch screen, the electrical signal of the photosensitive sensor will record the timestamp of the infrared touch screen being clicked.

[0091] Determining the effective starting position for writing can be done through a capacitive touch device, which contains a touch sensing layer. When the stylus touches the infrared touch screen, the touch sensing layer can sense the strength of the capacitance change to determine the writing position information.

[0092] Optionally, based on the above technical solution, the first sensing module may be an infrared beam sensing module.

[0093] It consists of independent transmitting and receiving modules. The transmitting module emits coded infrared light, and the receiving module outputs a control signal when it receives a valid signal. The transmitting module can be composed of infrared emitting tubes mounted on the top and left bezels of the touchscreen. The infrared emitting tubes emit infrared light to form a network of infrared rays. The receiving module can be composed of infrared receiving tubes mounted on the bottom and right bezels of the touchscreen. When an object (finger, gloved object, or any touch-sensitive object) enters the infrared network and blocks the infrared transmission and reception at a certain point, the intensity of the infrared light received by the receiving tubes in both the horizontal and vertical directions at that point will change. The controller can determine where the touch has occurred by understanding the changes in the infrared reception.

[0094] In this solution, the transmitting module emits infrared light to detect whether there is a pen-dropping or pen-lifting event. If the receiving module receives a signal indicating that a pen-dropping or pen-lifting event has occurred, the second sensing module will then perform the next task. This solution has high sensitivity and strong anti-interference capabilities, thereby improving the stability of the stylus operation.

[0095] In this application example, the method is executed by a display device, which receives writing operations from the writing device. The writing device is equipped with a tag signal emitting module, which emits a tag signal when the writing device contacts the display device and does not emit a tag signal when the writing device is separated from the display device. The presence of a pen-dropping event is identified by data collected by a first sensing module. If a pen-dropping event exists, the pen position information and timestamp information are associated and stored to obtain an association storage result. The presence of a tag signal is identified by data collected by a second sensing module. If a tag signal is detected, it is determined to be valid writing, and the starting position of the valid writing is determined based on the timestamp information of the detected tag signal and the association storage result. The technical solution provided in this embodiment, due to the uniqueness of the stylus's tag ID, can determine in real time whether a writing operation has occurred when the stylus touches the infrared touchscreen. This solves the problem in the prior art where, after the user finishes writing, the stylus is judged to be still in a writing state due to a low pen lifting height. It achieves real-time detection of whether the stylus has touched the screen, accurately displays the handwriting generated when the stylus touches the screen, avoids the problem of identifying it as a continuous stroke due to a low pen lifting height, and improves the recognition accuracy of stylus handwriting.

[0096] Example 2

[0097] Figure 2 This is a flowchart illustrating the writing operation recognition method provided in Embodiment 2 of this application. Figure 2 As shown, the specific steps include the following:

[0098] After determining the valid starting position of writing based on the timestamp information of the identified tag signal and the associated storage result, the method further includes:

[0099] S201, identify whether a pen stroke event exists by collecting data from the first sensing module; wherein, the first sensing module is located outside the display screen of the display device.

[0100] S202, if a pen stroke event exists, the pen position information and timestamp information are associated and stored to obtain the associated storage result.

[0101] S203, identify the presence of tag signals by collecting data from the second sensing module.

[0102] S204, if a tag signal is detected, it is determined to be a valid write, and the starting position of the valid write is determined based on the timestamp information of the detected tag signal and the associated storage result.

[0103] S205, the first sensing module identifies whether a pen-lifting event exists; if it exists, S206 is executed; if it does not exist, S207 is executed.

[0104] In this embodiment of the application, the pen-lifting event can be the operation of the user removing the stylus from the infrared touch screen when stopping writing.

[0105] The pen lift event can also be identified using infrared light. When the stylus moves away from the display screen, the infrared light, which was originally weak or disappeared, will return to its original state as the stylus disappears. The controller can determine that a pen lift event has occurred by recognizing that the received infrared light has become stronger, and then proceed to the next step, that is, to determine that the writing operation has ended.

[0106] S206, confirm the end of the writing operation.

[0107] The end of the writing operation can be determined by recognizing the pen lift event. At this point, the subsequent actions of the stylus will not be recognized, and the handwriting produced by the stylus will not be displayed.

[0108] S207, the second sensing module identifies whether the tag signal has disappeared.

[0109] The disappearance of the tag signal can also be detected using an RFID reader. When the user lifts the pen, the short-circuit switch closes, the stylus stops working, and the stylus tag ID cannot be recognized, thus detecting whether the tag signal has disappeared. The tag signal disappearance can occur when the user finishes writing, causing the stylus tag ID to become undetectable, or it can occur when the user randomly loses the stylus tag ID during writing.

[0110] S208, if the tag signal disappears and does not recover within a preset time period, then the writing operation is determined to be over.

[0111] The preset duration can be a verification period set to confirm whether there is still no ID after the second sensing module recognizes that the stylus tag ID has disappeared but no pen lift event is detected. If there is still no ID, it means that the stylus has been lifted. If there is an ID, it means that the user is still writing. It can be set to 10ms, 20ms, or 30ms. In this solution, 20ms can be used as the preset duration. This 20ms is a hysteresis filter to avoid the situation where the stylus tag ID is lost probabilistically when the user is writing, which would cause the handwriting to be disconnected.

[0112] The tag signal not being recovered can be a situation where the second sensing module detects that the stylus tag ID has disappeared, but the stylus tag ID is still not detected within a preset time range. If this happens, it means that the user has lifted the pen and the writing operation has ended.

[0113] The technical solution provided in this embodiment determines whether the writing operation has ended by identifying whether a pen lifting event exists through the first sensing module. If no pen lifting event exists, the writing operation is determined by identifying whether the tag signal has disappeared through the second sensing module. This can determine in real time whether the stylus has been lifted from the infrared touch screen. If the stylus has been lifted, the handwriting of the subsequent stylus operation will not be displayed, which can solve the problem of continuous writing and pen lifting when the user lifts the pen.

[0114] Example 3

[0115] Figure 3 This is a flowchart illustrating the writing operation recognition method provided in Embodiment 3 of this application. Figure 3 As shown, the specific steps include the following:

[0116] After the writing operation is completed, the method further includes:

[0117] S301, the data collected by the first sensing module identifies whether a pen stroke event exists; wherein, the first sensing module is located outside the display screen of the display device.

[0118] S302, if a pen stroke event exists, the pen position information and timestamp information are associated and stored to obtain the associated storage result.

[0119] S303 identifies the presence of a tag signal by collecting data from the second sensing module.

[0120] S304, if a tag signal is detected, it is determined to be a valid write, and the starting position of the valid write is determined based on the timestamp information of the detected tag signal and the associated storage result.

[0121] S305, the first sensing module identifies whether a pen-lifting event exists; if it exists, S306 is executed; if it does not exist, S307 is executed.

[0122] S306, confirm the end of the writing operation.

[0123] S307 uses the second sensing module to identify whether the tag signal has disappeared.

[0124] S308, if the tag signal disappears and does not recover within a preset time period, then the writing operation is determined to be over.

[0125] S309, Identify the last occurrence timestamp of the tag signal.

[0126] The last occurrence timestamp of the identification tag signal can also be achieved through the electrical signal of the photosensitive sensor. When the stylus leaves the infrared touch screen, the electrical signal of the photosensitive sensor will record the timestamp of the infrared touch screen being released.

[0127] S310, determine the end position of valid writing based on the last appearing timestamp.

[0128] The last timestamp can be the last time the stylus tag ID could be detected, which can be understood as the time when the user last performed a writing operation. In this solution, a legally valid timestamp can also be used, accurate to the second. The format can be year-month-day hour:minute:second. For example, if the user's last writing operation was on September 5, 2022 at 10:44:27, it can be represented as 2022-9-5 10:44:27. The effective writing termination position can be the point where the user lifted the stylus on the infrared touchscreen. This can also be represented using absolute coordinates. For example, the letter C can be used to represent the effective writing start position, so the representation method is: C(X2, Y2).

[0129] Determining the end position of valid writing can also be done through a capacitive touch device. When the stylus touches the infrared touch screen, the touch sensing layer can sense the strength of the capacitance change to determine the end position of writing.

[0130] The technical solution provided in this embodiment determines the end position of valid writing by identifying the last occurrence timestamp of the tag signal. It can detect in real time whether the stylus has moved away from the screen, thereby avoiding problems such as continuous writing and pen lifting after the user lifts the pen.

[0131] Example 4

[0132] Figure 4 This is a flowchart illustrating the writing operation identification method provided in Embodiment 4 of this application. Based on the above embodiments, this embodiment proposes further improvements, specifically: the tag signal transmitting module is an RFID tag; correspondingly, the effective writing start position is determined based on the timestamp information of the identified tag signal and the associated storage result, including: determining the effective writing start time based on the timestamp information of the identified tag signal and a preset response duration; and determining the effective writing start position based on the effective writing start time and the associated storage result. Figure 4 As shown, the specific steps include the following:

[0133] S401, the presence of a pen stroke event is identified by the data collected by the first sensing module; wherein, the first sensing module is located outside the display screen of the display device.

[0134] S402, if a pen stroke event exists, the pen stroke location information and timestamp information are associated and stored to obtain the associated storage result.

[0135] S403, the presence of a tag signal is identified by the data collected by the second sensing module; wherein, the tag signal emitting module is an RFID tag.

[0136] RFID tags are a non-contact automatic identification technology that uses radio frequency signals to identify target objects and obtain relevant data. The identification process does not require manual intervention. In this solution, the stylus is equipped with an RFID tag, which can confirm whether the pen has touched the screen by identifying whether there is ID information.

[0137] S404, if a tag signal is detected, determine the start time of the valid writing based on the timestamp information of the detected tag signal and the preset response duration.

[0138] The preset response time can be the reading delay of the RFID reader. Different readers have different delays. In this solution, the response time can be set to 17ms. The effective writing start time can be the difference between the time when the infrared touch screen is clicked, determined by the electrical signal of the photosensitive sensor, and the preset response time. For example, if the effective writing start time is T, and the time when the stylus tag ID is just recognized is T1, then T = T1 - 17ms.

[0139] The effective start time for writing can be determined by subtracting the time when the infrared touchscreen is clicked (determined by the electrical signal from the photosensitive sensor) from the preset response time using a time calculation device.

[0140] S405, determine the starting position of the valid writing based on the start time of the valid writing and the associated storage result.

[0141] The technical solution provided in this embodiment uses an RFID tag mounted on the stylus to identify whether the pen has contacted the screen by recognizing the presence of ID information. Then, based on the timestamp information of the recognized tag signal and the preset response time, the effective writing start time is determined. The effective writing start time and associated storage results are then used to determine the effective writing start position. Different response times can be set according to different stylus reader delays to accurately determine the time when the stylus contacts the screen, i.e., the effective writing start time, thereby accurately locating the effective writing start position.

[0142] Example 5

[0143] Figure 5 This is a flowchart illustrating the writing operation recognition method provided in Embodiment 5 of this application. Figure 5 As shown, the specific steps include the following:

[0144] After identifying the presence of a tag signal through the second sensing module, the method further includes:

[0145] S501, the presence of a pen stroke event is identified by the data collected by the first sensing module; wherein, the first sensing module is located outside the display screen of the display device.

[0146] S502, if a pen stroke event exists, the pen position information and timestamp information are associated and stored to obtain the associated storage result.

[0147] S503: Identify whether a tag signal exists by collecting data from the second sensing module; if it exists, execute S504; if it does not exist, execute S505.

[0148] S504, determine as valid writing, and determine the starting position of valid writing based on the timestamp information of the identified tag signal and the associated storage result.

[0149] S505: When a pen lift event occurs, stop storing the pen position information and timestamp information.

[0150] The technical solution provided in this embodiment, by stopping the storage of handwriting position information and timestamp information when a pen-lifting event occurs without recognizing a tag signal, can avoid the situation where, due to the writing height, the handwriting generated by the stylus is still displayed for a period of time when the user lifts the pen, thus avoiding the occurrence of continuous writing and pen lifting.

[0151] Example 6

[0152] Figure 6 This is a schematic diagram of the writing operation recognition device provided in Embodiment Six of this application. The device is configured on a display device, which receives writing operations from the writing device. The writing device is equipped with a tag signal emitting module, which emits a tag signal when the writing device is in contact with the display device, and does not emit a tag signal when the writing device is detached from the display device. Figure 6 As shown, it specifically includes the following:

[0153] The pen stroke event recognition unit 601 is used to identify whether a pen stroke event exists by using the data collected by the first sensing module;

[0154] The associated storage result generation unit 602 is used to associate and store the handwriting position information and timestamp information if a pen stroke event exists, and obtain the associated storage result.

[0155] The tag signal recognition unit 603 is used to identify whether a tag signal exists by means of the data collected by the second sensing module;

[0156] The start position determination unit 604 is used to determine that if a tag signal is detected, it is valid writing, and to determine the start position of valid writing based on the timestamp information of the detected tag signal and the associated storage result.

[0157] Furthermore, the device further includes: a writing operation recognition unit; the writing operation recognition unit is used for:

[0158] The first sensing module identifies whether a pen-lifting event exists.

[0159] If a pen-lifting event occurs, the writing operation is considered complete.

[0160] If there is no pen-lifting event, the second sensing module will identify whether the label signal has disappeared.

[0161] If the tag signal disappears and does not recover within a preset time period, the writing operation is considered to have ended.

[0162] Furthermore, the device also includes:

[0163] A timestamp recognition unit is used to identify the last occurrence timestamp of the tag signal through the second sensing module;

[0164] The end position determination unit is used to determine the end position of valid writing based on the last occurrence timestamp.

[0165] Furthermore, the tag signal transmitting module is an RFID tag;

[0166] Accordingly, the starting position determination unit includes:

[0167] The writing operation time determination subunit determines the start time of the effective writing based on the timestamp information of the identified tag signal and the preset response duration.

[0168] The writing operation position determination subunit determines the starting position of the valid writing based on the start time of the valid writing and the associated storage result.

[0169] Furthermore, the first sensing module is an infrared beam sensing module.

[0170] Furthermore, the device also includes:

[0171] The information storage unit is used to stop storing handwriting position information and timestamp information when a pen lifting event occurs if no tag signal is detected.

[0172] In this embodiment, the pen-drop event recognition unit is used to identify whether a pen-drop event exists through the data collected by the first sensing module; the associated storage result generation unit is used to associate and store the handwriting position information and timestamp information to obtain the associated storage result if a pen-drop event exists; the tag signal recognition unit is used to identify whether a tag signal start position determination unit exists through the data collected by the second sensing module; and the tag signal start position determination unit is used to determine valid writing if a tag signal is detected, and to determine the start position of valid writing based on the timestamp information of the detected tag signal and the associated storage result. Through the above-described writing operation recognition device, the problem of continuous writing caused by the user lifting the pen at a low height after completing writing in the prior art can be solved. It achieves real-time detection of whether the stylus has touched the screen, accurately displays the handwriting generated when the stylus touches the screen, avoids the problem of identifying continuous writing trajectories due to low pen lifting height, and improves the recognition accuracy of stylus handwriting.

[0173] The writing operation recognition device provided in this embodiment corresponds to the methods provided in the above embodiments and has a corresponding execution process and beneficial effects, which will not be described in detail here.

[0174] Example 7

[0175] like Figure 7 As shown, this application embodiment also provides an electronic device 700, including a processor 701, a memory 702, and a program or instructions stored in the memory 702 and executable on the processor 701. When the program or instructions are executed by the processor 701, they implement the various processes of the above-described writing operation recognition method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0176] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0177] Example 8

[0178] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described writing operation recognition method embodiment and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0179] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0180] Example 9

[0181] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described writing operation recognition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0182] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0183] Example 10

[0184] Figure 8 This is a schematic diagram of the writing device provided in Embodiment 10 of this application. Figure 8 As shown, this application embodiment also provides a writing device 800, including an RFID tag 801 and a short-circuit circuit 802 including the RFID tag; wherein, the short-circuit circuit 802 of the RFID tag is used to turn off the short circuit when the pen tip of the writing device 800 touches other objects, and to turn on the short circuit when the pen tip of the writing device 800 does not touch other objects.

[0185] The writing device provided in this embodiment interacts with the display device to implement the various processes of the above-described writing operation recognition method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0186] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0187] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0188] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

[0189] The above description is merely a preferred embodiment and the technical principles employed in this application. This application is not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions that can be made by those skilled in the art will not depart from the scope of protection of this application. Therefore, although this application has been described in detail through the above embodiments, this application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of this application, the scope of which is determined by the scope of the claims.

Claims

1. A method for recognizing writing operations, characterized in that, The method is executed by a display device, which receives writing operations from the writing device; the writing device is equipped with a tag signal emitting module, which emits a tag signal when the writing device is in contact with the display device, and does not emit a tag signal when the writing device is disconnected from the display device; the method includes: The presence of a pen stroke event is identified by collecting data from the first sensing module; If a pen stroke event exists, the pen stroke location information and timestamp information are associated and stored to obtain the associated storage result; The presence of tag signals is identified by collecting data from the second sensing module; If a tag signal is detected, it is determined to be a valid write, and the starting position of the valid write is determined based on the timestamp information of the detected tag signal and the associated storage result.

2. The method according to claim 1, characterized in that, After determining the valid starting position of writing based on the timestamp information of the identified tag signal and the associated storage result, the method further includes: The first sensing module identifies whether a pen-lifting event exists. If a pen-lifting event occurs, the writing operation is considered complete. If there is no pen-lifting event, the second sensing module will identify whether the label signal has disappeared. If the tag signal disappears and does not recover within a preset time period, the writing operation is considered to have ended.

3. The method according to claim 2, characterized in that, After the writing operation is completed, the method further includes: Identify the last occurrence timestamp of the tag signal; The termination position of valid writing is determined based on the last occurrence timestamp.

4. The method according to any one of claims 1-3, characterized in that, The tag signal transmitting module is an RFID tag; Accordingly, based on the timestamp information of the identified tag signal and the associated storage result, the starting position of the valid writing is determined, including: The start time of the effective writing is determined based on the timestamp information of the identified tag signal and the preset response duration. The starting position of the valid writing is determined based on the start time of the valid writing and the associated storage result.

5. The method according to any one of claims 1-3, characterized in that, The first sensing module is an infrared beam sensing module.

6. The method according to claim 5, characterized in that, After identifying the presence of a tag signal through the second sensing module, the method further includes: If no tag signal is detected, the storage of handwriting position information and timestamp information will be stopped when a pen lift event occurs.

7. A writing operation recognition device, characterized in that, The device is configured on a display device, which receives writing operations from the writing device; the writing device is equipped with a tag signal emitting module, which emits a tag signal when the writing device is in contact with the display device, and does not emit a tag signal when the writing device is detached from the display device; the device includes: The pen stroke event recognition unit is used to identify whether a pen stroke event exists by using the data collected by the first sensing module; The associated storage result generation unit is used to associate and store the handwriting position information and timestamp information if a pen stroke event exists, and obtain the associated storage result. The tag signal recognition unit is used to identify the presence of tag signals through the data collected by the second sensing module; The start position determination unit is used to determine that if a tag signal is detected, it is valid writing, and to determine the start position of valid writing based on the timestamp information of the detected tag signal and the associated storage result.

8. An electronic device, characterized in that, It includes a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the method for recognizing writing operations as described in any one of claims 1-6.

9. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions, which, when executed by a processor, implement the steps of the writing operation recognition method as described in any one of claims 1-6.

10. A writing device for implementing the method for recognizing writing operations as described in any one of claims 1-6, characterized in that, The writing device includes a tag signal transmitting module, which includes an RFID tag and a short-circuit circuit including the RFID tag. The short-circuit circuit of the RFID tag is used to turn off the short circuit and emit a tag signal when the pen tip of the writing device touches the display device; when the pen tip of the writing device leaves the display device, the short circuit is turned on and the RFID tag does not emit a tag signal.

Images