A handwriting detection method, electronic pen and handwriting detection system

Abstract

The embodiment of the present invention discloses a handwriting detection method, an electronic pen and a handwriting detection system, which are applied to the field of electronic pen technology and can solve the problem that the power consumption of the electronic pen is large and the handwriting detection process is complicated. The method comprises: if the electronic pen contacts the writing plane and the light intensity changes in the target area in the writing detection area of ​​the dynamic vision DVS sensor, the electronic pen determines the position coordinates of at least one first photosensitive point corresponding to the target area, and the electronic pen is provided with a DVS sensor, and the DVS sensor includes a plurality of photosensitive points; the electronic pen connects the position coordinates of at least one first photosensitive point to obtain the target handwriting of the electronic pen in the target area.

Description

Technical Field

[0001] The embodiments of the present invention relate to the technical field of electronic pens, and in particular to a handwriting detection method, an electronic pen, and a handwriting detection system. Background Art

[0002] Electronic pens are becoming increasingly popular as electronic devices. They can be used with paper and display devices, allowing the user's handwriting on paper to be fully displayed on the display device. Current methods for detecting handwriting with electronic pens require the pen to be written on specific paper or for the pen's sensor to emit specific light. This consumes a lot of power and complicates the handwriting detection process. Summary of the Invention

[0003] The present invention provides a handwriting detection method, an electronic pen, and a handwriting detection system to address the problems of high power consumption and complex handwriting detection processes in existing electronic pens. To address the above technical issues, the present invention is implemented as follows:

[0004] In a first aspect, a handwriting detection method is provided, the method comprising: a dynamic vision DVS sensor is provided in an electronic pen, the DVS sensor including a plurality of light-sensitive points;

[0005] If the electronic pen is in contact with the writing surface and a change in light intensity occurs in a target area within the writing detection area of the DVS sensor, the electronic pen determines position coordinates of at least one first photosensitizing point corresponding to the target area;

[0006] The electronic pen is connected to the position coordinates of the at least one first light-sensitive point to obtain the target handwriting of the electronic pen in the target area.

[0007] In a second aspect, an electronic pen is provided, wherein a dynamic vision sensor (DVS) is provided in the electronic pen, wherein the DVS sensor includes a plurality of photosensors; the electronic pen includes:

[0008] a processing module configured to determine the position coordinates of at least one first photosensing point corresponding to a target area in a writing detection area of the DVS sensor if the electronic pen contacts a writing surface and a light intensity change occurs in the target area;

[0009] The processing module is further configured to connect the position coordinates of the at least one first light-sensitive point to obtain the target handwriting of the electronic pen within the target area.

[0010] According to a third aspect, an electronic pen is provided, comprising:

[0011] a memory storing executable program code;

[0012] a processor coupled to the memory;

[0013] The processor calls the executable program code stored in the memory to execute the handwriting detection method in the first aspect of the embodiment of the present invention.

[0014] In a fourth aspect, a handwriting detection system is provided, comprising: the electronic pen according to the second aspect or the third aspect of the present invention, and a terminal device associated with the electronic pen;

[0015] The electronic pen is used to send the detected target handwriting within the target area to the terminal device;

[0016] The terminal device is used to determine the target text information corresponding to the target handwriting; photograph the target area through the camera of the terminal device to obtain a second photographed image; recognize the second photographed image to obtain second text information in the second photographed image; if the second text information is different from the target text information, output the second text information.

[0017] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program that enables a computer to execute the handwriting detection method of the first aspect of the embodiment of the present invention. The computer-readable storage medium includes ROM / RAM, a magnetic disk, or an optical disk.

[0018] According to a sixth aspect, a computer program product is provided. When the computer program product is run on a computer, the computer is caused to execute part or all of the steps of any one of the methods according to the first aspect.

[0019] In a seventh aspect, an application publishing platform is provided, which is used to publish a computer program product, wherein when the computer program product runs on a computer, the computer is enabled to execute part or all of the steps of any one method of the first aspect.

[0020] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0021] In an embodiment of the present invention, an electronic pen is equipped with a DVS sensor comprising multiple photosites. When the electronic pen contacts a writing surface and a target area within the DVS sensor's writing detection area experiences a change in light intensity, the electronic pen determines the position coordinates of at least one first photosite corresponding to the target area. The electronic pen then connects the position coordinates of the at least one first photosite to obtain the target handwriting within the target area. Because the light intensity in written and unwritten areas differs during writing, the DVS sensor in the electronic pen can determine the photosite coordinates corresponding to the written area based on the change in light intensity and then determine the electronic pen's handwriting based on these photosite coordinates. This handwriting detection scheme allows the electronic pen to write on any surface, and the DVS sensor in the electronic pen does not need to actively emit light. Since the DVS sensor can detect dynamic objects, even when the electronic pen and the writing surface undergo slight relative motion, the DVS sensor can detect handwriting on the writing surface based on light intensity. This simplifies the handwriting detection process and reduces the size and power consumption of the electronic pen. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0023] Figure 1 This is a schematic diagram of the structure of an electronic pen provided by an embodiment of the present invention. Figure 1 ;

[0024] Figure 2 This is a schematic diagram of the structure of a terminal device provided by an embodiment of the present invention. Figure 1 ;

[0025] Figure 3 This is a flow diagram of a handwriting detection method provided by an embodiment of the present invention. Figure 1 ;

[0026] Figure 4 This is a schematic diagram of the light-sensitive points corresponding to the movement process of the electronic pen provided by an embodiment of the present invention. Figure 1 ;

[0027] Figure 5 This is a flow diagram of a handwriting detection method provided by an embodiment of the present invention. Figure 2 ;

[0028] Figure 6 This is a flow diagram of a handwriting detection method provided by an embodiment of the present invention. Figure 3 ;

[0029] Figure 7 This is a scenario diagram of a handwriting detection method provided by an embodiment of the present invention. Figure 1 ;

[0030] Figure 8 This is a flow diagram of a handwriting detection method provided by an embodiment of the present invention. Figure 4 ;

[0031] Figure 9 This is a scenario diagram of a handwriting detection method provided by an embodiment of the present invention. Figure 2 ;

[0032] Figure 10 This is a scenario diagram of a handwriting detection method provided by an embodiment of the present invention. Figure 3 ;

[0033] Figure 11 This is a schematic diagram of the light-sensitive points corresponding to the movement process of the electronic pen provided by an embodiment of the present invention. Figure 2 ;

[0034] Figure 12 This is a schematic diagram of the structure of an electronic pen provided by an embodiment of the present invention. Figure 2 ;

[0035] Figure 13 This is a schematic diagram of the structure of an electronic pen provided by an embodiment of the present invention. Figure 3 ;

[0036] Figure 14 This is a schematic diagram of the structure of a terminal device provided by an embodiment of the present invention. Figure 2 ;

[0037] Figure 15 It is a structural diagram of a handwriting detection system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0038] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0039] The terms "first" and "second" in the present specification and claims are used to distinguish between different objects, rather than to describe a specific order of objects. For example, the terms "first photosite" and "second photosite" are used to distinguish between different photosites, rather than to describe a specific order of photosites.

[0040] The terms "including" and "having" and any variations thereof in the embodiments of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, product or apparatus that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products or apparatus.

[0041] It should be noted that, in the embodiments of the present invention, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present invention should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0042] Electronic pens, as an electronic device, are increasingly being used. They can be used with paper and display devices, allowing the user's handwriting on paper to be fully displayed on the display device. Current methods for detecting handwriting with electronic pens require the pen to be written on specific paper or for the pen's sensor to emit specific light. This consumes significant power and complicates the handwriting detection process.

[0043] To address the aforementioned issues, embodiments of the present invention provide a handwriting detection method, an electronic pen, and a handwriting detection system. The electronic pen is equipped with a DVS sensor, which includes multiple photosites. When the electronic pen contacts a writing surface and a target area within the DVS sensor's writing detection area experiences a change in light intensity, the electronic pen determines the position coordinates of at least one first photosite corresponding to the target area. The electronic pen then connects the position coordinates of the at least one first photosite to obtain the target handwriting of the electronic pen within the target area. Because the light intensity in written and unwritten areas differs during the writing process, the DVS sensor in the electronic pen can determine the photosite coordinates corresponding to the written area based on the change in light intensity, and then determine the electronic pen's handwriting based on these photosite coordinates. This handwriting detection scheme allows the electronic pen to write on any surface, and the DVS sensor in the electronic pen does not need to actively emit light. Because the DVS sensor can detect dynamic objects, even when the electronic pen and the writing surface undergo slight relative motion, the DVS sensor can detect handwriting on the writing surface based on light intensity. This simplifies the handwriting detection process and reduces the size and power consumption of the electronic pen.

[0044] The electronic pen according to the embodiment of the present invention is provided with a dynamic vision sensor (DVS) and a camera. The DVS sensor faces the tip of the electronic pen. It should be noted that the camera can be integrated into the DVS sensor or provided as a separate component in the electronic pen.

[0045] For example, Figure 1 The figure shows the structure of the electronic pen. Figure 1 In the embodiment, the camera is integrated into the DVS sensor 13. The DVS sensor 13 can be provided next to the tip 12 of the electronic pen 11, and the direction of the DVS sensor 13 is the direction of the tip 12 of the electronic pen 11. Figure 1 The area between the dotted lines in is the range of the writing detection area that can be detected by the DVS sensor 13. The angle between the two dotted lines can be set according to the requirements of the electronic pen, such as 80° or 120°.

[0046] The terminal device involved in the embodiment of the present invention may also be provided with a DVS sensor and a camera, which may be provided on the screen side of the terminal device. It should be noted that the camera may be integrated into the DVS sensor or provided as a separate component in the terminal device.

[0047] For example, Figure 2 The diagram below shows the structure of the terminal equipment. Figure 2 In the embodiment, the camera is integrated into the DVS sensor 13. The DVS sensor 13 can be set above the screen of the terminal device 21 or at other locations of the terminal device 21, which is not limited in the embodiment of the present invention.

[0048] The terminal device involved in the embodiment of the present invention may be an electronic device such as a mobile phone, a tablet computer, a laptop computer, a PDA, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA).

[0049] The handwriting detection method provided in the embodiments of the present invention may be executed by the aforementioned electronic pen and terminal device, or by a functional module and / or functional entity within the electronic pen and terminal device that implements the handwriting detection method. The specific implementation can be determined based on actual usage requirements and is not limited by the embodiments of the present invention. The handwriting detection method provided in the embodiments of the present invention is exemplified below using an electronic pen and terminal device as examples.

[0050] Example 1

[0051] like Figure 3As shown, an embodiment of the present invention provides a handwriting detection method. The embodiment of the present invention can be applied to a scenario where a user writes on a writing surface using an electronic pen. The method may include the following steps:

[0052] 301. The electronic pen determines the position coordinates of at least one first photosensitizing point corresponding to a target area.

[0053] In an embodiment of the present invention, if the electronic pen contacts the writing surface and a target area in the writing detection area of the DVS sensor experiences a light intensity change, the electronic pen can determine the position coordinates of at least one first photosensitizing point corresponding to the target area.

[0054] It should be noted that the DVS sensor may be provided with a photosensitive chip, and the photosensitive chip may be provided with a plurality of photosensitive points. The photosensitive points can be used to sense changes in light intensity, thereby sensing the relative motion between the object and the DVS sensor.

[0055] For example, during motion detection, the DVS sensor is generally stationary. When there's no relative motion between the object and the DVS sensor, meaning the light intensity detected by the DVS sensor hasn't changed, the multiple photosites on the photosensitive chip remain dormant. When there's relative motion between the object and the DVS sensor, meaning the light intensity detected by the DVS sensor changes, the photosites on the photosensitive chip corresponding to the area of light intensity change are activated. Based on the positions of these activated photosites, the area of light intensity change, i.e., the area of relative motion between the object and the DVS sensor, is determined, thereby deriving the object's motion trajectory.

[0056] Optionally, a method for determining whether a change in light intensity has occurred in a target area within a writing detection area of the DVS sensor may specifically include: the DVS sensor acquires an initial light intensity of the target area, with the DVS sensor pointing toward the tip of the electronic pen; a photosensitive circuit in the DVS sensor acquires a target light intensity of the target area in real time; if a difference between the target light intensity and the initial light intensity is greater than a preset difference, the electronic pen determines that a change in light intensity has occurred in the target area.

[0057] In this optional implementation, a DVS sensor in the electronic pen can obtain an initial light intensity in the target area. This initial light intensity is the light intensity when the light intensity remains unchanged, i.e., the light intensity detected by the DVS sensor in the target area when there is no relative motion between the electronic pen tip and the writing surface. A photosensitive circuit in the DVS sensor can then detect the light intensity in the writing detection area in real time. When the photosensitive circuit detects that the difference between the target light intensity and the initial light intensity in a particular area is greater than a preset difference, it indicates that a change in light intensity has occurred in that area, indicating that the electronic pen tip has experienced relative motion with the writing surface.

[0058] Because the DVS sensor only captures dynamic changes in a scene, it remains dormant when all objects in the scene are stationary. When any object in the scene moves, the DVS sensor immediately activates and captures changes in light intensity associated with the object's motion. This DVS sensor requires minimal data storage and computing resources and has a very low latency, reaching microseconds. Therefore, it can be used to detect speeding vehicles. Furthermore, the DVS sensor is highly sensitive to changes in light intensity, capturing even the smallest changes. Therefore, the preset difference in this embodiment of the present invention can be set relatively small, improving the accuracy of handwriting detection by the electronic pen and reducing the latency associated with handwriting detection.

[0059] Optionally, the method for determining whether the electronic pen is in contact with the writing surface may include the following implementation methods:

[0060] Implementation method 1: The pressure sensor detects the pressure value of the tip of the electronic pen in real time; when the pressure value is greater than or equal to a preset pressure threshold, the electronic pen determines that the electronic pen is in contact with the writing surface.

[0061] In this optional implementation, a pressure sensor can be provided in the tip of the electronic pen, which can detect the pressure value applied to the tip of the electronic pen in real time; when the pressure value is greater than or equal to a preset pressure threshold, the electronic pen can determine that the tip of the electronic pen has contacted the writing surface.

[0062] Implementation method 2: The distance sensor detects the distance between the tip of the electronic pen and the writing surface in real time; when the distance is less than or equal to a preset distance threshold, the electronic pen determines that the electronic pen is in contact with the writing surface.

[0063] In this optional implementation, a distance sensor may be provided in the tip of the electronic pen, which can detect the distance between the tip of the electronic pen and the writing surface in real time; when the distance is less than or equal to a preset distance threshold, the electronic pen may determine that the tip of the electronic pen has contacted the writing surface.

[0064] Through the above optional implementation method, the electronic pen can detect whether the electronic pen is in contact with the writing surface through a pressure sensor or a distance sensor. In this way, the electronic pen can determine whether the electronic pen is in contact with the writing surface based on specific data, thereby improving the accuracy of handwriting detection by the electronic pen.

[0065] 302. The electronic pen connects to the position coordinates of at least one first light-sensitive point to obtain target handwriting of the electronic pen in a target area.

[0066] In the embodiment of the present invention, after the electronic pen obtains the position coordinates of at least one first light-sensitive point, the position coordinates of the at least one first light-sensitive point can be connected to obtain the target handwriting of the electronic pen in the target area.

[0067] For example, Figure 4 As shown, it is assumed that the position coordinates of at least one first photosensing point include: point A (4.7, 8.2), point B (4.7, 7.3), point C (4.7, 6.6), point D (4.6, 6.0), point E (4.4, 5.1), point F (4.2, 4.4), point G (3.8, 3.7), point H (3.4, 2.9), point I (3.0, 2.0), point J (2.5, 1.0), K (4.7, 5.2), L (4.9, 4.5), M (5.2, 4.0), N (5.4, 3.2), O (5.6, 2.9), P (6.0, 2.2), Q (6.3, 1.8), R (4.8, 1.3), S (7.3, 1.1), T (8.0, 1.0). The electronic pen connects the position coordinates of the first photosensitizing point and determines that the target handwriting of the electronic pen in the target area is "person".

[0068] An embodiment of the present invention provides a handwriting detection method. An electronic pen is equipped with a DVS sensor, which includes multiple photosites. When the electronic pen contacts a writing surface and a target area within the DVS sensor's writing detection area experiences a change in light intensity, the electronic pen determines the position coordinates of at least one first photosite corresponding to the target area. The electronic pen then connects the position coordinates of the at least one first photosite to obtain the target handwriting of the electronic pen within the target area. Because the light intensity in written and unwritten areas differs during the writing process, the DVS sensor in the electronic pen can determine the photosite coordinates corresponding to the written area based on the change in light intensity, and then determine the electronic pen's handwriting based on these photosite coordinates. This handwriting detection scheme allows the electronic pen to write on any surface, and the DVS sensor in the electronic pen does not need to actively emit light. Because the DVS sensor can detect dynamic objects, even when the electronic pen and the writing surface undergo slight relative motion, the DVS sensor can detect handwriting on the writing surface based on light intensity. This simplifies the handwriting detection process and reduces the size and power consumption of the electronic pen.

[0069] As an optional implementation, after obtaining the target handwriting of the electronic pen in the target area, the electronic pen may further include the following implementation:

[0070] Implementation method 1: The electronic pen displays the target handwriting on the display screen area of the electronic pen.

[0071] In this optional implementation, a display screen area may be provided on the pen holder of the electronic pen, and a display screen may be embedded in the display screen area. In this embodiment of the present invention, after obtaining target handwriting, the electronic pen may display the target handwriting on the display screen, so that the user can see the handwriting recognized by the electronic pen through the display screen area.

[0072] Implementation method 2: The electronic pen sends the target handwriting to the terminal device associated with the electronic pen.

[0073] In this optional implementation, the electronic pen may be provided with a Bluetooth module or a wireless connection module, so that the electronic pen can connect to a terminal device via the Bluetooth module or the wireless connection module, thereby enabling interaction between the electronic pen and the terminal device. In this embodiment of the present invention, after obtaining the target handwriting, the electronic pen can send the target handwriting to the terminal device associated with the electronic pen. The terminal device can then display the target handwriting on the terminal device's display screen, allowing the user to see the handwriting recognized by the electronic pen on the terminal device's display screen.

[0074] Implementation method three: the electronic pen displays the target handwriting on the display screen area of the electronic pen, and the electronic pen sends the target handwriting to the terminal device associated with the electronic pen.

[0075] In this optional implementation, the pen holder of the electronic pen may be provided with a display screen area, in which a display screen may be embedded; the electronic pen may be provided with a Bluetooth module or a wireless connection module, so that the electronic pen can connect to a terminal device via the Bluetooth module or the wireless connection module, thereby enabling interaction between the electronic pen and the terminal device. In this embodiment of the present invention, after obtaining target handwriting, the electronic pen can display the target handwriting on the display screen area of the electronic pen and send the target handwriting to the terminal device associated with the electronic pen. After obtaining the target handwriting, the terminal device can display the target handwriting on the display screen of the terminal device, allowing the user to simultaneously see the handwriting recognized by the electronic pen on both the display screen area of the electronic pen and the display screen of the terminal device.

[0076] Through the above three optional implementation methods, after obtaining the target handwriting, the electronic pen can display the target handwriting in the display screen area of the electronic pen and / or send the target handwriting to the associated terminal device, so that the user can see the user's handwriting recognized by the electronic pen through the display screen area of the electronic pen and / or the display screen of the terminal device, which increases the ways in which the electronic pen outputs handwriting and improves the intelligence of the electronic pen.

[0077] Example 2

[0078] like Figure 5 As shown, an embodiment of the present invention provides a handwriting detection method. The embodiment of the present invention can be applied to a scenario where a user writes on a writing surface using an electronic pen. The method can also include the following steps:

[0079] 501. The electronic pen determines the position coordinates of at least one first photosensitizing point corresponding to a target area.

[0080] 502. The electronic pen activates at least one first light-sensitive point and obtains at least one activation moment of the at least one first light-sensitive point.

[0081] In an embodiment of the present invention, the electronic pen can activate at least one first photosensitive point when determining the position coordinates of at least one first photosensitive point, and simultaneously obtain the activation moment of each of the at least one first photosensitive point to obtain at least one activation moment.

[0082] It should be noted that the electronic pen can first determine the position coordinates of at least one first photosensitive point corresponding to the target area, then activate at least one first photosensitive point, and then obtain at least one activation moment of at least one first photosensitive point; the electronic pen can also first activate at least one first photosensitive point, then obtain at least one activation moment of at least one first photosensitive point, and then determine the position coordinates of at least one first photosensitive point corresponding to the target area; the electronic pen can also first determine the position coordinates of at least one first photosensitive point corresponding to the target area, activate at least one first photosensitive point, and obtain at least one activation moment of at least one first photosensitive point. The embodiments of the present invention do not make any limitations.

[0083] 503. The electronic pen connects the position coordinates of at least one first photosensitive point to obtain the target handwriting of the electronic pen within the target area.

[0084] 504. The electronic pen determines the order before and after at least one activation moment.

[0085] In the embodiments of the present invention, the electronic pen can sort at least one activation moment of at least one first photosensitive point in chronological order.

[0086] 505. The electronic pen determines the target stroke order information of the electronic pen within the target area according to the order before and after.

[0087] In the embodiments of the present invention, the electronic pen can connect the position coordinates of at least one first photosensitive point in the order before and after the activation moment, so as to obtain the target stroke order information of the electronic pen within the target area.

[0088] Exemplarily, as Figure 4 shown, the electronic pen sorts the activation moments of each photosensitive point and obtains the order before and after as: A - B - C - D - E - F - G - H - I - J - K - L - M - N - O - P - Q - R - S - T. According to this order before and after, the electronic pen can obtain that the writing trajectory of the electronic pen is first from the position corresponding to photosensitive point A to the position corresponding to photosensitive point J, and then from the position corresponding to photosensitive point K to the position corresponding to photosensitive point T, so as to obtain the stroke order information of writing "person" by the electronic pen within the target area as: first write the left slash, and then write the right slash.

[0089] 506. The electronic pen obtains the target text information corresponding to the target handwriting and the standard stroke order information corresponding to the target text information.

[0090] In the embodiments of the present invention, after obtaining the target handwriting, the electronic pen can determine the target text information corresponding to the target handwriting and obtain the standard stroke order information corresponding to the target text information from the database.

[0091] It should be noted that the standard stroke order information is determined based on the "General Standard Chinese Character Stroke Order Standard".

[0092] 507. If the target stroke order information is different from the standard stroke order information, the electronic pen sends the standard stroke order information to a terminal device associated with the electronic pen.

[0093] In an embodiment of the present invention, the electronic pen can compare the target stroke order information with the standard stroke order information. If the target stroke order information is different from the standard stroke order information, the electronic pen can send the standard stroke order information to a terminal device associated with the electronic pen. In this way, after the terminal device receives the standard stroke order information, it can display the standard stroke order information on the display screen of the terminal device and prompt the user with the standard stroke order information of the target text information corresponding to the target handwriting to correct the user's incorrect stroke order.

[0094] Optionally, the electronic pen can send the target handwriting and target stroke order information to a terminal device associated with the electronic pen, so that after the terminal device receives the target handwriting, it obtains the target text information corresponding to the target handwriting and the standard stroke order information corresponding to the target text information; and when the target stroke order information is different from the standard stroke order information, the standard stroke order information is output on the display screen of the terminal device.

[0095] Through the above optional implementation method, the electronic pen only needs to obtain the target handwriting and target stroke order information. The terminal device obtains the standard stroke order information according to the target handwriting and compares it with the target stroke order information. This can improve the interaction ability between the electronic pen and the terminal device.

[0096] An embodiment of the present invention provides a handwriting detection method. During the writing process of an electronic pen, the light intensity in the written area and the unwritten area differs. Therefore, a DVS sensor in the electronic pen can determine the coordinates of the photosites corresponding to the written area based on the change in light intensity. The electronic pen's handwriting is then determined based on these photosites. These photosites are then arranged in chronological order to obtain the stroke order information of the user's writing. The electronic pen can then calibrate the user's stroke order based on the standard stroke order information. If the electronic pen detects that the user's stroke order is incorrect, it can output the standard stroke order information. This handwriting detection scheme allows the electronic pen to write on any surface. The DVS sensor in the electronic pen does not need to actively emit light. Because the DVS sensor can detect dynamic objects, even when the electronic pen and the writing surface undergo slight relative motion, the DVS sensor can detect handwriting on the writing surface based on light intensity. This not only simplifies the handwriting detection process but also reduces the size and power consumption of the electronic pen. The electronic pen can also output the standard stroke order information to an associated terminal device, enhancing the pen's intelligence and improving the interaction between the pen and the terminal device.

[0097] As an optional implementation method, after obtaining the target handwriting of the electronic pen in the target area, it can also include: the electronic pen photographs the target area through the camera of the electronic pen to obtain a first photographed image; the electronic pen recognizes the first photographed image to obtain first text information in the first photographed image; the electronic pen obtains target text information corresponding to the target handwriting; if the first text information is different from the target text information, the electronic pen displays the first text information on the display screen area of the electronic pen, or sends the first text information to the terminal device associated with the electronic pen.

[0098] In this optional implementation, a camera may be provided on the electronic pen, and the electronic pen may obtain a first captured image of the target area through the camera; the electronic pen then performs text recognition on the first captured image of the target area to obtain first text information in the first captured image; the electronic pen may compare the first text information with the target text information. If the first text information is different from the target text information, it indicates that an error has occurred in the electronic pen's recognition of the handwriting, and the electronic pen may then output the first text information to calibrate the electronic pen's handwriting recognition.

[0099] The electronic pen outputs the first text information, which may be implemented in the following ways:

[0100] Implementation method 1: The electronic pen displays the first text information on the display screen area of the electronic pen.

[0101] In this optional implementation, a display screen area may be provided on the pen holder of the electronic pen, and a display screen may be embedded in the display screen area. In this embodiment of the present invention, after obtaining the first text information, the electronic pen may display the first text information on the display screen, so that the user can see the text information obtained by the electronic pen through the display screen area.

[0102] Implementation method 2: The electronic pen sends the first text information to a terminal device associated with the electronic pen.

[0103] In this optional implementation, the electronic pen may be provided with a Bluetooth module or a wireless connection module, so that the electronic pen can connect to a terminal device via the Bluetooth module or the wireless connection module, thereby enabling interaction between the electronic pen and the terminal device. In this embodiment of the present invention, after obtaining the first text message, the electronic pen can send the first text message to the terminal device associated with the electronic pen. The terminal device, after obtaining the first text message, can then display the first text message on the terminal device's display screen, allowing the user to view the text message obtained by the electronic pen through photo recognition on the terminal device's display screen.

[0104] Implementation Mode 3: The electronic pen displays the first text information in the display screen area of the electronic pen, and the electronic pen sends the first text information to the terminal device associated with the electronic pen.

[0105] In this optional implementation mode, a display screen area can be provided on the pen shaft of the electronic pen, and a display screen can be embedded in this display screen area; a Bluetooth module or a wireless connection module can be provided in the electronic pen, so that the electronic pen can be connected to the terminal device through this Bluetooth module or wireless connection module to realize the interaction between the electronic pen and the terminal device. In the embodiment of the present invention, after obtaining the first text information, the electronic pen can display the first text information in the display screen area of the electronic pen and send the first text information to the terminal device associated with the electronic pen. Then, after obtaining the first text information, the terminal device can display the first text information on the display screen of the terminal device, so that the user can see the text information obtained by the electronic pen through photo recognition on the display screen area of the electronic pen and the display screen of the terminal device at the same time.

[0106] Through the above three optional implementation modes, after obtaining the first text information, the electronic pen can display the first text information in the display screen area of the electronic pen, and / or send the first text information to the associated terminal device. In this way, the user can see the text information obtained by the electronic pen through photo recognition on the display screen area of the electronic pen, and / or the display screen of the terminal device. Adding steps for calibrating handwriting recognition can improve the accuracy of handwriting recognition by the electronic pen and also improve the intelligence level of the electronic pen.

[0107] As an optional implementation mode, after the electronic pen sends the standard stroke order information to the terminal device associated with the electronic pen, it can further include: the electronic pen saves the standard stroke order information and saves at least one other character in the word where the stroke order error character is located; when the electronic pen detects that the user is writing the at least one other character again, it displays the standard stroke order information in the display screen area of the electronic pen or the display screen of the terminal device associated with the electronic pen.

[0108] Exemplarily, assume that the user is writing the character "魉" in the idiom "魑魅魍魉". After detection, the electronic pen finds that the stroke order of the user writing the character "魉" is incorrect. Then the electronic pen can send the standard stroke order information of the character "魉" to the terminal device and save the standard stroke order information of the character "魉" and the idiom "魑魅魍魉". When the electronic pen detects that the user is writing "魑魅魍" again, the electronic pen speculates that the user may be about to write the character "魉". Then the electronic pen can display the standard stroke order information of the character "魉" in the display screen area of the electronic pen or the display screen of the terminal device associated with the electronic pen.

[0109] Through this optional implementation method, the electronic pen can save the words containing the characters with incorrect stroke order, and when the user writes the word again, the standard stroke order information of the characters with incorrect stroke order will be displayed. This can prompt the user with the standard stroke order information before the user writes, thereby improving the accuracy of the user's writing and the intelligence of the electronic pen.

[0110] Example 3

[0111] like Figure 6 As shown, the embodiment of the present invention provides a handwriting detection method, which can be applied to the scenario where a user uses an electronic pen to write on a writing surface, such as Figure 7 As shown, when a user uses an electronic pen 72 to write on a writing surface 71, the terminal device 21 can be set next to the writing surface 71 so that the writing surface 71 is within the depth of field of the DVS sensor 13 in the terminal device 21. The method can also include the following steps:

[0112] 601. The electronic pen determines the position coordinates of at least one first photosensitizing point corresponding to a target area.

[0113] 602. The electronic pen connects to the position coordinates of at least one first light-sensitive point to obtain target handwriting of the electronic pen in a target area.

[0114] 603. The electronic pen sends the target handwriting to a terminal device associated with the electronic pen, so that the terminal device determines the target text information corresponding to the target handwriting.

[0115] In the embodiment of the present invention, after obtaining the target handwriting, the electronic pen may send the target handwriting to a terminal device associated with the electronic pen, so that the terminal device can obtain target text information corresponding to the target handwriting after receiving the target handwriting.

[0116] Optionally, after acquiring the target text information corresponding to the target handwriting, the terminal device may save the target text information.

[0117] 604. The terminal device captures the target area through the camera of the terminal device to obtain a second captured image.

[0118] In the embodiment of the present invention, a camera is provided on the terminal device, and the terminal device can obtain the second captured image of the target area through the camera.

[0119] 605. The terminal device recognizes the second captured image to obtain second text information in the second captured image.

[0120] In the embodiment of the present invention, the terminal device may perform text recognition on the second captured image of the target area to obtain second text information in the second captured image.

[0121] 606. If the second text information is different from the target text information, the terminal device outputs the second text information.

[0122] In an embodiment of the present invention, the terminal device can compare the second text information with the target text information. If the second text information is different from the target text information, it means that there is an error in the handwriting recognition of the electronic pen. Then the terminal device can output the second text information to achieve calibration of the handwriting recognition of the electronic pen.

[0123] An embodiment of the present invention provides a handwriting detection method. When an electronic pen is writing, the light intensity in the written area and the unwritten area is different. Therefore, the DVS sensor in the electronic pen can determine the coordinates of the photosensitizing points corresponding to the written area based on the change in light intensity, and determine the handwriting of the electronic pen based on these photosensitizing point coordinates. After the electronic pen determines the handwriting, it sends the target handwriting to a terminal device. The terminal device can identify the text information written by the user using the electronic pen by taking a photo and calibrate the text information corresponding to the target handwriting sent by the electronic pen. This handwriting detection solution allows the electronic pen to write on any surface, and the DVS sensor in the electronic pen does not need to actively emit light. Since the DVS sensor can detect dynamic objects, when the electronic pen and the writing surface undergo slight relative motion, the DVS sensor can detect handwriting on the writing surface based on light intensity. This not only simplifies the handwriting detection process but also reduces the size and power consumption of the electronic pen. After obtaining handwriting, the electronic pen can also interact with the terminal device, which can take a photo of the handwriting for recognition. If the electronic pen's DVS sensor makes an error in real-time handwriting recognition, the terminal device can promptly prompt the user and output the correct text information. This improves the interaction between the electronic pen and the terminal device and increases the accuracy of handwriting recognition.

[0124] As an optional implementation method, the calibration of handwriting recognition by the electronic pen may also include: after the electronic pen obtains the target handwriting in the target area, the target light intensity of the target area can be obtained through the DVS sensor. At this time, if the difference between the target light intensity of the target area where the handwriting exists and the initial light intensity is greater than the preset difference, then the DVS sensor can obtain the position coordinates of at least one first photosensory point corresponding to the target area, and thereby obtain calibration text information composed of the calibration handwriting in the target area based on the position coordinates of the at least one first photosensory point; the electronic pen then compares the target text information corresponding to the target handwriting with the calibration text information corresponding to the calibration handwriting. If the target text information is different from the calibration text information, the calibration text information is output on the display screen area of the electronic pen.

[0125] For example, Figure 4As shown, the electronic pen determines that the target text information corresponding to the real-time recognized target handwriting is the character "人" (person). At this time, the electronic pen detects through the DVS sensor that the calibration text information is the character "乂". After detection, the electronic pen can find that "人" and "乂" are different, indicating that there is an error in the real-time handwriting detection of the electronic pen. Then, the electronic pen can display the calibration text information "乂" in the display area.

[0126] Through this optional implementation method, after the user finishes writing a sentence or a paragraph, the electronic pen can directly identify the sentence or the paragraph through the DVS sensor by comparing with the real-time recognized target handwriting, and then calibrate the text composed of the real-time recognized handwriting, which can improve the accuracy of the electronic pen in handwriting recognition.

[0127] As an optional implementation method, after the terminal device determines the target text information corresponding to the target handwriting, it may further include: the terminal device obtains a target image through the camera of the terminal device, and the target image includes the target handwriting; the terminal device obtains the question information corresponding to the target handwriting according to the target image; the terminal device obtains the standard answer information of the pre-stored question information; if the target text information corresponding to the target handwriting is different from the standard answer information, the terminal device outputs the standard answer information.

[0128] In this optional implementation method, the terminal device can perform optical character recognition on the target image to obtain the question information corresponding to the target handwriting, and compare the target text information corresponding to the real-time recognized target handwriting with the standard answer information corresponding to the question information, so as to achieve the purpose of correcting homework.

[0129] Through this optional implementation method, the terminal device can correct homework according to the handwriting recognized by the electronic pen, increasing the application scenarios of the DVS sensor in handwriting recognition and also improving the intelligence level of the electronic pen and the terminal device.

[0130] Furthermore, the electronic pen can also implement homework correction through the DVS sensor. Specifically, it may include: after the electronic pen obtains the target handwriting in the target area, it can obtain the light intensity of the writing detection area through the DVS sensor. At this time, the writing detection area includes the target handwriting and the printed handwriting; if the difference between the light intensity of the area with printed handwriting and the initial light intensity is greater than the preset difference, then the DVS sensor can obtain the position coordinates of at least one first photosensitive point corresponding to the area with printed handwriting, and thus obtain the question information composed of the printed handwriting in the writing detection area according to the position coordinates of at least one first photosensitive point; the electronic pen then obtains the standard answer information of the pre-stored question information; if the target text information corresponding to the target handwriting is different from the standard answer information, the electronic pen outputs the standard answer information.

[0131] Through this optional implementation method, the electronic pen can identify the question information corresponding to the user's target handwriting in the same way as real-time target handwriting recognition, thereby correcting homework based on the target handwriting and question information, increasing the application scenarios of handwriting recognition by the DVS sensor and improving the intelligence of the electronic pen.

[0132] Example 4

[0133] like Figure 8 As shown, an embodiment of the present invention provides a handwriting detection method. The embodiment of the present invention can also be applied to a scenario where a user writes part of the content on a writing surface with an electronic pen and then needs to continue writing at another location on the writing surface with the electronic pen. The method can also include the following steps:

[0134] 801. The electronic pen obtains the light intensity in the writing detection area through the DVS sensor multiple times.

[0135] In the embodiment of the present invention, during the non-contact movement process, the electronic pen obtains the light intensity in the writing detection area through the DVS sensor multiple times.

[0136] The writing detection area is an area on the writing plane that can be detected by the electronic pen each time the electronic pen detects the writing plane, and the non-contact movement process is a process in which the electronic pen moves from a first position on the writing plane to a second position without contact.

[0137] It should be noted that the DVS sensor may be equipped with a photosensitive chip with multiple photosites on it, which can sense changes in light intensity. The DVS sensor can also detect displacement. When the DVS sensor moves non-contact across the writing surface, the light intensity of the handwriting detected by the DVS sensor varies at different times. The DVS sensor can thus determine the displacement of the electronic pen based on the changes in the coordinates of the photosites.

[0138] Optionally, the method for the electronic pen to determine the first position and the second position may specifically include the following implementations:

[0139] Implementation method 1: The pressure sensor detects the pressure value of the tip of the electronic pen in real time, and the electronic pen can determine the first position and the second position according to the change of the pressure value.

[0140] Case 1: When the pressure sensor detects that the difference between the pressure values at the first detection moment and the second detection moment is greater than a preset pressure change threshold, and the pressure value at the first detection moment is greater than the pressure value at the second detection moment, the electronic pen can determine the position where the electronic pen contacts the writing surface at the first detection moment as the first position.

[0141] It should be noted that the first position is the position when the electronic pen and the writing surface switch from a contact state to a non-contact state, and the first detection time and the second detection time are adjacent detection times.

[0142] Furthermore, when the pressure sensor detects that the difference between the pressure values at the first detection moment and the second detection moment is greater than a preset pressure change threshold, the pressure value at the first detection moment is greater than the pressure value at the second detection moment, and the pressure value at the second detection moment is less than the preset pressure value threshold, the electronic pen can determine the position where the electronic pen contacts the writing plane at the first detection moment as the first position.

[0143] It should be noted that when the electronic pen is in contact with the writing surface, the user may hold it with greater force. In this way, even if the pressure value difference is greater than the preset pressure change threshold, it cannot be said that the electronic pen is not in contact with the writing surface at the second detection moment. Therefore, only when the pressure value difference between the first detection moment and the second detection moment is greater than the preset pressure change threshold, the pressure value at the first detection moment is greater than the pressure value at the second detection moment, and the pressure value at the second detection moment is less than the preset pressure value threshold, can it be said that the electronic pen and the writing surface have switched from the contact state to the non-contact state.

[0144] Case 2: When the pressure sensor detects that the difference between the pressure values at the third detection moment and the fourth detection moment is greater than the preset pressure change threshold, and the pressure value at the fourth detection moment is greater than the pressure value at the third detection moment, the electronic pen determines the position where the electronic pen contacts the writing surface at the fourth detection moment as the second position.

[0145] It should be noted that the second position is the position when the electronic pen and the writing surface switch from a non-contact state to a contact state, and the third detection time and the fourth detection time are adjacent detection times.

[0146] Furthermore, when the pressure sensor detects that the difference between the pressure values at the third detection moment and the fourth detection moment is greater than a preset pressure change threshold, the pressure value at the fourth detection moment is greater than the pressure value at the third detection moment, and the pressure value at the third detection moment is less than the preset pressure value threshold, the electronic pen can determine the position where the electronic pen contacts the writing plane at the fourth detection moment as the second position.

[0147] It should be noted that if the electronic pen makes very light contact with the writing surface at the third detection moment and makes very heavy contact with the writing surface at the fourth detection moment, then even if the pressure value difference is greater than the preset pressure change threshold, it cannot be said that the electronic pen and the writing surface were not in contact at the third detection moment. Therefore, only when the pressure value difference between the third and fourth detection moments is greater than the preset pressure change threshold, the pressure value at the fourth detection moment is greater than the pressure value at the third detection moment, and the pressure value at the third detection moment is less than the preset pressure value threshold, can it be said that the electronic pen and the writing surface have switched from a non-contact state to a contact state.

[0148] In this optional implementation, a pressure sensor can be provided in the tip of the electronic pen, which can detect the pressure value applied to the tip of the electronic pen in real time; when the difference between the pressure values at adjacent detection moments is greater than a preset pressure change threshold, the electronic pen can determine that the state between the electronic pen and the writing surface has changed.

[0149] Implementation method 2: The distance sensor detects the distance between the tip of the electronic pen and the writing surface in real time; the electronic pen can determine the first position and the second position according to the change of the distance.

[0150] Case 1: When the distance sensor detects that the distance difference between the first detection moment and the second detection moment is greater than a preset distance change threshold, and the distance at the first detection moment is smaller than the distance at the second detection moment, the electronic pen can determine the position where the electronic pen contacts the writing surface at the first detection moment as the first position.

[0151] It should be noted that the first position is the position when the electronic pen and the writing surface switch from a contact state to a non-contact state, and the first detection time and the second detection time are adjacent detection times.

[0152] Case 2: When the distance sensor detects that the distance difference between the third detection moment and the fourth detection moment is greater than the preset distance change threshold, and the distance at the fourth detection moment is less than the distance at the third detection moment, the electronic pen can determine the position where the electronic pen contacts the writing surface at the fourth detection moment as the second position.

[0153] It should be noted that the second position is the position when the electronic pen and the writing surface switch from a non-contact state to a contact state, and the third detection time and the fourth detection time are adjacent detection times.

[0154] In this optional implementation, a distance sensor can be provided in the tip of the electronic pen, which can detect the distance between the tip of the electronic pen and the writing surface in real time; when the distance difference between adjacent detection moments is greater than a preset distance change threshold, the electronic pen can determine that the state between the electronic pen and the writing surface has changed.

[0155] 802. The electronic pen determines the light intensity change positions acquired twice in a writing detection area to obtain multiple light intensity change positions during the non-contact movement process.

[0156] In an embodiment of the present invention, the electronic pen can sort the light intensities within the writing detection area obtained multiple times in chronological order, and compare the light intensities within the writing detection area obtained twice adjacently to determine the position of the light intensity change within the writing detection area obtained twice adjacently.

[0157] It should be noted that, during the non-contact movement process, there needs to be handwriting in the writing detection area. The handwriting can be handwriting written in advance by the user using an electronic pen, or it can be printed handwriting on a writing surface.

[0158] The number of light intensity change positions within the writing detection area obtained at any two adjacent times is at least two.

[0159] Optionally, after the electronic pen determines the position of the light intensity change within the writing detection area obtained twice adjacently, it may also include: the electronic pen determines the coordinates of the target photosensitivity points corresponding to the light intensity change position twice adjacently based on the position of the light intensity change obtained twice adjacently; and determines the coordinate change amount of the target photosensitivity points twice adjacently based on the coordinates of the target photosensitivity points twice adjacently.

[0160] For example, Figure 9 As shown, the electronic pen 72 moves non-contact from a first position to a second position on the writing surface 71, wherein the electronic pen 72 contacts the writing surface 71 at point A and point B at the first position and the second position, respectively. Figure 9 As shown in FIG. , between points A and B, a handwriting "8" is present on the writing plane 71. For example, the electronic pen moves from the position corresponding to point C to the position corresponding to point D. The DVS sensor 13 in the electronic pen 72 obtains the light intensity within the writing detection area at the third and fourth positions, as shown in FIG. Figure 10 As shown, by comparing the writing detection areas obtained by the DVS sensor at the third position and the fourth position, it can be found that the light intensities at the light intensity change position 101 and the light intensity change position 102 have both changed. Therefore, as Figure 11 As shown, the electronic pen can obtain the coordinates (5.4, 5.4) of the photosite 111 corresponding to the light intensity change position 101 in the DVS sensor, and the coordinates (4.2, 6.0) of the photosite 112 corresponding to the light intensity change position 102. Then the electronic pen can determine the coordinate change between the photosite 111 and the photosite 112 (-1.2, 0.6).

[0161] 803. The electronic pen determines a displacement between a first position and a second position according to a plurality of light intensity change positions.

[0162] In an embodiment of the present invention, the electronic pen determines the displacement between the first position and the second position based on multiple light intensity change positions, which may specifically include: the electronic pen determines the displacement between the first position and the second position based on the sum of the coordinate changes of each two adjacent target photosensitivity points.

[0163] It should be noted that the electronic pen can determine the coordinate change of the two adjacent target photosensitive points each time based on the coordinates of the two adjacent target photosensitive points; and by adding up the coordinate change each time, the coordinate change between the photosensitive point corresponding to the first position and the photosensitive point corresponding to the second position can be obtained, and then the displacement between the first position and the second position can be determined based on the correspondence between the photosensitive points and the positions.

[0164] 804. The electronic pen determines a second input cursor position corresponding to the second position based on the displacement and the first input cursor position corresponding to the first position on the associated display screen.

[0165] In the embodiment of the present invention, after the electronic pen determines the displacement from the first position to the second position, the electronic pen may determine the second input cursor position corresponding to the second position according to the first input cursor position corresponding to the first position.

[0166] Optionally, after the electronic pen determines the second input cursor position corresponding to the second position, the following optional implementation manner may be further included:

[0167] Implementation method 1: The electronic pen displays the second input cursor position on the display screen of the electronic pen.

[0168] In this optional implementation, a display screen area may be provided on the pen holder of the electronic pen, and a display screen may be embedded in the display screen area. In this embodiment of the present invention, the electronic pen may display the second input cursor position on the display screen after determining the second input cursor position.

[0169] Implementation method 2: The electronic pen displays the second input cursor position on the display screen of the terminal device associated with the electronic pen.

[0170] In this optional implementation, the electronic pen may be provided with a Bluetooth module or a wireless connection module, so that the electronic pen can connect to a terminal device via the Bluetooth module or the wireless connection module, enabling interaction between the electronic pen and the terminal device. In this embodiment of the present invention, after determining the second input cursor position, the electronic pen can send the second input cursor position to the terminal device associated with the electronic pen. The terminal device, after obtaining the second input cursor position, can then display the second input cursor position on the terminal device's display screen.

[0171] Implementation method three: the electronic pen displays the second input cursor position on both the display screen of the electronic pen and the display screen of the terminal device associated with the electronic pen.

[0172] In this optional implementation, the pen holder of the electronic pen may be provided with a display screen area, in which a display screen may be embedded; the electronic pen may be provided with a Bluetooth module or a wireless connection module, so that the electronic pen can connect to a terminal device via the Bluetooth module or the wireless connection module, enabling interaction between the electronic pen and the terminal device. In this embodiment of the present invention, after determining the second input cursor position, the electronic pen can display the second input cursor position within the display screen area of the electronic pen and send the second input cursor position to the terminal device associated with the electronic pen. After obtaining the second input cursor position, the terminal device can then display the second input cursor position on its display screen.

[0173] Through the above three optional implementation methods, after determining the second input cursor position, the electronic pen can display the second input cursor position in the display screen area of the electronic pen and / or send the second input cursor position to an associated terminal device. In this way, the user can see the position where the electronic pen has contacted the writing surface again through the display screen area of the electronic pen and / or the display screen of the terminal device, thereby improving the intelligence of the electronic pen.

[0174] 805. The electronic pen determines the position coordinates of at least one first photosensitizing point corresponding to the target area.

[0175] 806 . The electronic pen connects to the position coordinates of at least one first light-sensitive point to obtain target handwriting of the electronic pen in the target area.

[0176] An embodiment of the present invention provides a handwriting detection method. During a non-contact movement process, an electronic pen can repeatedly acquire light intensity within a writing detection area using a DVS sensor. The non-contact movement process involves contactless movement of the electronic pen from a first position on a writing surface to a second position. The electronic pen determines the position of light intensity changes within the writing detection area between two consecutive acquisitions to obtain multiple light intensity change positions during the non-contact movement process. The electronic pen then determines the displacement between the first and second positions based on the multiple light intensity change positions. The electronic pen then determines a second input cursor position corresponding to the second position based on the displacement and the first input cursor position corresponding to the first position on an associated display screen. With this solution, when a user is using the electronic pen to answer questions or take notes, and the electronic pen needs to move to write, the electronic pen can accurately determine the position of the electronic pen after leaving the writing surface and then re-contacting the writing surface. The cursor displayed on the associated display screen then moves accordingly. This allows detection of writing at different positions of the electronic pen.

[0177] This handwriting detection solution allows the electronic pen to write on any surface, and the DVS sensor in the electronic pen does not need to actively emit light. Since the DVS sensor can detect dynamic objects, when the electronic pen and the writing surface undergo slight relative motion, the DVS sensor can detect handwriting on the writing surface based on light intensity. This not only simplifies the handwriting detection process but also reduces the size and power consumption of the electronic pen. In this solution, the electronic pen can use the DVS sensor to detect handwriting on the writing surface when the electronic pen is in a suspended state, thereby determining the relationship between the position of the electronic pen when it is removed from the writing surface and the position when the electronic pen contacts the writing surface again. This avoids the situation where handwriting cannot be detected due to the electronic pen being removed from the writing surface. This is suitable for scenarios where users are using the electronic pen to answer questions or take notes, and other large-scale writing, and improves the accuracy of handwriting detection by the electronic pen.

[0178] Example 5

[0179] like Figure 12 As shown, an embodiment of the present invention provides an electronic pen, in which a DVS sensor is provided. The DVS sensor includes multiple photosensors. The electronic pen may include:

[0180] a processing module 1201 for determining position coordinates of at least one first photosensing point corresponding to a target area in a writing detection area of a DVS sensor if the electronic pen contacts a writing surface and a light intensity change occurs in the target area;

[0181] The processing module 1201 is further configured to connect the position coordinates of at least one first light-sensitive point to obtain the target handwriting of the electronic pen within the target area.

[0182] Optionally, the electronic pen further includes:

[0183] An acquisition module 1202 is configured to acquire an initial light intensity of a target area, with the DVS sensor facing the tip of the electronic pen;

[0184] The acquisition module 1202 is further used to acquire the target light intensity of the electronic pen in the target area in real time;

[0185] The processing module 1201 is specifically configured to determine that a light intensity change occurs in the target area if the difference between the target light intensity and the initial light intensity is greater than a preset difference.

[0186] Optionally, the acquisition module 1202 is specifically configured to detect the pressure value applied to the tip of the electronic pen in real time;

[0187] The processing module 1201 is specifically configured to determine that the electronic pen is in contact with the writing surface when the pressure value is greater than or equal to a preset pressure threshold.

[0188] Optionally, the processing module 1201 is further configured to, when the electronic pen determines the position coordinates of at least one first light-sensitive point corresponding to the target area, activate the at least one first light-sensitive point and obtain at least one activation time of the at least one first light-sensitive point;

[0189] The processing module 1201 is further configured to determine a sequence of at least one activation moment;

[0190] The processing module 1201 is further configured to determine target stroke order information of the electronic pen within the target area according to the front-to-back sequence;

[0191] The acquisition module 1202 is further configured to acquire target text information corresponding to the target handwriting and standard stroke order information corresponding to the target text information;

[0192] The electronic pen also includes:

[0193] The transceiver module 1203 is configured to send the standard stroke order information to a terminal device associated with the electronic pen if the target stroke order information is different from the standard stroke order information, so that the terminal device prompts the user of the standard stroke order information corresponding to the target text information.

[0194] Optionally, the processing module 1201 is further configured to capture the target area using a camera of the electronic pen to obtain a first captured image;

[0195] The processing module 1201 is further configured to recognize the first captured image to obtain first text information in the first captured image;

[0196] The acquisition module 1202 is further used to acquire target text information corresponding to the target handwriting;

[0197] The processing module 1201 is further configured to, if the first text information is different from the target text information, cause the electronic pen to display the first text information on a display screen area of the electronic pen, or to send the first text information to a terminal device associated with the electronic pen.

[0198] Optionally, the transceiver module 1203 is further configured to send the target handwriting to a terminal device associated with the electronic pen, so that the terminal device determines target text information corresponding to the target handwriting;

[0199] Optionally, the acquisition module 1202 is further configured to acquire light intensity within a writing detection area multiple times using a dynamic vision sensor (DVS) during the non-contact movement process, where the writing detection area is the area where the electronic pen detects the writing surface once. The non-contact movement process is the process of the electronic pen moving from a first position on the writing surface to a second position without contact, with the DVS sensor facing the tip of the electronic pen.

[0200] The processing module 1201 is further configured to determine the light intensity change positions within the writing detection area obtained between two adjacent times, so as to obtain multiple light intensity change positions during the non-contact movement process;

[0201] The processing module 1201 is further configured to determine a displacement between a first position and a second position according to the plurality of light intensity change positions;

[0202] The processing module 1201 is further configured to determine a second input cursor position corresponding to a second position based on the displacement and a first input cursor position corresponding to the first position on the associated display screen.

[0203] Optionally, the processing module 1201 is further configured to determine the coordinates of two adjacent target photosensitizing points corresponding to the light intensity change positions based on the light intensity change positions acquired two adjacent times;

[0204] The processing module 1201 is further configured to determine a change in the coordinates of the target light-sensitive point between two adjacent times based on the coordinates of the target light-sensitive point between two adjacent times;

[0205] The processing module 1201 is specifically configured to determine the displacement between the first position and the second position according to the sum of the coordinate changes of two adjacent target photosensitizing points.

[0206] Optionally, the processing module 1201 is further configured to detect the pressure value of the tip of the electronic pen in real time through a pressure sensor;

[0207] The processing module 1201 is further configured to, when the pressure sensor detects that the difference between the pressure values at the first detection moment and the second detection moment is greater than a preset pressure change threshold, and the pressure value at the first detection moment is greater than the pressure value at the second detection moment, determine the position at which the electronic pen contacts the writing surface at the first detection moment as a first position;

[0208] The processing module 1201 is further configured to, when the pressure sensor detects that the difference between the pressure values at the third detection moment and the fourth detection moment is greater than a preset pressure change threshold, and the pressure value at the fourth detection moment is greater than the pressure value at the third detection moment, determine the position at which the electronic pen contacts the writing surface at the fourth detection moment as the second position;

[0209] The first detection moment and the second detection moment are adjacent detection moments, and the third detection moment and the fourth detection moment are adjacent detection moments.

[0210] Optionally, the electronic pen may further include: a DVS sensor 13 .

[0211] The processing module 1201 , the acquisition module 1202 and the transceiver module 1203 may all execute the handwriting detection method performed by the electronic pen in the above-mentioned method embodiments through the DVS sensor 13 .

[0212] In the embodiment of the present invention, each module can implement the handwriting detection method provided by the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0213] like Figure 13 As shown, an embodiment of the present invention further provides an electronic pen, which may include:

[0214] A memory 1301 storing executable program code;

[0215] A processor 1302 coupled to the memory 1301;

[0216] The processor 1302 calls the executable program code stored in the memory 1301 to execute the handwriting detection method performed by the electronic pen in the above-mentioned method embodiments.

[0217] Optionally, the electronic pen may further include: a DVS sensor 13 .

[0218] The processor 1302 may execute the handwriting detection method performed by the electronic pen in the above-mentioned method embodiments through the DVS sensor 13 .

[0219] like Figure 14 As shown, an embodiment of the present invention further provides a terminal device, which may include:

[0220] The transceiver module 1401 is used to receive the target handwriting sent by the electronic pen;

[0221] The processing module 1402 is used to determine target text information corresponding to the target handwriting according to the target handwriting;

[0222] The processing module 1402 is further configured to capture the target area using a camera of the terminal device to obtain a second captured image;

[0223] The processing module 1402 is further configured to recognize the second captured image to obtain second text information in the second captured image;

[0224] The transceiver module 1401 is further configured to cause the terminal device to output the second text information if the second text information is different from the target text information.

[0225] Optionally, the terminal device further includes:

[0226] An acquisition module 1403 is configured to acquire a target image including target handwriting through a camera of a terminal device;

[0227] The acquisition module 1403 is further used to acquire the topic information corresponding to the target handwriting according to the target image;

[0228] The acquisition module 1403 is further used to obtain standard answer information of pre-stored question information;

[0229] The transceiver module 1401 is further configured to output the standard answer information if the target text information corresponding to the target handwriting is different from the standard answer information.

[0230] Optionally, the terminal device may further include: a DVS sensor 13 .

[0231] The transceiver module 1401 , the processing module 1402 and the acquisition module 1403 may all execute the handwriting detection method executed by the terminal device in the above-mentioned method embodiments through the DVS sensor 13 .

[0232] like Figure 15 As shown, the embodiment of the present invention further provides a handwriting detection system, which may include: Figure 12 Or the electronic pen shown in 13, and Figure 14 The terminal device shown.

[0233] An embodiment of the present invention provides a computer-readable storage medium storing a computer program, wherein the computer program enables a computer to execute part or all of the steps of the method in the above method embodiments.

[0234] An embodiment of the present invention further provides a computer program product, wherein when the computer program product is run on a computer, the computer is caused to execute part or all of the steps of the method in the above method embodiments.

[0235] An embodiment of the present invention further provides an application publishing platform, wherein the application publishing platform is used to publish a computer program product, wherein when the computer program product runs on a computer, the computer executes part or all of the steps of the method in the above method embodiments.

[0236] It should be understood that the references to "one embodiment" or "an embodiment" throughout this specification mean that the specific features, structures, or characteristics associated with the embodiment are included in at least one embodiment of the present invention. Therefore, the phrases "in one embodiment" or "in an embodiment" appearing throughout this specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art should also be aware that the embodiments described in this specification are all optional embodiments, and the actions and modules involved are not necessarily required for the present invention.

[0237] In various embodiments of the present invention, it should be understood that the size of the serial numbers of the above-mentioned processes does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0238] The units described above as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one place or distributed across multiple network units. Some or all of these units may be selected based on actual needs to achieve the objectives of this embodiment.

[0239] In addition, the functional units in the embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0240] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several requests for causing a computer device (which can be a personal computer, server, or network device, specifically a processor in the computer device) to execute some or all of the steps of the above-mentioned methods of various embodiments of the present invention.

[0241] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program. The program can be stored in a computer-readable storage medium, and the storage medium includes a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium capable of carrying or storing data.

Claims

1. A handwriting detection method, It is characterized in that The method comprises: If the electronic pen contacts the writing plane and a light intensity change occurs in a target area in a writing detection area of ​​a dynamic vision DVS sensor, the electronic pen determines the position coordinates of at least one first photosensing point corresponding to the target area, wherein the DVS sensor is provided in the electronic pen and includes a plurality of photosensing points; The electronic pen is connected to the position coordinates of the at least one first photosensing point to obtain the target handwriting of the electronic pen in the target area.

2. The method according to claim 1, It is characterized in that The light intensity change occurs in a target area in the writing detection area of ​​the DVS sensor, comprising: The DVS sensor acquires the initial light intensity of the target area, and the DVS sensor faces the pen tip of the electronic pen; The photosensitive circuit in the DVS sensor acquires the target light intensity of the target area in real time; If the difference between the target light intensity and the initial light intensity is greater than a preset difference, the electronic pen determines that a light intensity change occurs in the target area.

3. The method according to claim 1, It is characterized in that The tip of the electronic pen is provided with a pressure sensor, and the electronic pen contacts with a writing plane, including: The pressure sensor detects the pressure value of the tip of the electronic pen in real time; When the pressure value is greater than or equal to a preset pressure threshold, the electronic pen determines that the electronic pen is in contact with the writing plane.

4. The method according to claim 1, It is characterized in that The method further comprises: When the electronic pen determines the position coordinates of the at least one first photosensing point corresponding to the target area, the electronic pen activates the at least one first photosensing point and obtains at least one activation time of the at least one first photosensing point; The electronic pen determines the sequence of the at least one activation moment; The electronic pen determines target stroke order information of the electronic pen within the target area according to the front-to-back sequence; The electronic pen acquires target text information corresponding to the target handwriting and standard stroke order information corresponding to the target text information; If the target stroke order information is different from the standard stroke order information, the electronic pen sends the standard stroke order information to a terminal device associated with the electronic pen, so that the terminal device prompts the user of the standard stroke order information corresponding to the target text information.

5. The method according to claim 1, It is characterized in that After the electronic pen connects the position coordinates of the at least one first light-sensitive point to obtain the target handwriting of the electronic pen in the target area, the method further includes: The electronic pen photographs the target area through a camera of the electronic pen to obtain a first photographed image; The electronic pen recognizes the first photographed image to obtain first text information in the first photographed image; The electronic pen acquires target text information corresponding to the target handwriting; If the first text information is different from the target text information, the electronic pen displays the first text information on a display screen area of ​​the electronic pen, or sends the first text information to a terminal device associated with the electronic pen.

6. The method according to claim 1, It is characterized in that After the electronic pen connects the position coordinates of the at least one first light-sensitive point to obtain the target handwriting of the electronic pen in the target area, the method further includes: The electronic pen sends the target handwriting to a terminal device associated with the electronic pen, so that the terminal device determines the target text information corresponding to the target handwriting; The terminal device photographs the target area through a camera of the terminal device to obtain a second photographed image; The terminal device recognizes the second photographed image to obtain second text information in the second photographed image; If the second text information is different from the target text information, the terminal device outputs the second text information.

7. The method according to claim 6, It is characterized in that After the electronic pen sends the target handwriting to a terminal device associated with the electronic pen so that the terminal device determines the target text information corresponding to the target handwriting, the method further includes: The terminal device acquires a target image through a camera of the terminal device, wherein the target image includes the target handwriting; The terminal device acquires the topic information corresponding to the target handwriting according to the target image; The terminal device obtains the pre-stored standard answer information of the question information; If the target text information corresponding to the target handwriting is different from the standard answer information, the terminal device outputs the standard answer information.

8. The method according to claim 1, It is characterized in that The method further comprises: During the non-contact movement process, the electronic pen obtains the light intensity in the writing detection area through the DVS sensor multiple times, the writing detection area is the area when the electronic pen detects the writing plane once, and the non-contact movement process is the process of the electronic pen moving from a first position on the writing plane to a second position without contact; The electronic pen determines the light intensity change positions in the writing detection area obtained twice adjacently to obtain a plurality of light intensity change positions in the non-contact movement process; The electronic pen determines the displacement between the first position and the second position according to the multiple light intensity change positions; The electronic pen determines a second input cursor position corresponding to the second position according to the displacement and a first input cursor position corresponding to the first position on an associated display screen.

9. The method according to claim 8, It is characterized in that After determining the positions of light intensity changes in the writing detection area acquired twice adjacently, the method further includes: The electronic pen determines the coordinates of two adjacent target light-sensitive points corresponding to the light intensity change positions according to the light intensity change positions acquired two adjacent times; The electronic pen determines the coordinate change amount of the target photosensitive points for every two adjacent times according to the coordinates of the target photosensitive points for every two adjacent times; The electronic pen determines the displacement between the first position and the second position according to the multiple light intensity change positions, including: The electronic pen determines the displacement between the first position and the second position according to the sum of the coordinate change amounts of the target photosensitive points for every two adjacent times.

10. The method according to claim 8, wherein, a pressure sensor is arranged at the tip of the electronic pen, and the method further includes: the electronic pen detects the pressure value received by the tip of the electronic pen in real time through the pressure sensor; when the difference between the pressure values detected by the pressure sensor at the first detection moment and the second detection moment is greater than a preset pressure change threshold, and the pressure value at the first detection moment is greater than the pressure value at the second detection moment, the electronic pen determines the position where the electronic pen contacts the writing plane at the first detection moment as the first position; when the difference between the pressure values detected by the pressure sensor at the third detection moment and the fourth detection moment is greater than the preset pressure change threshold, and the pressure value at the fourth detection moment is greater than the pressure value at the third detection moment, the electronic pen determines the position where the electronic pen contacts the writing plane at the fourth detection moment as the second position; wherein, the first detection moment and the second detection moment are adjacent detection moments, and the third detection moment and the fourth detection moment are adjacent detection moments.

11. An electronic pen, wherein, including: a dynamic vision DVS sensor is arranged in the electronic pen, and the DVS sensor includes multiple photosensitive points; a processing module, configured to determine the position coordinates of at least one first photosensitive point corresponding to the target area if the electronic pen contacts the writing plane and the light intensity changes in the target area in the writing detection area of the DVS sensor; the processing module is further configured to connect the position coordinates of the at least one first photosensitive point to obtain the target handwriting of the electronic pen in the target area.

12. An electronic pen, wherein, including: a memory storing executable program code; and a processor coupled to the memory; the processor calls the executable program code stored in the memory to execute the handwriting detection method according to any one of claims 1 to 10.

13. A handwriting detection system, wherein, including: the electronic pen according to claim 11 or 12, and a terminal device associated with the electronic pen; the electronic pen is configured to send the target handwriting in the detected target area to the terminal device; the terminal device is configured to determine the target text information corresponding to the target handwriting; capture the target area through the camera of the terminal device to obtain a second captured image; recognize the second captured image to obtain second text information in the second captured image; if the second text information is different from the target text information, output the second text information.

14. A computer-readable storage medium, It is characterized in that include: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the handwriting detection method according to any one of claims 1 to 10 is implemented.

Images