A position determination method, electronic pen and position determination system

Abstract

The embodiment of the application discloses a position determination method, an electronic pen and a position determination system, is applied to the technical field of electronic pen, and can solve the problem of inaccurate detection of the position of the electronic pen contacting the writing plane again. The method comprises the following steps: in a non-contact movement process, the electronic pen obtains light intensity in a writing detection area through a dynamic vision sensor (DVS) multiple times, the non-contact movement process is a process that the electronic pen moves from a first position on a writing plane to a second position; the electronic pen determines a light intensity change position in the writing detection area obtained each time to obtain multiple light intensity change positions in the non-contact movement process; the electronic pen determines displacement between the first position and the second position according to the multiple light intensity change positions; and the electronic pen determines a second input cursor position corresponding to the second position according to the displacement and a first input cursor position corresponding to the first position on a display screen.

Description

Technical Field

[0001] This invention relates to the field of electronic pen technology, and more particularly to a position determination method, an electronic pen, and a position determination system. Background Technology

[0002] Currently, electronic pens are becoming increasingly widely used as electronic devices. They can be used with paper and display devices, allowing users to fully display their handwriting on the screen. During answering questions, users may need to remove the electronic pen from the writing surface, move it a short distance, and then write again at a different location. Current electronic pens continue recording handwriting from the previous position after the second stroke, failing to correlate the position of the pen being removed from the writing surface with the position of its re-contact. This results in inaccurate detection of the pen's re-contact position. Summary of the Invention

[0003] This invention provides a position determination method, an electronic pen, and a position determination system to solve the problem of inaccurate position detection when the electronic pen re-consumes the writing plane in the prior art. To solve the above technical problem, this invention is implemented as follows:

[0004] In a first aspect, a position determination method is provided, the method comprising: during a non-contact movement process, an electronic pen repeatedly acquires the light intensity within a writing detection area through a dynamic vision DVS sensor, the writing detection area being the area where the electronic pen detects the writing plane in a single instance, the non-contact movement process being the process by which the electronic pen moves non-contactly from a first position on the writing plane to a second position, and the DVS sensor being oriented toward the tip of the electronic pen;

[0005] The electronic pen determines the position of light intensity change within the writing detection area between each two adjacent acquisitions, so as to obtain multiple positions of light intensity change during the non-contact movement process;

[0006] The electronic pen determines the displacement between the first position and the second position based on the multiple light intensity change positions;

[0007] The electronic pen determines the second input cursor position corresponding to the second position based on the displacement and the first input cursor position on the associated display screen corresponding to the first position.

[0008] Secondly, an electronic pen is provided, comprising: an acquisition module for acquiring light intensity in a writing detection area multiple times via a dynamic visual DVS sensor during non-contact movement, wherein the writing detection area is the area where the electronic pen detects the writing plane in a single instance, the non-contact movement process is the process in which the electronic pen moves non-contactly from a first position on the writing plane to a second position, and the DVS sensor is oriented toward the tip of the electronic pen.

[0009] The processing module is used to determine the position of light intensity change within the writing detection area in each two adjacent acquisitions, so as to obtain multiple light intensity change positions during the non-contact movement process;

[0010] The processing module is further configured to determine the displacement between the first position and the second position based on the plurality of light intensity change positions;

[0011] The processing module is further configured to determine the second input cursor position corresponding to the second position based on the displacement and the first input cursor position on the associated display screen corresponding to the first position.

[0012] Thirdly, an electronic pen is provided, comprising:

[0013] Memory containing executable program code;

[0014] A processor coupled to the memory;

[0015] The processor calls the executable program code stored in the memory to execute the position determination method in the first aspect of the present invention.

[0016] Fourthly, a location determination system is provided, the location determination system comprising: an electronic pen as described in the second or third aspect of the embodiments of the present invention, and a terminal device associated with the electronic pen;

[0017] The electronic pen is used to send the detected handwriting within the target area to the terminal device;

[0018] The terminal device is used to determine target text information corresponding to the target handwriting; to capture the target area through the camera of the terminal device to obtain a second captured image; to recognize the second captured image to obtain second text information in the second captured image; and to output the second text information if the second text information is different from the target text information.

[0019] Fifthly, a computer-readable storage medium is provided that stores a computer program that causes a computer to execute the location determination method of the first aspect of the present invention. The computer-readable storage medium includes ROM / RAM, a magnetic disk, or an optical disk, etc.

[0020] In a sixth aspect, a computer program product is provided that, when the computer program product is run on a computer, causes the computer to perform some or all of the steps of any of the methods of the first aspect.

[0021] In a seventh aspect, an application publishing platform is provided for publishing computer program products, wherein when the computer program products are run on a computer, the computer performs some or all of the steps of any of the methods of the first aspect.

[0022] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0023] In this embodiment of the invention, during the non-contact movement process, the electronic pen can repeatedly acquire the light intensity within the writing detection area via the DVS sensor. This non-contact movement process involves the electronic pen moving non-contactly from a first position on the writing plane to a second position. The electronic pen determines the position of light intensity change within the writing detection area between each two adjacent acquisitions, thus obtaining multiple light intensity change positions during the non-contact movement process. Based on these multiple light intensity change positions, the electronic pen determines the displacement between the first and second positions. Based on the displacement and the first input cursor position corresponding to the first position on the associated display screen, the electronic pen determines the second input cursor position corresponding to the second position. Through this scheme, when a user is using the electronic pen to answer questions or take notes, requiring the pen to move, the electronic pen can accurately determine its position after leaving the writing plane and then re-contacting it. The cursor displayed on the associated display screen will then move accordingly. Thus, regardless of the distance the electronic pen moves, the cursor on the display screen will move synchronously, enabling writing detection at different positions. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 This is a schematic diagram of the structure of an electronic pen provided in an embodiment of the present invention. Figure 1 ;

[0026] Figure 2 This is a schematic diagram of the structure of a terminal device provided in an embodiment of the present invention. Figure 1 ;

[0027] Figure 3 This is a flowchart illustrating a location determination method provided in an embodiment of the present invention. Figure 1 ;

[0028] Figure 4 This is a scenario illustration of a location determination method provided in an embodiment of the present invention. Figure 1 ;

[0029] Figure 5 This is a scenario illustration of a location determination method provided in an embodiment of the present invention. Figure 2 ;

[0030] Figure 6 This is a schematic diagram of the photosensitive points corresponding to the movement process of an electronic pen provided in an embodiment of the present invention. Figure 1 ;

[0031] Figure 7 This is a flowchart illustrating a location determination method provided in an embodiment of the present invention. Figure 2 ;

[0032] Figure 8 This is a schematic diagram of the photosensitive points corresponding to the movement process of an electronic pen provided in an embodiment of the present invention. Figure 2 ;

[0033] Figure 9 This is a flowchart illustrating a location determination method provided in an embodiment of the present invention. Figure 3 ;

[0034] Figure 10 This is a flowchart illustrating a location determination method provided in an embodiment of the present invention. Figure 4 ;

[0035] Figure 11 This is a scenario illustration of a location determination method provided in an embodiment of the present invention. Figure 3 ;

[0036] Figure 12 This is a schematic diagram of the structure of an electronic pen provided in an embodiment of the present invention. Figure 2 ;

[0037] Figure 13 This is a schematic diagram of the structure of an electronic pen provided in an embodiment of the present invention. Figure 3 ;

[0038] Figure 14 This is a schematic diagram of the structure of a terminal device provided in an embodiment of the present invention. Figure 2 ;

[0039] Figure 15This is a schematic diagram of a location determination system provided in an embodiment of the present invention. Detailed Implementation

[0040] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0041] The terms "first" and "second," etc., used in the specification and claims of this invention are used to distinguish different objects, rather than to describe a specific order of objects. For example, "first position" and "second position," etc., are used to distinguish different positions, rather than to describe a specific order of positions.

[0042] The terms “comprising” and “having” and any variations thereof in this invention are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such process, method, product or device.

[0043] It should be noted that in the embodiments of the present invention, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of the present invention should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0044] In related technologies, electronic pens, as an electronic device, are increasingly widely used. Electronic pens can be used with paper and display devices, allowing users to fully display their handwriting on the display. During the process of answering questions, users may need to remove the electronic pen from the writing surface, move it a short distance, and then write again at a different location. Currently, electronic pens continue recording handwriting at the previous position after the pen is removed, failing to correlate the position of the pen being removed from the writing surface with the position of its re-contact. This results in inaccurate detection of the pen's re-contact position.

[0045] To address the aforementioned problems, this invention provides a position determination method, an electronic pen, and a position determination system. During non-contact movement, the electronic pen can repeatedly acquire light intensity within the writing detection area via a DVS sensor. This non-contact movement process involves the electronic pen moving non-contactly from a first position on the writing plane to a second position. The electronic pen determines the position of light intensity change within the writing detection area between each two adjacent acquisitions, thus obtaining multiple light intensity change positions during the non-contact movement process. Based on these multiple light intensity change positions, the electronic pen determines the displacement between the first and second positions. Based on the displacement and the position of the first input cursor on the associated display screen corresponding to the first position, the electronic pen determines the position of the second input cursor corresponding to the second position. With this solution, when a user is using the electronic pen for writing, such as answering questions or taking notes, the electronic pen can accurately determine its position after leaving the writing plane and then re-contacting it. The cursor displayed on the associated display screen will then move accordingly, ensuring that regardless of the pen's displacement, the cursor on the display screen will move synchronously, enabling writing detection at different positions.

[0046] The electronic pen described in this embodiment of the invention includes a Dynamic Vision Sensor (DVS) and a camera, with the DVS sensor facing the tip of the electronic pen. It should be noted that the camera can be integrated into the DVS sensor or it can be a separate component within the electronic pen.

[0047] For example, such as Figure 1 The diagram shown is a schematic of the electronic pen. Figure 1 In this configuration, the camera is integrated into the DVS sensor 13. The DVS sensor 13 can be positioned next to the tip 12 of the electronic pen 11, and the orientation of the DVS sensor 13 is the same as that of the tip 12 of the electronic pen 11. Figure 1 The area between the dotted lines is the range of the writing detection area that the DVS sensor 13 can detect. The angle between the two dotted lines can be set according to the needs of the electronic pen, such as 80° or 120°.

[0048] The terminal device involved in this embodiment of the invention may also include a DVS sensor and a camera, which can be located on the screen side of the terminal device. It should be noted that the camera can be integrated into the DVS sensor or it can be a separate component in the terminal device.

[0049] For example, such as Figure 2 The diagram shown is a structural schematic of the terminal device. Figure 2In this embodiment, the camera is integrated into the DVS sensor 13. The DVS sensor 13 can be set above the screen of the terminal device 21 or in other locations on the terminal device 21. This embodiment of the invention does not limit the location of the camera.

[0050] The terminal devices involved in the embodiments of the present invention can be mobile phones, tablet computers, laptops, handheld computers, ultra-mobile personal computers (UMPCs), netbooks, or personal digital assistants (PDAs) and other electronic devices.

[0051] The execution subject of the location determination method provided in this embodiment of the invention can be the aforementioned electronic pen and terminal device, or it can be a functional module and / or functional entity within the electronic pen and terminal device capable of implementing the location determination method. The specific implementation can be determined according to actual usage requirements, and this embodiment of the invention does not impose any limitations. The following uses an electronic pen and terminal device as an example to executively describe the location determination method provided in this embodiment of the invention.

[0052] Example 1

[0053] like Figure 3 As shown, an embodiment of the present invention provides a location determination method, which may include the following steps:

[0054] 301. The electronic pen repeatedly obtains the light intensity within the writing detection area through the DVS sensor.

[0055] In this embodiment of the invention, during non-contact movement, the electronic pen repeatedly obtains the light intensity within the writing detection area through the DVS sensor.

[0056] The writing detection area is the area on the writing surface that the electronic pen can detect each time it detects the writing surface. The non-contact movement process is the process by which the electronic pen moves from the first position on the writing surface to the second position without contact.

[0057] It should be noted that the DVS sensor can contain a photosensitive chip with multiple photosensitive points. These photosensitive points can be used to sense changes in light intensity. The DVS sensor can also detect displacement. When the DVS sensor moves non-contactly away from the writing surface, the light intensity of the pen strokes detected by the DVS sensor varies at different times. Therefore, the DVS sensor can determine the displacement of the electronic pen based on the changes in the coordinates of the photosensitive points.

[0058] Optionally, the method for the electronic pen to determine the first and second positions may specifically include the following implementations:

[0059] Method 1: The pressure sensor detects the pressure value on the tip of the electronic pen in real time, and the electronic pen can determine the first position and the second position based on the change in pressure value.

[0060] Scenario 1: When the pressure sensor detects that the pressure difference between the first detection time and the second detection time is greater than the preset pressure change threshold, and the pressure value at the first detection time is greater than the pressure value at the second detection time, the electronic pen can determine the position where the electronic pen contacts the writing surface at the first detection time as the first position.

[0061] It should be noted that the first position is the position when the electronic pen switches from a contact state to a non-contact state with the writing surface, and the first detection time and the second detection time are adjacent detection times.

[0062] Furthermore, when the pressure sensor detects that the pressure difference between the first detection time and the second detection time is greater than a preset pressure change threshold, the pressure value at the first detection time is greater than the pressure value at the second detection time, and the pressure value at the second detection time is less than the preset pressure threshold, the electronic pen can determine the position where the electronic pen contacts the writing surface at the first detection time as the first position.

[0063] It should be noted that during the contact between the electronic pen and the writing surface, the user may hold the pen with considerable force. In this case, even if the pressure difference is greater than the preset pressure change threshold, it cannot be concluded that the electronic pen is not in contact with the writing surface at the second detection moment. Therefore, only when the pressure difference between the first and second detection moments is greater than the preset pressure change threshold, the pressure value at the first detection moment is greater than the pressure value at the second detection moment, and the pressure value at the second detection moment is less than the preset pressure threshold, can it be concluded that the electronic pen has switched from a contact state to a non-contact state with the writing surface.

[0064] Scenario 2: When the pressure sensor detects that the pressure difference between the third and fourth detection times is greater than the preset pressure change threshold, and the pressure value at the fourth detection time is greater than the pressure value at the third detection time, the electronic pen determines the position where the electronic pen contacts the writing surface at the fourth detection time as the second position.

[0065] It should be noted that the second position is the position when the electronic pen switches from a non-contact state to a contact state with the writing surface, and the third and fourth detection times are adjacent detection times.

[0066] Furthermore, when the pressure sensor detects that the pressure difference between the third and fourth detection times is greater than a preset pressure change threshold, the pressure value at the fourth detection time is greater than the pressure value at the third detection time, and the pressure value at the third detection time is less than the preset pressure threshold, the electronic pen can determine the position where the electronic pen contacts the writing surface at the fourth detection time as the second position.

[0067] It should be noted that if the electronic pen makes very light contact with the writing surface at the third detection time and makes very heavy contact with the writing surface at the fourth detection time, even if the pressure difference is greater than the preset pressure change threshold, it cannot be said that the electronic pen was not in contact with the writing surface at the third detection time. Therefore, only when the pressure difference between the third and fourth detection times is greater than the preset pressure change threshold, the pressure value at the fourth detection time is greater than the pressure value at the third detection time, and the pressure value at the third detection time is less than the preset pressure threshold, can it be said that the electronic pen switched from a non-contact state to a contact state with the writing surface.

[0068] In this optional implementation, a pressure sensor can be installed in the tip of the electronic pen. The pressure sensor can detect the pressure value of the tip of the electronic pen in real time. When the pressure value difference between adjacent detection times is greater than a preset pressure change threshold, the electronic pen can consider that the state between the electronic pen and the writing plane has changed.

[0069] Method 2: A distance sensor detects the distance between the pen tip and the writing surface in real time; the pen can determine the first and second positions based on the changes in distance.

[0070] Scenario 1: When the distance sensor detects that the distance difference between the first detection time and the second detection time is greater than the preset distance change threshold, and the distance at the first detection time is less than the distance at the second detection time, the electronic pen can determine the position where the electronic pen contacts the writing surface at the first detection time as the first position.

[0071] It should be noted that the first position is the position when the electronic pen switches from a contact state to a non-contact state with the writing surface, and the first detection time and the second detection time are adjacent detection times.

[0072] Scenario 2: When the distance sensor detects that the distance difference between the third and fourth detection times is greater than the preset distance change threshold, and the distance at the fourth detection time is less than the distance at the third detection time, the electronic pen can determine the position where the electronic pen contacts the writing surface at the fourth detection time as the second position.

[0073] It should be noted that the second position is the position when the electronic pen switches from a non-contact state to a contact state with the writing surface, and the third and fourth detection times are adjacent detection times.

[0074] In this optional implementation, a distance sensor can be installed in the tip of the electronic pen. This distance sensor can detect the distance between the tip of the electronic pen and the writing surface in real time. When the distance difference between adjacent detection times is greater than a preset distance change threshold, the electronic pen can consider that the state between the electronic pen and the writing surface has changed.

[0075] 302. The electronic pen determines the position of light intensity change in the writing detection area between each two adjacent acquisitions, so as to obtain multiple positions of light intensity change during non-contact movement.

[0076] In this embodiment of the invention, the electronic pen can sort the light intensity of the writing detection area acquired multiple times in chronological order, and compare the light intensity of the writing detection area acquired in each two adjacent acquisitions to determine the position of the light intensity change in the writing detection area acquired in each two adjacent acquisitions.

[0077] It should be noted that during non-contact movement, handwriting must be present in the writing detection area. This handwriting can be handwriting written in advance by the user using an electronic pen, or it can be printed handwriting on the writing surface.

[0078] Among them, the number of light intensity change locations in any two adjacent writing detection areas is at least two.

[0079] Optionally, after the electronic pen determines the position of the light intensity change within each two adjacent acquisitions of the writing detection area, it may further include: the electronic pen determining the coordinates of the target photosensitive point corresponding to each two adjacent acquisitions of the light intensity change position; and determining the coordinate change amount of the target photosensitive point between each two adjacent acquisitions based on the coordinates of the target photosensitive point between each two adjacent acquisitions.

[0080] For example, such as Figure 4 As shown, the electronic pen 42 moves non-contactly from a first position to a second position on the writing plane 41, wherein the electronic pen 42 contacts the writing plane 41 at points A and B in the first and second positions, respectively. Figure 4 As shown, between points A and B, the handwriting "8" exists on the writing plane 41. Taking the movement of the electronic pen from point C to point D as an example, the DVS sensor 13 in the electronic pen 42 acquires the light intensity within the writing detection area at the third and fourth positions, respectively. Figure 5 As shown, comparing the writing detection areas acquired by the DVS sensor at the third and fourth positions reveals that the light intensity changes at both light intensity change positions 51 and 52. Therefore, as Figure 6As shown, the electronic pen can obtain the coordinates (5.4, 5.4) of the photosensitive point 61 corresponding to the light intensity change position 51 in the DVS sensor 13, and the coordinates (4.2, 6.0) of the photosensitive point 62 corresponding to the light intensity change position 52. Then the electronic pen can determine the coordinate change between the photosensitive point 61 and the photosensitive point 62 (-1.2, 0.6).

[0081] 303. The electronic pen determines the displacement between the first position and the second position based on multiple light intensity change locations.

[0082] In this embodiment of the invention, the electronic pen determines the displacement between the first position and the second position based on multiple light intensity change locations. Specifically, the electronic pen determines the displacement between the first position and the second position based on the sum of the coordinate changes of each two adjacent target photosensitive points.

[0083] It should be noted that after each pair of adjacent target photosensitive points, the electronic pen can determine the change in coordinates of those two adjacent photosensitive points; by adding up the coordinate changes each time, the coordinate change between the photosensitive point corresponding to the first position and the photosensitive point corresponding to the second position can be obtained; and based on the correspondence between the photosensitive points and positions, the displacement between the first and second positions can be determined.

[0084] 304. The electronic pen determines the position of the second input cursor corresponding to the second position based on the displacement and the position of the first input cursor on the associated display screen corresponding to the first position.

[0085] In this embodiment of the invention, after the electronic pen determines the displacement between the first position and the second position, it can determine the second input cursor position corresponding to the second position based on the first input cursor position corresponding to the first position.

[0086] Optionally, after the electronic pen determines the position of the second input cursor corresponding to the second position, the following optional implementation methods may also be included:

[0087] Method 1: The electronic pen displays the second input cursor position on the electronic pen's screen.

[0088] In this optional implementation, the pen barrel may have a display screen area, and a display screen may be embedded in this display screen area. In this embodiment of the invention, the electronic pen can display the second input cursor position on the display screen after determining the second input cursor position.

[0089] Method 2: The electronic pen displays the second input cursor position on the screen of the terminal device associated with the electronic pen.

[0090] In this optional implementation, the electronic pen can be equipped with a Bluetooth module or a wireless connection module. This allows the electronic pen to connect to a terminal device via the Bluetooth or wireless module, enabling interaction between the electronic pen and the terminal device. In this embodiment of the invention, after determining the second input cursor position, the electronic pen can send that position to the terminal device associated with it. The terminal device, upon receiving the second input cursor position, can then display it on its screen.

[0091] Method 3: The electronic pen displays the second input cursor position on both the electronic pen's display screen and the display screen of the terminal device associated with the electronic pen.

[0092] In this optional implementation, the electronic pen can have a display screen area embedded in its barrel; the electronic pen can also include a Bluetooth module or a wireless connection module, allowing it to connect to a terminal device and enable interaction between the pen and the device. In this embodiment, after determining the second input cursor position, the electronic pen displays that position on its display screen area and sends it to the associated terminal device. The terminal device, upon receiving the second input cursor position, can then display it on its own screen.

[0093] Through the three optional implementation methods described above, after determining the position of the second input cursor, the electronic pen can display the position of the second input cursor within the display area of ​​the electronic pen, and / or send the position of the second input cursor to the associated terminal device. In this way, the user can see the position where the electronic pen re-contacts the writing plane, as recognized by the electronic pen, through the display area of ​​the electronic pen, and / or the display screen of the terminal device, thereby improving the intelligence level of the electronic pen.

[0094] This invention provides a position determination method. During non-contact movement, the electronic pen can repeatedly acquire the light intensity within the writing detection area via a DVS sensor. This non-contact movement process involves the electronic pen moving non-contactly from a first position on the writing plane to a second position. The electronic pen determines the position of light intensity change within the writing detection area between each two adjacent acquisitions, thus obtaining multiple light intensity change positions during the non-contact movement process. Based on these multiple light intensity change positions, the electronic pen determines the displacement between the first and second positions. Based on the displacement and the position of the first input cursor on the associated display screen corresponding to the first position, the electronic pen determines the position of the second input cursor corresponding to the second position. With this method, when a user is using the electronic pen to answer questions or take notes, requiring the pen to move, the electronic pen can accurately determine its position after leaving the writing plane and then re-contacting it. The cursor displayed on the associated display screen will then move accordingly, ensuring that regardless of the pen's displacement, the cursor on the display screen will move synchronously, enabling writing detection at different positions.

[0095] Example 2

[0096] like Figure 7 As shown in the figure, an embodiment of the present invention provides a location determination method, which may further include the following steps:

[0097] 701. The electronic pen repeatedly obtains the light intensity within the writing detection area through the DVS sensor.

[0098] 702. The electronic pen determines the position of light intensity change in the writing detection area between each two adjacent acquisitions, so as to obtain multiple positions of light intensity change during non-contact movement.

[0099] 703. The electronic pen determines the displacement between the first position and the second position based on multiple light intensity change locations.

[0100] 704. The electronic pen determines the position of the second input cursor corresponding to the second position based on the displacement and the position of the first input cursor on the associated display screen corresponding to the first position.

[0101] 705. The electronic pen determines the position coordinates of at least one first photosensitive point corresponding to the target area.

[0102] In this embodiment of the invention, if the electronic pen comes into contact with the writing plane and a change in light intensity occurs in the target area of ​​the writing detection area of ​​the DVS sensor, then the electronic pen can determine the position coordinates of at least one first photosensitive point corresponding to the target area.

[0103] It should be noted that a photosensitive chip can be set in the DVS sensor, and multiple photosensitive points can be set on the photosensitive chip. These photosensitive points can be used to sense changes in light intensity, thereby sensing the relative motion between the object and the DVS sensor.

[0104] For example, during motion detection, the DVS sensor is generally stationary. When there is no relative motion between the object and the DVS sensor, i.e., the light intensity detected by the DVS sensor does not change, multiple photosensitive points on the photosensitive chip are in a dormant state. When there is relative motion between the object and the DVS sensor, i.e., the light intensity detected by the DVS sensor changes, the photosensitive points on the photosensitive chip corresponding to the area of ​​light intensity change are activated. Based on the positions of these activated photosensitive points, the area of ​​light intensity change is determined, i.e., the area of ​​relative motion between the object and the DVS sensor, thus obtaining the trajectory of the object's motion.

[0105] Optionally, the method for determining that a change in light intensity has occurred in the target area of ​​the writing detection area of ​​the DVS sensor may include: the DVS sensor acquiring the initial light intensity of the target area, with the DVS sensor facing the tip of the electronic pen; the photosensitive circuit in the DVS sensor acquiring the target light intensity of the electronic pen in the target area in real time; if the difference between the target light intensity and the initial light intensity is greater than a preset difference, the electronic pen determines that a change in light intensity has occurred in the target area.

[0106] In this optional implementation, the DVS sensor in the electronic pen can acquire the initial light intensity of the target area. This initial light intensity is the light intensity when the light intensity remains unchanged, that is, the light intensity of the target area detected by the DVS sensor when there is no relative movement between the pen tip and the writing surface. Then, the photosensitive circuit in the DVS sensor can detect the light intensity in the writing detection area in real time. When the photosensitive circuit detects that the difference between the target light intensity and the initial light intensity of a certain area is greater than a preset difference, it indicates that a change in light intensity has occurred in that area, meaning that the area is the target area where the pen tip and the writing surface have moved relative to each other.

[0107] The DVS sensor, being a sensor that only captures dynamic changes in a scene, is in a dormant state when all objects in the scene are stationary. When any object in the scene moves, the DVS sensor immediately activates and captures the changes in light intensity caused by the object's movement. This DVS sensor has very low requirements for data storage and computing resources, and it also has very low latency, reaching the microsecond level. Therefore, the DVS sensor can be used to detect whether a vehicle is speeding. Furthermore, the DVS sensor is highly sensitive to changes in light intensity, capturing even the smallest changes in a timely manner. Therefore, the preset difference value in this embodiment can be set relatively small, which improves the accuracy of handwriting detection by the electronic pen and reduces the latency of handwriting detection.

[0108] Optionally, the method for determining the contact between the electronic pen and the writing surface may include the following implementation methods:

[0109] Method 1: The pressure sensor detects the pressure value of the pen tip in real time; when the pressure value is greater than or equal to the preset pressure threshold, the pen determines that it is in contact with the writing surface.

[0110] In this optional implementation, a pressure sensor can be installed in the tip of the electronic pen. The pressure sensor can detect the pressure value of the tip of the electronic pen in real time. When the pressure value is greater than or equal to a preset pressure threshold, the electronic pen can consider that the tip of the electronic pen has made contact with the writing surface.

[0111] Method 2: The distance sensor detects the distance between the pen tip and the writing surface in real time; when the distance is less than or equal to a preset distance threshold, the pen determines that it is in contact with the writing surface.

[0112] In this optional implementation, the pen tip can be equipped with a distance sensor, which can detect the distance between the pen tip and the writing surface in real time; when the distance is less than or equal to a preset distance threshold, the pen can consider that the pen tip has made contact with the writing surface.

[0113] Through the above-mentioned optional implementation methods, the electronic pen can detect whether it is in contact with the writing surface using either a pressure sensor or a distance sensor. In this way, the electronic pen can determine whether it is in contact with the writing surface based on specific data, thereby improving the accuracy of handwriting detection.

[0114] 706. The electronic pen connects to the position coordinates of at least one first photosensitive point to obtain the target handwriting of the electronic pen within the target area.

[0115] In this embodiment of the invention, after the electronic pen obtains the position coordinates of at least one first photosensitive point, the position coordinates of the at least one first photosensitive point can be connected to obtain the target handwriting of the electronic pen in the target area.

[0116] For example, such as Figure 8 As shown, assume that the position coordinates of at least one first photosensitive point include: point A (4.7, 8.2), point B (4.7, 7.3), point C (4.7, 6.6), point D (4.6, 6.0), point E (4.4, 5.1), point F (4.2, 4.4), point G (3.8, 3.7), point H (3.4, 2.9), point I (3.0, 2.0), point... Points J (2.5, 1.0), K (4.7, 5.2), L (4.9, 4.5), M (5.2, 4.0), N (5.4, 3.2), O (5.6, 2.9), P (6.0, 2.2), Q (6.3, 1.8), R (4.8, 1.3), S (7.3, 1.1), and T (8.0, 1.0) are connected by the coordinates of the first photosensitive point. This connection reveals that the target handwriting within the target area is that of a "person".

[0117] This invention provides a position determination method. During non-contact movement, the electronic pen can repeatedly acquire the light intensity within the writing detection area via a DVS sensor. This non-contact movement process involves the electronic pen moving non-contactly from a first position on the writing plane to a second position. The electronic pen determines the position of light intensity change within the writing detection area between each two adjacent acquisitions, thus obtaining multiple light intensity change positions during the non-contact movement process. Based on these multiple light intensity change positions, the electronic pen determines the displacement between the first and second positions. Based on the displacement and the position of the first input cursor on the associated display screen corresponding to the first position, the electronic pen determines the position of the second input cursor corresponding to the second position. With this method, when a user is using the electronic pen to answer questions or take notes, requiring the pen to move, the electronic pen can accurately determine its position after leaving the writing plane and then re-contacting it. The cursor displayed on the associated display screen will then move accordingly, ensuring that regardless of the pen's displacement, the cursor on the display screen will move synchronously, enabling writing detection at different positions.

[0118] Furthermore, in this embodiment of the invention, if the electronic pen contacts the writing surface and a change in light intensity occurs in the target area of ​​the writing detection area of ​​the DVS sensor, the electronic pen determines the position coordinates of at least one first photosensitive point corresponding to the target area; the electronic pen connects the position coordinates of at least one first photosensitive point to obtain the target handwriting within the target area. Since the light intensity differs between the written and unwritten areas during writing, the DVS sensor in the electronic pen can determine the coordinates of the photosensitive points corresponding to the written area based on the change in light intensity, and determine the handwriting based on these photosensitive point coordinates. By detecting handwriting in this way, the electronic pen can write on any plane, and the DVS sensor in the electronic pen does not need to actively emit light. Because the DVS sensor can detect dynamic objects, when the electronic pen undergoes a slight relative movement with the writing surface, the DVS sensor can detect the handwriting on the writing surface based on the light intensity. This not only simplifies the handwriting detection process but also reduces the size and power consumption of the electronic pen.

[0119] As an optional implementation, after obtaining the target handwriting within the target area, the electronic pen can also include the following implementation methods:

[0120] Method 1: The electronic pen displays the target handwriting at the second input cursor position on the electronic pen's display screen.

[0121] In this optional implementation, the pen barrel may have a display screen area, and a display screen may be embedded in this display screen area. In this embodiment of the invention, after obtaining the target handwriting, the electronic pen can display the target handwriting at the second input cursor position on the electronic pen's display screen, thereby allowing the user to see the handwriting recognized by the electronic pen through the display screen area.

[0122] Method 2: The electronic pen displays the target handwriting at the second input cursor position on the display screen of the terminal device associated with the electronic pen.

[0123] In this optional implementation, the electronic pen can be equipped with a Bluetooth module or a wireless connection module. This allows the electronic pen to connect to a terminal device via the Bluetooth or wireless module, enabling interaction between the electronic pen and the terminal device. In this embodiment of the invention, after obtaining the target handwriting, the electronic pen can send the target handwriting to the terminal device associated with it. Upon receiving the target handwriting, the terminal device can display the target handwriting at the second input cursor position on its display screen, allowing the user to see the handwriting recognized by the electronic pen on the terminal device's display screen.

[0124] Method 3: The target handwriting is displayed at the second input cursor position on the electronic pen's screen and at the second input cursor position on the screen of the terminal device associated with the electronic pen.

[0125] In this optional implementation, the electronic pen can have a display screen area on its barrel, and a display screen can be embedded in this area. The electronic pen can also include a Bluetooth module or a wireless connection module, allowing it to connect to a terminal device and enable interaction between the pen and the device. In this embodiment, after obtaining the target handwriting, the electronic pen can display the target handwriting at the second input cursor position on its display screen and send it to the terminal device associated with the pen. Upon receiving the target handwriting, the terminal device can then display it at the second input cursor position on its display screen, allowing the user to simultaneously see the handwriting recognized by the electronic pen on both the pen's display screen and the terminal device's display screen.

[0126] Through the three optional implementation methods described above, after obtaining the target handwriting, the electronic pen can display the target handwriting on the display screen area of ​​the electronic pen, and / or send the target handwriting to the associated terminal device. In this way, the user can see the handwriting recognized by the electronic pen through the display screen area of ​​the electronic pen, and / or the display screen of the terminal device, which increases the ways in which the electronic pen outputs handwriting and improves the intelligence level of the electronic pen.

[0127] Example 3

[0128] like Figure 9 As shown in the figure, an embodiment of the present invention provides a location determination method, which may further include the following steps:

[0129] 901. The electronic pen repeatedly obtains the light intensity within the writing detection area through the DVS sensor.

[0130] 902. The electronic pen determines the position of light intensity change within the writing detection area between each two adjacent acquisitions, so as to obtain multiple positions of light intensity change during non-contact movement.

[0131] 903. The electronic pen determines the displacement between the first position and the second position based on multiple light intensity change locations.

[0132] 904. The electronic pen determines the position of the second input cursor corresponding to the second position based on the displacement and the position of the first input cursor on the associated display screen corresponding to the first position.

[0133] 905. The electronic pen determines the position coordinates of at least one first photosensitive point corresponding to the target area.

[0134] 906. The electronic pen activates at least one first photosensitive point, and acquires at least one activation moment of the at least one first photosensitive point.

[0135] In the embodiment of the present invention, when determining the position coordinates of at least one first photosensitive point, the electronic pen may activate the at least one first photosensitive point, and simultaneously acquire the activation moment of each first photosensitive point in the at least one first photosensitive point, so as to obtain at least one activation moment.

[0136] It should be noted that the electronic pen may first determine the position coordinates of the at least one first photosensitive point corresponding to the target area, then activate the at least one first photosensitive point, and then acquire at least one activation moment of the at least one first photosensitive point; the electronic pen may also first activate the at least one first photosensitive point, then acquire at least one activation moment of the at least one first photosensitive point, and then determine the position coordinates of the at least one first photosensitive point corresponding to the target area; the electronic pen may also determine the position coordinates of the at least one first photosensitive point corresponding to the target area, activate the at least one first photosensitive point, and acquire at least one activation moment of the at least one first photosensitive point simultaneously. The embodiment of the present invention imposes no specific limitation on this.

[0137] 907. The electronic pen connects the position coordinates of the at least one first photosensitive point to obtain a target handwriting trace of the electronic pen within the target area.

[0138] 908. The electronic pen determines the chronological order of the at least one activation moment.

[0139] In the embodiment of the present invention, the electronic pen may sort the at least one activation moment of the at least one first photosensitive point in chronological order.

[0140] 909. The electronic pen determines the target stroke order information of the electronic pen within the target area according to the chronological order.

[0141] In the embodiment of the present invention, the electronic pen may connect the position coordinates of the at least one first photosensitive point in the chronological order of the activation moments, so as to obtain the target stroke order information of the electronic pen within the target area.

[0142] For example, as Figure 8 shown, the electronic pen sorts the activation moments of each photosensitive point, and obtains the chronological order as: A-B-C-D-E-F-G-H-I-J-K-L-M-N-O-P-Q-R-S-T. According to this chronological order, the electronic pen can obtain that the writing trajectory of the electronic pen is first from the position corresponding to photosensitive point A to the position corresponding to photosensitive point J, and then from the position corresponding to photosensitive point K to the position corresponding to photosensitive point T, so as to obtain the stroke order information for the electronic pen to write the Chinese character "ren" (person) in the target area as: first write the left-falling stroke on the left, then write the right-falling stroke on the right.

[0143] 910. The electronic pen acquires the target text information corresponding to the target handwriting, as well as the standard stroke order information corresponding to the target text information.

[0144] In this embodiment of the invention, after obtaining the target handwriting, the electronic pen can determine the target text information corresponding to the target handwriting and retrieve the standard stroke order information corresponding to the target text information from the database.

[0145] It should be noted that this standard stroke order information is determined according to the "General Standard Chinese Character Stroke Order Standard".

[0146] 911. If the target stroke order information is different from the standard stroke order information, the electronic pen will send the standard stroke order information to the terminal device associated with the electronic pen.

[0147] In this embodiment of the invention, the electronic pen can compare the target stroke order information with the standard stroke order information. If the target stroke order information is different from the standard stroke order information, the electronic pen can send the standard stroke order information to the terminal device associated with the electronic pen. After the terminal device receives the standard stroke order information, it can display the standard stroke order information on the terminal device's display screen and prompt the user with the standard stroke order information of the target text information corresponding to the target handwriting, so as to correct the user's incorrect stroke order.

[0148] Optionally, the electronic pen can send the target handwriting and target stroke order information to a terminal device associated with the electronic pen, so that after receiving the target handwriting, the terminal device can obtain the target text information corresponding to the target handwriting and the standard stroke order information corresponding to the target text information; and if the target stroke order information and the standard stroke order information are different, the standard stroke order information can be output on the display screen of the terminal device.

[0149] With the above optional implementation methods, the electronic pen only needs to obtain the target handwriting and target stroke order information. The terminal device obtains the standard stroke order information based on the target handwriting and compares it with the target stroke order information, which can improve the interaction capability between the electronic pen and the terminal device.

[0150] This invention provides a position determination method. During non-contact movement, the electronic pen can repeatedly acquire the light intensity within the writing detection area via a DVS sensor. This non-contact movement process involves the electronic pen moving non-contactly from a first position on the writing plane to a second position. The electronic pen determines the position of light intensity change within the writing detection area between each two adjacent acquisitions, thus obtaining multiple light intensity change positions during the non-contact movement process. Based on these multiple light intensity change positions, the electronic pen determines the displacement between the first and second positions. Based on the displacement and the position of the first input cursor on the associated display screen corresponding to the first position, the electronic pen determines the position of the second input cursor corresponding to the second position. With this method, when a user is using the electronic pen to answer questions or take notes, requiring the pen to move, the electronic pen can accurately determine its position after leaving the writing plane and then re-contacting it. The cursor displayed on the associated display screen will then move accordingly, ensuring that regardless of the pen's displacement, the cursor on the display screen will move synchronously, enabling writing detection at different positions.

[0151] Furthermore, in this embodiment of the invention, the light intensity of the written area and the unwritten area are different during the writing process. Therefore, the DVS sensor in the electronic pen can determine the coordinates of the photosensitive points corresponding to the written area based on the changes in light intensity, and determine the pen's handwriting based on these photosensitive point coordinates. By arranging these photosensitive point coordinates in chronological order, the stroke order information of the user's writing can be obtained. The electronic pen can calibrate the user's writing stroke order based on the standard stroke order information. If the electronic pen detects that the user's writing stroke order is incorrect, it can output the standard stroke order information. Through this handwriting detection scheme, the electronic pen can write on any plane, and the DVS sensor in the electronic pen does not need to actively emit light. Since the DVS sensor can detect dynamic objects, when the electronic pen and the writing plane undergo slight relative movement, the DVS sensor can detect the handwriting on the writing plane based on light intensity. This not only simplifies the handwriting detection process but also reduces the size and power consumption of the electronic pen. The electronic pen can also output standard stroke order information to associated terminal devices, improving the intelligence of the electronic pen and enhancing the interaction capabilities between the electronic pen and the terminal device.

[0152] As an optional implementation, after obtaining the target handwriting in the target area by the electronic pen, the method may further include: the electronic pen taking a picture of the target area through its camera to obtain a first captured image; the electronic pen recognizing the first captured image to obtain first text information in the first captured image; the electronic pen acquiring target text information corresponding to the target handwriting; if the first text information is different from the target text information, the electronic pen displays the first text information on its display screen area, or sends the first text information to a terminal device associated with the electronic pen.

[0153] In this optional implementation, the electronic pen can be equipped with a camera, which can capture a first image of the target area. The electronic pen then performs text recognition on the first image of the target area to obtain the first text information in the first image. The electronic pen can compare the first text information with the target text information. If the first text information is different from the target text information, it means that the electronic pen has made a mistake in recognizing the handwriting. Then the electronic pen can output the first text information to calibrate the handwriting recognition of the electronic pen.

[0154] The electronic pen outputs the first text information, which can be implemented in the following ways:

[0155] Method 1: The electronic pen displays the first text information at the second input cursor position on the electronic pen's display screen.

[0156] In this optional implementation, the pen barrel can be provided with a display screen area, and a display screen can be embedded in this display screen area. In this embodiment of the invention, after obtaining the first text information, the electronic pen can display the first text information at the second input cursor position on the electronic pen's display screen, so that the user can see the text information obtained by the electronic pen through photo recognition through the display screen area.

[0157] Method 2: The electronic pen displays the first text information at the second input cursor position on the display screen of the terminal device associated with the electronic pen.

[0158] In this optional implementation, the electronic pen can be equipped with a Bluetooth module or a wireless connection module. This allows the electronic pen to connect to a terminal device via the Bluetooth or wireless module, enabling interaction between the electronic pen and the terminal device. In this embodiment of the invention, after receiving the first text information, the electronic pen sends it to the terminal device associated with it. Upon receiving the first text information, the terminal device displays it at the second input cursor position on its screen, allowing the user to see the text information obtained by the electronic pen through image recognition on the terminal device's screen.

[0159] Implementation Mode 3: The electronic pen displays first text information at a second input cursor position on the display screen of the electronic pen and at a second input cursor position on the display screen of a terminal device associated with the electronic pen.

[0160] In this optional implementation, a display screen area may be disposed on the pen barrel of the electronic pen, and a display screen may be embedded in the display screen area; a Bluetooth module or a wireless connection module may be disposed in the electronic pen, so that the electronic pen can connect to the terminal device through the Bluetooth module or the wireless connection module to realize interaction between the electronic pen and the terminal device. In the embodiments of the present invention, after obtaining the first text information, the electronic pen may display the first text information at the second input cursor position on the display screen of the electronic pen, and send the first text information to the terminal device associated with the electronic pen, so that after obtaining the first text information, the terminal device may display the first text information at the second input cursor position on the display screen of the terminal device, enabling the user to view the text information obtained by the electronic pen through photographing and recognition via both the display screen area of the electronic pen and the display screen of the terminal device simultaneously.

[0161] Through the above three optional implementation modes, after obtaining the first text information, the electronic pen may display the first text information in the display screen area of the electronic pen, and / or send the first text information to the associated terminal device, so that the user can view the text information obtained by the electronic pen through photographing and recognition via the display screen area of the electronic pen, and / or the display screen of the terminal device. Adding the step of calibrating handwriting recognition can improve the accuracy of handwriting recognition performed by the electronic pen, and also enhance the intelligence level of the electronic pen.

[0162] As an optional implementation, after the electronic pen sends standard stroke order information to the terminal device associated with the electronic pen, the method may further include: the electronic pen stores the standard stroke order information, and stores at least one other character in the word containing the character with incorrect stroke order; when the electronic pen detects again that the user is writing the at least one other character, the electronic pen displays the standard stroke order information at the second input cursor position on the display screen of the electronic pen.

[0163] For example, assume that the user is writing the character "魉" in the idiom "魑魅魍魉", and the electronic pen detects that the stroke order of the character "魉" written by the user is incorrect. In this case, the electronic pen may send the standard stroke order information of the character "魉" to the terminal device, and store the standard stroke order information of the character "魉" as well as the idiom "魑魅魍魉". When the electronic pen detects again that the user is writing "魑魅魍", the electronic pen infers that the user may intend to write the character "魉", and then the electronic pen may display the standard stroke order information of the character "魉" at the second input cursor position on the display screen of the electronic pen.

[0164] With this optional implementation, the electronic pen can save the word containing the incorrect stroke order and display the standard stroke order information of the incorrect stroke order when the user writes the word again. This can prompt the user with the standard stroke order information before writing, improve the accuracy of the user's writing, and also improve the intelligence of the electronic pen.

[0165] Example 4

[0166] like Figure 10 As shown, this embodiment of the invention provides a location determination method, such as... Figure 11 As shown, when a user writes on the writing plane 41 using the electronic pen 42, the terminal device 21 can be positioned next to the writing plane 41 so that the writing plane 41 is within the depth range of the DVS sensor 13 in the terminal device 21; the method may also include the following steps:

[0167] 1001. The electronic pen repeatedly obtains the light intensity within the writing detection area through the DVS sensor.

[0168] 1002. The electronic pen determines the position of light intensity change in the writing detection area between each two adjacent acquisitions, so as to obtain multiple positions of light intensity change during non-contact movement.

[0169] 1003. The electronic pen determines the displacement between the first position and the second position based on multiple light intensity change locations.

[0170] 1004. The electronic pen determines the position of the second input cursor corresponding to the second position based on the displacement and the position of the first input cursor on the associated display screen corresponding to the first position.

[0171] 1005. The electronic pen determines the position coordinates of at least one first photosensitive point corresponding to the target area.

[0172] 1006. The electronic pen connects to the position coordinates of at least one first photosensitive point to obtain the target handwriting of the electronic pen within the target area.

[0173] 1007. The electronic pen sends the target handwriting to the terminal device associated with the electronic pen, so that the terminal device can determine the target text information corresponding to the target handwriting.

[0174] In this embodiment of the invention, after obtaining the target handwriting, the electronic pen can send the target handwriting to the terminal device associated with the electronic pen, so that the terminal device can obtain the target text information corresponding to the target handwriting after receiving the target handwriting.

[0175] 1008. The terminal device uses its camera to capture images of the target area to obtain a second captured image.

[0176] In this embodiment of the invention, a camera is provided on the terminal device, and the terminal device can acquire a second captured image of the target area through the camera.

[0177] 1009. The terminal device recognizes the second captured image to obtain the second text information in the second captured image.

[0178] In this embodiment of the invention, the terminal device can perform text recognition on the second captured image of the target area to obtain the second text information in the second captured image.

[0179] 1010. If the second text information is different from the target text information, the terminal device outputs the second text information.

[0180] In this embodiment of the invention, the terminal device can compare the second text information with the target text information. If the second text information is different from the target text information, it indicates that the electronic pen has made a mistake in recognizing the handwriting. Then the terminal device can output the second text information to calibrate the handwriting recognition of the electronic pen.

[0181] This invention provides a position determination method. During non-contact movement, the electronic pen can repeatedly acquire the light intensity within the writing detection area via a DVS sensor. This non-contact movement process involves the electronic pen moving non-contactly from a first position on the writing plane to a second position. The electronic pen determines the position of light intensity change within the writing detection area between each two adjacent acquisitions, thus obtaining multiple light intensity change positions during the non-contact movement process. Based on these multiple light intensity change positions, the electronic pen determines the displacement between the first and second positions. Based on the displacement and the position of the first input cursor on the associated display screen corresponding to the first position, the electronic pen determines the position of the second input cursor corresponding to the second position. With this method, when a user is using the electronic pen to answer questions or take notes, requiring the pen to move, the electronic pen can accurately determine its position after leaving the writing plane and then re-contacting it. The cursor displayed on the associated display screen will then move accordingly, ensuring that regardless of the pen's displacement, the cursor on the display screen will move synchronously, enabling writing detection at different positions.

[0182] Furthermore, in the embodiments of the present invention, during the writing process of the electronic pen, the light intensity of the written area is different from that of the unwritten area. Therefore, the DVS sensor in the electronic pen can determine the coordinates of the photosensitive points corresponding to the written area according to the change of light intensity, and determine the handwriting of the electronic pen according to these coordinates of the photosensitive points; after determining the handwriting, the electronic pen transmits the target handwriting to the terminal device, and the terminal device can identify the text information written by the user with the electronic pen through photographing, so as to calibrate the text information corresponding to the target handwriting transmitted by the electronic pen. By detecting handwriting through this solution, the electronic pen can write on any plane, and the DVS sensor in the electronic pen does not need to actively emit light. Since the DVS sensor can detect dynamic objects, when a slight relative motion occurs between the electronic pen and the writing plane, the DVS sensor can detect the handwriting on the writing plane according to the light intensity. This not only simplifies the handwriting detection process, but also reduces the volume and power consumption of the electronic pen; after obtaining the handwriting, interaction with the terminal device can also be performed, and the terminal device performs photographing and recognition on the written handwriting. If the DVS sensor of the electronic pen makes a mistake in real-time handwriting recognition, the terminal device can promptly prompt the user and output correct text information, which can improve the interaction capability between the electronic pen and the terminal device, and improve the accuracy of the electronic pen in recognizing handwriting.

[0183] As an optional implementation, the calibration of handwriting recognition by the electronic pen may further include: after the electronic pen obtains the target handwriting in the target area, the DVS sensor may be used to acquire the target light intensity of the target area. At this time, the difference between the target light intensity of the target area where the handwriting exists and the initial light intensity is greater than a preset difference, then the DVS sensor may acquire the position coordinates of at least one first photosensitive point corresponding to the target area, so as to obtain the calibrated text information composed of the calibrated handwriting in the target area according to the position coordinates of the at least one first photosensitive point; the electronic pen then compares the target text information corresponding to the target handwriting with the calibrated text information corresponding to the calibrated handwriting, and if the target text information is different from the calibrated text information, the calibrated text information is displayed at the second input cursor position on the display screen of the electronic pen.

[0184] For example, as shown in Figure 8 , the electronic pen determines that the target text information is the Chinese character "ren" (person) according to the target handwriting recognized in real time; at this time, the electronic pen detects that the calibrated text information is the Chinese character "yi" (the radical representing cross), and the electronic pen may detect that "ren" is different from "yi", which indicates that the electronic pen has made an error in real-time handwriting detection, so the electronic pen may display the calibrated text information "yi" at the second input cursor position on the display screen of the electronic pen.

[0185] With this optional implementation, the electronic pen can directly identify a sentence or paragraph after the user has written it down using the DVS sensor by comparing it with the real-time target handwriting. Then, it can calibrate the text composed of the real-time identified handwriting, thereby improving the accuracy of handwriting recognition by the electronic pen.

[0186] As an optional implementation, after the terminal device determines the target text information corresponding to the target handwriting, it may further include: the terminal device acquiring a target image through its camera, the target image including the target handwriting; the terminal device acquiring question information corresponding to the target handwriting based on the target image; the terminal device acquiring standard answer information from pre-stored question information; and if the target text information corresponding to the target handwriting is different from the standard answer information, the terminal device outputting the standard answer information.

[0187] In this optional implementation, the terminal device can perform text recognition on the target image to obtain the question information corresponding to the target handwriting, and compare the target text information corresponding to the target handwriting recognized in real time with the standard answer information corresponding to the question information to achieve the purpose of grading homework.

[0188] With this optional implementation, the terminal device can correct assignments based on the handwriting recognized by the electronic pen, which increases the application scenarios of handwriting recognition by the DVS sensor and improves the intelligence of the electronic pen and the terminal device.

[0189] Furthermore, the electronic pen can also perform homework correction via a DVS sensor. Specifically, this can include: after the electronic pen obtains the target handwriting within the target area, it can use the DVS sensor to acquire the light intensity of the writing detection area, which includes both the target handwriting and printed handwriting; if the difference between the light intensity of the area containing printed handwriting and the initial light intensity is greater than a preset difference, the DVS sensor can acquire the position coordinates of at least one first photosensitive point corresponding to the area containing printed handwriting, and thus obtain the question information composed of printed handwriting within the writing detection area based on the position coordinates of at least one first photosensitive point; the electronic pen then acquires the standard answer information of the pre-stored question information; if the target text information corresponding to the target handwriting differs from the standard answer information, the electronic pen outputs the standard answer information.

[0190] With this optional implementation, the electronic pen can identify the question information corresponding to the user's target handwriting in the same way as real-time target handwriting recognition, thereby grading homework based on the target handwriting and question information. This increases the application scenarios of handwriting recognition using DVS sensors and also improves the intelligence level of the electronic pen.

[0191] Example 5

[0192] like Figure 12 As shown, an embodiment of the present invention provides an electronic pen, which includes:

[0193] The acquisition module 1201 is used to acquire the light intensity in the writing detection area multiple times through the dynamic vision DVS sensor during the non-contact movement process. The writing detection area is the area when the electronic pen detects the writing plane once. The non-contact movement process is the process of the electronic pen moving from the first position on the writing plane to the second position without contact. The DVS sensor is oriented towards the tip of the electronic pen.

[0194] The processing module 1202 is used to determine the position of light intensity change in the writing detection area between each two adjacent acquisitions, so as to obtain multiple positions of light intensity change during non-contact movement.

[0195] The processing module 1202 is also used to determine the displacement between the first position and the second position based on multiple light intensity change positions;

[0196] The processing module 1202 is also used to determine the second input cursor position corresponding to the second position based on the displacement and the first input cursor position on the associated display screen corresponding to the first position.

[0197] Optionally, the processing module 1202 is further configured to determine the coordinates of the target photosensitive point corresponding to each of the two adjacent light intensity change positions based on each of the two adjacent light intensity change positions acquired.

[0198] The processing module 1202 is also used to determine the amount of coordinate change of the target photosensitive point between each two adjacent coordinates based on the coordinates of the target photosensitive point between each two adjacent coordinates;

[0199] The processing module 1202 is specifically used to determine the displacement between the first position and the second position based on the sum of the coordinate changes of each two adjacent target photosensitive points.

[0200] Optionally, the processing module 1202 is also used to detect the pressure value of the pen tip in real time via a pressure sensor;

[0201] The processing module 1202 is further configured to determine the position where the electronic pen contacts the writing surface at the first detection time as the first position when the pressure sensor detects that the pressure difference between the first detection time and the second detection time is greater than a preset pressure change threshold, and the pressure value at the first detection time is greater than the pressure value at the second detection time.

[0202] The processing module 1202 is also used to determine the position where the electronic pen contacts the writing surface at the fourth detection time as the second position when the pressure sensor detects that the pressure difference between the third detection time and the fourth detection time is greater than the preset pressure change threshold, and the pressure value at the fourth detection time is greater than the pressure value at the third detection time.

[0203] Among them, the first detection time and the second detection time are adjacent detection times, and the third detection time and the fourth detection time are adjacent detection times.

[0204] Optionally, the electronic pen also includes:

[0205] Output module 1203 is used to display the position of the second input cursor on the display screen of the electronic pen;

[0206] or,

[0207] The output module 1203 is also used to display the position of a second input cursor on the display screen of a terminal device associated with the electronic pen.

[0208] Optionally, the processing module 1202 is further configured to determine the position coordinates of at least one first photosensitive point corresponding to the target area if the DVS sensor detects a change in light intensity in the target area of ​​the writing detection area.

[0209] The processing module 1202 is also used to connect the position coordinates of at least one first photosensitive point to obtain the target handwriting of the electronic pen in the target area.

[0210] Optionally, the acquisition module 1201 is specifically used to acquire the initial light intensity of the target area;

[0211] The acquisition module 1201 is specifically used to acquire the target light intensity of the target area in real time.

[0212] The processing module 1202 is specifically used to determine that a change in light intensity has occurred in the target area if the difference between the target light intensity and the initial light intensity is greater than a preset difference.

[0213] Optionally, the processing module 1202 is further configured to activate at least one first photosensitive point and acquire at least one activation moment of the at least one first photosensitive point when the electronic pen determines the position coordinates of at least one first photosensitive point corresponding to the target area.

[0214] The processing module 1202 is also used to determine the sequential order of at least one activation moment;

[0215] The processing module 1202 is also used to determine the target stroke order information of the electronic pen in the target area according to the previous and next order;

[0216] The acquisition module 1201 is also used to acquire target text information corresponding to the target handwriting, and standard stroke order information corresponding to the target text information;

[0217] The output module 1203 is also used to send the standard stroke order information to the terminal device associated with the electronic pen if the target stroke order information is different from the standard stroke order information, so that the terminal device can prompt the user for the standard stroke order information corresponding to the target text information.

[0218] Optionally, the output module 1203 is also used to display the target handwriting at a second input cursor position on the display screen of the electronic pen;

[0219] or,

[0220] The output module 1203 is also used to display the target handwriting at a second input cursor position on the display screen of a terminal device associated with the electronic pen.

[0221] Optionally, the processing module 1202 is also used to capture the target area through the camera of the electronic pen to obtain a first captured image;

[0222] The processing module 1202 is also used to recognize the first captured image to obtain the first text information in the first captured image;

[0223] The acquisition module 1201 is also used to acquire target text information corresponding to the target handwriting;

[0224] The output module 1203 is further configured to display the first text information on the display screen of the electronic pen, or display the first text information on the display screen of the terminal device associated with the electronic pen, if the first text information is different from the target text information.

[0225] Optionally, the output module 1203 is also used to send the target handwriting to a terminal device associated with the electronic pen, so that the terminal device can determine the target text information corresponding to the target handwriting.

[0226] Optionally, the electronic pen may also include: a DVS sensor 13.

[0227] In this embodiment, the acquisition module 1201, the processing module 1202, and the output module 1203 can all execute the position determination method performed by the electronic pen in the above method embodiments through the DVS sensor 13.

[0228] In this embodiment of the invention, each module can implement the location determination method provided in the above method embodiments and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0229] like Figure 13 As shown, this embodiment of the invention also provides an electronic pen, which may include:

[0230] Memory 1301 storing executable program code;

[0231] Processor 1302 coupled to memory 1301;

[0232] Specifically, the processor 1302 calls the executable program code stored in the memory 1301 to execute the position determination method performed by the electronic pen in the above method embodiments.

[0233] Optionally, the electronic pen may also include: a DVS sensor 13.

[0234] The processor 1302 can execute the position determination method performed by the electronic pen in the above-described method embodiments through the DVS sensor 13.

[0235] like Figure 14 As shown, embodiments of the present invention also provide a terminal device, which may include:

[0236] The transceiver module 1401 is used to receive the target handwriting sent by the electronic pen;

[0237] Processing module 1402 is used to determine the target text information corresponding to the target handwriting based on the target handwriting.

[0238] The processing module 1402 is also used to capture a target area through the camera of the terminal device to obtain a second captured image;

[0239] The processing module 1402 is also used to recognize the second captured image to obtain the second text information in the second captured image;

[0240] The transceiver module 1401 is also used to output the second text information if the second text information is different from the target text information.

[0241] Optionally, the terminal device may also include:

[0242] The acquisition module 1403 is used to acquire a target image through the camera of the terminal device, the target image including the target handwriting;

[0243] The acquisition module 1403 is also used to acquire question information corresponding to the target handwriting based on the target image;

[0244] The acquisition module 1403 is also used to acquire the standard answer information of the pre-stored question information;

[0245] The transceiver module 1401 is also used to output the standard answer information if the target text information corresponding to the target handwriting is different from the standard answer information.

[0246] Optionally, the terminal device may also include: DVS sensor 13.

[0247] Among them, the transceiver module 1401, the processing module 1402, and the acquisition module 1403 can all execute the location determination method executed by the terminal device in the above method embodiments through the DVS sensor 13.

[0248] like Figure 15 As shown, embodiments of the present invention also provide a location determination system, which may include: as Figure 12 Or the electronic pen shown in 13, and such as Figure 14 The terminal device shown.

[0249] This invention provides a computer-readable storage medium storing a computer program that causes a computer to perform some or all of the steps of the methods described in the above embodiments.

[0250] This invention also provides a computer program product, wherein when the computer program product is run on a computer, the computer performs some or all of the steps of the methods described in the above method embodiments.

[0251] This invention also provides an application publishing platform, which is used to publish computer program products. When the computer program products are run on a computer, the computer performs some or all of the steps of the methods described in the above method embodiments.

[0252] It should be understood that the phrase "one embodiment" or "an embodiment" throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of the invention. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Those skilled in the art should also recognize that the embodiments described in the specification are optional embodiments, and the actions and modules involved are not necessarily essential to the invention.

[0253] In various embodiments of the present invention, it should be understood that the sequence number of each process does not necessarily imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0254] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; they can be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0255] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0256] If the integrated units described above are implemented as software functional units and sold or used as independent products, they can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several requests to cause a computer device (which can be a personal computer, server, or network device, specifically a processor in the computer device) to execute some or all of the steps of the methods described in the various embodiments of the present invention.

[0257] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, including read-only memory (ROM), random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), one-time programmable read-only memory (OTPROM), electrically-Erasable Programmable Read-Only Memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, disk storage, magnetic tape storage, or any other computer-readable medium capable of carrying or storing data.

Claims

1. A method for determining a location, characterized in that, The method includes: During the non-contact movement process, the electronic pen repeatedly acquires the light intensity within the writing detection area through the Dynamic Vision (DVS) sensor. The writing detection area is the area where the electronic pen detects the writing plane in a single instance. The non-contact movement process is the process by which the electronic pen moves non-contactly from a first position on the writing plane to a second position. The DVS sensor is disposed in the electronic pen, facing the tip of the electronic pen. The DVS sensor contains a photosensitive chip with multiple photosensitive points, which are used to sense changes in light intensity. The electronic pen determines the location of the light intensity change within the writing detection area between each two consecutive acquisitions; The electronic pen determines the coordinates of the target photosensitive point corresponding to each two adjacent light intensity change positions based on each two adjacent light intensity change positions. The electronic pen determines the change in coordinates of the target photosensitive point between each two adjacent pairs of coordinates. The electronic pen determines the displacement between the first position and the second position based on the coordinate change. The electronic pen determines the second input cursor position corresponding to the second position based on the displacement and the first input cursor position on the associated display screen corresponding to the first position.

2. The method according to claim 1, characterized in that, The electronic pen determines the displacement between the first position and the second position based on the coordinate change, including: The electronic pen determines the displacement between the first position and the second position based on the sum of the coordinate changes of each two adjacent target photosensitive points.

3. The method according to claim 1, characterized in that, The electronic pen has a pressure sensor in its tip, and the method further includes: The electronic pen uses the pressure sensor to detect the pressure value applied to the pen tip in real time. When the pressure sensor detects that the pressure difference between the first detection time and the second detection time is greater than a preset pressure change threshold, and the pressure value at the first detection time is greater than the pressure value at the second detection time, the electronic pen determines the position where the electronic pen contacts the writing surface at the first detection time as the first position; When the pressure sensor detects that the pressure difference between the third detection time and the fourth detection time is greater than the preset pressure change threshold, and the pressure value at the fourth detection time is greater than the pressure value at the third detection time, the electronic pen determines the position where the electronic pen contacts the writing surface at the fourth detection time as the second position. Wherein, the first detection time and the second detection time are adjacent detection times, and the third detection time and the fourth detection time are adjacent detection times.

4. The method according to claim 1, characterized in that, After determining the second input cursor position corresponding to the second position, the method further includes: The electronic pen displays the second input cursor position on its display screen; or, The electronic pen displays the second input cursor position on the display screen of the terminal device associated with the electronic pen.

5. The method according to claim 1, characterized in that, After determining the second input cursor position corresponding to the second position, the method further includes: If the DVS sensor detects a change in light intensity in the target area of ​​the writing detection area, the electronic pen determines the position coordinates of at least one first photosensitive point corresponding to the target area; The electronic pen connects to the position coordinates of at least one first photosensitive point to obtain the target handwriting of the electronic pen within the target area.

6. The method according to claim 5, characterized in that, The change in light intensity in the target area of ​​the writing detection region of the DVS sensor includes: The DVS sensor acquires the initial light intensity of the target area; The photosensitive circuit in the DVS sensor acquires the target light intensity of the target area in real time. If the difference between the target light intensity and the initial light intensity is greater than a preset difference, the electronic pen determines that the light intensity of the target area has changed.

7. The method according to claim 5, characterized in that, The method further includes: When the electronic pen determines the position coordinates of at least one first photosensitive point corresponding to the target area, the electronic pen activates the at least one first photosensitive point and acquires at least one activation time of the at least one first photosensitive point; The electronic pen determines the sequential order of the at least one activation moment; The electronic pen determines the target stroke order information within the target area based on the aforementioned sequence. The electronic pen acquires target text information corresponding to the target handwriting, as well as standard stroke order information corresponding to the target text information; If the target stroke order information is different from the standard stroke order information, the electronic pen sends the standard stroke order information to the terminal device associated with the electronic pen, so that the terminal device prompts the user for the standard stroke order information corresponding to the target text information.

8. The method according to claim 5, characterized in that, After the electronic pen connects to the position coordinates of at least one first photosensitive point to obtain the target handwriting within the target area, the method further includes: The electronic pen uses its camera to capture images of the target area to obtain a first image. The electronic pen recognizes the first captured image to obtain the first text information in the first captured image; The electronic pen acquires target text information corresponding to the target handwriting; If the first text information is different from the target text information, the electronic pen will display the first text information on its display screen, or display the first text information on the display screen of a terminal device associated with the electronic pen.

9. The method according to claim 5, characterized in that, After the electronic pen connects to the position coordinates of at least one first photosensitive point to obtain the target handwriting within the target area, the method further includes: The electronic pen sends the target handwriting to a terminal device associated with the electronic pen, so that the terminal device can determine the target text information corresponding to the target handwriting; The terminal device captures the target area using its camera to obtain a second captured image; The terminal device recognizes the second captured image to obtain the second text information in the second captured image; If the second text information is different from the target text information, the terminal device outputs the second text information.

10. The method according to claim 9, characterized in that, The electronic pen sends the target handwriting to a terminal device associated with the electronic pen, so that after the terminal device determines the target text information corresponding to the target handwriting, the method further includes: The terminal device acquires a target image through its camera, and the target image includes the target handwriting. The terminal device obtains the question information corresponding to the target handwriting based on the target image; The terminal device acquires the pre-stored standard answer information for the question information; If the target text information corresponding to the target handwriting is different from the standard answer information, the terminal device outputs the standard answer information.

11. An electronic pen, characterized in that, include: The acquisition module is used to acquire the light intensity within the writing detection area multiple times through the dynamic visual DVS sensor during non-contact movement. The writing detection area is the area where the electronic pen detects the writing plane once. The non-contact movement process is the process in which the electronic pen moves from a first position on the writing plane to a second position without contact. The DVS sensor is disposed in the electronic pen and faces the tip of the electronic pen. The DVS sensor is provided with a photosensitive chip, and the photosensitive chip is provided with multiple photosensitive points, which are used to sense changes in light intensity. The processing module is used to determine the location of the light intensity change within the writing detection area in each of two adjacent acquisitions; The processing module is further configured to determine the coordinates of the target photosensitive point corresponding to each two adjacent light intensity change positions based on each two adjacent light intensity change positions acquired. The processing module is further configured to determine the change in coordinates of the target photosensitive point between each two adjacent pairs of coordinates based on the coordinates of the target photosensitive point between each two adjacent pairs of coordinates. The processing module is further configured to determine the displacement between the first position and the second position based on the coordinate change. The processing module is further configured to determine the second input cursor position corresponding to the second position based on the displacement and the first input cursor position on the associated display screen corresponding to the first position.

12. An electronic pen, characterized in that, include: Memory containing executable program code; and the processor coupled to the memory; The processor invokes the executable program code stored in the memory to execute the location determination method as described in any one of claims 1 to 10.

13. A location determination system, characterized in that, include: The electronic pen as described in claim 11 or 12, and the terminal device associated with the electronic pen; The electronic pen is used to send the detected handwriting within the target area to the terminal device; The terminal device is used to determine target text information corresponding to the target handwriting; and to capture the target area using the camera of the terminal device to obtain a second captured image. The second captured image is identified to obtain the second text information in the second captured image; If the second text information is different from the target text information, then the second text information is output.

14. A computer-readable storage medium, characterized in that, include: The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the location determination method as described in any one of claims 1 to 10.

Images