Smart pen based on data collection

Abstract

The invention provides a smart pen based on data collection, and relates to the technical field of smart pens. The smart pen comprises a controller, a communication module, a pressure sensor, a high-speed camera, an inertial navigation unit, an audio module and an ink core, receiving position information, pressure sensing signals and reference content at multiple moments obtained according to the high-speed camera, the inertial navigation unit and the pressure sensor; determining a font similarity score, a writing mode similarity score and a writing proficiency score; and an identification result is obtained and sent to the server through the communication module, and a prompt message fed back by the server is played through the audio module. According to the method and the device, when the user writes by using the smart pen, the font similarity, the writing mode similarity and the writing proficiency of the written content can be detected, and the prompt message is generated and played, so that the user is helped to know the actual writing condition, and the effect and the efficiency of practicing writing by using the smart pen by the user are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of smart pens, and in particular to a smart pen based on data collection. Background Art

[0002] In the related art, CN106739662B discloses a conference reminder recording pen, including a pen core, a pen head, a pen body and a pen cap, characterized in that a dot matrix light source is embedded in the pen body, and the dot matrix light source can be refracted through the pen body after having a certain brightness; the front end of the pen body is connected to the pen head, and the rear end has a sealing plate, on which a processor and a circular sliding rheostat are fixed, the slider of the sliding rheostat is fixed on the pen cap, the fixed end of the sliding rheostat is electrically connected to the dot matrix light source, and the slider end is electrically connected to the power supply, the data information that needs to be reminded is stored in the processor, and the outside of the pen cap has a read operation key for operating to read the data in the processor, and the data information stored in the processor is displayed through the dot matrix light source. The beneficial effects of this scheme are: the appearance is the same as that of an ordinary signature pen, and the speaker is given a reminder without others knowing, and important things can be recorded in time through recording when negotiating with customers.

[0003] CN110539574A discloses a self-study pen device that helps students learn efficiently, including a connected writing pen segment and a point-reading segment; the writing pen segment includes a first shell and a refill set arranged in the first shell, the point-reading segment includes a second shell and a point-reading head arranged at one end of the second shell, the point-reading head is provided with an optical module circuit for identifying invisible codes on books, and the first shell and the second shell are detachably connected. In the present invention, a detachably connected writing pen segment and a point-reading segment are designed, the writing pen segment realizes writing and drawing of the writing pen, and the point-reading segment realizes point-reading, combining the traditional writing pen and the point-reading pen, overcoming the functional defects of a separate writing pen or a point-reading pen; no local storage is required, different from the traditional point-reading pen that stores content in a local storage card, the smart point-writing pen controls media resources through the Internet cloud platform, and can update, modify and manage content in real time.

[0004] When a user of a smart pen writes with the smart pen, the user may encounter problems such as irregular writing strokes, incorrect writing stroke order, or writing taking too long. According to relevant technologies, the user can only interact with the user through voice and other means, and it is difficult to detect the user's actual writing situation or generate targeted prompt messages, resulting in low quality of writing practice using the smart pen.

[0005] The information disclosed in the background technology section of this application is only intended to deepen the understanding of the general background technology of this application, and should not be regarded as an admission or any form of suggestion that the information constitutes the prior art already known to those skilled in the art. Summary of the invention

[0006] The present invention provides a smart pen based on data collection, which can solve the technical problems that the related art is difficult to determine the actual writing situation of the smart pen user and is also difficult to generate targeted prompt messages.

[0007] According to a first aspect of the present invention, there is provided a smart pen based on data collection, comprising: a controller, a communication module, a pressure sensor, a high-speed camera, an inertial navigation unit, an audio module, a battery, a charger and an ink cartridge;

[0008] The high-speed camera is arranged at the front end of the smart pen to shoot the identification code on the coding paper and transmit the shot video frame to the controller for identification;

[0009] The ink cartridge is used for writing in the area corresponding to the identification code, and the tip of the ink cartridge is located at the front end of the smart pen;

[0010] The pressure sensor is arranged at the rear end of the ink cartridge and is close to the rear end of the ink cartridge, and is used to generate a pressure sensing signal when the tip of the ink cartridge contacts the paper and generates pressure on the pressure sensor through the rear end of the ink cartridge, and send the pressure sensing signal to the controller;

[0011] The inertial navigation unit is used to determine the position information of the front end of the smart pen when writing;

[0012] The battery is used to provide power to the smart pen, and the charger is used to replenish power to the battery;

[0013] The controller is used to identify the written content through the pressure sensing signal and the position information, obtain the recognition result, send it to the server through the communication module, receive the prompt message corresponding to the recognition result fed back by the server, and play the prompt message through the audio module.

[0014] Technical effect: According to the present invention, based on the position information of the front end of the smart pen at multiple times sent by the inertial navigation unit, the pressure sensor signal sent by the pressure sensor, and the video frame shot by the high-speed camera, the position information, pressure sensor signal and reference content at multiple times can be obtained, and the glyph similarity score, writing style similarity score and writing proficiency score can be determined by the controller, and then the recognition result of the written content can be determined, and the prompt message received from the server can be played while sending it to the server. It can provide more accurate information such as the glyph similarity, writing style similarity and writing proficiency of the written content, which helps users understand the writing situation and conduct more targeted writing exercises, thereby improving the effect and efficiency of users practicing writing with the smart pen. The recognition result of the identification code can be sent to the server through the communication module, and the reference content corresponding to the recognition result sent by the server is received. When the user of the smart pen starts writing, a coordinate system is established. Based on the inertial navigation unit and the pressure sensor, the first position information of the front end of the smart pen at each moment when the user is writing and the second position information of each moment in the time period when the front end of the smart pen leaves the coded paper between each stroke are determined according to the preset time threshold and the preset pressure threshold, so as to provide basic data for determining the recognition result of the written content. When determining the glyph similarity score, the reference glyph information can be obtained according to the reference content, the trajectory information of multiple writings and the starting position of writing can be determined based on the preset pressure threshold, and the glyph reference trajectory information and the reference glyph writing range can be determined according to the reference glyph information. Based on the sampling points set on the glyph reference trajectory and the preset neighborhood range, the target sampling points are determined, and then the standardization degree of all trajectory information written by the user of the smart pen and the completeness of the glyph information written by the user of the smart pen are obtained, so as to obtain the glyph similarity score by combining the two aspects, thereby improving the accuracy, comprehensiveness and objectivity of the glyph similarity score. When determining the writing style similarity score, the glyph reference track information can be determined based on the reference glyph information, and the standard writing track of each stroke in the glyph reference track information and the standard writing order of each stroke can be determined based on the reference writing style information, and each first identification vector and second identification vector are sorted in a unified manner to avoid the problem of different serial numbers due to the writing direction of the track information being different from the writing direction of the standard writing track, thereby causing the stroke corresponding to the track information to be judged incorrectly, thereby improving the accuracy of determining the strokes corresponding to each track information. In addition, the standard writing vector in the standard writing track and the writing track vector in the track information can be determined, and then the writing style similarity score is obtained through the strokes corresponding to the track information, the standard writing vector and the writing track vector, taking into account the correctness of the writing style of the track information and the correctness of the writing order of the track information, so that the writing style similarity score can accurately represent the correctness of the writing style, thereby improving the accuracy and objectivity of the writing style similarity score.When determining the writing proficiency score, the similarity between the actual writing duration information and the reference time information can be determined based on the first position information, the second position information and the reference time information, thereby obtaining the writing proficiency score. The writing proficiency score can accurately and objectively represent the writing proficiency. The recognition result of the written content determined based on the glyph similarity score, the writing method similarity score and the writing proficiency score can be sent to the server, and the prompt message fed back by the server can be received and played, thereby helping the smart pen user understand the actual writing situation of the written content.

[0015] It should be understood that the above general description and the following detailed description are exemplary and explanatory only and do not limit the present invention. Other features and aspects of the present invention will become more apparent from the following detailed description of exemplary embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other embodiments can be obtained based on these drawings without creative work.

[0017] Figure 1 A schematic diagram of a smart pen based on data collection according to an embodiment of the present invention is exemplarily shown. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0019] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0020] Figure 1 A schematic diagram of a smart pen based on data collection according to an embodiment of the present invention is exemplarily shown, wherein the smart pen includes: a controller, a communication module, a pressure sensor, a high-speed camera, an inertial navigation unit, an audio module, a battery, a charger, and an ink cartridge;

[0021] The high-speed camera is arranged at the front end of the smart pen to shoot the identification code on the coding paper and transmit the shot video frame to the controller for identification;

[0022] The ink cartridge is used for writing in the area corresponding to the identification code, and the tip of the ink cartridge is located at the front end of the smart pen;

[0023] The pressure sensor is arranged at the rear end of the ink cartridge and is close to the rear end of the ink cartridge, and is used to generate a pressure sensing signal when the tip of the ink cartridge contacts the paper and generates pressure on the pressure sensor through the rear end of the ink cartridge, and send the pressure sensing signal to the controller;

[0024] The inertial navigation unit is used to determine the position information of the front end of the smart pen when writing;

[0025] The battery is used to provide power to the smart pen, and the charger is used to replenish power to the battery;

[0026] The controller is used to identify the written content through the pressure sensing signal and the position information, obtain the recognition result, send it to the server through the communication module, receive the prompt message corresponding to the recognition result fed back by the server, and play the prompt message through the audio module.

[0027] According to the data collection-based smart pen of the embodiment of the present invention, the position information, pressure sensing signals and reference content at multiple moments can be obtained based on the position information of the front end of the smart pen at multiple moments sent by the inertial navigation unit, the pressure sensing signals sent by the pressure sensor and the video frames shot by the high-speed camera, and the controller can be used to determine the glyph similarity score, the writing style similarity score and the writing proficiency score, and then determine the recognition result of the written content, and play the prompt message received from the server while sending it to the server. It can provide more accurate information such as the glyph similarity, writing style similarity and writing proficiency of the written content, which helps users understand the writing situation and conduct more targeted writing exercises, thereby improving the effect and efficiency of users practicing writing with the smart pen.

[0028] According to an embodiment of the present invention, the high-speed camera in the smart pen is arranged at the front end of the smart pen. Since the identification code on the coding paper is a very small two-dimensional code, an ordinary camera cannot shoot the identification code on the coding paper. Therefore, when the user writes with the smart pen, the identification code on the coding paper can be shot by the high-speed camera arranged at the front end of the smart pen, and the shot video frame is transmitted to the controller for identification.

[0029] According to an embodiment of the present invention, the pressure sensor is arranged at the rear end of the ink core and is in close contact with the rear end of the ink core. When the user writes with the smart pen, the tip of the ink core will contact the paper, and a certain pressure will be generated on the tip of the ink core when writing. The ink core is cylindrical and is arranged in the smart pen. The tip of the ink core is located at the front end of the smart pen. When writing, the pressure will be transmitted from the front end of the ink core to the rear end. The rear end of the ink core will generate pressure on the pressure sensor, generate a pressure sensing signal, and send it to the controller.

[0030] According to an embodiment of the present invention, the inertial navigation unit is used to determine the position information of the front end of the smart pen when writing. For example, when a user writes with the smart pen, the ink cartridge in the smart pen can be used to write in the area corresponding to the identification code, and the inertial navigation unit can record the position information of the front end of the smart pen at each time, and connect the position information to obtain the writing track of the user using the smart pen.

[0031] According to an embodiment of the present invention, the controller is used to identify the written content through the pressure sensing signal and the position information, obtain the recognition result, send it to the server through the communication module, receive the prompt message corresponding to the recognition result fed back by the server, and play the prompt message through the audio module to help the user understand the writing situation.

[0032] According to an embodiment of the present invention, the written content is identified by the pressure sensing signal and the position information to obtain the identification result, including: identifying the identification code in the area corresponding to the identification code, and sending the identification result of the identification code to the server through the communication module; receiving the reference content corresponding to the identification result sent by the server; when the received pressure sensing signal is greater than or equal to the preset pressure threshold for the first time, taking the position information of the front end of the smart pen as the origin to establish a coordinate system, wherein the xoy plane of the coordinate system is parallel to the horizontal direction, and the z axis is parallel to the vertical direction; receiving the position information of the front end of the smart pen sent by the inertial navigation unit and the pressure sensing signal sent by the pressure sensor at multiple times; when the duration of the pressure sensing signal being less than the preset pressure threshold is greater than or equal to the preset duration threshold, stopping receiving the pressure sensing signal and the position information; determining the recognition result of the written content according to the received position information, pressure sensing signal and reference content at multiple times.

[0033] According to an embodiment of the present invention, the identification code in the area corresponding to the identification code is identified, and the identification result of the identification code is sent to the server through the communication module, and the server can generate reference content corresponding to the identification result. For example, the identification result in the area corresponding to the identification code is the English letter "A". After the above identification result is sent to the server through the communication module, the server can generate information such as the standard writing of the English letter "A", that is, the reference content corresponding to the identification result, and send the reference content corresponding to the identification result to the controller. Since the user will not generate pressure on the ink core or the generated pressure is very small when he is not writing, therefore, when the received pressure sensing signal is greater than or equal to the preset pressure threshold for the first time, it can be considered that the user has applied pressure to the smart pen for the first time, and the ink core in the smart pen will release water, that is, the user starts to write with the smart pen. At this time, the position information of the front end of the smart pen is used as the coordinate origin, that is, when the user starts writing, the position where the smart pen first contacts the coding paper is used as the coordinate origin to establish a three-dimensional coordinate system. The xoy plane of the above three-dimensional coordinate system is parallel to the horizontal direction, that is, the plane where the coding paper is located, and the z axis is parallel to the vertical direction, that is, perpendicular to the plane where the coding paper is located.

[0034] According to an embodiment of the present invention, at multiple moments, for example, the coordinate information of the front end of the smart pen in the three-dimensional coordinate system sent by the inertial navigation unit, that is, the position information of the front end of the smart pen, and the pressure sensing signal sent by the pressure sensor are received once every 100 milliseconds. The present invention does not limit the time interval between each moment. Since the user lifts the front end of the smart pen away from the paper during writing (for example, when writing a stroke of a certain word and lifting the smart pen to write the next stroke), no pressure is generated or the pressure is very small. If the time length of the pressure sensing signal being less than the preset pressure threshold is short (that is, less than the preset time threshold), it can be considered as this situation. If the time length of the pressure sensing signal being less than the preset pressure threshold is greater than or equal to the preset time threshold, it can be considered that the user has not written for a long time, that is, the user has ended the writing behavior. At this time, the pressure sensing signal and the position information are stopped from being received. For example, when the time length of the pressure sensing signal being less than the preset pressure threshold is greater than or equal to the preset time threshold of 1 second, the pressure sensing signal and the position information can be stopped from being received. The present invention does not limit the preset pressure threshold and the preset time threshold.

[0035] According to an embodiment of the present invention, the position information includes: first position information at each moment in a time period when the pressure sensing signal is greater than or equal to a preset pressure threshold, and second position information at each moment in a time period when the pressure sensing signal is less than the preset pressure threshold. That is, from the time when the received pressure sensing signal is greater than or equal to the preset pressure threshold for the first time to the time when the duration of the pressure sensing signal being less than the preset pressure threshold is greater than or equal to the preset duration threshold, the pressure sensing signal may be greater than or equal to the preset pressure threshold for multiple times, and may be less than the preset pressure threshold for multiple times. The first position information at each moment in a time period greater than or equal to the preset pressure threshold can be obtained, which is the position information of the front end of the smart pen at each moment in the time period when the user of the smart pen writes each stroke, and the second position information at each moment in a time period when the pressure sensing signal is less than the preset pressure threshold, which is the position information of the front end of the smart pen at each moment in the time period when the user of the smart pen lifts the pen between each stroke when writing. During the writing process, when the user finishes writing a stroke and then writes the next stroke, the front end of the smart pen may separate from the paper, generating a small pressure sensing signal. The inertial navigation unit will continue to determine the position information of the front end of the smart pen, and thus the position information of the front end of the smart pen in this time period can be used to determine the position of the next stroke, that is, the starting position of the next stroke, thereby determining the positional relationship between the next stroke and the previously written stroke. The time interval between each moment can be 100 milliseconds, and the present invention does not limit the time interval between each moment.

[0036] In this way, the recognition result of the identification code can be sent to the server through the communication module, and the reference content corresponding to the recognition result sent by the server is received. When the user of the smart pen starts writing, a coordinate system is established. Based on the inertial navigation unit and the pressure sensor, according to the preset time threshold and the preset pressure threshold, the first position information of the front end of the smart pen at each moment when the user is writing and the second position information at each moment in the time period when the front end of the smart pen leaves the coded paper between writing strokes are determined, thereby providing basic data for determining the recognition result of the written content.

[0037] According to an embodiment of the present invention, the recognition result of the written content is determined based on the received position information, pressure sensing signal and reference content at multiple moments, including: determining reference glyph information, reference writing method information and reference time information for writing the reference content based on the reference content; determining a glyph similarity score based on the first position information, the second position information and the reference glyph information; determining a writing method similarity score based on the first position information, the second position information, the reference glyph information and the reference writing method information; determining a writing proficiency score based on the first position information, the second position information and the reference time information; determining the recognition result of the written content based on the glyph similarity score, the writing method similarity score and the writing proficiency score. For example, based on the reference content of the English letter "A", the standard glyph of the corresponding text, the standard stroke order and the standard writing method of writing, and the theoretical time required to write the corresponding reference content, that is, the reference glyph information, reference writing method information and reference time information for writing the reference content of the corresponding text can be determined.

[0038] According to an embodiment of the present invention, determining a glyph similarity score based on the first position information, the second position information and the reference glyph information includes: determining the trajectory information of the first writing based on the first position information at each moment within the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the first time; determining the starting position of the second writing based on the second position information at the last moment within the time period when the pressure sensing signal is less than the preset pressure threshold for the first time; determining the trajectory information of the second writing based on the starting position of the second writing and the first position information at each moment within the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the second time; determining the trajectory information of the i+th writing based on the second position information at the last moment within the time period when the pressure sensing signal is less than the preset pressure threshold for the i-th time. The starting position of 1 writing, wherein i≥2, and i is a positive integer; according to the starting position of the i+1th writing, and the first position information of each moment in the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the i+1th time, determine the trajectory information of the i+1th writing; according to the reference glyph information, determine the glyph reference trajectory information and the reference glyph writing range, wherein the reference glyph writing range is used to represent the reasonable range of the writing trajectory of each stroke of the reference glyph, the glyph reference trajectory information is used to represent the standard writing trajectory of each stroke of the reference glyph, and the glyph reference trajectory information is completely within the reference glyph writing range; according to the trajectory information of multiple writings, the glyph reference trajectory information and the reference glyph writing range, determine the glyph similarity score.

[0039] According to the embodiment of the present invention, since the moment when the pressure sensing signal is greater than or equal to the preset pressure threshold for the first time can be used as the moment when the smart pen user starts writing, the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the first time is the time period when the smart pen user writes the first stroke. Therefore, the stroke trajectory of the first stroke, i.e., the trajectory information of the first writing, can be determined according to the first position information of each moment in the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the first time. The time period when the pressure sensing signal is less than the preset pressure threshold for the first time is the time period from when the smart pen user finishes writing the first stroke to when he starts writing the second stroke. Therefore, the last moment in the time period when the pressure sensing signal is less than the preset pressure threshold for the first time can be the moment when the smart pen user starts writing the second stroke. Therefore, the second position information of the last moment in the time period when the pressure sensing signal is less than the preset pressure threshold for the first time is the starting position of the second writing, in other words, the starting position of the second writing stroke. Similarly, the trajectory of the second stroke of the writing, i.e., the trajectory information of the second writing, can be determined based on the starting position of the second writing and the first position information of each moment in the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the second time. Similarly, the starting position of the i+1th writing can be determined based on the second position information of the last moment in the time period when the pressure sensing signal is less than the preset pressure threshold for the i-th time, i.e., it can be used as the starting position of the i+1th stroke of the writing. And the trajectory of the i+1th stroke of the writing content can be determined based on the starting position of the i+1th writing and the first position information of each moment in the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the i+1th time, i.e., the trajectory information of the i+1th writing. Based on the above process, the trajectory of all the strokes written by the user of the smart pen when writing, i.e., all the trajectory information of the writing can be obtained.

[0040] According to an embodiment of the present invention, the glyph reference trajectory information can be determined based on the reference glyph information, which can be used as a standard writing trajectory for the written content. Since there may be some deviations from the reference glyph information when the smart pen user writes, but it will not affect the overall glyph, the reference glyph writing range can be determined based on the reference glyph information. The reference glyph writing range is a reasonable range set for the trajectory of each stroke, and the closest distances from each position in the glyph reference trajectory information to the edge of the reference glyph writing range are equal. The present invention does not limit the determination of the reference glyph writing range. The glyph reference trajectory information should be completely within the reference glyph writing range. When the trajectory information of each stroke written by the smart pen user is within the reference glyph writing range, the trajectory information of each stroke written by the smart pen user is within a reasonable writing range, and it can be considered that each stroke of the smart pen user is more consistent with the corresponding reference glyph information.

[0041] According to an embodiment of the present invention, based on the trajectory information of multiple writings, the glyph reference trajectory information and the reference glyph writing range, determining the glyph similarity score includes: evenly setting sampling points on the glyph reference trajectory information; determining a target sampling point of the trajectory information within a preset neighborhood range centered on the sampling point; determining the glyph similarity score S according to formula (1). F ,

[0042]

[0043] Among them, L tr，j is the jth written trajectory information, n is the number of trajectory information, Ω R N is the reference character writing range. M is the number of target sampling points, N is the number of sampling points, len(*) is the length function, j≤n, and both j and n are positive integers.

[0044] According to an embodiment of the present invention, sampling points are evenly set on the glyph reference trajectory information, for example, a sampling point is set every 2 mm on the glyph reference trajectory information. The present invention does not limit the spacing distance between sampling points. The circular range determined with each sampling point as the center can be used as a preset neighborhood range. When the trajectory information exists in the neighborhood range, it means that there is a trajectory written by the smart pen user in the neighborhood range. Therefore, the corresponding sampling points with trajectory information in the neighborhood range can be confirmed as target sampling points and used to judge the glyph similarity. If the trajectory information does not exist in the neighborhood range, it means that there is no trajectory written by the smart pen user in the neighborhood range, the user's writing trajectory may deviate greatly from the reference trajectory information, or the user's writing trajectory information is incomplete and not all strokes are written.

[0045] According to an embodiment of the present invention, in formula (1), since the writing trajectory information of the smart pen user is a point set, the writing range of the reference character is also a point set, therefore, (L tr，j ∩Ω R ) can represent the intersection of the j-th writing trajectory information and the reference glyph writing range, and then the sum of the lengths of the intersections of all the trajectory information written by the smart pen user and the reference glyph writing range can be obtained. therefore, The ratio information between the sum of the lengths of the intersection of all the trajectory information written by the smart pen user and the reference glyph writing range and the sum of the lengths of all the trajectory information written by the smart pen user is the ratio of all the trajectory information that is within the reference self-writing range. The closer the above ratio information is to 1, the higher the ratio of all the trajectory information that is within the reference glyph writing range, that is, the more standardized the trajectory information is. Therefore, the above ratio information can be used as the standardization degree of the glyph information written by the user. When the user writes, there may be only a partial writing trajectory, that is, the glyph is incomplete, but all or most of the written trajectory information is within the reference glyph writing range, resulting in the above ratio information being high, but the similarity between the trajectory information and the font reference trajectory information is not high. Therefore, it is necessary to further judge the completeness of the glyph information written by the smart pen user. In formula (1), It represents the ratio of the number of target sampling points to the number of sampling points. The larger the ratio is, the larger the proportion of the number of trajectory information written by the smart pen user in the neighborhood of each sampling point is, that is, the larger the proportion of the number of target sampling points is, the higher the completeness of the glyph information written by the smart pen user is. Therefore, the ratio of the number of target sampling points to the number of sampling points can be used as the completeness of the glyph information written by the smart pen user. The product of the degree of standardization of all trajectory information written by the smart pen user and the completeness of the glyph information written by the smart pen user can be used as the glyph similarity score. The higher the glyph similarity score is, the higher the similarity between the glyph information written by the smart pen user and the reference glyph information is.

[0046] In this way, reference glyph information can be obtained based on the reference content, and the trajectory information of multiple writings and the starting position of writing can be determined based on a preset pressure threshold. At the same time, the glyph reference trajectory information and the reference glyph writing range can be determined based on the reference glyph information. Based on the sampling points set on the glyph reference trajectory and the preset neighborhood range, the target sampling points can be determined, and then the degree of standardization of all trajectory information written by the smart pen user and the completeness of the glyph information written by the smart pen user can be obtained, so as to obtain a glyph similarity score by combining the two aspects, thereby improving the accuracy, comprehensiveness and objectivity of the glyph similarity score.

[0047] According to an embodiment of the present invention, a writing style similarity score is determined based on the first position information, the second position information, the reference glyph information and the reference writing style information, including: determining the glyph reference trajectory information based on the reference glyph information; determining the standard writing trajectory of each stroke in the glyph reference trajectory information and the standard writing order of each stroke based on the reference writing style information; determining the first minimum bounding rectangle of the standard writing trajectory of multiple strokes and the first centroid of the first minimum bounding rectangle based on the glyph reference trajectory information; determining the second minimum bounding rectangle of multiple trajectory information and the second centroid of the second minimum bounding rectangle ; Determine the strokes corresponding to each trajectory information according to the glyph reference trajectory information, the first centroid, the trajectory information and the second centroid; Divide the standard writing trajectory equally according to the number of moments included in the time period corresponding to the trajectory information corresponding to the standard writing trajectory to obtain multiple standard writing trajectory segments; Determine the standard writing vector corresponding to each standard writing trajectory segment according to the reference writing method information; Determine the writing trajectory vector in the trajectory information according to each first position information in the trajectory information corresponding to the standard writing trajectory; Determine the writing method similarity score according to the standard writing vector, the writing trajectory vector, the standard writing order and the sequence number of the trajectory information.

[0048] According to an embodiment of the present invention, the glyph reference trajectory information can be obtained according to the reference glyph information, which can be used as the standard writing trajectory of the written content. According to the reference writing method information, the standard writing method of each stroke and the order of writing each stroke under the standard writing method can be separated, that is, the standard writing trajectory of each stroke and the standard writing order of each stroke. According to the glyph reference trajectory information, the first minimum bounding rectangle of the standard writing trajectory of multiple strokes is determined. For example, if the glyph reference trajectory information is the glyph reference trajectory information of the English letter "A", then a minimum bounding rectangle that selects all the strokes of the English letter "A" can be determined, that is, the first minimum bounding rectangle of the standard writing trajectory of multiple strokes, and the centroid of the above-mentioned first minimum bounding rectangle is determined at the same time, which is the first centroid. Similarly, the second minimum bounding rectangle of the multiple trajectory information of the content written by the smart pen user can be determined, and the centroid of the second minimum bounding rectangle can be determined at the same time, which is the second centroid.

[0049] According to an embodiment of the present invention, based on the character reference trajectory information, the first centroid, the trajectory information and the second centroid, the strokes corresponding to each trajectory information are determined, including: uniformly setting a preset number of first identification points on the standard writing trajectory of each stroke in the character reference trajectory information; determining a first identification vector between each first identification point and the first centroid; uniformly setting the preset number of second identification points on the trajectory information; determining a second identification vector between each second identification point and the second centroid; and obtaining a stroke recognition score SE of the jth trajectory information according to formula (2): j ,

[0050]

[0051] Among them, I 1，y，x is the first identification vector corresponding to the xth first identification point on the standard writing trajectory of the yth stroke, For I 1，y，x The transposed vector of ||I 1，y，x || is I 1，y，x The model, I 2，j，x is the second identification vector corresponding to the xth second identification point on the jth trajectory information, ||I 2，j，x || is I 2，j，x The modulus, n p is the preset number, n is the number of trajectory information, j≤n, y≤n, x≤n p , and j, n, y, n, x and n p are all positive integers; the stroke corresponding to the standard writing trajectory that maximizes the stroke recognition score of the j-th trajectory information is determined as the stroke corresponding to the j-th trajectory information.

[0052] According to an embodiment of the present invention, a preset number of first identification points are evenly set on the standard writing trajectory of each stroke in the glyph reference trajectory information. For example, if the glyph reference trajectory information is the glyph reference trajectory information of the English letter "A", then three first identification points can be evenly set on the standard writing trajectory of each stroke in the corresponding glyph reference trajectory information. The present invention does not limit the preset number of identification points. Then determine the first identification vector between each first identification point and the first centroid. The first identification vector can be obtained by connecting each first identification point with the first centroid. In order to facilitate the determination of the strokes corresponding to each trajectory information, the obtained first identification points can be sorted in order from top to bottom. If the order cannot be determined from top to bottom, then sort the first identification points in order from left to right, so that the serial number of each first identification point can be determined, and when determining the serial number of the second identification point, the determination method is the same as the determination method of the first identification point, so as to avoid the problem of different serial numbers due to the different writing direction of the trajectory information and the writing direction of the standard writing trajectory, thereby causing errors in similarity calculation. For example, when the glyph reference trajectory information is the glyph reference trajectory information of the English letter "A", the first stroke therein is a line segment from the upper right end to the lower left end, and three first identification points are evenly set on the standard writing trajectory information corresponding to the first stroke. When the first identification vectors are sorted in the order from top to bottom and then from left to right, it can be considered that the order of the three first identification points evenly set on the standard writing trajectory information corresponding to the first stroke is: the order of the first identification point at the upper right end is 1, the order of the first identification point in the middle is 2, and the order of the first identification point at the lower left end is 3. Similarly, the order of each first identification point corresponding to the preset number of identification points on the standard writing trajectory information corresponding to the remaining two strokes in the English letter "A" can be determined, and the order of the first identification point in the stroke can be used as the serial number of the first identification vector corresponding to the first identification point. Similarly, a preset number of second identification points can be evenly set on the trajectory information written by the smart pen user and a second identification vector between each second identification point and the second centroid can be determined, and then the sequence number of the second identification vector can be determined, so as to be used to judge the strokes in the glyph reference trajectory information corresponding to each trajectory information written by the smart pen user.

[0053] According to an embodiment of the present invention, in formula (2), The cosine similarity between the first identification vector corresponding to the xth first identification point on the standard writing trajectory of the yth stroke and the second identification vector corresponding to the xth second identification point on the jth trajectory information is averaged to obtain the similarity between the standard writing trajectory of the yth stroke and the jth trajectory information. Based on this item, the similarity between the jth trajectory information and the standard writing trajectory of each stroke can be obtained. The maximum value of the similarity between the jth trajectory information and the standard writing trajectory of each stroke can be used as the stroke recognition score of the jth trajectory information. The stroke corresponding to the standard writing trajectory corresponding to the maximum value of the similarity can be considered as the stroke corresponding to the standard writing trajectory corresponding to the jth trajectory information. In the example, suppose that when the smart pen user writes, the order of strokes is different from the standard writing order. For example, the horizontal line segment of the letter "A" is taken as the first trajectory information, and the standard writing trajectory of the first stroke in the glyph reference trajectory information is the line segment from the upper right end to the lower left end, and the horizontal line segment is the standard writing trajectory of the third stroke in the glyph reference trajectory information. Based on the above solution to the maximum value of similarity, the standard writing trajectory of the stroke with the highest similarity to the first trajectory information is not the standard writing trajectory of the first stroke, but the standard writing trajectory of the third stroke.

[0054] According to an embodiment of the present invention, the standard writing trajectory is evenly divided according to the number of moments included in the time period corresponding to the trajectory information corresponding to the standard writing trajectory, so as to obtain a plurality of standard writing trajectory segments. For example, in the glyph reference trajectory information of the English letter "A", the trajectory information corresponding to the standard writing trajectory of the first stroke is a line segment from the upper right end to the lower left end, and the length of the writing time period of the trajectory information is 1 second. The position information is obtained every 100 milliseconds, so the number of moments is 10. Therefore, 10 equal points can be set on the standard writing trajectory of the first stroke to obtain 9 standard writing trajectory segments. Since each standard writing trajectory segment has the position information of the starting endpoint and the ending endpoint (that is, the position information of the above-mentioned equal points), and the standard writing direction of each stroke is included in the reference writing method information, a standard writing vector corresponding to each standard writing trajectory segment can be formed. Since the first position information in the trajectory information corresponding to the standard writing trajectory is determined at each moment, each first position information in the trajectory information corresponding to the standard writing trajectory will divide the corresponding trajectory information. Therefore, the vector between two adjacent first position information can be determined according to the two adjacent first position information. For example, the vector pointing from the first first position information to the second first position information in the trajectory information corresponding to the standard writing trajectory of the first stroke is obtained, and so on, the writing trajectory vector in the trajectory information of each stroke can be obtained. It can be used to determine the similarity between the standard writing trajectory corresponding to the trajectory information written by the smart pen user and the writing trajectory information.

[0055] According to an embodiment of the present invention, the writing style similarity score is determined according to the standard writing vector, the writing trajectory vector, the standard writing order and the sequence number of the trajectory information, including: determining the writing style similarity score S according to formula (3): W ,

[0056]

[0057] Among them, V j，k is the kth writing trajectory vector in the jth writing trajectory information, j S is the sequence number of the standard writing order of the strokes corresponding to the j-th writing trajectory information, V j，k The transposed vector of ||V j，k || is V j，k The model, V j，k，S is the standard writing vector corresponding to the kth standard writing trajectory segment in the standard writing trajectory corresponding to the jth writing trajectory information, ||V j，k，s || is V j，k，s The modulus, n j is the number of writing trajectory vectors in the trajectory information of the jth writing, n j It is equal to the number of first position information in the j-th written track information minus 1, n is the number of track information, k≤n j , j≤n, and k, n j , j and n are all positive integers.

[0058] According to an embodiment of the present invention, in formula (3), The cosine similarity between the standard writing vector corresponding to the kth standard writing trajectory segment in the standard writing trajectory corresponding to the trajectory information of the jth writing and the kth writing trajectory vector in the trajectory information of the jth writing is represented. By averaging the above cosine similarities, the similarity between each trajectory information and its corresponding standard writing trajectory can be obtained.

[0059] According to an embodiment of the present invention, in formula (3), |jj S | can represent the difference between the sequence number of the standard writing order of the strokes corresponding to the trajectory information of the jth writing and the sequence number of the actual writing order of the strokes corresponding to the trajectory information of the jth writing. Therefore, The similarity between the sequence number of the standard writing order of the strokes corresponding to the j-th writing trajectory information and the sequence number of the actual writing order of the strokes corresponding to the j-th writing trajectory information can be represented, and can also be used as the standard degree of the order of the j-th writing trajectory information. The standard degree of the order of the j-th writing trajectory information can be used as a weight to weight the similarity between the j-th writing trajectory information and its corresponding standard writing trajectory, and the similarity between multiple writing trajectory information and their corresponding standard writing trajectory can be weighted in the same way, and the weighted average value is obtained to determine the writing method similarity score. If the writing method similarity score is high, it can be explained that the correctness of the writing method of each trajectory information is high, and the correctness of the writing order of each trajectory information is high.

[0060] In this way, the reference trajectory information of the glyph can be determined according to the reference glyph information, and the standard writing trajectory of each stroke in the glyph reference trajectory information and the standard writing order of each stroke can be determined according to the reference writing method information, and each first identification vector and second identification vector can be sorted in a unified manner to avoid the problem of different serial numbers due to the writing direction of the trajectory information being different from the writing direction of the standard writing trajectory, thereby causing the strokes corresponding to the trajectory information to be judged incorrectly, thereby improving the accuracy of determining the strokes corresponding to each trajectory information. In addition, the standard writing vector in the standard writing trajectory and the writing trajectory vector in the trajectory information can be determined, and then the writing method similarity score can be obtained through the strokes corresponding to the trajectory information, the standard writing vector and the writing trajectory vector, taking into account the correctness of the writing method of the trajectory information and the correctness of the writing order of the trajectory information, so that the writing method similarity score can accurately represent the correctness of the writing method, thereby improving the accuracy and objectivity of the writing method similarity score.

[0061] According to an embodiment of the present invention, determining the writing proficiency score according to the first position information, the second position information and the reference time information includes: determining the writing proficiency score S according to formula (4): S ,

[0062]

[0063] Among them, Δt j is the duration of the time period during which the pressure sensing signal is greater than or equal to the preset pressure threshold for the jth time, Δt R is the reference time information, n is the number of trajectory information, j≤n, and both j and n are positive integers.

[0064] According to an embodiment of the present invention, in formula (4), It can represent the total duration of the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold, that is, the actual total writing duration information. Therefore, It can indicate the difference between the actual total writing time and the reference time information. The actual writing time information and the reference time information can be used as the writing proficiency score. The higher the writing proficiency score, the closer the actual total writing time of the smart pen user is to the reference time, and the higher the writing proficiency of the smart pen user.

[0065] In this way, the similarity between the actual writing time information and the reference time information can be determined based on the first position information, the second position information and the reference time information, and then the writing proficiency score can be obtained, so that the writing proficiency score can accurately and objectively represent the writing proficiency.

[0066] According to an embodiment of the present invention, the recognition result of the written content can be determined based on the glyph similarity score, the writing style similarity score and the writing proficiency score. The recognition result of the written content can describe the glyph similarity, writing style similarity and writing proficiency corresponding to the content written by the smart pen user, and the above three scores can be weighted and summed to obtain a total score as the recognition result. The recognition result is sent to the server through the communication module, and a prompt message corresponding to the recognition result fed back by the server is received, and the prompt message is played through the audio module, which can help the smart pen user understand the actual writing situation of the written content. For example, the prompt message may include a description of the correctness of the user's overall writing, that is, a description generated based on the total score; the prompt message may include a description of glyph similarity, that is, a description obtained based on the glyph similarity score; the prompt message may include a description of the correctness of the writing style, that is, a description obtained based on the writing style similarity; the prompt message may include a description of the writing proficiency, that is, a description obtained based on the writing proficiency score.

[0067] In this way, the recognition results of the written content can be determined based on the glyph similarity score, writing style similarity score and writing proficiency score and sent to the server. At the same time, the prompt message feedback from the server is received and played, thereby helping the smart pen user understand the actual writing situation of the written content.

[0068] According to the data collection-based smart pen of the embodiment of the present invention, the position information, pressure sensing signals and reference content at multiple moments can be obtained based on the position information of the front end of the smart pen at multiple moments sent by the inertial navigation unit, the pressure sensing signals sent by the pressure sensor and the video frames shot by the high-speed camera, and the controller can be used to determine the glyph similarity score, the writing style similarity score and the writing proficiency score, and then determine the recognition result of the written content, and play the prompt message received from the server while sending it to the server. It can provide more accurate information such as the glyph similarity, writing style similarity and writing proficiency of the written content, which helps users understand the writing situation and conduct more targeted writing exercises, thereby improving the effect and efficiency of users practicing writing with the smart pen. The recognition result of the identification code can be sent to the server through the communication module, and the reference content corresponding to the recognition result sent by the server is received. When the user of the smart pen starts writing, a coordinate system is established. Based on the inertial navigation unit and the pressure sensor, the first position information of the front end of the smart pen at each moment when the user is writing and the second position information of each moment in the time period when the front end of the smart pen leaves the coded paper between each stroke are determined according to the preset time threshold and the preset pressure threshold, so as to provide basic data for determining the recognition result of the written content. When determining the glyph similarity score, the reference glyph information can be obtained according to the reference content, the trajectory information of multiple writings and the starting position of writing can be determined based on the preset pressure threshold, and the glyph reference trajectory information and the reference glyph writing range can be determined according to the reference glyph information. Based on the sampling points set on the glyph reference trajectory and the preset neighborhood range, the target sampling points are determined, and then the standardization degree of all trajectory information written by the user of the smart pen and the completeness of the glyph information written by the user of the smart pen are obtained, so as to obtain the glyph similarity score by combining the two aspects, thereby improving the accuracy, comprehensiveness and objectivity of the glyph similarity score. When determining the writing style similarity score, the glyph reference track information can be determined based on the reference glyph information, and the standard writing track of each stroke in the glyph reference track information and the standard writing order of each stroke can be determined based on the reference writing style information, and each first identification vector and second identification vector are sorted in a unified manner to avoid the problem of different serial numbers due to the writing direction of the track information being different from the writing direction of the standard writing track, thereby causing the stroke corresponding to the track information to be judged incorrectly, thereby improving the accuracy of determining the strokes corresponding to each track information. In addition, the standard writing vector in the standard writing track and the writing track vector in the track information can be determined, and then the writing style similarity score is obtained through the strokes corresponding to the track information, the standard writing vector and the writing track vector, taking into account the correctness of the writing style of the track information and the correctness of the writing order of the track information, so that the writing style similarity score can accurately represent the correctness of the writing style, thereby improving the accuracy and objectivity of the writing style similarity score.When determining the writing proficiency score, the similarity between the actual writing duration information and the reference time information can be determined based on the first position information, the second position information and the reference time information, thereby obtaining the writing proficiency score. The writing proficiency score can accurately and objectively represent the writing proficiency. The recognition result of the written content determined based on the glyph similarity score, the writing method similarity score and the writing proficiency score can be sent to the server, and the prompt message fed back by the server can be received and played, thereby helping the smart pen user understand the actual writing situation of the written content.

[0069] It should be understood by those skilled in the art that the embodiments of the present invention described above and shown in the accompanying drawings are only examples and do not limit the present invention. The purpose of the present invention has been fully and effectively achieved. The functional and structural principles of the present invention have been demonstrated and explained in the embodiments, and the embodiments of the present invention may be deformed or modified in any way without departing from the principles.

[0070] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A smart pen based on data collection, characterized in that: include: Controller, communication module, pressure sensor, high-speed camera, inertial navigation unit, audio module, battery, charger and ink cartridge; The high-speed camera is arranged at the front end of the smart pen to shoot the identification code on the coding paper and transmit the shot video frame to the controller for identification; The ink cartridge is used for writing in the area corresponding to the identification code, and the tip of the ink cartridge is located at the front end of the smart pen; The pressure sensor is arranged at the rear end of the ink cartridge and is close to the rear end of the ink cartridge, and is used to generate a pressure sensing signal when the tip of the ink cartridge contacts the paper and generates pressure on the pressure sensor through the rear end of the ink cartridge, and send the pressure sensing signal to the controller; The inertial navigation unit is used to determine the position information of the front end of the smart pen when writing; The battery is used to provide power to the smart pen, and the charger is used to replenish power to the battery; The controller is used to identify the written content through the pressure sensing signal and the position information, obtain the recognition result, send it to the server through the communication module, receive the prompt message corresponding to the recognition result fed back by the server, and play the prompt message through the audio module.

2. The smart pen based on data collection according to claim 1, characterized in that: Recognize the written content through the pressure sensing signal and the position information to obtain a recognition result, including: Identify the identification code in the area corresponding to the identification code, and send the identification result of the identification code to the server through the communication module; receiving reference content corresponding to the recognition result sent by the server; When the received pressure sensing signal is greater than or equal to the preset pressure threshold for the first time, the position information of the front end of the smart pen is used as the origin to establish a coordinate system, wherein the xoy plane of the coordinate system is parallel to the horizontal direction, and the z axis is parallel to the vertical direction; At multiple moments, receiving the position information of the front end of the smart pen sent by the inertial navigation unit and the pressure sensing signal sent by the pressure sensor; When the duration of the pressure sensing signal being less than the preset pressure threshold is greater than or equal to the preset duration threshold, stop receiving the pressure sensing signal and the position information; The recognition result of the written content is determined based on the received position information at multiple moments, the pressure sensing signal and the reference content.

3. The smart pen based on data collection according to claim 2, characterized in that: The position information includes: first position information at each moment in a time period when the pressure sensing signal is greater than or equal to a preset pressure threshold, and second position information at each moment in a time period when the pressure sensing signal is less than the preset pressure threshold.

4. The smart pen based on data collection according to claim 3, characterized in that: Determine the recognition result of the written content according to the received position information at multiple times, the pressure sensing signal and the reference content, including: Determining reference glyph information, reference writing method information, and reference time information for writing the reference content according to the reference content; Determining a glyph similarity score according to the first position information, the second position information and the reference glyph information; Determining a writing style similarity score according to the first position information, the second position information, the reference glyph information and the reference writing style information; Determine a writing proficiency score according to the first position information, the second position information and the reference time information; The recognition result of the written content is determined according to the glyph similarity score, the writing style similarity score and the writing proficiency score.

5. The smart pen based on data collection according to claim 4, characterized in that: Determining a glyph similarity score according to the first position information, the second position information and the reference glyph information includes: Determine the first writing trajectory information according to the first position information at each moment in the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the first time; Determine the starting position of the second writing according to the second position information of the last moment in the time period when the pressure sensing signal is less than the preset pressure threshold for the first time; Determine the trajectory information of the second writing according to the starting position of the second writing and the first position information of each moment in the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the second time; Determine the starting position of the i+1th writing according to the second position information of the last moment in the time period when the pressure sensing signal is less than the preset pressure threshold for the i-th time, where i≥2 and i is a positive integer; Determine the trajectory information of the i+1th writing according to the starting position of the i+1th writing and the first position information of each moment in the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the i+1th time; Determine the glyph reference trajectory information and the reference glyph writing range according to the reference glyph information, wherein the reference glyph writing range is used to represent a reasonable range of the writing trajectory of each stroke of the reference glyph, the glyph reference trajectory information is used to represent a standard writing trajectory of each stroke of the reference glyph, and the glyph reference trajectory information is completely within the reference glyph writing range; The glyph similarity score is determined according to the track information of multiple writings, the glyph reference track information and the reference glyph writing range.

6. The smart pen based on data collection according to claim 5, characterized in that: Determining a glyph similarity score according to the track information of multiple writings, the glyph reference track information and the reference glyph writing range includes: Evenly setting sampling points on the glyph reference trajectory information; Determine that a target sampling point of the trajectory information exists within a preset neighborhood range centered on the sampling point; According to the formula Determine the glyph similarity score S F , where L tr，j is the jth written trajectory information, n is the number of trajectory information, Ω R N is the reference character writing range. M is the number of target sampling points, N is the number of sampling points, len(*) is the length function, j≤n, and both j and n are positive integers.

7. The smart pen based on data collection according to claim 5, characterized in that: Determining a writing style similarity score according to the first position information, the second position information, the reference glyph information, and the reference writing style information includes: Determining glyph reference trajectory information according to the reference glyph information; Determine, according to the reference writing method information, a standard writing trajectory of each stroke in the character reference trajectory information, and a standard writing order of each stroke; Determining, according to the glyph reference trajectory information, a first minimum circumscribed rectangle of a standard writing trajectory of a plurality of strokes and a first centroid of the first minimum circumscribed rectangle; Determine a second minimum bounding rectangle of the plurality of track information and a second centroid of the second minimum bounding rectangle; Determine the strokes corresponding to each track information according to the character reference track information, the first centroid, the track information and the second centroid; According to the number of moments included in the time period corresponding to the trajectory information corresponding to the standard writing trajectory, the standard writing trajectory is evenly divided to obtain a plurality of standard writing trajectory segments; Determining a standard writing vector corresponding to each standard writing trajectory segment according to the reference writing method information; Determine a writing trajectory vector in the trajectory information according to each first position information in the trajectory information corresponding to the standard writing trajectory; A writing style similarity score is determined according to the standard writing vector, the writing trajectory vector, the standard writing sequence and the sequence number of the trajectory information.

8. The smart pen based on data collection according to claim 7, characterized in that: Determining strokes corresponding to each track information according to the character reference track information, the first centroid, the track information, and the second centroid includes: Evenly setting a preset number of first marking points on the standard writing trajectory of each stroke in the glyph reference trajectory information; Determining a first identification vector between each first identification point and the first centroid; Evenly setting the preset number of second marking points on the trajectory information; Determining a second identification vector between each second identification point and the second centroid; According to the formula Get the stroke recognition score SE of the jth trajectory information j , where I 1，y，x is the first identification vector corresponding to the xth first identification point on the standard writing trajectory of the yth stroke, For I 1，y，x The transposed vector of ||I 1，y，x || is I 1，y，x The model, I 2，j，x is the second identification vector corresponding to the xth second identification point on the jth trajectory information, ||I 2，j，x || is I 2，j，x The modulus, n p is the preset number, n is the number of trajectory information, j≤n, y≤n, x≤n p , and j, n, y, n, x and n p All are positive integers; The stroke corresponding to the standard writing trajectory that maximizes the stroke recognition score of the j-th trajectory information is determined as the stroke corresponding to the j-th trajectory information.

9. The smart pen based on data collection according to claim 7, characterized in that: Determining a writing style similarity score according to the standard writing vector, the writing trajectory vector, the standard writing order and the sequence number of the trajectory information includes: According to the formula Determine the writing style similarity score S W , where V j，k is the kth writing trajectory vector in the jth writing trajectory information, j S is the sequence number of the standard writing order of the strokes corresponding to the j-th writing trajectory information, V j，k The transposed vector of ||V j，k || is V j，k The model, V j，k，S is the standard writing vector corresponding to the kth standard writing trajectory segment in the standard writing trajectory corresponding to the jth writing trajectory information, ||V j，k，S || is V j，k，S The modulus, n j is the number of writing trajectory vectors in the trajectory information of the jth writing, n j It is equal to the number of first position information in the j-th written track information minus 1, n is the number of track information, k≤n j , j≤n, and k, n j , j and n are all positive integers.

10. The smart pen based on data collection according to claim 5, characterized in that: Determining a writing proficiency score according to the first position information, the second position information, and the reference time information includes: According to the formula Determine the writing proficiency score S S , where Δt j is the duration of the time period when the pressure sensing signal is greater than or equal to the preset pressure threshold for the jth time, Δt R is the reference time information, n is the number of trajectory information, j≤n, and both j and n are positive integers.

Images