Handwriting rendering method and related device, electronic device and intelligent blackboard

By determining and generating the attribute information of touch screen data and filtering abnormal data, the problem of poor infrared touch screen data quality is solved, the quality and continuity of rendered data are improved, and the better display effect on the screen is achieved.

CN119166031APending Publication Date: 2024-12-20IFLYTEK CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411177289.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-26
Publication Date
2024-12-20

AI Technical Summary

Technical Problem

Existing infrared touch screens are susceptible to word deformation and abnormal data when collecting data, resulting in poor quality of rendered data and affecting the upper screen display of the electronic display.

Method used

By determining the position coordinates of the touch center point and the attribute information of the historical track point, the attribute information of the current track point is generated, and combining the position coordinates of the current track point and the information of the historical track point, the abnormal data is filtered to improve the continuity and personality of the rendering data. to improve the generation quality of rendered data.

Benefits of technology

It effectively improves the quality of the upper-screen rendering data generated by infrared touch screen data acquisition, reduces abnormal data interference, retains the personalized characteristics of the original text, and achieves a smoother and more accurate rendering effect.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119166031A_ABST
    Figure CN119166031A_ABST
Patent Text Reader

Abstract

The invention discloses a handwriting rendering method, a related device, an electronic device and an intelligent blackboard. The method comprises the steps of at least determining position coordinates of a touch center point based on current touch data collected by the infrared touch screen at the current moment; generating attribute information of a current track point corresponding to the current touch data based on the attribute information of the historical track point and the position coordinate of the touch center point; wherein the attribute information at least comprises position coordinates, speed and acceleration, and the historical touch data corresponding to the historical track point and the current touch data belong to the same section of touch track; and on-screen rendering data of the current track point is generated based on the attribute information of the current track point. According to the scheme, the generation quality of the on-screen rendering data generated based on the infrared touch screen acquisition data can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of intelligent educational technology, and in particular to a handwriting rendering method and related devices, electronic devices and intelligent blackboards. Background Art

[0002] At present, infrared touch frames are installed around the writing board, and corresponding writing operations on the writing board can be obtained through infrared touch detection, so as to realize multi-screen display of the blackboard content on the writing board itself and the electronic display screen.

[0003] In the prior art, infrared touch detection is easily affected by interferences such as handwriting deformation, resulting in poor quality of data generated by rendering, thereby affecting the upper screen display on the electronic display screen. In order to solve the above problems, auxiliary tools such as chalk connectors are usually used to correct the writing posture to reduce the probability of handwriting deformation. However, due to the inconvenience of using auxiliary tools and the inability to solve the interference of abnormal data such as flying insect data, the quality of the upper screen rendering data generated is poor. In view of this, how to improve the generation quality of the upper screen rendering data generated based on the infrared touch screen acquisition data has become a problem that needs to be solved urgently. Summary of the invention

[0004] The main technical problem solved by the present application is to provide a handwriting rendering method and related devices, electronic devices and smart blackboards, which can improve the generation quality of upper screen rendering data generated based on infrared touch screen acquisition data.

[0005] In order to solve the above technical problems, the first aspect of the present application provides a handwriting rendering method, including determining at least the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen at the current moment; generating attribute information of the current trajectory point corresponding to the current touch data based on the attribute information of the historical trajectory point and the position coordinates of the touch center point; wherein the attribute information includes at least the position coordinates, speed and acceleration, and the historical touch data corresponding to the historical trajectory point and the current touch data belong to the same touch trajectory; based on the attribute information of the current trajectory point, generating the upper screen rendering data of the current trajectory point.

[0006] In order to solve the above-mentioned technical problems, the second aspect of the present application provides a handwriting rendering device, including a center determination module, an attribute generation module and a rendering generation module. The center determination module is used to determine at least the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen at the current moment; the attribute generation module is used to generate attribute information of the current trajectory point corresponding to the current touch data based on the attribute information of the historical trajectory point and the position coordinates of the touch center point; wherein the attribute information includes at least position coordinates, speed and acceleration, and the historical touch data corresponding to the historical trajectory point belongs to the same touch trajectory as the current touch data; the rendering generation module is used to generate on-screen rendering data of the current trajectory point based on the attribute information of the current trajectory point.

[0007] In order to solve the above technical problem, the third aspect of the present application provides an electronic device, including a memory and a processor coupled to each other, the memory stores program instructions, and the processor is used to execute the program instructions to implement the handwriting rendering method described in the first aspect.

[0008] In order to solve the above-mentioned technical problems, the fourth aspect of the present application provides a smart blackboard, including an infrared touch screen, a touch rendering device and an electronic display screen. The touch rendering device is respectively communicated with the infrared touch screen and the electronic display screen. The infrared touch screen is arranged with relatively arranged transmitting light bars and receiving light bars. The electronic display screen is used to display the upper screen rendering data sent by the touch rendering device, and the touch rendering device is the electronic device described in the above-mentioned third aspect.

[0009] In order to solve the above technical problem, the fifth aspect of the present application provides a computer-readable storage medium storing program instructions that can be executed by a processor, and the program instructions are used to implement the handwriting rendering method described in the first aspect.

[0010] The above scheme, based on the current touch data collected by the infrared touch screen at the current moment, at least determines the position coordinates of the touch center point, generates the attribute information of the current track point corresponding to the current touch data based on the attribute information of the historical track point and the position coordinates of the touch center point, and the attribute information at least includes the position coordinates, speed and acceleration, and the historical touch data corresponding to the historical track point and the current touch data belong to the same touch track, and generates the upper screen rendering data of the current track point based on the attribute information of the current track point. On the one hand, the generation of the attribute information of the current track point is related to the attribute information of the historical track point, which can improve the continuity between each track point as much as possible to obtain the smoothest rendering data, and on the other hand, the generation of the attribute information of the current track point is related to the position coordinates of the touch center point, which can retain the personalized handwriting of the original touch data as much as possible, and the attribute information of the historical track point and the position coordinates of the touch center point are used as reference information for the generation of the attribute information of the current track point, which can filter the abnormal data collected by the infrared touch screen, so as to improve the generation quality of the upper screen rendering data generated based on the data collected by the infrared touch screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 It is a flowchart of an embodiment of the handwriting rendering method of the present application;

[0012] Figure 2 (a) is a schematic diagram of an embodiment of the original touch data in the handwriting rendering method of the present application;

[0013] Figure 2 (b) is a schematic diagram of an embodiment of the upper screen rendering data in the handwriting rendering method of the present application;

[0014] Figure 3 It is a schematic diagram of the framework of an embodiment of a handwriting rendering device of the present application;

[0015] Figure 4 It is a schematic diagram of a framework of an embodiment of an electronic device of the present application;

[0016] Figure 5 It is a structural diagram of an embodiment of the smart blackboard of the present application;

[0017] Figure 6 It is a schematic diagram of a framework of an embodiment of a computer-readable storage medium of the present application. DETAILED DESCRIPTION

[0018] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0019] The terms "system" and "network" are often used interchangeably in this article. The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship. In addition, "many" in this article means two or more than two.

[0020] See also Figure 1 , Figure 1 It is a flowchart of an embodiment of the handwriting rendering method of the present application.

[0021] Specifically, the following steps may be included:

[0022] Step S10: based on the current touch data collected by the infrared touch screen at the current moment, at least determine the position coordinates of the touch center point.

[0023] In the disclosed embodiments, the infrared touch screen is a touch screen implemented using infrared technology. Its working principle is to form a horizontally and vertically crossed infrared matrix by arranging infrared transmitting tubes and infrared receiving tubes on the four sides of the screen. When the user touches the screen with a finger or other object, the infrared rays passing through the position in the horizontal and vertical directions will be blocked. When the touch screen scans and finds that the infrared rays are blocked, the position of the touch point on the screen is determined by calculation. It should be noted that the specific structure of the infrared touch screen is not limited in this application.

[0024] In one implementation scenario, the current touch data is obtained based on the touch action of the target object on the infrared touch screen, such as chalk writing, finger touch, etc. Based on the current touch data collected by the infrared touch screen at the current moment, at least the position coordinates of the touch center point of the current touch data can be determined.

[0025] In a specific implementation scenario, it can be understood that the current touch data is a plane figure with a certain area, and the position information of all vertices on the periphery of the plane figure formed by the current touch data is obtained, and the obtained plane figure is divided to obtain a number of triangles. Specifically, it can be achieved by selecting any vertex among the several vertices and drawing lines to connect other non-adjacent vertices, calculating the center of mass of each triangle based on the vertex coordinates of each triangle, and calculating the area of ​​each triangle to obtain the area ratio of each triangle in the plane figure, and weighting the center of mass of each triangle according to the proportion of its area to the plane figure to obtain the center point of the entire plane figure as the touch center point of the current touch data.

[0026] In a specific implementation scenario, if the plane figure formed by the current touch data is a convex polygon, the coordinates of the four corner points of the circumscribed rectangle of the convex polygon are obtained, and then the average value of the horizontal coordinates of each corner point is taken as the horizontal coordinate of the touch center point, and the average value of the vertical coordinates of each corner point is taken as the vertical coordinate of the touch center point to obtain the position coordinates of the touch center point.

[0027] In a specific implementation scenario, based on the current touch data collected by the infrared touch screen at the current moment, the trajectory information of the touch center point is also determined, that is, the change of the actual writing trajectory of the target object, such as the speed and acceleration of the touch center point, is determined, which is not limited in this application.

[0028] In one implementation scenario, after determining the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen at the current moment, the number of receiving lights in the receiving light bar that have not received infrared rays at the current moment is obtained, that is, the infrared rays in the infrared touch screen are blocked at the current moment. When the number of receiving lights that have not received infrared rays is not greater than the preset threshold, the current touch data is considered to be abnormal data, such as flying insects, dust, false touch, etc., and the current touch data is deleted and the touch data at the next moment is waited. The above scheme determines whether the current touch data is abnormal data based on the number of receiving lights in the receiving light bar that have not received infrared rays at the current moment, which can reduce the interference of abnormal data and improve the quality of subsequent on-screen rendering data generation.

[0029] In a specific implementation scenario, after determining the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen at the current moment, the Kalman filter algorithm based on Gaussian white noise can be used to process the current touch data and filter out the noise data. Specifically, the noise data includes thermal noise, electronic noise, environmental noise, etc. Thermal noise is noise caused by temperature, which mainly comes from the sensor itself. Due to the thermal effect, the electrons inside the sensor move randomly, generating unstable voltage and current, thereby generating random noise in the signal. Thermal noise is mainly related to temperature and resistance. The higher the temperature, the greater the resistance, and the greater the noise. Electronic noise is caused by the instability of electronic movement, and mainly occurs in the circuit. In electronic devices, since electrons have a wave nature, there is a noise potential of moving electrons in the circuit. Environmental noise is noise caused by interference from the surrounding environment, mainly including solar radiation, atmospheric radiation, artificial electromagnetic radiation, and other electronic devices. The above scheme performs noise filtering based on the current touch data and filters out noise data, which helps to improve the accuracy and stability of the infrared touch screen.

[0030] Step S20: generating attribute information of the current track point corresponding to the current touch data based on the attribute information of the historical track point and the position coordinates of the touch center point.

[0031] In an implementation scenario, based on the attribute information of the historical trajectory point and the position coordinates of the touch center point, a detection result is obtained to characterize whether the current touch data is triggered by a normal writing touch. The historical touch data corresponding to the historical trajectory point and the current touch data belong to the same touch trajectory, for example, several touch data belonging to the same stroke during the writing process, specifically "horizontal", "vertical", "vertical hook", etc. all belong to the same touch trajectory. Based on the detection result, it is selected to generate the attribute information of the current trajectory point based on the attribute information of the historical trajectory point, or to filter the current touch data. In the above scheme, on the one hand, the generation of the attribute information of the current trajectory point is related to the attribute information of the historical trajectory point, which can improve the continuity between each trajectory point as much as possible to obtain the smoothest rendering data. On the other hand, the generation of the attribute information of the current trajectory point is related to the position coordinates of the touch center point, which can retain the personalized handwriting of the original touch data as much as possible, and the attribute information of the historical trajectory point and the position coordinates of the touch center point are used as reference information for the generation of the attribute information of the current trajectory point, which can filter the abnormal data collected by the infrared touch screen, so as to improve the generation quality of the upper screen rendering data generated based on the infrared touch screen collected data.

[0032] In a specific implementation scenario, based on the attribute information of the historical trajectory point, a target coordinate range is generated, and based on whether the position coordinates of the touch center point are within the target coordinate range, the detection result is determined. Specifically, the attribute information of the historical trajectory point at least includes the position coordinates, speed and acceleration of each historical trajectory point. Based on the attribute information of each historical trajectory point, the trajectory change of the touch trajectory to which the current touch data belongs can be obtained to generate a reasonable target coordinate range. For example, based on the coordinate position, speed and acceleration of the previous historical trajectory point, a candidate trajectory point coordinate position (x, y) is calculated, and based on the speed, acceleration and position coordinate changes of all historical trajectory points, a constant a representing the trajectory change amplitude is generated, that is, the generated target coordinate range is (x±b, y±b), or, based on the selected width of the stroke to be rendered, a constant b is set, that is, the generated target coordinate range is (x±b, y±b). It should be noted that the above embodiment is only a possible implementation method, and the method for generating the target coordinate range is not limited in this application.

[0033] In a specific implementation scenario, when the position coordinates of the touch center point are not within the target coordinate range, it is determined that the detection result is that the current touch data is not triggered by normal writing touch, such as accidental finger touch, chalk breakage, etc.

[0034] In another specific implementation scenario, when the position coordinates of the touch center point are within the target coordinate range, it is determined that the detection result is that the current touch data is triggered by a normal writing touch.

[0035] In a specific implementation scenario, when the current touch data is detected as triggered by a normal writing touch, the attribute information of the current trajectory point is generated based on the attribute information of the historical trajectory point. For example, the speed m and acceleration n in the attribute information of the previous historical trajectory point are obtained, and the time interval t between two adjacent trajectory points is set. Based on the attribute information and time t, the distance between the current trajectory point and the previous historical trajectory point at the next moment is predicted to be x, and based on the attribute information of several historical trajectory points, the deflection angle y between the current trajectory point and the previous historical trajectory point is predicted, and the position coordinates (a, b) of the previous historical trajectory point are obtained, so that the speed m1 and acceleration n1 of the current trajectory point, as well as the position coordinates (a1, b1) of the current trajectory point can be obtained.

[0036] In another specific implementation scenario, when the current touch data is detected as not triggered by a normal writing touch, the current touch data is filtered.

[0037] In a specific implementation scenario, the infrared touch screen is arranged with a transmitting light bar and a receiving light bar that are relatively arranged, and any transmitting light in the transmitting light bar transmits infrared rays in several directions to the corresponding receiving light in the receiving light bar. For example, a transmitting light in the transmitting light bar transmits three infrared rays to the corresponding receiving light, respectively to the left end, the middle and the right end of the receiving light. When the attribute information also includes the pen tilt angle, the receiving light in the receiving light bar that has not received infrared rays in at least one direction at the current moment is selected as the target light, and the pen tilt angle of the current track point used to determine the change range of the rendering width in the upper screen rendering data is determined based on at least the position coordinates of each target light and the position coordinates of the current track point. The above scheme obtains the pen tilt angle of the current track point as reference information for the generation of the upper screen rendering data, which can improve the generation quality of the upper screen rendering data generated based on the infrared touch screen acquisition data.

[0038] In a specific implementation scenario, the pen tilt angle of the current track point can be obtained based on the number of target lights. For example, the number of target lights selected based on the historical track points is 1, and the pen tilt angle is 90 degrees, which is approximately perpendicular to the infrared touch screen writing. The number of target lights selected based on the current track point is 3, and the pen tilt angle of the current track point can be obtained as 45 degrees based on writing habits, and so on. Alternatively, a target light is selected based on the current track point, and the middle and right ends corresponding to the target light do not receive infrared rays, while the left end corresponding to the target light receives infrared rays, and the pen tilt angle of the current track point can be obtained as a, and so on. It should be noted that the above embodiment is only a possible implementation method, and the method for calculating the pen tilt angle is not limited in this application.

[0039] In one implementation scenario, after generating the attribute information of the current track point corresponding to the current touch data based on the attribute information of the historical track point and the position coordinates of the touch center point, reference information for determining whether the current track point is the touch track endpoint is obtained based on the coordinate difference between the position coordinates of the current track point and the position coordinates of the previous track point, and whether to perform text recognition on the target touch track to obtain a recognition result based on whether the reference information is the touch track endpoint, and the target touch track includes the written touch track from the previous written text to the current track point. The above scheme performs text recognition before generating the on-screen rendering data, and uses the coordinate difference between the position coordinates of the current track point and the position coordinates of the previous track point as reference information for whether to perform text recognition, which can reduce the amount of data processing while maximizing the quality of the on-screen rendering data generation.

[0040] In a specific implementation scenario, the position coordinates of the current track point, such as (a, b), are obtained, and the position coordinates of the previous track point, such as (m, n), and the difference between the horizontal coordinates and the difference between the vertical coordinates are calculated respectively as the coordinate difference between the current track point position coordinates and the previous track point position coordinates, that is, am and bn, and the preset difference condition is that the horizontal coordinate difference is not less than w and / or the vertical coordinate difference is not less than y, and the size relationship between am and w and the size relationship between bn and y are determined. When the coordinate difference meets the preset difference condition, the current track point is used as the starting point of the current touch track, and the previous track point is used as the ending point of the previous touch track, and the coordinate difference for the touch track is determined. The reference information generated by the on-screen rendering data can be used to reasonably divide, render and display characters, improve the quality of the on-screen rendering data generation, and when and only when the horizontal coordinate difference is less than w and the vertical coordinate difference is less than y, it indicates that the coordinate difference does not meet the preset difference condition, and the previous track point is used as the middle point of the current touch track, and the current track point is used as the candidate end point of the current touch track. If the touch data is not collected within the preset time period, the candidate end point is used as the end point of the current touch track. If the touch data is collected within the preset time period, the track point that has been used as the candidate end point becomes the previous track point of the current track point, and whether the preset difference condition is met is re-determined based on the coordinate difference. The above scheme uses the coordinate difference between the position coordinates of the current track point and the position coordinates of the previous track point as reference information for whether to perform text recognition, which can reduce the amount of data processing while maximizing the quality of the on-screen rendering data generation.

[0041] Please refer to Figure 2 (a) and Figure 2 (b) Figure 2 (a) is a schematic diagram of an embodiment of the original touch data in the handwriting rendering method of the present application, Figure 2 (b) is a schematic diagram of an embodiment of the upper screen rendering data in the handwriting rendering method of the present application. Figure 2 As shown in (a), there are situations where different characters in the original touch data are far apart or overlapped. Based on the coordinate difference between the position coordinates of the current track point and the position coordinates of the previous track point, after obtaining reference information for determining whether the current track point is the touch track endpoint, it can be used to perform operations such as segmentation and reorganization between the characters contained in the original touch data, such as Figure 2 (b) is shown to improve the generation quality of the rendered data displayed on the screen.

[0042] In a specific implementation scenario, when the reference information is a touch endpoint, a recognition result representing text recognition of a target touch trajectory is obtained.

[0043] In a specific implementation scenario, the touch endpoints include a starting point of touch data and an ending point of touch data. When the reference information represents the starting point or the ending point of the touch track, a recognition result representing text recognition of the target touch track is obtained.

[0044] In a specific implementation scenario, when the reference information is not an endpoint of a touch track, such as a middle point of the touch track, a recognition result indicating that text recognition is not performed on the target touch track is obtained.

[0045] Step S30: Based on the attribute information of the current trajectory point, generate on-screen rendering data of the current trajectory point.

[0046] In the disclosed embodiment, the upper screen rendering data is generated based on rendering technology. The rendering technology involves multiple aspects such as light and shadow calculation, color mixing, texture mapping, etc. For specific technical details, please refer to the rendering technology, etc., which will not be repeated here.

[0047] In an implementation scenario, the on-screen rendering data of the current track point is generated based on the attribute information of the current track point. On the one hand, the generation of the attribute information of the current track point is related to the attribute information of the historical track point, which can improve the continuity between the track points as much as possible to obtain the smoothest rendering data. On the other hand, the generation of the attribute information of the current track point is related to the position coordinates of the touch center point, which can retain the personalized handwriting of the original touch data as much as possible, and the attribute information of the historical track point and the position coordinates of the touch center point are used as reference information for the generation of the attribute information of the current track point, which can filter the abnormal data collected by the infrared touch screen, so as to improve the generation quality of the on-screen rendering data generated based on the infrared touch screen collected data.

[0048] In a specific implementation scenario, generating on-screen rendering data of the current trajectory point based on the recognition result and the attribute information of the current trajectory point can improve the generation quality of the on-screen rendering data generated based on the infrared touch screen acquisition data.

[0049] In a specific implementation scenario, when the recognition result represents text recognition of the target touch trajectory, the written text corresponding to the target touch trajectory is determined, and the target touch trajectory includes a written touch trajectory from the previous written text to the current trajectory point. Based on the written text corresponding to the target touch trajectory, separation information between the written text corresponding to the target touch trajectory and the previous written text is obtained. Based on the separation information and attribute information of the current trajectory point, on-screen rendering data of the current trajectory point is generated. For example, a minimum separation threshold and a maximum separation threshold are set. When the separation information represents that the distance between the written text corresponding to the target writing trajectory and the previous written text is less than the minimum separation threshold or greater than the maximum separation threshold, the separation distance between the two written texts is adjusted to between the minimum separation threshold and the maximum separation threshold.

[0050] The above scheme, based on the current touch data collected by the infrared touch screen at the current moment, at least determines the position coordinates of the touch center point, generates the attribute information of the current track point corresponding to the current touch data based on the attribute information of the historical track point and the position coordinates of the touch center point, and the attribute information at least includes the position coordinates, speed and acceleration, and the historical touch data corresponding to the historical track point and the current touch data belong to the same touch track, and generates the upper screen rendering data of the current track point based on the attribute information of the current track point. On the one hand, the generation of the attribute information of the current track point is related to the attribute information of the historical track point, which can improve the continuity between each track point as much as possible to obtain the smoothest rendering data, and on the other hand, the generation of the attribute information of the current track point is related to the position coordinates of the touch center point, which can retain the personalized handwriting of the original touch data as much as possible, and the attribute information of the historical track point and the position coordinates of the touch center point are used as reference information for the generation of the attribute information of the current track point, which can filter the abnormal data collected by the infrared touch screen, so as to improve the generation quality of the upper screen rendering data generated based on the data collected by the infrared touch screen.

[0051] See also Figure 3 , Figure 3 Schematic diagram of the framework of an embodiment of the handwriting rendering device 30 of the present application. Figure 3 As shown, the handwriting rendering device 30 includes a center determination module 31, an attribute generation module 32 and a rendering generation module 33. The center determination module 31 is used to determine at least the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen at the current moment; the attribute generation module 32 is used to generate attribute information of the current trajectory point corresponding to the current touch data based on the attribute information of the historical trajectory point and the position coordinates of the touch center point; wherein the attribute information at least includes the position coordinates, speed and acceleration, and the historical touch data corresponding to the historical trajectory point and the current touch data belong to the same touch trajectory; the rendering generation module 33 is used to generate the upper screen rendering data of the current trajectory point based on the attribute information of the current trajectory point.

[0052] Therefore, the handwriting rendering device 30 determines at least the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen at the current moment, generates the attribute information of the current track point corresponding to the current touch data based on the attribute information of the historical track point and the position coordinates of the touch center point, and the attribute information at least includes the position coordinates, speed and acceleration, and the historical touch data corresponding to the historical track point and the current touch data belong to the same touch track, and generates the upper screen rendering data of the current track point based on the attribute information of the current track point. On the one hand, the generation of the attribute information of the current track point is related to the attribute information of the historical track point, which can improve the continuity between each track point as much as possible to obtain the smoothest rendering data, and on the other hand, the generation of the attribute information of the current track point is related to the position coordinates of the touch center point, which can retain the personalized handwriting of the original touch data as much as possible, and the attribute information of the historical track point and the position coordinates of the touch center point are used as reference information for the generation of the attribute information of the current track point, which can filter the abnormal data collected by the infrared touch screen, so as to improve the generation quality of the upper screen rendering data generated based on the data collected by the infrared touch screen.

[0053] In some disclosed embodiments, the attribute generation module 32 also includes a detection result acquisition module (not shown), which is used to obtain a detection result characterizing whether the current touch data is triggered by a normal writing touch based on the attribute information of the historical trajectory points and the position coordinates of the touch center point; the attribute generation module 32 also includes a detection selection module (not shown), which is used to select the attribute information based on the historical trajectory points based on the detection results, generate the attribute information of the current trajectory points, or filter the current touch data.

[0054] In some disclosed embodiments, the detection selection module (not shown) also includes a selection detection submodule (not shown), which is used to generate attribute information of the current trajectory point based on the attribute information of the historical trajectory points in response to the current touch data being detected as triggered by a normal writing touch; and to filter the current touch data in response to the current touch data being detected as not triggered by a normal writing touch.

[0055] In some disclosed embodiments, the detection result acquisition module (not shown) also includes a range generation module (not shown), which is used to generate a target coordinate range based on the attribute information of the historical trajectory points; the detection result acquisition module (not shown) also includes a result determination module (not shown), which is used to determine the detection result based on whether the position coordinates of the touch center point are within the target coordinate range.

[0056] In some disclosed embodiments, the result determination module (not shown) also includes a determination submodule (not shown) for determining, in response to the position coordinates of the touch center point not being within the target coordinate range, that the detection result includes: the current touch data is not triggered by a normal writing touch; and in response to the position coordinates of the touch center point being within the target coordinate range, determining the detection result includes: the current touch data is triggered by a normal writing touch.

[0057] In some disclosed embodiments, after generating the attribute information of the current trajectory point corresponding to the current touch data based on the attribute information of the historical trajectory point and the position coordinates of the touch center point, and before generating the on-screen rendering data of the current trajectory point based on the attribute information of the current trajectory point, the handwriting rendering device 30 also includes a reference information acquisition module (not shown) for obtaining reference information for determining whether the current trajectory point is an endpoint of the touch trajectory based on the coordinate difference between the position coordinates of the current trajectory point and the position coordinates of the previous trajectory point; the handwriting rendering device 30 also includes a recognition result acquisition module (not shown) for determining whether to perform text recognition on the target touch trajectory to obtain a recognition result based on whether the reference information is an endpoint of the touch trajectory; wherein the target touch trajectory includes a written touch trajectory from the previous written text to the current trajectory point; the rendering generation module 33 also includes a rendering submodule (not shown) for generating the on-screen rendering data of the current trajectory point based on the recognition result and the attribute information of the current trajectory point.

[0058] In some disclosed embodiments, the recognition result acquisition module (not shown) also includes an endpoint confirmation submodule (not shown), which is used to obtain a recognition result representing text recognition of the target touch trajectory in response to the current trajectory point being determined by reference information to be a touch trajectory endpoint; in response to the current trajectory point being determined by reference information not to be a touch trajectory endpoint, obtain a recognition result representing that text recognition is not performed on the target touch trajectory.

[0059] In some disclosed embodiments, when the recognition result represents text recognition of the target touch trajectory, the rendering sub-module (not shown) also includes a written text determination module (not shown) for identifying the written text corresponding to the target touch trajectory; the rendering sub-module (not shown) also includes a separation information confirmation module (not shown) for obtaining separation information between the written text corresponding to the target touch trajectory and the previous written text based on the written text corresponding to the target touch trajectory; the rendering sub-module (not shown) also includes a rendering generation sub-module (not shown) for generating on-screen rendering data of the current trajectory point based on the separation information and attribute information of the current trajectory point.

[0060] In some disclosed embodiments, the reference information acquisition module (not shown) also includes an endpoint generation submodule (not shown), which is used to determine, in response to the coordinate difference satisfying a preset difference condition, that the reference information includes: the current trajectory point as the starting point of the current segment of the touch trajectory, and the previous trajectory point as the ending point of the previous segment of the touch trajectory; in response to the coordinate difference not satisfying the preset difference condition, the reference information includes: the previous trajectory point as the middle point of the current segment of the touch trajectory, the current trajectory point as the candidate ending point of the current segment of the touch trajectory, and after no touch data is collected within a preset time period, the candidate ending point is used as the ending point of the current segment of the touch trajectory.

[0061] In some disclosed embodiments, the attribute information also includes a pen tilt angle, the infrared touch screen is arranged with a relatively arranged transmitting light bar and a receiving light bar, and any transmitting light in the transmitting light bar transmits infrared rays in several directions to a corresponding receiving light in the receiving light bar, and the handwriting rendering device 30 also includes a target light selection module (not shown), which is used to select a receiving light in the receiving light bar that has not received infrared rays in at least one direction at the current moment as a target light; the handwriting rendering device 30 also includes an angle determination module (not shown), which is used to determine the pen tilt angle of the current track point based on at least the position coordinates of each target light and the position coordinates of the current track point; wherein the pen tilt angle is used to determine the variation amplitude of the rendering width in the upper screen rendering data.

[0062] In some disclosed embodiments, the infrared touch screen is arranged with a relatively arranged transmitting light bar and a receiving light bar. After at least determining the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen at the current moment, and before generating the attribute information of the current trajectory point corresponding to the current touch data based on the attribute information of the historical trajectory point and the position coordinates of the touch center point, the handwriting rendering device 30 also includes a receiving light quantity detection module (not shown) for detecting the number of receiving lights in the receiving light bar that have not received infrared rays at the current moment; the handwriting rendering device 30 also includes a touch data screening module (not shown) for deleting the current touch data in response to the number of receiving lights being not greater than a preset threshold, and waiting for the touch data at the next moment.

[0063] See also Figure 4 , Figure 4 4 is a schematic diagram of a framework of an embodiment of the electronic device 40 of the present application. Figure 4As shown, the electronic device 40 includes a memory 41 and a processor 42 coupled to each other, the memory 41 stores program instructions, and the processor 42 is used to execute the program instructions to implement the steps in any of the above-mentioned handwriting rendering method embodiments. Specifically, the electronic device 40 may include but is not limited to: a server, a desktop computer, a laptop computer, a tablet computer, a smart phone, etc., which are not limited here. Specifically, the processor 42 is used to control itself and the memory 41 to implement any of the above-mentioned handwriting rendering method embodiments. The processor 42 can also be called a CPU (Central Processing Unit). The processor 42 may be an integrated circuit chip with signal processing capabilities. The processor 42 can also be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field-programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. In addition, the processor 42 can be implemented by an integrated circuit chip.

[0064] Therefore, the electronic device 40 determines at least the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen at the current moment, generates the property information of the current track point corresponding to the current touch data based on the property information of the historical track point and the position coordinates of the touch center point, and the property information at least includes the position coordinates, speed and acceleration, and the historical touch data corresponding to the historical track point and the current touch data belong to the same touch track, and generates the upper screen rendering data of the current track point based on the property information of the current track point. On the one hand, the generation of the property information of the current track point is related to the property information of the historical track point, which can improve the continuity between each track point as much as possible to obtain the smoothest rendering data, and on the other hand, the generation of the property information of the current track point is related to the position coordinates of the touch center point, which can retain the personalized handwriting of the original touch data as much as possible, and the property information of the historical track point and the position coordinates of the touch center point are used as reference information for the generation of the property information of the current track point, which can filter the abnormal data collected by the infrared touch screen, so as to improve the generation quality of the upper screen rendering data generated based on the data collected by the infrared touch screen.

[0065] See also Figure 5 , Figure 5 Schematic diagram of the framework of an embodiment of the smart blackboard 50 of the present application. Figure 5As shown, the smart blackboard 50 includes an infrared touch screen 51, a touch rendering device (not shown) and an electronic display screen 53. The touch rendering device (not shown) is respectively connected to the infrared touch screen 51 and the electronic display screen 53 for communication. The infrared touch screen 51 is provided with a transmitting light bar 511 and a receiving light bar 512 which are relatively arranged. The electronic display screen 53 is used to display the upper screen rendering data sent by the touch rendering device (not shown), and the touch rendering device (not shown) is the electronic device 40 described in the aforementioned embodiment.

[0066] Therefore, the infrared touch screen 51 detects the touch data on the infrared touch screen 51 in real time based on the reception of the infrared light bar 512 by the transmitting light bar 511. The touch rendering device (not shown) determines at least the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen 51 at the current moment, and generates the attribute information of the current track point corresponding to the current touch data based on the attribute information of the historical track point and the position coordinates of the touch center point, wherein the attribute information includes at least the position coordinates, the speed and the acceleration, and the historical touch data corresponding to the historical track point and the current touch data belong to the same touch track, and generates the upper screen rendering data of the current track point based on the attribute information of the current track point, and renders the upper screen rendering data of the current track point to the upper screen. The screen rendering data is sent to a display touch rendering device (not shown) to display the upper screen rendering data corresponding to the current touch data. On the one hand, the generation of the current trajectory point attribute information is related to the attribute information of the historical trajectory point, which can improve the continuity between the various trajectory points as much as possible to obtain the smoothest possible rendering data. On the other hand, the generation of the current trajectory point attribute information is related to the position coordinates of the touch center point, which can retain the personalized handwriting of the original touch data as much as possible, and use the attribute information of the historical trajectory point and the position coordinates of the touch center point as reference information for generating the current trajectory point attribute information, which can filter out abnormal data collected by the infrared touch screen, thereby improving the generation quality of the upper screen rendering data.

[0067] In one implementation scenario, the number of infrared touch screens 51 and the number of electronic display screens 53 are not limited in this application. For example, the smart blackboard 50 is equipped with two infrared touch screens 51 and one electronic display screen 53. When the target object is written on any infrared touch screen 51, the corresponding on-screen rendering data can be generated. Alternatively, the smart blackboard 50 is equipped with two infrared touch screens 51 and two electronic display screens 53. After the target object is written on any infrared touch screen 51, it can be displayed at the corresponding position of any electronic display screen 53, or at the corresponding positions of the two electronic display screens 53 at the same time. It should be noted that the structure of the above-mentioned smart blackboard is only a possible embodiment, and the specific structure of the smart blackboard is not limited in this application.

[0068] In one implementation scenario, the relative position between the infrared touch screen 51 and the electronic display screen 53 is not limited in the present application. For example, the infrared touch screen 51 and the electronic display screen 53 are arranged on the same horizontal plane, the infrared touch screen 51 is arranged on the left side of the electronic display screen 53, or the infrared touch screen 51 is arranged above the electronic display screen 53, or the infrared touch screen 51 and the electronic display screen 53 are not arranged on the same horizontal plane, the infrared touch screen 51 is arranged in front of the electronic display screen 53, or the infrared touch screen 51 and the electronic display screen 53 are arranged overlapping.

[0069] In an implementation scenario, the infrared touch screen 51 is arranged with a relatively arranged transmitting light bar 511 and a receiving light bar 512. The transmitting light bar 511 is arranged with a plurality of transmitting lights, and the receiving light bar 512 is arranged with receiving lights corresponding to each transmitting light. When there is no obstruction between the transmitting light and the corresponding receiving light, the receiving light can receive the infrared light emitted by the transmitting light. On the contrary, when there is an obstruction between the transmitting light and the corresponding receiving light, the receiving light cannot receive the infrared light emitted by the transmitting light.

[0070] In a specific implementation scenario, any transmitting light in the transmitting light bar 511 transmits infrared rays in several directions to the corresponding receiving light in the receiving light bar 512. For example, one transmitting light in the transmitting light bar 511 transmits three infrared rays to the corresponding receiving light, respectively to the left end, the middle end, and the right end of the receiving light. It should be noted that the above embodiment is only one possible implementation method, and the structures of the transmitting light bar 511 and the receiving light bar 512 are not limited in this application.

[0071] See also Figure 6 , Figure 6 Schematic diagram of a framework of an embodiment of a computer-readable storage medium 60 of the present application. The computer-readable storage medium 60 stores program instructions 61 that can be executed by a processor, and the program instructions 61 are used to implement the steps in any of the above-mentioned embodiments of the handwriting rendering method.

[0072] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0073] The above description of various embodiments tends to emphasize the differences between the various embodiments. The same or similar aspects can be referenced to each other, and for the sake of brevity, they will not be repeated herein.

[0074] In the several embodiments provided in the present application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device implementation described above is only schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0075] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, and may be located in one place or distributed over multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0076] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0077] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of each implementation method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code.

[0078] If the technical solution of this application involves personal information, the product using the technical solution of this application has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing the personal information. If the technical solution of this application involves sensitive personal information, the product using the technical solution of this application has obtained the individual's separate consent before processing the sensitive personal information, and at the same time meets the "explicit consent" requirement. For example, on personal information collection devices such as cameras, clear and prominent signs are set to inform that the personal information collection scope has been entered and personal information will be collected. If the individual voluntarily enters the collection scope, it is deemed that he or she agrees to the collection of his or her personal information; or on the device that processes personal information, the personal information processing rules are notified by obvious signs / information, and the individual's authorization is obtained through pop-up information or by asking the individual to upload his or her personal information; among them, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.

Claims

1. A handwriting rendering method, characterized in that: include: Based on the current touch data collected by the infrared touch screen at the current moment, at least determine the position coordinates of the touch center point; Based on the attribute information of the historical trajectory point and the position coordinates of the touch center point, the attribute information of the current trajectory point corresponding to the current touch data is generated; wherein the attribute information at least includes the position coordinates, the speed and the acceleration, and the historical touch data corresponding to the historical trajectory point and the current touch data belong to the same touch trajectory; Based on the attribute information of the current trajectory point, on-screen rendering data of the current trajectory point is generated.

2. The method according to claim 1, characterized in that The generating the attribute information of the current track point corresponding to the current touch data based on the attribute information of the historical track point and the position coordinates of the touch center point includes: Based on the attribute information of the historical track points and the position coordinates of the touch center point, a detection result indicating whether the current touch data is triggered by a normal writing touch is obtained; In response to the detection result indicating that the current touch data is triggered by a normal writing touch, generating attribute information of the current track point based on the attribute information of the historical track point; In response to the detection result indicating that the current touch data is not triggered by a normal writing touch, the current touch data is filtered.

3. The method according to claim 2, characterized in that The obtaining of the detection result representing whether the current touch data is triggered by a normal writing touch based on the attribute information of the historical track point and the position coordinates of the touch center point includes: Based on the attribute information of the historical trajectory points, a target coordinate range is generated; In response to the position coordinates of the touch center point not being within the target coordinate range, determining the detection result includes: the current touch data is not triggered by a normal writing touch; In response to the position coordinates of the touch center point being within the target coordinate range, determining the detection result includes: the current touch data is triggered by a normal writing touch.

4. The method according to claim 1, characterized in that: After generating the attribute information of the current trajectory point corresponding to the current touch data based on the attribute information of the historical trajectory point and the position coordinates of the touch center point, and before generating the on-screen rendering data of the current trajectory point based on the attribute information of the current trajectory point, the method further includes: Based on the coordinate difference between the position coordinates of the current track point and the position coordinates of the previous track point, obtaining reference information for determining whether the current track point is an endpoint of the touch track; Based on whether the reference information is the endpoint of the touch track, determining whether to perform text recognition on the target touch track to obtain a recognition result; wherein the target touch track includes a written touch track from the last written text to the current track point; The step of generating on-screen rendering data of the current trajectory point based on the attribute information of the current trajectory point further includes: Based on the recognition result and the attribute information of the current trajectory point, on-screen rendering data of the current trajectory point is generated.

5. The method according to claim 4, characterized in that The determining whether to perform text recognition on the target touch track based on whether the reference information is the touch track endpoint to obtain a recognition result includes at least one of the following: In response to determining that the current track point is the touch track endpoint according to the reference information, obtaining a recognition result representing text recognition of the target touch track; In response to determining, based on the reference information, that the current track point is not an endpoint of the touch track, a recognition result indicating that text recognition is not performed on the target touch track is obtained.

6. The method according to claim 4, characterized in that In the case where the recognition result represents text recognition of the target touch track, generating on-screen rendering data of the current track point based on the recognition result and the attribute information of the current track point includes: Identify the written text corresponding to the target touch track; Based on the written characters corresponding to the target touch track, obtaining separation information between the written characters corresponding to the target touch track and the previous written characters; Based on the separation information and the attribute information of the current trajectory point, on-screen rendering data of the current trajectory point is generated.

7. The method according to claim 4, characterized in that The obtaining, based on the coordinate difference between the position coordinates of the current track point and the position coordinates of the previous track point, reference information for determining whether the current track point is an endpoint of the touch track includes at least one of the following: In response to the coordinate difference satisfying a preset difference condition, determining the reference information includes: the current track point being used as a starting point of a current touch track, and the previous track point being used as an ending point of a previous touch track; In response to the coordinate difference not satisfying a preset difference condition, determining that the reference information includes: the previous trajectory point is used as the middle point of the current segment touch trajectory, the current trajectory point is used as a candidate termination point of the current segment touch trajectory, and after no touch data is collected within a preset time period, the candidate termination point is used as the termination point of the current segment touch trajectory.

8. The method according to claim 1, characterized in that The attribute information also includes a pen tilt angle, the infrared touch screen is arranged with a transmitting light bar and a receiving light bar arranged relatively, and any transmitting light in the transmitting light bar transmits infrared rays in several directions to a corresponding receiving light in the receiving light bar, and the method also includes: Selecting a receiving light in the receiving light bar that has not received the infrared light from at least one direction at the current moment as a target light; At least based on the position coordinates of each of the target lights and the position coordinates of the current track point, the pen stroke inclination angle of the current track point is determined; wherein the pen stroke inclination angle is used to determine the variation range of the rendering width in the upper screen rendering data.

9. The method according to claim 1, characterized in that: The infrared touch screen is arranged with a transmitting light bar and a receiving light bar arranged relatively. After at least determining the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen at the current moment, and before generating the attribute information of the current track point corresponding to the current touch data based on the attribute information of the historical track point and the position coordinates of the touch center point, the method further includes: Obtain the number of receiving lights in the receiving light bar that have not received infrared rays at the current moment; In response to the number of the receiving lights being not greater than a preset threshold, the current touch data is deleted, and touch data at a next moment is waited for.

10. A handwriting rendering device, characterized in that: include: A center determination module, used to determine at least the position coordinates of the touch center point based on the current touch data collected by the infrared touch screen at the current moment; an attribute generation module, configured to generate attribute information of a current trajectory point corresponding to the current touch data based on the attribute information of the historical trajectory point and the position coordinates of the touch center point; wherein the attribute information at least includes position coordinates, velocity and acceleration, and the historical touch data corresponding to the historical trajectory point and the current touch data belong to the same touch trajectory; The rendering generation module is used to generate on-screen rendering data of the current trajectory point based on the attribute information of the current trajectory point.

11. An electronic device, characterized in that: The invention at least comprises a memory and a processor coupled to each other, wherein the memory stores program instructions, and the processor is used to execute the program instructions to implement the handwriting rendering method according to any one of claims 1 to 9.

12. A smart blackboard, characterized in that: It includes an infrared touch screen, a touch rendering device and an electronic display screen, wherein the touch rendering device is respectively connected to the infrared touch screen and the electronic display screen for communication, the infrared touch screen is arranged with a transmitting light bar and a receiving light bar arranged relatively, the electronic display screen is used to display the upper screen rendering data sent by the touch rendering device, and the touch rendering device is the electronic device described in claim 11 above.

13. A computer-readable storage medium, characterized in that: Program instructions that can be executed by a processor are stored, and the program instructions are used to implement the handwriting rendering method according to any one of claims 1 to 9.

Citation Information

Cited By

  • Window state recognition and control method and device, electronic equipment and storage medium

    CN120599549A

  • Screen writing track display method and device and storage medium

    CN120872222A