Method and device for presenting handwriting, interactive panel and storage medium

Abstract

The application discloses a writing trace presentation method and device, an interactive panel and a storage medium. The touch accuracy of a touch frame of the interactive panel reaches a set accuracy range. The method comprises the following steps: displaying a writing interface through a display screen; obtaining touch point information fed back through the touch frame when a touch object touches the surface of the display screen and moves, the touch object being controlled by a user; and presenting writing traces matching the moving state of the touch object on the writing interface through analysis of each touch point information. By using the method, the writing traces presented on the writing interface can be more matched with the moving state of the touch object in the writing process, so that the writing traces with the writing style of the user are better presented, and the presentation effect of the writing traces on the interactive panel is improved.

Description

Technical Field

[0001] This application relates to the field of touch writing technology for electronic devices, and more particularly to methods, devices, interactive whiteboards and storage media for presenting handwriting. Background Technology

[0002] The touch frame is a crucial hardware component of interactive flat panels, primarily used to collect touch information generated by user touch operations. Most interactive flat panels on the market use touch frames with insufficient touch precision, such as non-high-precision touch frames below a certain range. The main drawbacks of these non-high-precision touch frames are: difficulty in identifying the type of writing pen; difficulty in ensuring the same touch area is generated by the same writing pen; difficulty in determining whether the touch medium is a writing pen, a finger, or an eraser; and difficulty in determining the touch rotation angle.

[0003] In the process of developing this invention, the inventors discovered the following defects: the software layer of the interactive flat panel cannot maximize the use of touch information fed back by the touch frame, which results in no significant improvement in touch-related performance effects on the interactive flat panel (such as the presentation effect of handwriting when writing). Summary of the Invention

[0004] In view of this, embodiments of this application provide a method, apparatus, interactive flat panel, and storage medium for presenting handwriting, thereby improving the presentation effect of handwriting on the interactive flat panel.

[0005] In a first aspect, embodiments of this application provide a method for presenting handwriting, applied to an interactive flat panel, wherein the touch accuracy of the touch frame of the interactive flat panel reaches a set accuracy range, and the method includes:

[0006] The writing interface is displayed on the screen;

[0007] When a touch object touches and moves on the surface of the display screen, touch point information is obtained through the touch frame, and the touch object is controlled by the user;

[0008] By analyzing the information of each touch point, the writing handwriting on the writing interface is presented in a manner that matches the movement state of the touched object.

[0009] Furthermore, the movement state is reflected by the magnitude of the pressure value exerted by the touch object on the display screen and the direction of movement.

[0010] Further, obtaining the touch point information fed back through the touch frame includes:

[0011] Each touch signal is identified by the hardware circuitry within the touch frame; the touch signal is generated when the touch object moves on the display screen.

[0012] The touch point information is obtained by the touch frame in response to each touch signal via the HID (Human Interface Device) standard protocol.

[0013] One touch point information corresponds to one touch point, and the touch point information includes: touch point coordinates and touch point pressure sensitivity.

[0014] Furthermore, after obtaining the touch point information fed back through the touch frame, the method also includes:

[0015] The touch point information is processed to ensure that the touch point information has a unified unit format and data structure.

[0016] Further, the processing of each of the touch point information includes:

[0017] Based on the obtained touch frame size information and screen resolution information, the units of each data information in the touch point information are converted into a unified set unit format;

[0018] The touch point information is recorded using the data structure corresponding to the specified unit format.

[0019] Furthermore, through analysis of the information of each touch point, a handwriting pattern matching the movement state of the touched object is presented on the writing interface, including:

[0020] By analyzing the information of each touch point, the movement state information of the touch points generated by the touch object during the movement is determined;

[0021] By analyzing the movement state information, a handwriting outline that matches the movement state of the touched object is constructed.

[0022] Fill in the outline of the handwriting and present it on the writing interface.

[0023] Furthermore, the step of determining the movement state information of the touch points generated during the movement of the touch object by analyzing the information of each touch point includes:

[0024] Get the preset stroke thickness value;

[0025] For each touch point, extract the touch point pressure sensitivity from the corresponding touch point information;

[0026] The preset pressure sensitivity coefficient association table is searched to determine the first thickness scaling coefficient corresponding to the pressure sensitivity of the touch point, and the product value of the handwriting thickness value and the first thickness scaling coefficient is determined.

[0027] The product value is used as the first margin value of the touch point in the four directions of up, down, left and right, and each first margin value is recorded as the movement state information of the touch point.

[0028] Furthermore, the step of determining the movement state information of the touch points generated during the movement of the touch object by analyzing the information of each touch point includes:

[0029] Obtain a preset handwriting thickness value, and use half of the handwriting thickness value as the reference margin value of each touch point in the four directions of top, bottom, left and right.

[0030] By analyzing the information of each touch point, the second thickness scaling factor corresponding to each touch point in the four directions of up, down, left and right is determined;

[0031] For each touch point, the reference margin values ​​of the touch point in the four directions of top, bottom, left and right are corrected according to the second thickness scaling factor corresponding to the touch point in the four directions of top, bottom, left and right, so as to obtain the corrected second margin values.

[0032] Each of the second margin values ​​is recorded as the movement state information of the touch point.

[0033] Furthermore, the touch point information also includes: the generation time of the touch point and the movement direction of the touch point;

[0034] The step of analyzing the information of each touch point to determine the second thickness scaling factor corresponding to each touch point in the four directions of up, down, left, and right includes:

[0035] For each touch point, the generation time of the touch point is obtained from the corresponding touch point information, and the target touch points included in the time period before the generation time are searched.

[0036] Based on the touch point, the touch point coordinates and movement direction of each target touch point, determine the touch offset information corresponding to the touch point, and the target distance value of the touch point in the four directions of up, down, left and right;

[0037] Based on the touch offset information, the target distance values, and the touch pressure sensitivity of the touch point, the second thickness scaling factor of the touch point in the four directions of up, down, left, and right is determined respectively.

[0038] Further, determining the touch offset value corresponding to the touch point and the target distance values ​​of the touch point in the four directions of up, down, left, and right based on the touch point coordinates and movement direction of each target touch point includes:

[0039] Select a core touch point from the target touch points, and determine the lateral and longitudinal offset distances between the core touch point and the touch points, wherein the time difference between the generation time of the core touch point and the generation time of the touch points is the largest.

[0040] Filter out touch points from the target touch points whose movement direction is different from that of the touch points, and correct the lateral offset distance and longitudinal offset distance based on the touch point coordinates of the filtered touch points;

[0041] The touch offset information of the touch point is constructed based on the corrected lateral offset distance and longitudinal offset distance;

[0042] Determine the coordinate differences of the touch point relative to each of the target touch points in the four directions of up, down, left and right, and determine the maximum coordinate difference as the target distance value of the touch point in the four directions of up, down, left and right;

[0043] The coordinate difference is determined by the positive and negative values ​​based on the set positive horizontal and vertical directions.

[0044] Further, determining the second thickness scaling factor of the touch point in the four directions of up, down, left, and right based on the touch offset information, each of the target distance values, and the touch pressure sensitivity of the touch point includes:

[0045] For each direction, the offset distance in the corresponding direction is extracted from the touch offset information and recorded as the target offset distance;

[0046] Determine the difference between the target distance value in the direction and the target offset distance, and quotient the difference and a set touch constant as the scaling factor to be corrected;

[0047] The product of the scaling factor to be corrected and the touch pressure sensitivity is used as the second coarseness scaling factor in the direction.

[0048] Furthermore, the step of constructing a handwriting outline that matches the movement state of the touched object by analyzing the movement state information includes:

[0049] For each touch point, the current margin value of the touch point in the four directions of up, down, left and right is extracted from the movement state information. The current margin value is either the first margin value or the second margin value.

[0050] Based on the current margin values ​​and the touch point coordinates of the touch point, determine the pen outline points corresponding to the touch point in the four directions of up, down, left and right.

[0051] The pen outline points corresponding to each of the aforementioned touch points are summarized to form a pen outline point set. The pen outline points in the pen outline point set are connected according to a first set rule to form a first handwriting outline with a closed region.

[0052] The first rule is that the area of ​​the enclosed region formed is the largest.

[0053] Furthermore, the step of constructing a handwriting outline that matches the movement state of the touched object by analyzing the movement state information includes:

[0054] For each touch point, the current margin value of the touch point in the four directions of up, down, left and right is extracted from the movement state information. The current margin value is either the first margin value or the second margin value.

[0055] Based on the current margin values ​​and the touch point coordinates of the touch point, determine the asymmetric elliptical region corresponding to the touch point, and determine the tangent point of the asymmetric elliptical region;

[0056] The asymmetrical elliptical regions are connected along the tangent direction through corresponding tangent points to form a second handwriting contour with a closed region.

[0057] Further, determining the asymmetric elliptical region corresponding to the touch point based on each of the margin values ​​and the touch point coordinates includes:

[0058] A virtual coordinate system is constructed along the touch point, and the edge values ​​corresponding to the four directions of up, down, left and right are grouped in pairs to obtain four groups;

[0059] For each group, based on the two margin values ​​included in the group and the coordinates of the touch point, and combined with the ellipse construction formula, the corresponding ellipse is determined, and the effective area is extracted from the ellipse;

[0060] The four extracted effective regions are combined to form the asymmetric elliptical region.

[0061] Further, extracting the effective region from the ellipse includes:

[0062] Determine the quadrant intervals in the virtual coordinate system corresponding to the two constant values ​​associated with the ellipse during its construction;

[0063] The region within the quadrant of the ellipse is defined as the valid region.

[0064] Furthermore, by analyzing the aforementioned movement state information, a handwriting outline matching the movement state of the touched object is constructed, including:

[0065] For each touch point, a preset margin value determination strategy is used to determine the effective margin value of the touch point in the four directions of top left, bottom right, top right and bottom left.

[0066] Based on the effective margin values, determine the first outline point of the touch point in the four directions of top left, bottom right, top right, and bottom left;

[0067] Based on the corresponding movement status information, determine the second outline point of the touch point in the four directions of up, down, left and right;

[0068] The third stroke outline is formed based on the first and second stroke outlines corresponding to each of the aforementioned touch points.

[0069] Furthermore, the process of constructing a third handwriting outline based on the first and second stroke outlines corresponding to each of the aforementioned touch points includes:

[0070] For each touch point, the circumscribed octagon of the touch point is constructed based on the first and second outline points corresponding to the touch point.

[0071] Determine the approximate tangent point of the circumscribed octagon;

[0072] Each of the circumscribed octagons is connected by its corresponding approximate tangent point to form an approximate tangent line, and then connected along the approximate tangent line direction to form a third handwriting contour with a closed region.

[0073] Secondly, embodiments of this application provide a handwriting display device configured on an interactive flat panel, wherein the touch accuracy of the touch frame of the interactive flat panel reaches a set accuracy range, and the device includes:

[0074] The display module is used to display the writing interface on the screen.

[0075] The acquisition module is used to obtain touch point information fed back by the touch frame when a touch object touches the surface of the display screen and moves, wherein the touch object is controlled by the user;

[0076] The presentation module is used to present handwriting on the writing interface that matches the movement state of the touched object by analyzing the information of each of the touch points.

[0077] Thirdly, embodiments of this application also provide an interactive flat panel, comprising:

[0078] The touch frame has a touch accuracy that reaches a set accuracy range and is used to collect touch point information generated when the object is touched.

[0079] The display screen, combined with the touch frame, forms a touch screen for displaying interactive content;

[0080] One or more processors; a storage device for storing one or more programs;

[0081] When the one or more programs are executed by the one or more processors, the one or more processors implement the method as provided in the first aspect of this application.

[0082] Fourthly, embodiments of this application also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform the method described in the first aspect.

[0083] The above-described method, apparatus, interactive flat panel, and storage medium for presenting handwriting are described. The proposed method can be executed by an interactive flat panel equipped with a touch frame whose touch precision reaches a set range. The method first displays a writing interface on a screen; then, when a touch object touches and moves on the surface of the screen, touch point information fed back by the touch frame is obtained; finally, by analyzing the information of each touch point, handwriting matching the movement state of the touch object can be presented on the writing interface. This embodiment's technical solution, for an interactive flat panel configured with a high-precision touch frame in its hardware structure, can optimize the functionality of the configured high-precision touch frame at the software application level through the method provided in this embodiment. Compared to existing interactive flat panels that have not undergone software optimization, the method provided in this embodiment ensures that the handwriting presented on the writing interface better matches the movement state of the touch object moved by the user during writing, thereby better presenting handwriting with the user's writing style and improving the handwriting presentation effect on the interactive flat panel. Attached Figure Description

[0084] Other features, objects, and advantages of this application will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings:

[0085] Figure 1 A flowchart illustrating a method for presenting handwriting according to an embodiment of this application is provided.

[0086] Figure 1a This is a diagram illustrating the effect of a touch frame responding to a touch object in a handwriting presentation method provided in Embodiment 1 of this application.

[0087] Figure 1b A diagram illustrating the effect of a conventional handwriting rendering method is provided.

[0088] Figure 1c The following diagram illustrates the effect of the handwriting rendering method provided in Embodiment 1 of this application;

[0089] Figure 2 A flowchart illustrating a method for presenting handwriting according to Embodiment 2 of this application is provided;

[0090] Figure 2a A flowchart illustrating one implementation of the handwriting presentation method provided in Embodiment 2 of this application for determining movement state information is provided.

[0091] Figure 2b A diagram illustrating the effect of the movement state information determined in Embodiment 2 of the present invention is provided.

[0092] Figure 2c A flowchart illustrating one implementation of the handwriting outline determination in the handwriting presentation method provided in Embodiment 2 of this application is provided.

[0093] Figure 2d An illustration of the effect of determining the outline of handwriting in the handwriting presentation method provided in Embodiment 2 of the present invention is given;

[0094] Figure 2e Another implementation flowchart of determining the movement state information in the handwriting presentation method provided in Embodiment 2 of this application is given;

[0095] Figure 2f Another implementation flowchart of handwriting outline determination in the handwriting presentation method provided in Embodiment 2 of this application is given;

[0096] Figure 2g A diagram illustrating the effect of the asymmetric elliptical region determined in Embodiment 2 of this application is provided.

[0097] Figure 2h A diagram illustrating the effect of the second handwriting outline determined in Embodiment 2 of this application is provided.

[0098] Figure 2i A flowchart illustrating another implementation of the handwriting outline determination in the handwriting presentation method provided in Embodiment 2 of this application is given;

[0099] Figure 2j A diagram illustrating the effect of the third handwriting outline determined in Embodiment 2 of this application is provided.

[0100] Figure 2k A handwriting display image with user writing style effects presented by the method provided in Embodiment 2 of this application is given;

[0101] Figure 3 This is a structural block diagram of a handwriting display device provided in Embodiment 3 of this application;

[0102] Figure 4 This is a schematic diagram of the structure of an interactive flat panel provided in Embodiment 4 of this application. Detailed Implementation

[0103] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings. It should be understood that the described embodiments are merely some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0104] In the following description, when referring to the accompanying drawings, the same numbers in different drawings denote the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0105] In the description of this application, it should be understood that the terms "first," "second," "third," etc., are used only to distinguish similar objects and are not necessarily used to describe a specific order or sequence, nor should they be construed as indicating or implying relative importance. Those skilled in the art can understand the specific meaning of the above terms in this application according to the specific circumstances. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0106] In practical applications, the hardware of an interactive flat panel consists of a display screen, an intelligent processing system, and other components, which are combined into a whole structure and supported by a dedicated software system.

[0107] The display screen can specifically include light-emitting diode (LED) displays, organic light-emitting diode (OLED) displays, and liquid crystal display (LCD) displays. By placing optical touch sensors on both sides of the display screen surface, a touch frame can be formed, creating a touch display screen. The optical touch sensors forming the touch frame can use light signals to scan the surface of the display screen for touch objects, such as a user's finger or a stylus. It is understood that to protect the display screen from scratches by touch objects, a cover glass is placed on the surface of the display screen; therefore, in the embodiments of this specification, the surface of the display screen refers to the surface of the cover glass.

[0108] When an object touches the display screen and triggers a certain interface on the display screen, it performs operations such as positioning. The touch frame can respond to the above touch operations and pass the corresponding touch operation information to the intelligent processing system at the application layer, thereby realizing various interactive applications through the intelligent processing system.

[0109] Taking one type of optical touch sensor that constitutes the touch frame as an example, let's explain the touch frame from the perspective of technical principles:

[0110] Specifically, an optical touch sensor can include an infrared emitter and an infrared receiver. The infrared emitter transmits infrared signals, and the infrared receiver receives infrared signals. The touch point is located by using a dense array of infrared signals distributed in different directions to form a beam grid. A bezel with a circuit board is mounted on the display screen, which arranges the infrared emitters and receivers around the display screen to form a horizontally and vertically intersecting beam grid touch frame.

[0111] When the display screen has the aforementioned touch frame, when the touch object blocks the infrared signal, it will cause a decrease in the light measurement value at the corresponding infrared receiver, thus allowing the position of the touch point on the screen to be determined.

[0112] Specifically, the infrared transmitter is installed on the first side of the display screen bezel, and the infrared receiver is installed on the second side of the display screen bezel. The first and second sides are positioned opposite each other, meaning that the infrared receiver is within the scanning range of the infrared transmitter, so that the infrared signal emitted by the infrared transmitter is received by the infrared receiver.

[0113] To meet different business needs, the shape of the display screen varies, such as rectangular, hexagonal, and circular. The shape of the bezel also varies with the shape of the display screen, such as rectangular, hexagonal, and circular. For different bezel shapes, the settings of the infrared transmitter and infrared receiver in each infrared module also differ.

[0114] Generally, the conventional touch frames on interactive flat panels typically offer touch accuracy within a standard range when responding to touch signals from objects. These conventional touch frames can be categorized as non-high-precision touch frames. For non-high-precision touch frames with standard accuracy, it may be difficult to accurately determine the size of the touch area on the display screen. Therefore, in touch writing mode, it's challenging to determine the type of object being written on or the touch medium (finger, stylus) being used. Furthermore, non-high-precision touch frames also struggle to ensure that the same type of object displays the same touch area during the touch process.

[0115] In this embodiment, the interactive flat panel preferably uses a high-precision touch frame, which, compared to a conventional touch frame with a touch accuracy within the normal range, offers superior touch precision. High touch precision means that the touch accuracy has reached a set precision range, where the precision of the set precision range is higher than the normal precision range. This type of touch frame can provide more refined touch information to the upper-level application layer, such as the touch area of ​​the object, more accurate touch point coordinates, and the rotation angle of the object during touch.

[0116] Meanwhile, the intelligent processing system in the interactive whiteboard can include a host processor, which is the processor of the interactive whiteboard. The software built into the host processor can realize different functional applications and display images and create vivid audio-visual effects through the display screen.

[0117] Among them, the host processor is a high-performance computing module.

[0118] For example, the host processor can be an Android module, which can install the Android system and be configured with components such as CPU (Central Processing Unit), GPU (Graphics Processing Unit), RAM (random access memory), and ROM (Read-Only Memory). For example, for Android 7.0, the CPU is a dual-core A72 and a quad-core A53, the GPU is a Mali T860, the RAM is 4GB, the ROM is 32GB, and so on.

[0119] For example, the host processor can be a PC (personal computer) module, configured with components such as CPU, GPU, memory, and hard drive. For instance, for a pluggable Intel Core series modular computer, the CPU is Intel Core i5 / i7, the GPU is integrated Intel HD Graphics, the memory is DDR4 8G / 16G, and the hard drive is 128G / 256G.

[0120] Example 1

[0121] Figure 1A flowchart illustrating a method for presenting handwriting according to an embodiment of this application is provided. This embodiment is applicable to situations where handwriting is presented on a writing interface. The method can be executed by a handwriting presentation device, which can be implemented by software and / or hardware and can be configured in an interactive flat panel, particularly in the processor of the interactive flat panel, which can be a host processor in an intelligent processing system. Simultaneously, the touch frame equipped in the interactive flat panel possesses a touch accuracy within a set accuracy range; furthermore, the touch frame is also electrically connected to the display screen.

[0122] like Figure 1 As shown in Embodiment 1 of this application, a method for presenting handwriting includes the following steps:

[0123] S101, The writing interface is displayed on the screen.

[0124] It is understood that the execution entity of the method provided in this embodiment, namely the interactive flat panel, is also equipped with a Graphics Processing Unit (GPU), which can provide video processing functions. Specifically, the GPU can receive information from the host processor, load it into the frame memory, and generate the serial display data and scan control timing required by the display screen according to the partitioned driving method for the video signal. Based on the above operations, the display screen on the interactive flat panel can play frame data information according to the serial display data and scan control timing, thereby displaying various images on the display screen.

[0125] In this embodiment, the display interface can be considered as the interface displayed on the screen after the user triggers the entry into writing mode. Specifically, in writing mode, an interface can be displayed on the screen where the user can select handwriting attribute parameters, such as handwriting color and handwriting thickness, and the handwriting can be displayed on the interface according to the configured parameters.

[0126] Generally, the writing interface can be a standalone interface. For example, the interactive whiteboard provides an electronic whiteboard. The user triggers a control operation to display the electronic whiteboard within the interactive whiteboard. The interactive whiteboard receives the control operation and displays the electronic whiteboard as the writing interface. At this time, the user can trigger touch operations on the electronic whiteboard. These touch operations are represented in the form of a trajectory. Therefore, through analysis of the generated trajectory by the upper-layer application of the interactive whiteboard, the handwriting corresponding to the trajectory can be displayed on the screen of the interactive whiteboard. The control operations on the electronic whiteboard include, but are not limited to, touch operations, keyboard operations, mouse operations, and physical button operations.

[0127] Furthermore, the writing interface can also be a background interface. For example, the interactive whiteboard displays local courseware, screen data transmitted from a screen sharing device (USB dongle, USB software protector) belonging to the source device (such as a laptop), and other data. When a user triggers an annotation operation on the interactive whiteboard, the whiteboard receives the annotation operation, freezes the courseware, screen data, etc., making them the background, i.e., maintaining the current frame of the displayed courseware, screen data, etc., and generates a mask layer on top of the courseware, screen data, etc., thus serving as the writing interface. At this time, the user can trigger a touch operation on the screen of the interactive whiteboard. This touch operation is represented in the form of a trajectory, and the interactive whiteboard can display handwriting corresponding to the touch trajectory on the mask layer.

[0128] The term "courseware" can refer to course documents created based on teaching requirements, through steps such as determining teaching objectives, analyzing teaching content and tasks, and designing teaching activity structures and interfaces. For example, the courseware can be a common format file such as a Word document, PPT (PowerPoint presentation), or a whiteboard document for courseware presentation, or it can be a custom page composed of elements such as text, tables, and images. This embodiment does not impose any restrictions on this.

[0129] S102. When a touch object touches the surface of the display screen and moves, touch point information is obtained through the touch frame, and the touch object is controlled by the user.

[0130] In this embodiment, the touch object can be a user's finger, an active stylus, or a passive stylus, etc. The user can control the touch object to move on the display surface of the interactive flat panel. The movement state of the touch object can be used to present handwriting.

[0131] As described above in the embodiments of this application, the interactive flat panel is also equipped with a touch frame integrated with the display screen. Specifically, the touch frame can be a border embedded in the edge of the display screen, consisting of an optical touch sensor. In this step, the touch frame can generate touch signals based on the included optical touch sensor when a touch object moves on the display screen, and identify the corresponding touch point information by responding to the touch signals.

[0132] Specifically, Figure 1a This is a diagram illustrating the effect of a touch frame responding to a touch object in a handwriting presentation method provided in Embodiment 1 of this application. Figure 1a As shown, one or more optical touch sensors 120 are installed on both sides of the edge of the interactive flat panel display screen 110, forming a touch frame. The movement state of the touch object (such as a finger) operated by the user on the display screen 110 can be presented using finger states 131 to 135.

[0133] As described above, during the startup and operation of the interactive flat panel, the processor can activate the optical touch sensor 120. The optical touch sensor 120 scans light signals on the surface of the interactive flat panel's display screen and detects whether a touch object appears on the display screen surface based on the transmission of the light signals. When a touch object is detected, a corresponding touch signal is generated in real time during the movement of the touch object. At the same time, the touch frame can respond to the generated touch signals, thereby feeding back the identified touch point data to the upper layer of the interactive flat panel (such as the main processor in the intelligent processing system). In this embodiment, the touch point data is recorded as touch point information.

[0134] S103. By analyzing the information of each of the touch points, the writing handwriting that matches the movement state of the touched object is presented on the writing interface.

[0135] In this embodiment, considering that the touch accuracy of the touch frame configured on the interactive flat panel relative to the touch object reaches the set accuracy range, the touch frame used in this embodiment can be considered a high-precision touch frame. The touch point information fed back by this touch frame in the above steps is superior to the touch point information fed back by existing conventional touch frames in both accuracy and detail. For example, the touch point information includes at least the coordinate information of the touch point and the pressure sensitivity information of the touch point.

[0136] In this embodiment, from the user's perspective, when a user touches the screen to enter writing mode, it indicates that the user's intention is to write text or mark important content using the presented handwriting. When a user writes text, a better writing experience is one where the handwriting reflects the user's writing style on paper, such as displaying the user's unique pen strokes. Alternatively, the user may prefer a smoother, more coherent handwriting style as a marker.

[0137] On an interactive whiteboard, to achieve personalized presentation of a user's handwriting in this embodiment, it is necessary to acquire data information representing the user's personalized characteristics. Then, through data processing, an effect that meets the user's needs can be presented. It is understood that the user's writing process is equivalent to the user controlling the movement of a touch object on the display screen surface, and the user's personalized style is mainly reflected in the control of the touch object's movement.

[0138] Therefore, when different users control the movement of a touch object, the pressure sensitivity and direction of movement reflected on the display screen vary individually. In other words, the movement state of the touch object controlled by different users is not the same on the display screen. However, the high-precision touch frame configured in the interactive flat panel of this embodiment can reflect the different movement states of the touch object in the feedback touch point information. Furthermore, the movement state is reflected by the magnitude of the pressure sensitivity value and the direction of movement of the touch object on the display screen, both of which can be extracted from the touch point information.

[0139] By analyzing the touch point information in this step, the writing style can be displayed on the writing interface to match the movement of the touched object. For example, when the displayed writing style is text, it can reflect the user's writing style; when the displayed writing style is a marker or other mark, it can more smoothly and accurately mark the content that the user wants to mark.

[0140] In this embodiment, for the process of presenting a user's personalized handwriting through the analysis of touch point information, this step can first determine the position of each touch point required to determine the handwriting by using the touch point information during the movement. Then, it can analyze the points to be connected, the lines to be connected, and the required connection methods between them when presenting the handwriting outline based on each touch point. Finally, based on the above information, the handwriting that matches the movement of the touch object controlled by the user can be presented.

[0141] For example, Figure 1b A diagram illustrating the effect of a conventional handwriting rendering method is provided. Figure 1c The following diagram illustrates the effect of the handwriting rendering method provided in Embodiment 1 of this application. It can be observed that... Figure 1b as well as Figure 1c The handwriting displayed is primarily user-written text. For example... Figure 1b As shown, using existing conventional handwriting display methods, the presented text is merely a conventional handwriting representation and does not reflect the user's writing characteristics. For example... Figure 1c As shown, the handwriting presentation method of this application embodiment can present the text in a personalized way, whether the user's handwriting is messy or neat, rounded or with sharp strokes.

[0142] This application provides a handwriting presentation method in Embodiment 1, which can be executed by an interactive flat panel equipped with a touch frame whose touch precision reaches a set accuracy range. The method first displays a writing interface on a screen; then, when a touch object touches and moves on the surface of the screen, touch point information fed back by the touch frame is obtained; finally, by analyzing the information of each touch point, handwriting matching the movement state of the touch object can be presented on the writing interface. The interactive flat panel, the main body executing this method, is equipped with a high-precision touch frame in its hardware structure. The method provided in this embodiment optimizes the functionality of the configured high-precision touch frame at the software application level. Compared to existing interactive flat panels that are not optimized at the software level, the method provided in Embodiment 1 ensures that the handwriting presented on the writing interface better matches the movement state of the touch object moved by the user during writing, thus better presenting handwriting with the user's writing style and improving the handwriting presentation effect on the interactive flat panel.

[0143] As an optional embodiment of Embodiment 1 of this application, this optional embodiment may further optimize the following after obtaining the touch point information fed back through the touch frame: process each of the touch point information to make each of the touch point information have a unified unit format and data structure.

[0144] It should be noted that in this embodiment, the handwriting presentation operation is mainly performed by the intelligent processing system on the upper layer of the interactive flat panel, which can be executed by the host processor. The touch point information required for handwriting presentation is mainly fed back by the touch frame at the hardware level of the interactive flat panel. In this embodiment, the touch point information fed back by the touch frame can be regarded as the input information required by the upper layer.

[0145] The touch frames configured on the interactive flat panel may have different execution parameters if they come from different manufacturers. This could lead to differences in the representation of the touch information fed back by the touch frames, affecting the normal execution of the handwriting presentation method. To ensure the uniformity of data information in the execution process of handwriting presentation, an information processing operation proposed in this optional embodiment is added based on the above embodiment one.

[0146] For example, this optional embodiment can analyze the production information and batch information of the touch frame to determine the original information format of the touch point information fed back by the touch frame. Then, the unit format and data structure of the touch point information can be processed to ensure that the data input to the upper layer of the interactive flat panel has a unified information format. The processed touch point information removes the unit format related to the touch frame manufacturer or batch. For example, the touch area unit in the original information format is basically based on the number of optical trigger sensors obscured on the touch frame as the touch width and touch height unit. This optional embodiment can convert this into a unified abstract unit within the software, such as a pixel unit.

[0147] Based on the above optimizations, this embodiment can specify the processing of each touch point information as follows:

[0148] Based on the obtained touch frame size information and screen resolution information, the units of each data information in the touch point information are converted into a unified set unit format;

[0149] The touch point information is recorded using the data structure corresponding to the specified unit format.

[0150] In a specific implementation of this optional embodiment, in order to obtain relatively accurate data information from inside the touch frame, it is necessary to know the size of the touch frame currently equipped with the interactive tablet and the screen resolution information of the display screen, etc. This information can be obtained by communicating with the touch frame hardware or by reading from the intelligent processing system.

[0151] For specific processing of touch point information, this optional embodiment can uniformly convert the touch point coordinates, height and width of the touch point, or the vertices of the geometric shape formed when touched, which are identified by the touch frame in the original information format, into more abstract unit values ​​at the software level, such as coordinate points represented by pixels, width or height values, etc.

[0152] Similarly, another advantage of the high-precision touch frame is that it can also capture the rotation operation of the touched object during the touch process and determine the rotation angle of the touch rotation. At this time, through the processing method of this optional embodiment, the initially obtained rotation angle can also be processed according to a uniform unit of radians.

[0153] The optional embodiment of Embodiment 1 of this application specifically optimizes and adds the processing operation of the touch point information fed back by the touch frame. Through this processing operation, the unified input of touch point information can be realized, avoiding the incompatibility of touch point information in subsequent execution caused by different attribute parameters of the touch frame itself, and effectively improving the execution efficiency of handwriting presentation.

[0154] Example 2

[0155] Figure 2 A flowchart illustrating a handwriting presentation method according to Embodiment 2 of this application is provided. This embodiment is an optimization based on the above embodiment. In this embodiment, obtaining the touch point information fed back by the touch frame can be specifically optimized as follows: identifying each touch signal through the hardware circuit of the touch frame, wherein the touch signal is generated when the touch object moves on the display screen; obtaining the touch point information fed back by the touch frame for each touch signal through the HID standard protocol of human-computer interaction, wherein one touch point information corresponds to one touch point, and the touch point information includes: touch point coordinates and touch point pressure sensitivity.

[0156] Meanwhile, this embodiment can further specify the writing handwriting on the writing interface that matches the movement state of the touched object by analyzing the information of each of the touch points as follows: by analyzing the information of each of the touch points, the movement state information of the touch points generated by the touched object during the movement is determined; by analyzing the information of each of the movement states, a handwriting outline that matches the movement state of the touched object is constructed; the handwriting outline is filled and presented on the writing interface.

[0157] like Figure 2 As shown in Embodiment 2 of this application, a method for presenting handwriting includes the following operations:

[0158] S201, The writing interface is displayed on the screen.

[0159] For example, the writing interface can be entered by the user triggering the writing button, or it can be entered by the user triggering the editing function in certain related scenarios (such as courseware display scenarios).

[0160] S202. When a touch object touches the surface of the display screen and moves, the hardware circuit in the touch frame identifies each touch signal, which is generated when the touch object moves on the display screen.

[0161] Specifically, the optical touch sensor can be considered the core component of the touch frame. After the interactive tablet is powered on and running, and the optical touch sensor is powered on, the optical touch sensor located at the edge of the display screen (such as an infrared emitter on one side and an infrared receiver on the other side) can detect whether there is a touch object on the display surface by using the beam grid formed by densely distributed infrared signals in different directions to determine whether it is blocked. If there is a touch object, a corresponding touch signal will be generated at the corresponding position when the touch object blocks the normally emitted infrared signal. Then, the hardware circuit set in the touch frame can identify the touch signal, such as by identifying the high and low levels of the touch signal, to determine the coordinate information of the position of the touch signal represented by hardware-level data, the width and height information corresponding to the touch object blocking the beam grid, and even the touch area and rotation information of the touch object.

[0162] It is understandable that as the object moves on the screen, a set of touch signals can be generated accordingly. The hardware circuit on the touch frame can effectively identify the relevant touch information of each touch signal in the set. At the same time, the pressure sensitivity information of the object at each touch point can be determined by the pressure exerted by the object on the hardware circuit of the touch frame.

[0163] S203. Obtain the touch point information fed back by the touch frame for each touch signal through the Human-Computer Interaction (HID) standard protocol.

[0164] It is known that, considering that the touch frame is a hardware structure on the interactive tablet, the touch point information identified by the hardware circuit on the touch frame relative to each touch point is difficult to be directly input to the upper-level software processing module. Therefore, this step can use a special human-computer interaction HID standard protocol to obtain the converted touch point information that is readable at the software level. The object of the conversion process is the touch point information identified at the hardware level.

[0165] In the handwriting rendering implemented based on this embodiment, each touch point information fed back by the touch frame specifically represents each touch point triggered by the touched object. The required touch point information must at least include touch point coordinates and touch point pressure sensitivity. Specifically, touch point coordinates are the basic information of touch control, while touch point pressure sensitivity can be used to represent the touch pressure applied by the user when moving the touched object. This information can indirectly reflect the user's writing style.

[0166] Through the steps described above in this embodiment, the touch point information fed back by the touch frame can be obtained in real time during the movement of the touch object. Thus, this embodiment can realize the presentation of handwriting on the writing interface through the following steps S204 to S206.

[0167] S204. By analyzing the information of each touch point, determine the movement state information of the touch points generated by the touch object during the movement.

[0168] In this embodiment, in order to present handwriting on the writing interface that matches the movement state of the touched object, the information related to the movement state of the touched object during the movement can be determined first through this step. In this embodiment, the movement state determination of the touched object can be transformed into the movement state information of each touch point generated during the movement process.

[0169] It is understandable that the generation of touch points is related to the touch frame's sensing of the touch object. In the touch frame's sensing of the touch object, a touch signal can be generated by the touch object blocking the light grid. The hardware circuit of the touch frame responds to the touch signal and can determine the corresponding occluded position on the touch frame. The corresponding occluded position can be considered as the location where the touch point is generated. After obtaining the coordinates of the occluded position, it is equivalent to obtaining the coordinate information of the touch point.

[0170] During the movement of the object being touched, each touch point is discrete. In order to form a presentable handwriting based on these discrete touch points, it is necessary to first determine the information that can be associated with each touch point. Generally, this association information can be a simple connection between adjacent touch points, with the resulting line serving as one of the trajectories in the handwriting.

[0171] However, the displayed handwriting has pre-set attributes such as the thickness or color of the strokes. Therefore, simply connecting touch points to form lines cannot produce handwriting that matches the user's individual handwriting. Current methods for drawing handwriting often use the Bézier curve algorithm, which treats touch points as control points and adds virtual points between two touch points to create a smooth curve. However, this algorithm struggles to personalize the handwriting of different users, and the stroke thickness remains uniform.

[0172] In this embodiment, the extension distance of each touch point in the four directions of up, down, left, and right can be determined with each touch point as the center. The extension distance of the touch point in each direction can be a reflection of the pressure and movement direction applied by the user relative to the touch point. Specifically, it can also be determined based on the movement direction and touch pressure of the touch point.

[0173] Considering that the movement state of the touch object is related to the pressure sensitivity and movement direction when the user controls the movement of the touch object, in order to obtain handwriting that matches the user's writing style, we can first use the extension distance of the touch point in each direction as the movement state information representing the movement state of the touch object. Preferably, in this step, the extension distance of the touch point in each direction can be recorded as the edge value of the touch point in each direction and uniformly regarded as the movement state information corresponding to the touch point.

[0174] The margin values ​​of the touch point in each direction may be the same or different. To facilitate differentiation, this embodiment records the margin values ​​with the same data value as the first margin value and the margin values ​​with different values ​​as the second margin value. The first and second margin values ​​of the touch point in each direction can be determined by different methods, and the different methods of determining the margin values ​​directly reflect the different methods of determining the movement state information.

[0175] For example, the margin value can be a pre-set handwriting thickness value and a calculated value of a coefficient to be determined. In the calculation of the first margin value, the specific values ​​of the coefficient to be determined in each direction can be the same; in the calculation of the second margin value, the specific values ​​of the coefficient to be determined in each direction can be different.

[0176] Regarding the specific determination of movement status information, as a first optional embodiment of this second embodiment, Figure 2a A flowchart illustrating one implementation of the handwriting rendering method provided in Embodiment 2 of this application for determining movement state information is given. Figure 2a As shown, this optional embodiment further determines the movement state information of the touch points generated by the touch object during movement by analyzing the information of each touch point, which is specified in the following steps:

[0177] S2041. Obtain the preset stroke thickness value.

[0178] In this embodiment, the handwriting thickness value can be specifically considered as an attribute parameter value preset by the user when configuring handwriting attribute information after the user triggers the entry into writing mode. This handwriting thickness value is equivalent to giving the thickness benchmark of the presented writing.

[0179] The following steps S2042 to S2044 are implementations for determining the movement state information of a single touch point. The movement state information of each touch point can be determined through the following steps.

[0180] S2042. For each touch point, extract the touch point pressure sensitivity from the corresponding touch point information.

[0181] This step can directly extract the touch point pressure sensitivity contained in the touch point information.

[0182] S2043. Search the preset pressure sensitivity coefficient association table, determine the first thickness scaling coefficient corresponding to the pressure sensitivity of the touch point, and determine the product value of the handwriting thickness value and the first thickness scaling coefficient.

[0183] In this embodiment, the association between touch pressure sensitivity and thickness scaling factor can be established in advance. Preferably, the value range of the thickness scaling factor is (0,1). Different sizes of touch pressure sensitivity values ​​can be determined to have a corresponding thickness scaling factor value within the range of (0,1), forming a pressure sensitivity coefficient association table.

[0184] Therefore, in this step, after obtaining the touch point pressure sensitivity from the touch point information, a matching thickness scaling factor can be found from the pressure sensitivity coefficient association table. For ease of distinction, this embodiment refers to this thickness scaling factor as the first thickness scaling factor. Furthermore, the combination of the thickness scaling factor and the handwriting thickness value can be used to determine the actual thickness of the touch point displayed on the writing interface. Preferably, this step considers the product of the handwriting thickness value and the first thickness scaling factor as the reference value upon which the actual thickness displayed on the writing interface depends.

[0185] S2044. The product value is used as the first margin value of the touch point in the four directions of up, down, left and right, and each first margin value is recorded as the movement state information of the touch point.

[0186] In this embodiment, the product value determined above can be regarded as the extension distance of the handwriting to be presented extending in all directions from the touch point as the intersection point. The extension in all directions can preferably be the extension in the four directions of up, down, left and right. The extension distance of the touch point in the four directions of up, down, left and right can be regarded as the edge value of the touch point in the four directions of up, down, left and right. In this embodiment, it is recorded as the first edge value. The four edge values ​​after summing can be recorded as the movement state information of the touch point.

[0187] For example, Figure 2b A diagram illustrating the effect of the movement state information determined in Embodiment 2 of the present invention is provided. Figure 2b As shown, points A, B, C, and D can be considered as touch points generated during the movement of the object. Each touch point, as the intersection point, forms two intersecting lines in both the horizontal and vertical directions. This achieves extension in four directions (up, down, left, and right) relative to the touch point. The edge values ​​for each direction can be obtained and endpoints marked. The resulting 16 endpoints A1–A4, B1–B4, C1–C4, and D1–D4 are respectively presented in… Figure 2b The image shows the margin values ​​of touch points A, B, C, and D in the four directions of up, down, left, and right.

[0188] S205. By analyzing the movement state information, a handwriting outline matching the movement state of the touched object is formed.

[0189] In this embodiment, the characteristics of the presented handwriting are mainly matched with the movement state of the touched object, and the user's writing style can be displayed through the presented handwriting. Considering that the movement state of the touched object is determined by the touch pressure and movement direction when the user operates the touched object, in order to present handwriting with the user's style on the writing interface, it is necessary to first determine the movement state information that represents the movement state of the touched object through the above steps.

[0190] Based on the movement state information determined for each touch point, this step can determine the thickness of the handwriting that each touch point can present on the writing interface. Considering the continuity of the handwriting, as the touch object moves, this embodiment needs to ensure that the touch points generated during the movement are connected to each other, and that the connected touch points can present a smooth handwriting outline with the user's style.

[0191] After determining the movement state information of the touch points, one implementation method for connecting the touch points in this embodiment can be described as follows: the endpoints of the margin values ​​in the four directions of up, down, left, and right included in the movement state information can be used as the pen outline points corresponding to the touch points. The connection between two adjacent touch points can be established through the determined pen outline points. Finally, the closed curve obtained after the connection is used as the pen outline that matches the movement state of the touch object.

[0192] After determining the movement state information of the touch points, another implementation method for connecting the touch points in this embodiment can be described as follows: Consider using the margin values ​​in the four directions (up, down, left, and right) included in the movement state information. Combine the margin values ​​in adjacent directions to construct an ellipse. Finally, stitch together the elliptical regions from the four constructed ellipses to form an asymmetric elliptical region around the touch point. Thus, for each touch point, there is a corresponding asymmetric ellipse. Adjacent touch points can be connected through their corresponding asymmetric ellipse and its tangent. Ultimately, the line outline formed by connecting all touch points can also be used as the handwriting outline.

[0193] After determining the movement state information of the touch points, another implementation method for connecting the touch points in this embodiment can be described as follows: The margin values ​​of the touch points in the four directions (up, down, left, and right) can be determined using the margin values ​​included in the movement state information. The endpoints of each margin value can then be sequentially connected to form an octagon corresponding to each touch point. Thus, each touch point corresponds to an octagon, and adjacent touch points can be connected through their corresponding octagons and approximate tangent points on the octagons. Finally, the line outline formed by connecting all touch points can also be used as the handwriting outline.

[0194] It should be noted that in this embodiment, the handwriting is generated in real time relative to the movement of the touched object, and the latest touch point information fed back during the movement of the touched object can be regarded as the last touch point in the touch point sequence.

[0195] As a second optional embodiment of this second embodiment, Figure 2c A flowchart illustrating one implementation of the handwriting outline determination in the handwriting presentation method provided in Embodiment 2 of this application is given. Figure 2c As shown, this optional embodiment further concretizes the process of constructing a handwriting outline that matches the movement state of the touched object by analyzing the movement state information of each of the aforementioned movement states into the following steps:

[0196] S2051. For each touch point, extract the current margin value of the touch point in the four directions of up, down, left and right from the movement state information. The current margin value is either the first margin value or the second margin value.

[0197] In this embodiment, based on the above description, for each touch point, depending on the method of determining the movement state information, the touch point can obtain a first margin value where the margin values ​​in the four directions are the same data value; or it can obtain a second margin value where the margin values ​​in the four directions are different data values. The current margin value used in this step is specifically related to the method used in determining the margin value above, and can be either the value recorded as the first margin value or the value recorded as the second margin value.

[0198] It is also known that this step and the following S2052 are operations relative to each touch point.

[0199] S2052. Based on the current margin values ​​and the touch point coordinates of the touch point, determine the pen outline points corresponding to the touch point in the four directions of up, down, left and right.

[0200] In this embodiment, after knowing the touch point coordinates and the current margin values ​​in each direction, the coordinate values ​​of the endpoints of the margin values ​​corresponding to each current margin value can be determined in the same coordinate system, and the determined coordinate values ​​are used as the pen point coordinate values ​​of the touch point in the four directions of up, down, left, and right.

[0201] S2053. Summarize the pen outline points corresponding to each of the aforementioned touch points to form a pen outline point set. Connect each pen outline point in the pen outline point set according to a first set rule to form a first handwriting outline with a closed region.

[0202] It is known that the touch frame on the interactive flat panel provides feedback on touch point information according to a certain cycle. Therefore, this embodiment can receive the touch point information of each touch point generated within a cycle by the touch frame at a certain moment, and can present the handwriting of each touch point received at that moment according to the method provided in this embodiment.

[0203] This step allows us to obtain the pen outline points of each touch point within a cycle. By connecting these pen outline points, adjacent touch points can be connected to establish a connection, ultimately obtaining a handwriting outline that satisfies the first set rule, referred to as the first handwriting outline in this embodiment. The first set rule is that the area of ​​the formed closed region is the largest.

[0204] Understandably, the connection between pen outline points first considers that two adjacent touch points can be connected through one or more pen outline points. Then, based on satisfying the first set rule, a closed area containing each touch point is formed, constituting the pen outline formed when the touch object moves in this cycle.

[0205] Figure 2d An illustration of the effect of handwriting outline determination in the handwriting presentation method provided in Embodiment 2 of the present invention is given. Figure 2d As shown, the corresponding pen outline points for touch points A, B, C, and D can be determined. When connecting the pen outline points based on each touch point, the area of ​​the closed region formed after the connection should be maximized. Therefore, one pen outline point may not participate in the connection but may be included within the closed region. For example... Figure 2d Finally, at point B3 in the stroke outline, Figure 2d The first handwriting outline that constitutes the first closed region 21 is formed in the middle.

[0206] S206. Fill in the outline of the handwriting and present it on the writing interface.

[0207] It is understandable that the defined handwriting outline is a closed area, which can be filled with the handwriting color set in advance to form the handwriting on the writing interface.

[0208] It should be noted that the method provided in this embodiment can be implemented in real time along with the touch point information fed back by the touch frame. Because the touch point information is fed back periodically, this embodiment can present a segment of handwriting corresponding to a certain number of touch points fed back within a period. This embodiment also considers the connection between the last touch point in the previous period and the first touch point in the next period. For the connection between two touch points, the connection method between adjacent touch points in the same period given in this embodiment can be used to achieve the connection, such as directly connecting through the outline point, or connecting through the asymmetrical ellipse formed by the two adjacent touch points and the corresponding tangent, or connecting through the octagon formed by the two adjacent touch points and the corresponding approximate tangent point. In summary, the method provided in this embodiment can ensure a smooth connection between the touch points fed back by the touch frame.

[0209] This application provides a method for presenting handwriting in Embodiment 2, which specifies the feedback form of touch point information and the presentation method of handwriting. The execution of this method is based on the premise that the interactive tablet is equipped with a touch frame whose touch precision is within a set precision range. Compared to existing interactive tablets with conventional touch frames, this embodiment, after configuring a high-precision touch frame at the hardware level, can provide more accurate touch point information containing more effective information to the application layer. Therefore, combined with the method provided in this embodiment, it ensures that the handwriting presented on the writing interface better matches the movement state of the touch object moved by the user during writing, thus better presenting handwriting with the user's writing style, thereby improving the handwriting presentation effect on the interactive tablet.

[0210] As a third optional embodiment of this second embodiment, S204 above is provided, that is, another way to determine the movement state information of the touch points generated by the touch object during the movement by analyzing the information of each touch point.

[0211] As described above, besides the implementation method given in the first optional embodiment, there are other implementation methods for determining motion state information. This third optional embodiment provides another implementation method for determining motion state information. By implementing this method, it can be ensured that the margin values ​​determined by the touch point in the four directions (up, down, left, and right) are different data values.

[0212] Specifically, Figure 2e Another implementation flowchart of determining the movement state information in the handwriting presentation method provided in Embodiment 2 of this application is given. Figure 2e As shown, determining the movement status information specifically includes the following steps:

[0213] S2401. Obtain a preset handwriting thickness value, and use half of the handwriting thickness value as the reference edge distance value of each touch point in the four directions of top, bottom, left and right.

[0214] This step is equivalent to a preprocessing step, where a baseline margin value can be given to each touch point in the four directions of up, down, left, and right.

[0215] S2402. By analyzing the information of each touch point, determine the second thickness scaling factor corresponding to each touch point in the four directions of up, down, left and right.

[0216] In this embodiment, to achieve different margin values ​​for the touch point in the four directions (up, down, left, and right), the key is to determine the appropriate scaling factor for the touch point in each of these directions. Considering the different directions of movement sensed by the touch point when the object is moved, it can be known that the pressure sensitivity used by the user in controlling the movement of the object also differs in the four directions. This step can determine the possible offset of the touch point in the four directions by analyzing the movement direction of the touch point in the touch point information. Finally, the determined offset is used to determine the corresponding scaling factor for the touch point in each direction. This scaling factor is denoted as the second scaling factor.

[0217] Unlike the above-mentioned lookup of the corresponding touch pressure when calculating the first coarseness scaling factor, this step specifically considers the horizontal and vertical offset of each touch point relative to a certain number of touch points generated before it, and finally considers the impact of this offset on the coarseness scaling factor.

[0218] Based on the above optimizations, this third optional embodiment further optimizes the touch point information by including: the generation time of the touch point and the movement direction of the touch point; and further, by analyzing the information of each touch point, it determines the second thickness scaling factor corresponding to each touch point in the four directions of up, down, left, and right, which is specifically defined as follows:

[0219] a1. For each touch point, obtain the generation time of the touch point from the corresponding touch point information, and find each target touch point included in the time period before the generation time.

[0220] In this embodiment, the touch point information fed back by the touch frame also includes the generation time of the touch point during the touch movement. In the implementation of determining the movement state information provided in this third optional embodiment, this step can first determine how many target touch points are included in a set time period.

[0221] Understandably, for each touch point, this step is required to select touch points whose generation time falls within a set time period ahead of the touch point, based on the touch point's generation time, and record them as target touch points.

[0222] b1. Based on the touch point, the touch point coordinates and movement direction of each target touch point, determine the touch offset information corresponding to the touch point, and the target distance value of the touch point in the four directions of up, down, left and right.

[0223] This step uses each touch point as the current touch point for margin value calculation, and its relative to the selected target touch point serves as a reference point for margin value calculation. Knowing the touch point coordinates and movement direction of the current touch point and each target touch point, the offset of the current touch point relative to the target touch point in the horizontal and vertical directions can be determined. This further determines the touch offset information of the current touch point, as well as the target distance values ​​of the touch point in the four directions of up, down, left, and right. The touch offset information includes the horizontal and vertical offset data of the touch point.

[0224] In this third optional embodiment, the steps for determining the touch offset information and the target distance value can be described as follows:

[0225] b11. Select a core touch point from the target touch points, and determine the lateral offset distance and longitudinal offset distance between the core touch point and the touch point, wherein the time difference between the generation time of the core touch point and the generation time of the touch point is the largest.

[0226] For example, suppose the touch point for which the margin value is to be calculated is touch point A. There are four target touch points preceding touch point A, which are denoted as touch points B, C, D, and E in order of their generation time. Based on the description of this step, touch point B has the largest time difference with touch point A in terms of generation time; therefore, touch point B is designated as the core touch point.

[0227] Based on the touch point coordinates of touch point A and touch point B, the movement direction of touch point A can be selected as the positive direction in the horizontal and vertical directions. Then, the horizontal and vertical coordinates of touch point A are subtracted from the horizontal and vertical coordinates of touch point B in the horizontal and vertical directions, respectively. The resulting coordinate differences can be recorded as the horizontal offset distance X1 and the vertical offset distance Y1, respectively.

[0228] b12. Filter out touch points from the target touch points whose movement direction is different from the movement direction of the touch point, and correct the horizontal offset distance and vertical offset distance based on the touch point coordinates of the filtered touch points.

[0229] As described above, the movement directions of touch point A and touch points B to E can be obtained, and it can be checked whether there are touch points among touch points B to E with different movement directions than touch point A. If there are, the touch point can be recorded as a filtered touch point, and the touch point coordinates of the filtered touch point can be obtained.

[0230] Assuming touch point C is the filtered touch point, the process of correcting the lateral offset distance X1 and the vertical offset distance Y1 is described as follows:

[0231] Find the next touch point after touch point C, i.e. touch point D, and calculate the horizontal distance x1 and vertical distance y1 of touch point C and touch point D. Similarly, the projection of the movement direction of touch point A in the horizontal and vertical directions is taken as the positive horizontal and vertical directions.

[0232] The difference between the lateral offset distance X1 and the lateral distance value x1 is used as the corrected lateral offset distance value, and the difference between the longitudinal offset distance Y1 and the longitudinal distance value y1 is used as the corrected longitudinal offset distance value.

[0233] It is known that this step is an optional step. If there are no touch points with different movement directions, this step can be skipped and step b13 can be executed directly.

[0234] b13. The touch offset information of the touch point is constructed based on the corrected lateral offset distance and longitudinal offset distance.

[0235] b14. Determine the coordinate differences of the touch point relative to each of the target touch points in the four directions of up, down, left and right, and determine the maximum coordinate difference as the target distance value of the touch point in the four directions of up, down, left and right.

[0236] Following the example above, after knowing the coordinates of touch points A to E and their movement direction, and determining that the projection of the movement direction of touch point A in the horizontal and vertical directions is positive, we can select the horizontal and vertical coordinates of touch point A and the horizontal and vertical coordinates of touch points B to E to calculate the difference in the four directions of up, down, left, and right. Then, we can select the largest coordinate difference in the four directions and regard the largest coordinate difference as the target distance value of touch point A in the corresponding direction.

[0237] The specific implementation description for calculating the coordinate differences between touch point A and touch points B through E in four directions is as follows:

[0238] Assuming the coordinates of touch points A to E are (5,5), (4,4), (3,3), (2,2) and (1,1) respectively, and the movement direction is upper right, then right and up can be taken as positive directions. The differences between the upper and right directions are 4, 3, 2, 1 and 0 respectively. It can be seen that 4 is the target distance value in these two directions.

[0239] Compared to up and right, down and left are considered negative directions. In the down and left directions, the determined differences are -4, -3, -2, -1, and 0, respectively. It can be seen that 0 is the target distance value in these two directions.

[0240] The coordinate difference is determined by the positive and negative values ​​based on the set positive horizontal and vertical directions.

[0241] c1. Based on the touch offset information, the target distance values, and the touch pressure sensitivity of the touch point, determine the second thickness scaling factor of the touch point in the four directions of up, down, left, and right.

[0242] The process of determining the second coarse scaling factor in step c1 can be specifically described by the following sub-steps in this third optional embodiment:

[0243] c11. For each direction, extract the offset distance in the corresponding direction from the touch offset information and record it as the target offset distance.

[0244] Following the example above, the directions in this step specifically include four directions: up, down, left, and right. The target offset distance corresponding to the up and down direction should be the vertical offset distance Y1, and the target offset distance in the left and right direction should be the horizontal offset distance X1.

[0245] c12. Determine the difference between the target distance value in the direction and the target offset distance, and quotient the difference and the set touch constant as the scaling factor to be corrected.

[0246] Following the example above, for touch points A to E, the target distance value of touch point A relative to touch points B to E is 4 in the upward and right directions, and 0 in the downward and left directions.

[0247] Therefore, for the upward direction, the scaling factor to be corrected can be Y1-k1, and for the right direction it is X1-k1; for the downward direction, the scaling factor to be corrected can be Y1 / k; and for the left direction, the scaling factor to be corrected can be X1 / k. Here, k1 is 4 / k, where 4 is the target distance value determined above, and k is a set touch constant.

[0248] c13. The product of the scaling factor to be corrected and the touch pressure sensitivity is used as the second coarseness scaling factor in the direction.

[0249] Following the example above, the touch pressure sensitivity of touch point A can also be obtained. This step can be used to directly multiply the scaling factor to be corrected in each direction (up, down, left, right) of the touch point with the touch pressure sensitivity. The calculated product value can be regarded as the second coarse scaling factor in the corresponding direction.

[0250] S2403. For each touch point, the reference margin values ​​of the touch point in the four directions of up, down, left and right are corrected according to the second thickness scaling coefficients corresponding to the touch point in the four directions of up, down, left and right, so as to obtain the corrected second margin values.

[0251] In this third optional embodiment, after determining the second scaling factor through the above exemplary description, the reference margin value in each direction can be directly corrected based on the second scaling factor of the touch point in each of the up, down, left, and right directions. The correction process can be understood as the product of the reference margin value in that direction and the corresponding second scaling factor. The final determined product value is used as the margin value of the touch point in that direction, which is denoted as the second margin value in this embodiment.

[0252] S2404. Record each of the second margin values ​​as the movement state information of the touch point.

[0253] In this embodiment, after determining the second margin values ​​in the four directions (up, down, left, and right) for each touch point through the above steps, the second margin values ​​in each direction can be collectively referred to as the movement state information of the touch point.

[0254] As a fourth optional embodiment of this second embodiment, this optional embodiment provides the above-mentioned S205, that is, by analyzing each of the movement state information, another way of constructing a handwriting outline that matches the movement state of the touched object.

[0255] As described above, besides the implementation method given in the second optional embodiment, there are other implementation methods for determining the handwriting outline. This fourth optional embodiment provides another implementation method for determining the movement state information. By implementing this method, compared with the handwriting outline formed by the method provided in the first optional embodiment, the method of forming the handwriting outline by the touch point provided in this optional embodiment can improve the smoothness of the handwriting outline.

[0256] Specifically, Figure 2f Another implementation flowchart of handwriting outline determination in the handwriting presentation method provided in Embodiment 2 of this application is given. Figure 2f As shown, determining the outline of handwriting specifically includes the following steps:

[0257] S2501. For each touch point, extract the current margin value of the touch point in the four directions of up, down, left and right from the movement state information. The current margin value is either the first margin value or the second margin value.

[0258] Similarly, in this optional embodiment, based on the above description, for each touch point, depending on the method of determining the movement state information, the touch point can obtain a first margin value where the margin values ​​in the four directions are the same data value; or it can obtain a second margin value where the margin values ​​in the four directions are different data values. The current margin value used in this step can also be either the value recorded as the first margin value or the value recorded as the second margin value.

[0259] S2502. Based on the current margin values ​​and the touch point coordinates of the touch point, determine the asymmetric elliptical region corresponding to the touch point, and determine the tangent point of the asymmetric elliptical region.

[0260] This optional embodiment introduces the concept of determining the handwriting outline based on ellipses. Considering the different margin values ​​in each direction, this optional embodiment considers constructing the handwriting outline using asymmetrical elliptical regions. These asymmetrical elliptical regions can evolve from conventional ellipses, and their specific characteristics are related to the current margin values ​​of the touch point in each direction.

[0261] It should be noted that in this embodiment, the case where the touch point has the same margin value in all directions can be regarded as a special case where the second margin value is used in all directions.

[0262] Based on the above optimizations, this fourth optional embodiment further optimizes the determination of the asymmetric elliptical region corresponding to the touch point by combining the current margin values ​​with the touch point coordinates of the touch point as follows:

[0263] a2. Construct a virtual coordinate system along the touch point, and group the edge values ​​corresponding to the four directions of up, down, left and right into four groups.

[0264] For example, assuming that the margin values ​​of touch point A in the four directions of up, down, left, and right are represented by q, w, e, and r respectively, then after pairwise grouping, the four groups obtained can be (q, e), (q, r), (w, e), and (w, r).

[0265] b2. For each group, based on the two margin values ​​included in the group and the coordinates of the touch point, and combined with the ellipse construction formula, determine the corresponding ellipse, and extract the effective area from the ellipse.

[0266] Following the example above, taking the group (q,e) as an example, the two margin values ​​q and e can be used as the two margins for constructing the ellipse. After knowing the coordinates of the touch point A, the first ellipse corresponding to the group (q,e) can be obtained by combining the ellipse construction formula.

[0267] In this fourth optional embodiment, the specific implementation of extracting the effective region from the ellipse can be described as follows: determining the quadrant intervals corresponding to the two constant values ​​associated with the ellipse during its construction in the virtual coordinate system; and determining the region in the ellipse that is located in the quadrant interval as the effective region.

[0268] Following the example above, we analyze the margin values ​​of q and e in the up and left directions, respectively. Thus, in the region formed by the first ellipse and the coordinate system, the quadrants to which the corresponding directions q and e belong can be considered as the effective region.

[0269] c2. Summarize the four extracted effective regions and splice them together to form the asymmetric elliptical region.

[0270] For example, Figure 2g A diagram illustrating the effect of the asymmetric elliptical region determined in Embodiment 2 of this application is provided. Figure 2g As shown, the asymmetric elliptical region contains four valid regions, namely the first valid region 01, the second valid region 02, the third valid region 03, and the fourth valid region 04. These four valid regions come from four different ellipses. Each ellipse can be determined using the method described in step b2 above, and each valid region can also be determined using the same method for determining valid regions.

[0271] S2503. Connect each of the asymmetrical elliptical regions along the tangent direction through the corresponding tangent points to form a second handwriting outline with a closed region.

[0272] Figure 2h The following is a diagram illustrating the effect of the second handwriting outline determined in Embodiment 2 of this application, as shown in the figure. Figure 2h As shown, a first closed region 22 is formed by connecting the asymmetrical elliptical regions of each touch point with their corresponding tangent points and the corresponding tangent lines in pairs. This first closed region 22 can serve as the second handwriting outline of the touch point. It should be noted that... Figure 2h This is just a schematic diagram. The tangents given for each asymmetric ellipse in the diagram are not strictly accurate. However, in practical applications, the connection method used can strictly follow the tangents at the tangent points.

[0273] In this fourth optional embodiment, steps S2501 and S2502 described above can be used to determine a corresponding asymmetric elliptical region for each touch point. Then, based on the tangent point determination method for ellipses, two tangent points (where the distance between the tangent lines corresponding to the two tangent points is the largest) can be determined from each asymmetric ellipse. Next, each asymmetric ellipse can be connected sequentially along the tangent direction through the determined tangent points, according to the adjacency relationship of the touch points. Finally, the closed region formed by the connection is used as the second handwriting contour. It is understood that each touch point is included within this second handwriting contour.

[0274] As a fifth optional embodiment of this second embodiment, this optional embodiment provides the above-mentioned S205, that is, by analyzing each of the movement state information, another implementation method is used to construct a handwriting outline that matches the movement state of the touched object.

[0275] Furthermore, similar to the fourth optional embodiment described above, another implementation method for determining the handwriting outline is proposed. This fifth optional embodiment differs from the fourth optional embodiment in that it optimizes the computational performance of the fourth optional embodiment. This is because the calculation process of the ellipse tangent point in the fourth optional embodiment is relatively complex and consumes computational resources. Therefore, the implementation method provided by this fifth optional embodiment can be used to optimize computational performance.

[0276] Specifically, Figure 2i A flowchart illustrating another implementation of the handwriting outline determination in the handwriting presentation method provided in Embodiment 2 of this application is given. Figure 2i As shown, determining the outline of handwriting specifically includes the following steps:

[0277] S251. For each touch point, a preset margin value determination strategy is used to determine the effective margin value of the touch point in the four directions of top left, bottom right, top right and bottom left.

[0278] Specifically, the method for determining the effective margin value in this embodiment can be described as follows:

[0279] First, the asymmetric elliptical region of the touch point is determined. The method for determining the asymmetric elliptical region can refer to the method of the fourth optional embodiment described above.

[0280] A virtual coordinate system is constructed based on the touch point, and rays with an angle of 45 degrees passing through the touch point are determined in each quadrant. Each ray represents the upper left, lower left, upper right, and lower right directions of the touch point.

[0281] Determine the intersection point of each ray with the asymmetric elliptical region. The distance between the intersection point coordinates and the touch point coordinates can be recorded as the effective edge distance value of the touch point in the upper left, lower left, upper right, and lower right directions, respectively.

[0282] S252. Determine the first outline point corresponding to the touch point in the four directions of top left, bottom right, top right and bottom left according to each of the effective margin values.

[0283] It is known that the effective margin values ​​in the four directions of left, bottom right, top right, and bottom left each have margin value endpoints, which are the intersection points of the rays described above and the asymmetric ellipse. In this step, each margin value endpoint can be regarded as a pen outline point in the corresponding direction, which is denoted as the first pen outline point in this embodiment.

[0284] S253. Determine the second outline point corresponding to the touch point in the four directions of up, down, left and right based on the corresponding movement state information.

[0285] Similarly, it can be understood that each touch point can determine its corresponding movement state information through the method given above in this embodiment. The movement state information specifically includes the margin values ​​of the touch point in the four directions of up, down, left, and right (which may be the first margin value or the second margin value). Similarly, the margin endpoints corresponding to the margin values ​​in each direction can be used as the corresponding pen outline points, which are denoted as the second pen outline points in this embodiment.

[0286] S254. Based on the first and second stroke outlines corresponding to each of the touch points, a third stroke outline is formed.

[0287] For each touch point, there are 8 corresponding pen outline points. Connecting these 8 pen outline points forms an octagon. Thus, each touch point corresponds to an octagon. This step can obtain the final handwriting outline by connecting the octagons of each touch point, which is referred to as the third handwriting outline in this embodiment.

[0288] Based on the above optimizations, this fifth optional embodiment further specifies the formation of the third handwriting outline based on the first and second stroke outlines corresponding to each of the touch points as follows:

[0289] a3. For each touch point, construct the circumscribed octagon of the touch point based on the first and second outline points corresponding to the touch point.

[0290] b3. Determine the approximate tangent point of the circumscribed octagon.

[0291] In this embodiment, the condition for being an approximate tangent point is that two points on the circumscribed octagon are connected to the touch point, forming corresponding line segments. The lines passing through these two points and perpendicular to the corresponding line segments are considered as the corresponding approximate tangents. Assuming the distance between the two approximate tangents is the largest, then these two points can be considered as approximate tangent points of the circumscribed octagon.

[0292] c3. Connect the circumscribed octagons with their respective approximate tangent points to form approximate tangent lines, and then connect them along the approximate tangent line directions to form a third handwriting contour with a closed region.

[0293] For example, Figure 2j A diagram illustrating the effect of the third handwriting outline determined in Embodiment 2 of this application is provided. Figure 2jAs shown, a second closed region 23 is formed by connecting the circumscribed octagons of each touch point with their corresponding approximate tangent points using the resulting approximate tangent lines. This second closed region 23 can serve as the third handwriting outline of the touch point. It should also be noted that... Figure 2j This is just a schematic diagram. The approximate tangents given for each circumscribed octagon in the diagram are not rigorous, or it is difficult to clearly identify the location of the approximate tangents. However, in practical applications, the connection method used can strictly follow the tangents of the approximate tangent points.

[0294] To facilitate a better understanding of the effective representation of handwriting style provided in this embodiment, which effectively presents the user's handwriting style, this embodiment provides an example of presenting the brushstroke effect in a calligraphy style during the user's writing process. Specifically, Figure 2k A handwriting display image with user-defined writing style effects, presented using the method provided in Embodiment 2 of this application, is given. For example... Figure 2k As shown, this illustration specifically demonstrates the outline 24 of a brush tip formed when a user writes in a calligraphy style. This image also better illustrates that the method provided in this embodiment ensures that the handwriting displayed on the writing interface matches the movement of the touch object during writing, thus improving the user experience.

[0295] Example 3

[0296] Figure 3 This is a structural block diagram of a handwriting display device according to Embodiment 3 of this application. The handwriting display device can be integrated into an interactive flat panel, wherein the touch accuracy of the touch frame equipped in the interactive flat panel is within a set accuracy range. The device may specifically include the following modules:

[0297] Display module 31 is used to display the writing interface via a display screen;

[0298] The acquisition module 32 is used to obtain touch point information fed back by the touch frame when a touch object touches the surface of the display screen and moves, wherein the touch object is controlled by the user;

[0299] The presentation module 33 is used to present handwriting on the writing interface that matches the movement state of the touched object by analyzing the information of each of the touch points.

[0300] This application provides a handwriting presentation device in Embodiment 3. The interactive flat panel, the execution subject of this device, is equipped with a high-precision touch frame in its hardware structure. The high-precision touch frame can be optimized at the software application level through the method provided in this embodiment. Compared with existing interactive flat panels that have not been optimized at the software level, this embodiment 3 integrates a handwriting presentation device on the interactive flat panel. This device can ensure that the handwriting presented on the writing interface can better match the movement state of the touch object moved by the user during the writing process, thereby better presenting handwriting with the user's writing style, and thus improving the handwriting presentation effect on the interactive flat panel.

[0301] Furthermore, the movement state is reflected by the magnitude of the pressure value exerted by the touch object on the display screen and the direction of movement.

[0302] Furthermore, module 32 can be specifically used for:

[0303] When a touch object touches and moves on the surface of the display screen, the hardware circuit in the touch frame identifies each touch signal, which is generated when the touch object moves on the display screen.

[0304] The touch point information is obtained by the touch frame in response to each touch signal via the HID (Human Interface Device) standard protocol.

[0305] One touch point information corresponds to one touch point, and the touch point information includes: touch point coordinates and touch point pressure sensitivity.

[0306] Furthermore, the device also includes an input processing module.

[0307] The input processing module can be used to process the touch point information fed back by the touch frame after obtaining it, so that the touch point information has a unified unit format and data structure.

[0308] Based on the above optimizations, the specific implementation of the input processing module in processing the touch point information may include:

[0309] Based on the obtained touch frame size information and screen resolution information, the units of each data information in the touch point information are converted into a unified set unit format;

[0310] The touch point information is recorded using the data structure corresponding to the specified unit format.

[0311] Furthermore, the presentation module 33 may specifically include:

[0312] The first determining unit is used to determine the movement state information of the touch points generated by the touch object during the movement by analyzing the information of each touch point;

[0313] The second determining unit is used to construct a handwriting outline that matches the movement state of the touched object by analyzing the movement state information of each of the aforementioned movement states.

[0314] A handwriting rendering unit is used to fill the outline of the handwriting and present it on the writing interface.

[0315] Based on the above optimizations, the first determining unit can specifically be used for:

[0316] Get the preset stroke thickness value;

[0317] For each touch point, extract the touch point pressure sensitivity from the corresponding touch point information;

[0318] The preset pressure sensitivity coefficient association table is searched to determine the first thickness scaling coefficient corresponding to the pressure sensitivity of the touch point, and the product value of the handwriting thickness value and the first thickness scaling coefficient is determined.

[0319] The product value is used as the first margin value of the touch point in the four directions of up, down, left and right, and each first margin value is recorded as the movement state information of the touch point.

[0320] Based on the above optimizations, the first determining unit can also be used for:

[0321] The preprocessing subunit is used to obtain a pre-set handwriting thickness value and use half of the handwriting thickness value as the reference edge distance value of each touch point in the four directions of top, bottom, left and right.

[0322] The coefficient determination subunit is used to determine the second coarseness scaling coefficient corresponding to each of the touch points in the four directions of up, down, left and right by analyzing the information of each touch point;

[0323] The margin determination subunit is used to correct the reference margin values ​​of each touch point in the four directions of top, bottom, left and right according to the second thickness scaling factor corresponding to the touch point in the four directions of top, bottom, left and right, so as to obtain the corrected second margin values.

[0324] The information recording subunit is used to record each of the second margin values ​​as the movement state information of the touch point.

[0325] Furthermore, the touch point information also includes: the generation time of the touch point and the movement direction of the touch point;

[0326] Accordingly, the coefficient determining subunit can be specifically used for:

[0327] For each touch point, the generation time of the touch point is obtained from the corresponding touch point information, and the target touch points included in the time period before the generation time are searched.

[0328] Based on the touch point, the touch point coordinates and movement direction of each target touch point, determine the touch offset information corresponding to the touch point, and the target distance value of the touch point in the four directions of up, down, left and right;

[0329] Based on the touch offset information, the target distance values, and the touch pressure sensitivity of the touch point, the second thickness scaling factor of the touch point in the four directions of up, down, left, and right is determined respectively.

[0330] Further, determining the touch offset information corresponding to the touch point and the target distance values ​​of the touch point in the four directions of up, down, left, and right based on the touch point, the touch point coordinates, and the movement direction of each target touch point specifically includes:

[0331] Select a core touch point from the target touch points, and determine the lateral and longitudinal offset distances between the core touch point and the touch points, wherein the time difference between the generation time of the core touch point and the generation time of the touch points is the largest.

[0332] Filter out touch points from the target touch points whose movement direction is different from that of the touch points, and correct the lateral offset distance and longitudinal offset distance based on the touch point coordinates of the filtered touch points;

[0333] The touch offset information of the touch point is constructed based on the corrected lateral offset distance and longitudinal offset distance;

[0334] Determine the coordinate differences of the touch point relative to each of the target touch points in the four directions of up, down, left and right, and determine the maximum coordinate difference as the target distance value of the touch point in the four directions of up, down, left and right;

[0335] The coordinate difference is determined by the positive and negative values ​​based on the set positive horizontal and vertical directions.

[0336] Further, determining the second thickness scaling factor of the touch point in the four directions of up, down, left, and right based on the touch offset information, each of the target distance values, and the touch pressure sensitivity of the touch point may specifically include:

[0337] For each direction, the offset distance in the corresponding direction is extracted from the touch offset information and recorded as the target offset distance;

[0338] Determine the difference between the target distance value in the direction and the target offset distance, and quotient the difference and a set touch constant as the scaling factor to be corrected;

[0339] The product of the scaling factor to be corrected and the touch pressure sensitivity is used as the second coarseness scaling factor in the direction.

[0340] Furthermore, the second determining unit can specifically be used for:

[0341] For each touch point, the current margin value of the touch point in the four directions of up, down, left and right is extracted from the movement state information. The current margin value is either the first margin value or the second margin value.

[0342] Based on the current margin values ​​and the touch point coordinates of the touch point, determine the pen outline points corresponding to the touch point in the four directions of up, down, left and right.

[0343] The pen outline points corresponding to each of the aforementioned touch points are summarized to form a pen outline point set. The pen outline points in the pen outline point set are connected according to a first set rule to form a first handwriting outline with a closed region.

[0344] The first rule is that the area of ​​the enclosed region formed is the largest.

[0345] Furthermore, the second determining unit may further include:

[0346] The first determining subunit is used to extract the current margin value of the touch point in the four directions of up, down, left and right from the movement state information for each touch point. The current margin value is either the first margin value or the second margin value.

[0347] The second determining subunit is used to determine the asymmetric elliptical region corresponding to the touch point based on each of the current margin values ​​and the touch point coordinates of the touch point, and to determine the tangent point of the asymmetric elliptical region.

[0348] The third determining subunit is used to connect each of the asymmetric elliptical regions along the tangent direction through corresponding tangent points to form a second handwriting outline with a closed region.

[0349] Based on the above embodiments, the second determining subunit can specifically be used for:

[0350] A virtual coordinate system is constructed along the touch point, and the edge values ​​corresponding to the four directions of up, down, left and right are grouped in pairs to obtain four groups;

[0351] For each group, based on the two margin values ​​included in the group and the coordinates of the touch point, and combined with the ellipse construction formula, the corresponding ellipse is determined, and the effective area is extracted from the ellipse;

[0352] The four extracted effective regions are combined to form the asymmetric elliptical region.

[0353] Furthermore, the specific execution steps for extracting the effective region from the ellipse in the third determining subunit include:

[0354] Determine the quadrant intervals in the virtual coordinate system corresponding to the two constant values ​​associated with the ellipse during its construction;

[0355] The region within the quadrant of the ellipse is defined as the valid region.

[0356] Furthermore, the second determining unit may further include:

[0357] The fourth determining subunit is used to determine the effective margin value of the touch point in the four directions of top left, bottom right, top right and bottom left for each touch point using a preset margin value determination strategy.

[0358] The fifth determining subunit is used to determine the first outline point of the touch point in the four directions of upper left, lower right, upper right and lower left according to each of the effective edge distance values;

[0359] The sixth determining subunit is used to determine the second outline point corresponding to the touch point in the four directions of up, down, left and right based on the corresponding movement state information;

[0360] The seventh determining subunit is used to form a third handwriting outline based on the first and second stroke outline points corresponding to each of the touch points.

[0361] Based on the above optimizations, the seventh sub-unit is determined, which can be used specifically for:

[0362] For each touch point, the circumscribed octagon of the touch point is constructed based on the first and second outline points corresponding to the touch point.

[0363] Determine the approximate tangent point of the circumscribed octagon;

[0364] Each of the circumscribed octagons is connected by its corresponding approximate tangent point to form an approximate tangent line, and then connected along the approximate tangent line direction to form a third handwriting contour with a closed region.

[0365] Example 4

[0366] Figure 4This is a schematic diagram of an interactive flat panel according to Embodiment 4 of this application. The interactive flat panel includes: a processor 40, a memory 41, a display screen 42, an input device 43, an output device 44, and a touch frame 45. The interactive flat panel may have one or more processors 40. Figure 4 Taking a processor 40 as an example, the number of memory units 41 in this interactive flat panel can be one or more. Figure 4 Taking a memory unit 41 as an example, the processor 40, memory unit 41, display screen 42, input device 43, output device 44, and touch frame 45 of this interactive flat panel can be connected via a bus or other means. Figure 4 Taking the example of a connection between China and Israel via a bus.

[0367] The memory 41, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as program instructions / modules corresponding to the interactive flat panel described in any embodiment of the present invention (e.g., display module 31, acquisition module 32, and presentation module 33 in a handwriting display device). The memory 41 may primarily include a program storage area and a data storage area, wherein the program storage area may store the operating system and at least one application program required for a function; the data storage area may store data created based on the use of the device, etc. Furthermore, the memory 41 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 41 may further include memory remotely located relative to the processor 40, and these remote memories can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0368] The display screen 42 and the touch frame 45 cover each other to form a touch screen (not shown in the figure), which is used to display interactive content. Generally speaking, the display screen 42 is used to display data according to the instructions of the processor 40, and is also used to receive touch operations on the display screen 42 and send the corresponding signals to the processor 40 or other devices.

[0369] Input device 43 can be used to receive input digital or character information, and generate key signal inputs related to user settings and function control of the display device. It can also be a camera for acquiring images and a sound pickup device for acquiring audio data. Output device 44 may include audio devices such as speakers. It should be noted that the specific composition of input device 43 and output device 44 can be set according to actual conditions.

[0370] The touch frame 45 has a touch accuracy that reaches a set accuracy range and is used to collect touch point information generated when the object is touched.

[0371] The processor 40 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 41, thereby realizing the above-mentioned method of presenting handwriting.

[0372] The interactive flat panel provided above can be used to execute the handwriting presentation method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0373] Example 5

[0374] Embodiment 5 of the present invention also provides a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform a method for presenting handwriting, including:

[0375] The writing interface is displayed on the screen;

[0376] When a touch object touches and moves on the surface of the display screen, touch point information is obtained through the touch frame, and the touch object is controlled by the user;

[0377] By analyzing the information of each touch point, the writing handwriting on the writing interface is presented in a manner that matches the movement state of the touched object.

[0378] Of course, the computer-executable instructions provided in the embodiments of the present invention are not limited to the handwriting presentation method operation described above, but can also perform related operations in the handwriting presentation method provided in any embodiment of the present invention, and have corresponding functions and beneficial effects.

[0379] Based on the above description of the implementation methods, those skilled in the art can clearly understand that this application can be implemented using software and necessary general-purpose hardware, and of course, it can also be implemented using hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory, hard disk, or optical disk, etc., including several instructions to cause an interactive flat panel (which may be a robot, personal computer, server, or network device, etc.) to execute the handwriting presentation method described in any embodiment of this application.

[0380] It is worth noting that the various units and modules included in the above-mentioned course recommendation device are only divided according to functional logic, but are not limited to the above division, as long as they can achieve the corresponding functions; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the scope of protection of this application.

[0381] It should be understood that various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0382] Note that the above are merely preferred embodiments and the technical principles employed in this application. Those skilled in the art will understand that this application is not limited to the specific embodiments described herein, and various obvious changes, readjustments, and substitutions can be made without departing from the scope of protection of this application. Therefore, although this application has been described in detail through the above embodiments, this application is not limited to the above embodiments, and may include many other equivalent embodiments without departing from the concept of this application, the scope of which is determined by the scope of the appended claims.

Claims

1. A method for presenting handwriting, characterized in that, Applied to an interactive flat panel, wherein the touch accuracy of the touch frame of the interactive flat panel reaches a set accuracy range, the method includes: The writing interface is displayed on the screen; When a touch object touches and moves on the surface of the display screen, touch point information is obtained through the touch frame, and the touch object is controlled by the user; By analyzing the information of each touch point, the writing handwriting that matches the movement state of the touched object is presented on the writing interface; Among them, by analyzing the information of each touch point, the writing handwriting displayed on the writing interface matches the movement state of the touched object, including: By analyzing the information of each touch point, the movement state information of the touch points generated by the touch object during the movement is determined; By analyzing the movement state information, a handwriting outline that matches the movement state of the touched object is constructed. Fill in the outline of the handwriting and present it on the writing interface; The step of determining the movement state information of the touch points generated during the movement of the touch object by analyzing the information of each touch point includes: Get the preset stroke thickness value; For each touch point, extract the touch point pressure sensitivity from the corresponding touch point information; Determine the first coarseness scaling factor corresponding to the pressure sensitivity of the touch point; Based on the stroke thickness value and the first thickness scaling factor, the movement state information of the touch point generated by the touch object during the movement is determined.

2. The method according to claim 1, characterized in that, The movement state is represented by the pressure value of the touch object on the display screen and the direction of movement.

3. The method according to claim 1, characterized in that, The process of obtaining the touch point information fed back through the touch frame includes: Each touch signal is identified by the hardware circuitry within the touch frame; the touch signal is generated when the touch object moves on the display screen. The touch point information is obtained by the touch frame in response to each touch signal via the HID (Human Interface Device) standard protocol. One touch point information corresponds to one touch point, and the touch point information includes: touch point coordinates and touch point pressure sensitivity.

4. The method according to claim 1, characterized in that, After obtaining the touch point information fed back through the touch frame, the method further includes: The touch point information is processed to ensure that the touch point information has a unified unit format and data structure.

5. The method according to claim 4, characterized in that, The processing of the touch point information includes: Based on the obtained touch frame size information and screen resolution information, the units of each data information in the touch point information are converted into a unified set unit format; The touch point information is recorded using the data structure corresponding to the specified unit format.

6. The method according to claim 1, characterized in that, The determination of the first scaling factor corresponding to the pressure sensitivity of the touch point includes: Look up the preset pressure sensitivity coefficient association table to determine the first coarseness scaling coefficient corresponding to the pressure sensitivity of the touch point; The step of determining the movement state information of the touch point generated by the touch object during movement based on the handwriting thickness value and the first thickness scaling factor includes: Determine the product of the stroke thickness value and the first thickness scaling factor; The product value is used as the first margin value of the touch point in the four directions of up, down, left and right, and each first margin value is recorded as the movement state information of the touch point; wherein, the movement state information of the touch point is the margin value formed by the extension distance of the touch point in each direction; if the data values ​​of the margin values ​​are the same, they are the first margin values.

7. The method according to claim 1, characterized in that, The step of determining the movement state information of the touch points generated by the touch object during movement by analyzing the information of each touch point also includes: Obtain a preset handwriting thickness value, and use half of the handwriting thickness value as the reference margin value of each touch point in the four directions of top, bottom, left and right. By analyzing the information of each touch point, the second thickness scaling factor corresponding to each touch point in the four directions of up, down, left and right is determined; For each touch point, the reference margin values ​​of the touch point in the four directions of top, bottom, left and right are corrected according to the second thickness scaling factor corresponding to the touch point in the four directions of top, bottom, left and right, so as to obtain the corrected second margin values. Each of the second margin values ​​is recorded as the movement state information of the touch point; wherein, the movement state information of the touch point is the margin value formed by the extension distance of the touch point in each direction; different data values ​​of the margin values ​​are the second margin values.

8. The method according to claim 7, characterized in that, The touch point information also includes: the generation time of the touch point and the movement direction of the touch point; The step of analyzing the information of each touch point to determine the second thickness scaling factor corresponding to each touch point in the four directions of up, down, left, and right includes: For each touch point, the generation time of the touch point is obtained from the corresponding touch point information, and the target touch points included in the time period before the generation time are searched. Based on the touch point, the touch point coordinates and movement direction of each target touch point, determine the touch offset information corresponding to the touch point, and the target distance value of the touch point in the four directions of up, down, left and right; Based on the touch offset information, the target distance values, and the touch pressure sensitivity of the touch point, the second thickness scaling factor of the touch point in the four directions of up, down, left, and right is determined respectively.

9. The method according to claim 8, characterized in that, The step of determining the touch offset value corresponding to the touch point and the target distance values ​​of the touch point in the four directions of up, down, left, and right, based on the touch point and the touch point coordinates and movement direction of each target touch point, includes: Select a core touch point from the target touch points, and determine the lateral and longitudinal offset distances between the core touch point and the touch points, wherein the time difference between the generation time of the core touch point and the generation time of the touch points is the largest. Filter out touch points from the target touch points whose movement direction is different from that of the touch points, and correct the lateral offset distance and longitudinal offset distance based on the touch point coordinates of the filtered touch points; The touch offset information of the touch point is constructed based on the corrected lateral offset distance and longitudinal offset distance; Determine the coordinate differences of the touch point relative to each of the target touch points in the four directions of up, down, left and right, and determine the maximum coordinate difference as the target distance value of the touch point in the four directions of up, down, left and right; The coordinate difference is determined by the positive and negative values ​​based on the set positive horizontal and vertical directions.

10. The method according to claim 8, characterized in that, The step of determining the second thickness scaling factor of the touch point in the four directions of up, down, left, and right based on the touch offset information, each of the target distance values, and the touch pressure sensitivity of the touch point includes: For each direction, the offset distance in the corresponding direction is extracted from the touch offset information and recorded as the target offset distance; Determine the difference between the target distance value in the direction and the target offset distance, and quotient the difference and a set touch constant as the scaling factor to be corrected; The product of the scaling factor to be corrected and the touch pressure sensitivity is used as the second coarseness scaling factor in the direction.

11. The method according to claim 1, characterized in that, The step of constructing a handwriting outline that matches the movement state of the touched object by analyzing the movement state information of each of the aforementioned movement states includes: For each touch point, the current margin value of the touch point in the four directions of top, bottom, left, and right is extracted from the movement state information. The current margin value is either a first margin value or a second margin value. Wherein, if the margin values ​​are the same, it is the first margin value; if the margin values ​​are different, it is the second margin value. Based on each of the current margin values ​​and the touch point coordinates of the touch point, the corresponding pen outline point of the touch point in the four directions of top, bottom, left, and right is determined. The pen outline points corresponding to each of the aforementioned touch points are summarized to form a pen outline point set. The pen outline points in the pen outline point set are connected according to a first set rule to form a first handwriting outline with a closed region. The first rule is that the area of ​​the enclosed region formed is the largest.

12. The method according to claim 1, characterized in that, The step of constructing a handwriting outline that matches the movement state of the touched object by analyzing the movement state information of each of the aforementioned movement states includes: For each touch point, the current margin value of the touch point in the four directions of up, down, left and right is extracted from the movement state information. The current margin value is either the first margin value or the second margin value. Based on the current margin values ​​and the touch point coordinates of the touch point, determine the asymmetric elliptical region corresponding to the touch point, and determine the tangent point of the asymmetric elliptical region; The asymmetric elliptical regions are connected along the tangent direction through corresponding tangent points to form a second handwriting outline with a closed region; wherein, the data values ​​of the margins are the same, which is the first margin value, and the data values ​​of the margins are different, which is the second margin value.

13. The method according to claim 12, characterized in that, The step of determining the asymmetric elliptical region corresponding to the touch point based on each of the current margin values ​​and the touch point coordinates includes: A virtual coordinate system is constructed along the touch point, and the edge values ​​corresponding to the four directions of up, down, left and right are grouped in pairs to obtain four groups; For each group, based on the two margin values ​​included in the group and the coordinates of the touch point, and combined with the ellipse construction formula, the corresponding ellipse is determined, and the effective area is extracted from the ellipse; The four extracted effective regions are combined to form the asymmetric elliptical region.

14. The method according to claim 13, characterized in that, Extracting the effective region from the ellipse includes: Determine the quadrant intervals in the virtual coordinate system corresponding to the two constant values ​​associated with the ellipse during its construction; The region within the quadrant of the ellipse is defined as the valid region.

15. The method according to claim 1, characterized in that, By analyzing the movement state information, a handwriting outline matching the movement state of the touched object is constructed, including: For each touch point, a preset margin value determination strategy is used to determine the effective margin value of the touch point in the four directions of top left, bottom right, top right and bottom left. Based on the effective margin values, determine the first outline point of the touch point in the four directions of top left, bottom right, top right, and bottom left; Based on the corresponding movement status information, determine the second outline point of the touch point in the four directions of up, down, left and right; The third stroke outline is formed based on the first and second stroke outlines corresponding to each of the aforementioned touch points.

16. The method according to claim 15, characterized in that, The third handwriting outline is formed based on the first and second stroke outlines corresponding to each of the touch points, including: For each touch point, the circumscribed octagon of the touch point is constructed based on the first and second outline points corresponding to the touch point. Determine the approximate tangent point of the circumscribed octagon; Each of the circumscribed octagons is connected by its corresponding approximate tangent point to form an approximate tangent line, and then connected along the approximate tangent line direction to form a third handwriting contour with a closed region.

17. A device for displaying handwriting, characterized in that, Configured on an interactive flat panel, wherein the touch accuracy of the touch frame of the interactive flat panel reaches a set accuracy range, the device includes: The display module is used to display the writing interface on the screen. The acquisition module is used to obtain touch point information fed back by the touch frame when a touch object touches the surface of the display screen and moves, wherein the touch object is controlled by the user; The presentation module is used to present handwriting on the writing interface that matches the movement state of the touched object by analyzing the information of each of the touch points. The presentation module specifically includes: The first determining unit is used to determine the movement state information of the touch points generated by the touch object during the movement by analyzing the information of each touch point; The second determining unit is used to construct a handwriting outline that matches the movement state of the touched object by analyzing the movement state information of each of the aforementioned movement states. A handwriting rendering unit is used to fill the outline of the handwriting and display it on the writing interface; The first determining unit is specifically used for: Get the preset stroke thickness value; For each touch point, extract the touch point pressure sensitivity from the corresponding touch point information; Determine the first coarseness scaling factor corresponding to the pressure sensitivity of the touch point; Based on the stroke thickness value and the first thickness scaling factor, the movement state information of the touch point generated by the touch object during the movement is determined.

18. An interactive flat panel, characterized in that, include: The touch frame has a touch precision that reaches a set precision range, and is used to collect touch point information generated when the object is touched. The display screen, combined with the touch frame, forms a touch screen for displaying interactive content; One or more processors; Storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1-16.

19. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the method as described in any one of claims 1-16.

Images