A handwriting display method, device, equipment and storage medium

By acquiring touch input signals to determine the writing device mode and generating predicted handwriting signals for rendering, the problem of handwriting display delay on touch devices is solved, improving the user experience without increasing hardware costs.

CN116027956BActive Publication Date: 2026-04-14LENOVO (BEIJING) LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-12-21
Publication Date
2026-04-14

AI Technical Summary

Technical Problem

In existing technologies, touch devices suffer from delays in handwriting display, resulting in a poor writing experience for users, and methods that increase hardware costs have limited effectiveness.

Method used

By acquiring touch input signals, the current mode of the writing device is determined, and a predicted handwriting signal is generated based on the touch input signal for predicted handwriting rendering and display, thereby reducing latency.

Benefits of technology

It effectively reduces handwriting display latency, improves user experience, and does not require additional hardware costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116027956B_ABST
    Figure CN116027956B_ABST
Patent Text Reader

Abstract

The present disclosure provides a handwriting display method and device, equipment and storage medium, which relates to the technical field of computer. The method mainly comprises: obtaining a touch input signal; determining the current mode of a writing device according to the touch input signal, and generating a predicted handwriting signal of the writing device in the corresponding mode according to the touch input signal; performing handwriting rendering according to the predicted handwriting signal to obtain a first rendering result, and displaying the first rendering result. Thus, the handwriting of the writing device is predicted to obtain a predicted handwriting signal, and the predicted handwriting signal is rendered and displayed in real time, which can effectively reduce the delay of handwriting display without any hardware cost.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a handwriting display method, apparatus, device, and storage medium. Background Technology

[0002] With the development of technology, more and more users are choosing to use writing devices such as styluses to input on tablets or other touch-enabled devices. However, touch-enabled devices require a considerable amount of time from receiving input data to displaying it on the screen, resulting in handwriting display latency and severely impacting the user's writing experience. Current technologies typically employ pens with higher reporting rates and / or screens with higher refresh rates to reduce handwriting display latency, but this increases hardware costs and offers limited improvement in latency. Summary of the Invention

[0003] This disclosure provides a handwriting display method, apparatus, device, and storage medium to at least solve the above-mentioned technical problems existing in the prior art.

[0004] According to a first aspect of this disclosure, a handwriting display method is provided, the method comprising: acquiring a touch input signal; determining a current mode of a writing device based on the touch input signal, and generating a predicted handwriting signal of the writing device in the corresponding mode based on the touch input signal; performing handwriting rendering based on the predicted handwriting signal to obtain a first rendering result, and displaying the first rendering result.

[0005] In one embodiment, the touch input signal includes a first touch input signal; determining the current mode of the writing device based on the touch input signal includes: if the first touch input signal meets a first input condition, then the current mode of the writing device is determined to be a first mode; if the first touch input signal does not meet the first input condition, then the current mode of the writing device is determined to be a second mode.

[0006] In one embodiment, the touch input signal includes a second touch input signal; determining the current mode of the writing device based on the touch input signal includes: if the second touch input signal meets a second input condition, then the current mode of the writing device is determined to be a third mode.

[0007] In one possible implementation, generating a predicted handwriting signal for the writing device in a corresponding mode based on a touch input signal includes: in the first mode, acquiring a touch position change value and a corresponding touch direction of the first touch input signal; if the touch position change value meets a preset threshold, determining a third touch input signal based on the touch direction corresponding to the first touch input signal, and obtaining the predicted handwriting signal based on the third touch input signal; if the touch position change value does not meet the preset threshold, obtaining the predicted handwriting signal based on an input second touch input signal.

[0008] In one embodiment, the third touch input signal includes position information; determining the third touch input signal based on the touch direction corresponding to the first touch input signal includes: determining the position information of the third touch input signal based on the touch direction corresponding to the first touch input signal.

[0009] In one possible implementation, obtaining the predicted handwriting signal based on the input second touch input signal includes: acquiring the angle change value of the second touch input signal; searching for position information corresponding to the angle change value according to a preset correspondence, the preset correspondence including the angle change value and its corresponding position information; and generating the predicted handwriting signal based on the position information.

[0010] In one possible implementation, generating a predicted handwriting signal for the writing device in a corresponding mode based on the touch input signal includes: in the second mode, acquiring an angle change value of the input second touch input signal; searching for position information corresponding to the angle change value according to a preset correspondence, the preset correspondence including the angle change value and its corresponding position information; and generating the predicted handwriting signal based on the position information.

[0011] In one possible implementation, the second touch input signal includes a touch position; generating a predicted handwriting signal of the writing device in a corresponding mode based on the touch input signal includes: in the third mode, performing linear fitting based on the touch position and historical position to obtain a fitting result; and generating the predicted handwriting signal based on the fitting result.

[0012] In one possible implementation, the step of rendering handwriting based on the predicted handwriting signal includes: acquiring the predicted handwriting signal, drawing the acquired predicted handwriting signal in real time, and obtaining the first rendering result.

[0013] In one embodiment, the method further includes: acquiring a real-time handwriting signal; if the position information represented by the real-time handwriting signal is different from that represented by the predicted handwriting signal, then the first rendering result is corrected according to the real-time handwriting signal to obtain a second rendering result, and the second rendering result is displayed.

[0014] According to a second aspect of this disclosure, a handwriting display device is provided, the device comprising: an acquisition module for acquiring a touch input signal; a generation module for determining the current mode of a writing device based on the touch input signal, and generating a predicted handwriting signal of the writing device in the corresponding mode based on the touch input signal; and a rendering module for rendering handwriting based on the predicted handwriting signal to obtain a first rendering result, and displaying the first rendering result.

[0015] According to a third aspect of this disclosure, an electronic device is provided, comprising:

[0016] At least one processor; and

[0017] A memory communicatively connected to the at least one processor; wherein,

[0018] The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the methods described in this disclosure.

[0019] According to a fourth aspect of this disclosure, a non-transitory computer-readable storage medium is provided storing computer instructions for causing the computer to perform the methods described in this disclosure.

[0020] This disclosure discloses a handwriting display method, apparatus, device, and storage medium. First, a touch input signal is acquired. Then, based on the touch input signal, the current mode of the writing device is determined. A predicted handwriting signal for the writing device in the corresponding mode is generated based on the touch input signal. Finally, handwriting rendering is performed based on the predicted handwriting signal to obtain a first rendering result, which is then displayed. Thus, by predicting the handwriting on the writing device, obtaining the predicted handwriting signal, and rendering and displaying the predicted handwriting signal in real time, the latency of handwriting display can be effectively reduced without any hardware cost.

[0021] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0022] The above and other objects, features, and advantages of this disclosure will become readily apparent from the following detailed description of exemplary embodiments, taken in conjunction with the accompanying drawings. Several embodiments of this disclosure are illustrated in the drawings by way of example and not limitation, in which:

[0023] In the accompanying drawings, the same or corresponding reference numerals indicate the same or corresponding parts.

[0024] Figure 1 A flowchart illustrating a handwriting display method according to a first embodiment of the present disclosure is shown;

[0025] Figure 2 A flowchart illustrating a handwriting display method according to a fourth embodiment of this disclosure is shown;

[0026] Figure 3 A flowchart illustrating a handwriting display method according to a fifth embodiment of this disclosure is shown;

[0027] Figure 4 A flowchart illustrating a handwriting display method according to a sixth embodiment of this disclosure is shown;

[0028] Figure 5 A schematic diagram of a handwriting display method according to the seventh embodiment of this disclosure is shown.

[0029] Figure 6 A flowchart illustrating a handwriting display method according to an eighth embodiment of this disclosure is shown;

[0030] Figure 7 A schematic diagram of a first scenario of a handwriting display method according to an eighth embodiment of the present disclosure is shown;

[0031] Figure 8 A second scenario diagram of a handwriting display method according to the eighth embodiment of this disclosure is shown;

[0032] Figure 9 A schematic diagram of the structure of a handwriting display device according to the ninth embodiment of this disclosure is shown;

[0033] Figure 10 A schematic diagram of the composition structure of an electronic device according to an embodiment of the present disclosure is shown. Detailed Implementation

[0034] To make the objectives, features, and advantages of this disclosure more apparent and understandable, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0035] Figure 1 A flowchart illustrating a handwriting display method according to a first embodiment of this disclosure is shown, as follows: Figure 1 As shown, the method mainly includes:

[0036] Step S101: Obtain the touch input signal.

[0037] In this embodiment, it is first necessary to acquire the touch input signal. The touch input signal is the input signal received by the tablet computer or other touch-enabled device when the user uses a writing device such as a stylus to input on the tablet computer or other touch-enabled device. The touch input signal may include the touch signal of the user's palm and the writing signal of the writing device such as the stylus.

[0038] In one implementation, the touch input signal is obtained by scanning the touch chip (Touch IC) in a tablet computer or other touch-enabled device. The touch chip can scan once per frame to obtain the touch input signal for the corresponding frame.

[0039] Step S102: Determine the current mode of the writing device based on the touch input signal, and generate a predicted handwriting signal of the writing device in the corresponding mode based on the touch input signal.

[0040] In this embodiment, the current mode of a writing device such as a stylus can be determined based on the different touch input signals. The current mode of the writing device is the current writing state of the writing device, which can reflect the current writing method of the user. In different current modes, a predicted handwriting signal of the writing device in the corresponding mode can be generated based on the touch input signal.

[0041] In one implementation, the current mode of the writing device can be determined based on the types of signals included in the touch input signal. For example, if the touch input signal includes both the user's palm touch signal and the writing signal of the writing device, the current mode of the writing device is determined to be a first mode; if the touch input signal only includes the writing signal of the writing device, the current mode of the writing device is determined to be a second mode, and so on. Accordingly, the predicted handwriting signal of the writing device in the corresponding mode can be generated in the following ways: for example, in the first mode, the current position of the writing device is determined based on the writing signal, and the movement direction of the user's palm is determined based on the touch signal. Then, a preset number of signals are predicted along the movement direction of the touch signal after the current position to obtain the predicted handwriting signal; in the second mode, the current position and movement direction of the writing device are determined based on the writing signal, and then a preset number of signals are predicted along the movement direction of the writing device after the current position to obtain the predicted handwriting signal.

[0042] Step S103: Render the handwriting based on the predicted handwriting signal to obtain a first rendering result, and display the first rendering result.

[0043] In this embodiment, after obtaining the predicted handwriting signal, handwriting rendering is performed based on the predicted handwriting signal to obtain a first rendering result, and the first rendering result is displayed. Since the first rendering result is rendered in advance based on the predicted handwriting signal, it is more advanced than the rendering result of the actual handwriting signal of the writing device. Therefore, displaying the first rendering result can effectively reduce the delay of handwriting display.

[0044] In one possible implementation, handwriting rendering based on a predicted handwriting signal includes: acquiring the predicted handwriting signal, drawing the acquired predicted handwriting signal in real time, and obtaining a first rendering result. Specifically, after generating the predicted handwriting signal, it is necessary to draw the acquired predicted handwriting signal in real time to ensure the timeliness of the first rendering result, thereby reducing the delay in handwriting display.

[0045] In the first embodiment of this disclosure, a touch input signal is first acquired. Then, based on the touch input signal, the current mode of the writing device is determined, and a predicted handwriting signal for the writing device in the corresponding mode is generated. Finally, handwriting rendering is performed based on the predicted handwriting signal to obtain a first rendering result, which is then displayed. Thus, predicting the handwriting of the writing device, obtaining a predicted handwriting signal, and rendering and displaying the predicted handwriting signal in real time effectively reduces the latency of handwriting display without any hardware cost.

[0046] In the second embodiment of this disclosure, the touch input signal includes a first touch input signal; determining the current mode of the writing device based on the touch input signal includes: if the first touch input signal meets the first input condition, then the current mode of the writing device is determined to be a first mode; if the first touch input signal does not meet the first input condition, then the current mode of the writing device is determined to be a second mode.

[0047] In this embodiment, the touch input signal includes a first touch input signal, which is a touch signal from the user's palm. The first input condition includes the first touch input signal changing within a preset number of frames. If the first touch input signal meets the first input condition, the current mode of the writing device is determined to be a first mode; if the first touch input signal does not meet the first input condition, the current mode of the writing device is determined to be a second mode. It should be emphasized that in both the first and second modes, the touch input signal also includes a second touch input signal, which is a writing signal from the writing device.

[0048] In the third embodiment of this disclosure, the touch input signal includes a second touch input signal; determining the current mode of the writing device based on the touch input signal includes: if the second touch input signal meets the second input condition, then the current mode of the writing device is determined to be a third mode.

[0049] In this embodiment, the touch input signal only includes the second touch input signal, which is the writing signal of the writing device. It includes the position information and angle information of the writing device. The second input condition includes that the angle information of the second touch input signal has not changed within a preset number of frames. If the second touch input signal meets the second input condition, the current mode of the writing device is determined to be the third mode.

[0050] In one possible implementation, if the second touch input signal does not meet the second input condition, that is, the angle information of the second touch input signal changes within a preset number of frames, then the current mode of the writing device can be determined to be the second mode.

[0051] In this disclosure, the first mode can be understood as the user's normal writing mode, where, in addition to the stylus or other writing device contacting the tablet or other touch-enabled device, the user's palm also contacts the tablet or other touch-enabled device, and the position of the user's palm changes during the writing process. The second mode can be understood as the user's suspended writing mode, which includes two situations: the first situation is that the user's palm does not contact the tablet or other touch-enabled device during writing, only the stylus or other writing device contacts the tablet or other touch-enabled device, and the angle of the stylus or other writing device changes during the writing process; the second situation is that, in addition to the stylus or other writing device contacting the tablet or other touch-enabled device, the user's palm also contacts the tablet or other touch-enabled device, but the position of the user's palm does not change during the writing process. The third mode can be understood as the test writing mode, where, in order to test the performance of the writing device, a clamping tool is used to hold the writing device on the tablet or other touch-enabled device for writing. In this case, no palm contacts the tablet or other touch-enabled device, and due to the clamping tool, the angle of the writing device does not change during the writing process.

[0052] In the second and third embodiments of this disclosure, the current mode of the writing device is determined based on the types of signals contained in the touch input signal and the changes in the signals. This facilitates the subsequent generation of the predicted handwriting signal of the writing device in the corresponding mode by adopting the corresponding prediction method according to the different current modes, thereby ensuring the accuracy of the predicted handwriting signal.

[0053] Figure 2 A flowchart illustrating a handwriting display method according to a fourth embodiment of this disclosure is shown, as follows: Figure 2As shown, the method for generating a predicted handwriting signal for a writing device in a given mode based on the touch input signal includes:

[0054] Step S201: In the first mode, obtain the touch position change value and the corresponding touch direction of the first touch input signal.

[0055] In this embodiment, generating the predicted handwriting signal in the first mode first requires obtaining the touch position change value and corresponding touch direction of the first touch input signal. The first touch input signal reflects the touch position of the user's palm. The touch position change value is the change in the touch position within a preset number of frames, and the touch direction is the direction of change of the touch position within the preset number of frames. For example, if the first touch input signal shows that the touch position has moved n pixels to the right within the preset number of frames, then the touch position change value is n pixels, and the touch direction is right.

[0056] In step S202, if the change value of the touch position meets the preset threshold, then the third touch input signal is determined according to the touch direction corresponding to the first touch input signal, and the predicted handwriting signal is obtained according to the third touch input signal.

[0057] Step S203: If the touch position change value does not meet the preset threshold, the predicted handwriting signal is obtained based on the input second touch input signal.

[0058] In this embodiment, the touch position change value meets the preset threshold if the touch position change value is greater than a preset number of pixels, i.e., the touch position change value is large. In this case, the third touch input signal can be determined based on the touch direction corresponding to the first touch input signal. The third touch input signal is a signal predicted along the touch direction corresponding to the first touch input signal. Then, the predicted handwriting signal can be obtained based on the third touch input signal. If the touch position change value does not meet the preset threshold, i.e., the touch position change value of the first touch input signal is small, the touch direction corresponding to the first touch input signal cannot accurately reflect the writing direction of the writing device. Therefore, the predicted handwriting signal can be obtained based on the input second touch input signal.

[0059] In one embodiment, the third touch input signal includes position information. Determining the third touch input signal based on the touch direction corresponding to the first touch input signal includes: determining the position information of the third touch input signal based on the touch direction corresponding to the first touch input signal. The position information indicates the positional tendency of the writing device, i.e., the writing direction of the writing device after the current position. When the touch position change value meets a preset threshold, the touch direction corresponding to the first touch input signal can be determined as the position information of the third touch input signal. Then, the current position of the writing device is determined based on the second touch input signal input in the first mode, and a signal of a preset number of frames is predicted along the position information of the third touch input signal after the current position, thereby obtaining the predicted handwriting signal.

[0060] Figure 3 A schematic flowchart of a handwriting display method according to a fifth embodiment of this disclosure is shown, as follows: Figure 3 As shown, step S203, which obtains the predicted handwriting signal based on the input second touch input signal, includes:

[0061] Step S301: Obtain the angle change value of the second touch input signal.

[0062] In this embodiment, the angle change value of the second touch input signal is first obtained. The second touch input signal includes the angle information of the writing device. The angle change value is the change value of the angle information of the writing device within a preset number of frames. For example, the angle change value of the writing device can be that the writing device tilts n degrees from the X axis to the Y axis of the coordinate system within a preset number of frames.

[0063] Step S302: According to the preset correspondence, find the position information corresponding to the angle change value. The preset correspondence includes the angle change value and its corresponding position information.

[0064] Step S303: Generate a predicted handwriting signal based on the location information.

[0065] In this embodiment, the preset correspondence includes the angle change value and its corresponding position information. For example, the relationship between the angle change value and the position information can be determined in advance through experiments, and the angle change value and its corresponding position information can be stored in the preset correspondence one by one. After obtaining the angle change value of the second touch input signal, the position information corresponding to the angle change value can be found in the preset correspondence. Then, the current position of the writing device can be determined according to the second touch signal, and the signal of the preset number of frames can be predicted along the position information corresponding to the angle change value after the current position, thereby obtaining the predicted handwriting signal.

[0066] In the fourth and fifth embodiments of this disclosure, in the first mode, it is first determined whether the touch position change value of the first touch input signal meets a preset threshold. If the touch position change value meets the preset threshold, the predicted handwriting signal is directly determined based on the touch direction corresponding to the first touch input signal. This simplifies the handwriting signal prediction process and reduces the computational load. If the touch position change value does not meet the preset threshold, the predicted handwriting signal is obtained based on the input second touch input signal. Thus, under different conditions in the first mode, corresponding prediction methods are used to generate predicted handwriting signals, thereby obtaining more accurate predicted handwriting signals.

[0067] Figure 4 A flowchart illustrating a handwriting display method according to a sixth embodiment of this disclosure is shown, as follows: Figure 4 As shown, the method for generating a predicted handwriting signal for a writing device in a given mode based on the touch input signal includes:

[0068] Step S401: In the second mode, obtain the angle change value of the input second touch input signal.

[0069] In this embodiment, since the first touch input signal does not change or there is no first touch input signal in the second mode, it is impossible to generate a predicted handwriting signal based on the first touch input signal. However, the angle information of the second touch input signal changes within a preset number of frames in the second mode. Therefore, in the second mode, a predicted handwriting signal can be directly generated based on the second touch input signal. First, it is necessary to obtain the angle change value of the second touch input signal. The method for obtaining the angle change value of the second touch input signal is similar to step S301, and will not be described again here.

[0070] Step S402: According to the preset correspondence, find the position information corresponding to the angle change value. The preset correspondence includes the angle change value and its corresponding position information.

[0071] Step S403: Generate a predicted handwriting signal based on the location information.

[0072] Steps S402 and S403 are similar to steps S302 and S303, and will not be described again here.

[0073] In the sixth embodiment of this disclosure, in the second mode, the predicted handwriting signal is generated directly based on the angle change value of the second touch input signal, which can obtain a more accurate predicted handwriting signal in the second mode.

[0074] In the seventh embodiment of this disclosure, the second touch input signal includes a touch position; generating a predicted handwriting signal of the writing device in the corresponding mode based on the touch input signal includes: in the third mode, performing linear fitting based on the touch position and historical position to obtain a fitting result; and generating a predicted handwriting signal based on the fitting result.

[0075] In this embodiment, since the third mode does not include the first touch input signal and the angle information of the second touch input signal does not change within a preset number of frames, it is impossible to generate a predicted handwriting signal based on the angle change value of the first or second touch input signal. Therefore, in the third mode, a linear fit is performed based on the touch position and the historical position to obtain the fitting result, and then a preset handwriting signal is generated based on the fitting result. Here, the touch position is the current position of the writing device. The fitting curve obtained by linearly fitting the touch position and the historical position can reflect the direction of the writing device. Therefore, a predicted handwriting signal can be generated based on the fitting curve. For example, the position after the touch position on the fitting curve is determined as the predicted position, and a predicted handwriting signal is generated based on the predicted position.

[0076] Figure 5 A schematic diagram of a handwriting display method according to the seventh embodiment of this disclosure is shown, such as... Figure 5 As shown, curve L is the writing curve of the writing device, which can be converted into a second touch input signal. The touch position 5c, and historical positions 5a and 5b can be determined from the second touch input signal. A historical position can be selected at intervals of time T, meaning the interval between 5a, 5b, and 5c can be T, for example, the length of one frame. Linear fitting is performed based on the position information of 5a, 5b, and 5c to obtain the fitting result f(t). If the position information corresponding to touch position 5c can be represented as f(a), the position information corresponding to historical position 5a can be represented as f(a-2T), and the position information corresponding to historical position 5b can be represented as f(aT), then the position information of predicted position 5d is f(a+T). Converting the position information f(a+T) of predicted position 5d into a signal representation yields the predicted handwriting signal. It should be emphasized that the number of historical positions and the number of predicted positions can be selected according to the actual situation, and this disclosure does not limit them.

[0077] In the seventh embodiment of this disclosure, in the third mode, linear fitting is performed based on the touch position and the historical position, and a predicted handwriting signal is generated based on the fitting result, which can obtain a more accurate predicted handwriting signal in the third mode.

[0078] Figure 6 A flowchart illustrating a handwriting display method according to an eighth embodiment of this disclosure is shown, as follows: Figure 6 As shown, a handwriting display method further includes:

[0079] Step S104: Acquire real-time handwriting signal.

[0080] In step S105, if the position information represented by the real-time handwriting signal and the predicted handwriting signal are different, the first rendering result is corrected according to the real-time handwriting signal to obtain the second rendering result, and the second rendering result is displayed.

[0081] In this embodiment, the real-time handwriting signal is the actual writing signal of the writing device. To avoid a deviation between the predicted handwriting signal and the real-time handwriting signal of the writing device, after acquiring the real-time handwriting signal, it is necessary to compare the real-time handwriting signal with the predicted handwriting signal. If the position information represented by the real-time handwriting signal and the predicted handwriting signal is different, the first rendering result is corrected according to the real-time handwriting signal to obtain the second rendering result, and the second rendering result is displayed.

[0082] Figure 7 A schematic diagram of a first scenario of a handwriting display method according to the eighth embodiment of this disclosure is shown, as follows: Figure 7 As shown, 7a, 7b, and 7c represent the handwriting signals already rendered by the writing device, 7d represents the signal of the current position of the writing device, i.e., the real-time handwriting signal, and 7e and 7f represent the predicted handwriting signals. After obtaining the real-time handwriting signal 7d of the writing device, the first rendering result obtained by rendering the predicted handwriting signal after the original handwriting signal 7c can be corrected based on the real-time handwriting signal 7d to obtain the correct second rendering result. At the same time, based on the predicted handwriting signals 7e and 7f, two frames of handwriting signals can be rendered in advance after the real-time handwriting signal 7d to obtain the first rendering result after the real-time handwriting signal 7d.

[0083] Figure 8 A second scenario diagram of a handwriting display method according to the eighth embodiment of this disclosure is shown, as follows: Figure 8As shown, curve P represents the writing curve of the writing device, curve 8a represents the first rendering result obtained after point O based on the predicted handwriting signal, and curve 8b represents the actual writing curve of the writing device after point O. At this point, the position information represented by the real-time handwriting signal after point O differs from that represented by the predicted handwriting signal. Therefore, curve 8a can be corrected based on the real-time handwriting signal after point O to obtain curve 8b, which is the second rendering result. Specifically, when generating the predicted handwriting signal, a prediction threshold can be set in advance. For example, the prediction threshold can be one frame, meaning that a predicted handwriting signal of one frame is predicted after the current position of the writing device. However, it should be emphasized that if the prediction threshold is too small, it will not effectively improve the handwriting delay; if the prediction threshold is too large, the first rendering result obtained based on the predicted handwriting signal may be recognizable by the naked eye, affecting the user experience. Therefore, in specific scenarios, the prediction threshold can be set according to the actual situation.

[0084] In the eighth embodiment of this disclosure, the accuracy of handwriting rendering can be further improved and the user experience enhanced by correcting the first rendering result based on the real-time handwriting signal.

[0085] Figure 9 A schematic diagram of the structure of a handwriting display device according to the ninth embodiment of this disclosure is shown, as follows: Figure 9 As shown, the device mainly includes:

[0086] The acquisition module 10 is used to acquire touch input signals; the generation module 11 is used to determine the current mode of the writing device based on the touch input signals, and generate a predicted handwriting signal of the writing device in the corresponding mode based on the touch input signals; the rendering module 12 is used to render handwriting based on the predicted handwriting signals, obtain a first rendering result, and display the first rendering result.

[0087] In one embodiment, the touch input signal includes a first touch input signal; the generation module 11 includes: a first determining submodule, configured to determine the current mode of the writing device as a first mode when the first touch input signal meets the first input condition; and to determine the current mode of the writing device as a second mode when the first touch input signal does not meet the first input condition.

[0088] In one embodiment, the touch input signal includes a second touch input signal; the generation module 11 includes a second determination submodule, used to determine that the current mode of the writing device is a third mode when the second touch input signal meets the second input conditions.

[0089] In one possible implementation, the generation module 11 includes:

[0090] The first acquisition submodule is used to acquire the touch position change value and the corresponding touch direction of the first touch input signal in the first mode; the first generation submodule is used to determine the third touch input signal according to the touch direction corresponding to the first touch input signal if the touch position change value meets the preset threshold, and obtain the predicted handwriting signal according to the third touch input signal; the second generation submodule is used to obtain the predicted handwriting signal according to the input second touch input signal if the touch position change value does not meet the preset threshold.

[0091] In one embodiment, the third touch input signal includes position information; the first generation submodule is further configured to determine the position information of the third touch input signal based on the touch direction corresponding to the first touch input signal.

[0092] In one possible implementation, the second generation submodule includes: an acquisition unit for acquiring the angle change value of the second touch input signal; a search unit for searching for position information corresponding to the angle change value according to a preset correspondence, the preset correspondence including the angle change value and its corresponding position information; and a generation unit for generating a predicted handwriting signal based on the position information.

[0093] In one embodiment, the generation module 11 includes: a second acquisition submodule, used to acquire the angle change value of the input second touch input signal in a second mode; a search submodule, used to search for position information corresponding to the angle change value according to a preset correspondence, the preset correspondence including the angle change value and its corresponding position information; and a third generation submodule, used to generate a predicted handwriting signal according to the position information.

[0094] In one embodiment, the generation module 11 includes: a fitting submodule, used to perform linear fitting based on the touch position and historical position in a third mode to obtain a fitting result; and a fourth generation submodule, used to generate a predicted handwriting signal based on the fitting result.

[0095] In one embodiment, the rendering module 12 includes a real-time rendering submodule, used to acquire a predicted handwriting signal, draw the acquired predicted handwriting signal in real time, and obtain a first rendering result.

[0096] In one embodiment, the device further includes: a second acquisition module for acquiring a real-time handwriting signal; and a correction module for correcting the first rendering result based on the real-time handwriting signal to obtain a second rendering result if the real-time handwriting signal differs from the touch position information represented by the predicted handwriting signal, and then displaying the second rendering result.

[0097] According to embodiments of this disclosure, this disclosure also provides an electronic device and a readable storage medium.

[0098] Figure 10A schematic block diagram of an example electronic device 1000 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0099] like Figure 10 As shown, device 1000 includes a computing unit 1001, which can perform various appropriate actions and processes according to a computer program stored in read-only memory (ROM) 1002 or a computer program loaded from storage unit 1008 into random access memory (RAM) 1003. The RAM 1003 may also store various programs and data required for the operation of device 1000. The computing unit 1001, ROM 1002, and RAM 1003 are interconnected via bus 1004. Input / output (I / O) interface 1005 is also connected to bus 1004.

[0100] Multiple components in device 1000 are connected to I / O interface 1005, including: input unit 1006, such as keyboard, mouse, etc.; output unit 1007, such as various types of monitors, speakers, etc.; storage unit 1008, such as disk, optical disk, etc.; and communication unit 1009, such as network card, modem, wireless transceiver, etc. Communication unit 1009 allows device 1000 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0101] The computing unit 1001 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 1001 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 1001 performs the various methods and processes described above, such as a handwriting display method. For example, in some embodiments, a handwriting display method may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 1008. In some embodiments, part or all of the computer program may be loaded and / or installed on device 1000 via ROM 1002 and / or communication unit 1009. When the computer program is loaded into RAM 1003 and executed by the computing unit 1001, one or more steps of a handwriting display method described above may be performed. Alternatively, in other embodiments, the computing unit 1001 may be configured to perform a handwriting display method by any other suitable means (e.g., by means of firmware).

[0102] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0103] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0104] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0105] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0106] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0107] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0108] It should be understood that the various forms of processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0109] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this disclosure, "a plurality of" means two or more, unless otherwise explicitly specified.

[0110] The above description is merely a specific embodiment of this disclosure, but the scope of protection of this disclosure is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this disclosure should be included within the scope of protection of this disclosure. Therefore, the scope of protection of this disclosure should be determined by the scope of the claims.

Claims

1. A handwriting display method, characterized in that, The method includes: Acquire touch input signals; Based on the touch input signal, the current mode of the writing device is determined, and a predicted handwriting signal of the writing device in the corresponding mode is generated based on the touch input signal. Handwriting is rendered based on the predicted handwriting signal to obtain a first rendering result, and the first rendering result is displayed. Wherein, the touch input signal includes a first touch input signal; the first touch input signal is a touch signal from the user's palm; determining the current mode of the writing device based on the touch input signal includes: If the first touch input signal meets the first input condition, then the current mode of the writing device is determined to be the first mode; the first input condition includes the first touch input signal changing within a preset number of frames; If the first touch input signal does not meet the first input condition, then the current mode of the writing device is determined to be the second mode.

2. The method according to claim 1, characterized in that, The touch input signal includes a second touch input signal; determining the current mode of the writing device based on the touch input signal includes: If the second touch input signal meets the second input condition, then the current mode of the writing device is determined to be the third mode.

3. The method according to claim 1, characterized in that, The step of generating the predicted handwriting signal of the writing device in the corresponding mode based on the touch input signal includes: In the first mode, the touch position change value and the corresponding touch direction of the first touch input signal are obtained; If the change value of the touch position meets the preset threshold, then the third touch input signal is determined according to the touch direction corresponding to the first touch input signal, and the predicted handwriting signal is obtained according to the third touch input signal; If the change value of the touch position does not meet the preset threshold, the predicted handwriting signal is obtained based on the input second touch input signal.

4. The method according to claim 3, characterized in that, The third touch input signal includes position information; determining the third touch input signal based on the touch direction corresponding to the first touch input signal includes: The position information of the third touch input signal is determined based on the touch direction corresponding to the first touch input signal.

5. The method according to claim 3, characterized in that, The step of obtaining the predicted handwriting signal based on the input second touch input signal includes: Obtain the angle change value of the second touch input signal; According to a preset correspondence, the location information corresponding to the angle change value is found. The preset correspondence includes the angle change value and its corresponding location information. The predicted handwriting signal is generated based on the location information.

6. The method according to claim 1, characterized in that, The step of generating the predicted handwriting signal of the writing device in the corresponding mode based on the touch input signal includes: In the second mode, the angle change value of the input second touch input signal is obtained; According to a preset correspondence, the location information corresponding to the angle change value is found. The preset correspondence includes the angle change value and its corresponding location information. The predicted handwriting signal is generated based on the location information.

7. The method according to claim 2, characterized in that, The second touch input signal includes the touch position; generating the predicted handwriting signal of the writing device in the corresponding mode based on the touch input signal includes: In the third mode, a linear fit is performed based on the touch position and the historical position to obtain the fitting result; The predicted handwriting signal is generated based on the fitting result.

8. The method according to claim 1, characterized in that, The step of rendering handwriting based on the predicted handwriting signal includes: The predicted handwriting signal is acquired, and the acquired predicted handwriting signal is drawn in real time to obtain the first rendering result.

9. The method according to any one of claims 1 to 8, characterized in that, The method further includes: Acquire real-time handwriting signals; If the position information represented by the real-time handwriting signal is different from that represented by the predicted handwriting signal, the first rendering result is corrected according to the real-time handwriting signal to obtain a second rendering result, and the second rendering result is displayed.

10. A handwriting display device, characterized in that, The device includes: The acquisition module is used to acquire touch input signals; The generation module is used to determine the current mode of the writing device based on the touch input signal, and generate a predicted handwriting signal of the writing device in the corresponding mode based on the touch input signal. The rendering module is used to render the handwriting based on the predicted handwriting signal, obtain a first rendering result, and display the first rendering result. Wherein, the touch input signal includes a first touch input signal; the first touch input signal is a touch signal from the user's palm; determining the current mode of the writing device based on the touch input signal includes: If the first touch input signal meets the first input condition, then the current mode of the writing device is determined to be the first mode; the first input condition includes the first touch input signal changing within a preset number of frames; If the first touch input signal does not meet the first input condition, then the current mode of the writing device is determined to be the second mode.

11. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-9.

12. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-9.

Citation Information

Patent Citations

  • Handwriting drawing method, device and equipment and storage medium

    CN111475045A

  • Touch track display method, device and equipment and storage medium

    CN112486399A