A writing display method, device, equipment, system and storage medium

Abstract

The present application proposes a writing display method, device, equipment, system and storage medium, the method comprising: after a writing application completes the writing handwriting rendering process in the current synchronization signal cycle, in the current synchronization signal cycle, starting the synthesis process of the writing handwriting rendering result of the writing application in the current synchronization signal cycle to obtain the writing handwriting synthesis result; and displaying the obtained writing handwriting synthesis result. The method can significantly reduce the delay of the display device displaying the writing handwriting and improve the pen-following effect of the writing handwriting display.

Description

Technical Field

[0001] The present application relates to the field of human-computer interaction technology, and in particular to a writing display method, device, equipment, system and storage medium. Background Art

[0002] The display process of the user's handwriting on the display device mainly includes the system collecting the writing touch position information, the writing application drawing and rendering the writing handwriting according to the writing touch position information, the display subsystem synthesizing the writing handwriting rendering results, and the screen display of the writing handwriting synthesis results.

[0003] The system synchronization signal of the display device is used to achieve synchronous control of the display process. Under this display process synchronization mechanism, the writing application performs writing handwriting drawing and rendering operations, the display subsystem performs synthesis operations on the writing handwriting rendering results, and the screen display refreshes, all of which are triggered when the system synchronization signal is received, so that each process remains synchronized. The above display process synchronization mechanism can eliminate lag and improve graphic visual performance.

[0004] However, when the handwriting of the user is actually displayed, the display delay of the handwriting is relatively high, and it is unable to synchronously follow the writing of the user, resulting in the handwriting not following the pen, thus affecting the user's writing experience. Summary of the invention

[0005] Based on the above-mentioned technical status, the present application proposes a writing display method, device, equipment, system and storage medium, which can significantly reduce the delay of the display device in displaying writing handwriting and improve the pen-following effect of the writing handwriting display.

[0006] A writing display method, comprising:

[0007] When the writing application completes the writing handwriting rendering process in the current synchronization signal cycle, in the current synchronization signal cycle, the synthesis process of the writing handwriting rendering result of the writing application in the current synchronization signal cycle is started to obtain the writing handwriting synthesis result;

[0008] The synthesized result of the handwriting is displayed.

[0009] Optionally, the method further includes:

[0010] When a writing event trigger signal is received, a synchronization trigger signal is sent to the system, so that the system sends a system synchronization signal after receiving the synchronization trigger signal;

[0011] The writing event trigger signal is sent by the input subsystem when it senses a writing input event; and the writing application starts to execute writing handwriting drawing and rendering processing when it receives a system synchronization signal sent by the system.

[0012] Optionally, the current synchronization signal cycle takes the moment when the system synchronization signal sent by the system is received as the starting moment;

[0013] When the system synchronization signal sent by the system is received, the writing handwriting drawing and rendering process of the writing application is monitored.

[0014] Optionally, the method further includes:

[0015] When a writing event trigger signal is detected, a writing display working mode is started; in the writing display working mode, when the writing application completes the writing handwriting rendering process within the current synchronization signal cycle, within the current synchronization signal cycle, a synthesis process of the writing handwriting rendering result of the writing application within the current synchronization signal cycle is started to obtain a writing handwriting synthesis result; and the obtained writing handwriting synthesis result is put on the display screen for display;

[0016] When a writing event end signal is detected, exiting the writing display working mode;

[0017] The writing event trigger signal is sent by the input subsystem when it senses that a writing input event has occurred, and the writing event end signal is sent by the input subsystem when it senses that a writing input event has ended.

[0018] Optionally, also include:

[0019] When the synthesis processing of the handwriting rendering result of the writing application in the current synchronization signal cycle is completed, determining whether the completion time exceeds the end time of the current synchronization signal cycle;

[0020] If the completion time exceeds the end time of the current synchronization signal cycle, determining whether the duration of the completion time exceeding the end time of the current synchronization cycle exceeds a set duration;

[0021] If the set time period is exceeded, the synthesis processing of the handwriting rendering result of the writing application in the next synchronization signal cycle of the current synchronization signal cycle is canceled.

[0022] A writing display system, comprising:

[0023] The display subsystem is used to start synthesis processing of the writing handwriting rendering result of the writing application in the current synchronization signal cycle after the writing application completes the writing handwriting rendering processing in the current synchronization signal cycle to obtain the writing handwriting synthesis result;

[0024] The synthesized result of the handwriting is displayed.

[0025] Optionally, also include:

[0026] The input subsystem is used to send a writing event trigger signal to the display subsystem when sensing a writing input event, and to send the collected touch position information to the writing application;

[0027] The display subsystem is also used to send a synchronization trigger signal to the system when a writing event trigger signal sent by the input subsystem is detected, so that the system sends a system synchronization signal after receiving the synchronization trigger signal; when the writing application receives the system synchronization signal sent by the system, it performs writing handwriting drawing and rendering processing according to the touch position information.

[0028] A writing display device, comprising:

[0029] A handwriting synthesis unit is used to start synthesis processing of the handwriting rendering result of the writing application in the current synchronization signal cycle after the writing application completes the handwriting rendering processing in the current synchronization signal cycle to obtain the handwriting synthesis result;

[0030] The handwriting display unit is used to display the obtained handwriting synthesis result.

[0031] A writing display device, comprising:

[0032] Memory and processor;

[0033] The memory is connected to the processor and is used to store programs;

[0034] The processor is used to implement the above-mentioned writing display method by running the program in the memory.

[0035] A storage medium stores a computer program, and when the computer program is executed by a processor, the above-mentioned writing display method is implemented.

[0036] In the above-mentioned writing display method, the start of the synthesis processing of the display subsystem of the display device is not controlled by the system synchronization signal, but after the writing device completes the writing handwriting rendering, the synthesis of the writing handwriting rendering result is immediately started, and the writing handwriting synthesis result is displayed. This writing display method makes the entire writing handwriting display processing flow more compact, enables the display subsystem to start the writing handwriting synthesis processing earlier, and can refresh the writing handwriting synthesis result to the display screen for display earlier, that is, it can enable the user's writing handwriting to be displayed on the display screen of the display device faster, thereby reducing the delay of writing handwriting display. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0038] Figure 1 It is a schematic diagram of the processing flow of handwriting display provided in an embodiment of the present application;

[0039] Figure 2 is a schematic diagram of a synchronous display process of a display device provided in an embodiment of the present application;

[0040] Figure 3 It is a schematic diagram of the handwriting display process provided by an embodiment of the present application;

[0041] Figure 4 It is a flowchart of a writing display method provided in an embodiment of the present application;

[0042] Figure 5 It is a schematic diagram of the handwriting display process in the handwriting display method provided in the embodiment of the present application;

[0043] Figure 6 is a structural schematic diagram of a writing display system provided in an embodiment of the present application;

[0044] Figure 7 is a structural schematic diagram of a writing display device provided in an embodiment of the present application;

[0045] Figure 8 It is a structural schematic diagram of a writing display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] The technical solution of the embodiment of the present application is applicable to the application scenario where the display device displays the user's handwriting. By adopting the technical solution of the embodiment of the present application, the delay of the display device in displaying the user's handwriting can be reduced, so that the handwriting display can follow the pen better, which is beneficial to improving the user's writing experience.

[0047] Display devices are usually equipped with operating systems such as Android, IOS, and Windows as the native operating systems of the display devices. On this basis, users can develop or load third-party applications on the native operating system of the display device, for example, they can install writing applications to draw user handwriting.

[0048] See also Figure 1As shown, in a conventional writing scenario, when a user writes on the input device of a display device, the input device collects touch position information when the user writes, and sends the collected touch position information to a writing application through the input subsystem of the display device system. The writing application draws and renders the writing handwriting based on the acquired touch position information, and then sends the writing handwriting rendering result to the display subsystem of the display device. The display subsystem performs display content synthesis processing based on the received writing handwriting rendering result to obtain a writing handwriting synthesis result. Finally, the writing handwriting synthesis result is projected onto the display screen of the display device for display.

[0049] Among them, the input device of the display device is a device that supports user handwriting input, which can be a part of the display device or an independent input device connected to the display device. For example, when the display screen of the display device is a touch display screen, the touch display screen has the function of collecting user writing trajectory information, that is, the touch display screen can be used as an input device of the display device to collect touch position information when the user writes. Alternatively, the input device of the display device can also be an input functional component such as a writing board installed on the display device, or a device that allows user handwriting input such as a writing board that is connected to the display device through a data line.

[0050] It can be seen that the display process of the display device displaying the user's handwriting mainly includes: the input subsystem collects and sends touch position information to the writing application, the writing application draws and renders the handwriting, the display subsystem synthesizes the display content of the rendering result of the writing application, and the display subsystem puts the synthesized result on the display screen for display.

[0051] In addition, the native operating system of the display device also realizes the synchronization control of the display process through the system synchronization signal (VSYNC). The display process synchronization mechanism of the display device makes image rendering, display content synthesis of rendered images, and screen display refresh all triggered when receiving the system synchronization signal, so that each process is synchronized.

[0052] by Figure 2 Taking the synchronous display process in the Android operating system shown as an example, when a system synchronization signal arrives, the screen refreshes and displays the display content of the Nth frame. At the same time, the display subsystem starts to synthesize the display content of the N+1th frame, and the writing application starts to render the display content of the N+2th frame; when the next system synchronization signal arrives, the screen refreshes and displays the display content of the N+1th frame. At the same time, the display subsystem starts to synthesize the display content of the N+2th frame, and the writing application starts to render the display content of the N+3th frame, and so on.

[0053] It can be seen that based on the above display process synchronization mechanism, image rendering, display content synthesis and screen refresh processing are performed for different image frames in one synchronization signal cycle. The above display process synchronization mechanism realizes the strict synchronization of each process in the display process, which can effectively eliminate freezes and improve graphic visual performance in practical applications.

[0054] The display process synchronization mechanism is also used to synchronize the handwriting display process. Under this display process synchronization mechanism, the handwriting drawn and rendered by the writing application in the current synchronization signal cycle needs to be synthesized by the display subsystem in the next synchronization signal cycle and refreshed to the display screen for display in the next synchronization signal cycle.

[0055] However, in actual applications, it was found that the display device has a high delay in displaying the user's written notes, and the display of the handwriting cannot synchronously follow the user's writing, resulting in the handwriting not following the pen, affecting the user's writing experience.

[0056] After a lot of tests, the inventor of this case found that in the display device, the process of drawing and rendering the handwriting according to the touch position information of the user's writing by the writing application usually takes about 8ms, and the processing time of the display subsystem to synthesize the rendering results of the writing application is usually about 5ms, and the speed at which the synthesis results of the display subsystem are refreshed to the display screen is faster, and its time consumption is almost negligible. In other words, the actual time consumption of the process of drawing and rendering handwriting, synthesizing handwriting, and refreshing handwriting to the display screen is about 13ms.

[0057] However, under the display process synchronization mechanism of the native operating system of the display device, this process will take longer. Take the 60Hz screen refresh rate of the Android operating system as an example, see Figure 3 As shown, for a certain frame of handwriting display image, it is rendered when the system synchronization signal arrives at time T, synthesized when the system synchronization signal arrives at time T+1, and refreshed to the screen for display when the system synchronization signal arrives at time T+2. It can be seen that under the display process synchronization mechanism, the rendering and synthesis of handwriting takes a total of 21.7ms (16.7ms+5ms). If the final display of the handwriting is considered, it takes at least two synchronization signal cycles from the beginning of the rendering of the handwriting to the final refresh to the display screen for display, that is, 33.4ms, which is obviously greater than the actual time of 13ms, thus forming an obvious handwriting display delay.

[0058] In response to the above problems, the inventor of the technical solution of this application conducted in-depth research and proposed a technical solution that can reduce the delay of the display device in displaying the user's handwriting. The application of this solution can make the display of the user's handwriting more accurate, thereby improving the user's writing experience.

[0059] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0060] The present application embodiment provides a writing display method, see Figure 4 As shown, the method includes:

[0061] S401. When sensing a writing input event, the input subsystem sends a writing event trigger signal to the display subsystem, and sends touch position information collected from the writing input event to the writing application.

[0062] Specifically, the input subsystem in the display device system is connected to the input device of the display device and is used to monitor writing events occurring on the input device. When the user starts writing on the input device, such as when a capacitive pen is pressed on the input device, the input subsystem can sense that a touch event has occurred.

[0063] When the input subsystem senses a writing input event, it determines that the current input scene is a writing input scene. At this time, the input subsystem receives touch position information from the input device and sends the touch position information to the writing application. At the same time, the input subsystem sends a writing event trigger signal to the display subsystem in the display device system. The purpose of the writing event trigger signal is to notify the display subsystem that the current input scene is a user writing input scene.

[0064] S402: The display subsystem receives a writing event trigger signal sent by the input subsystem.

[0065] S403: The display subsystem sends a synchronous trigger signal to the system and starts the writing display working mode.

[0066] Specifically, after the display subsystem detects the writing event trigger signal sent by the input subsystem, for example, it receives the writing event trigger information sent by the input subsystem, or actively detects that the input subsystem sends a writing event trigger signal, it can clarify the subsequent content to be displayed and write handwriting for the user. At this time, the display subsystem starts the writing display working mode. In this writing display working mode, the work of the display subsystem is no longer constrained by the display process synchronization mechanism of the display device system. Specifically, the start of the display content synthesis work of the display subsystem is not controlled by the system synchronization signal of the display device system, but is started in time according to the business progress.

[0067] The display subsystem sends a synchronization trigger signal to the display device system. The synchronization trigger signal is used to trigger the bottom layer of the display device system to send a system synchronization signal. The period of the system synchronization signal is used to control the synchronization of various subsystems or applications above the bottom layer of the display device system. The period of the system synchronization signal sent by the bottom layer of the display device system is set according to the display device system. For example, for a display device system with a screen refresh rate of 60Hz, its system synchronization signal period is about 16.7ms.

[0068] S404: When the display device system receives the synchronization trigger signal, it sends a system synchronization signal.

[0069] Specifically, the system synchronization signal sent by the display device system will be sent to the writing application and the display subsystem at the same time.

[0070] S405: When the writing application receives the system synchronization signal, it starts to execute writing handwriting drawing and rendering processing.

[0071] For details, see Figure 3 As shown, when the writing application receives the system synchronization signal, it starts to draw and render the writing handwriting within the current synchronization signal cycle according to the touch position information sent by the input subsystem. Specifically, the writing handwriting is first drawn according to the touch position information, and then the drawn writing handwriting is rendered to obtain the writing handwriting rendering result.

[0072] The current synchronization signal cycle starts with the time when the system synchronization signal is received and ends with the time when the next system synchronization signal is received. When the next system synchronization signal is received, the next synchronization signal cycle begins.

[0073] It should be noted that in the display process of a conventional display device, when the input subsystem senses a writing event, it usually sends a signal to the writing application first, and the writing application then sends a system synchronization signal to the bottom layer of the display device system. Only then can the writing application receive the system synchronization signal and start the writing handwriting drawing and rendering processing.

[0074] In the embodiment of the present application, the input subsystem directly sends a writing event trigger signal to the display subsystem, and after receiving the writing event trigger signal, the display subsystem sends a synchronization trigger signal to the display device system, so that the bottom layer of the display device system sends a system synchronization signal, and the writing application can receive the system synchronization signal. The system synchronization signal triggering process is completely carried out in the display device system without passing through the writing application.

[0075] Since the writing application is a third-party application or an independent application loaded in the display device system, directly triggering the system synchronization signal through the display device system can make the triggering of the system synchronization signal more timely, and enable the writing application to receive the system synchronization signal earlier, thereby starting the writing handwriting drawing and rendering processing.

[0076] Therefore, compared with the conventional display device display process, the processing of the above steps S401-S405 in the embodiment of the present application can enable the writing application to start the writing handwriting drawing and rendering work faster, thereby facilitating a more timely display of the user's writing handwriting, that is, it is beneficial to reduce the writing handwriting display delay.

[0077] S406: When receiving the system synchronization signal, the display subsystem starts monitoring the writing application's handwriting drawing and rendering processing.

[0078] Specifically, when the display subsystem receives the system synchronization signal, that is, when the writing application starts to execute the writing handwriting drawing and rendering processing within the current synchronization cycle, it starts to monitor the writing handwriting drawing and rendering processing of the writing application, specifically monitoring its processing progress, so as to be able to determine whether the writing application has completed the writing handwriting rendering processing within the current synchronization cycle.

[0079] When the writing application completes the writing handwriting rendering process within the current synchronization signal cycle, the display subsystem executes step S407, and starts the synthesis process of the writing handwriting rendering result of the writing application within the current synchronization signal cycle within the current synchronization signal cycle to obtain the writing handwriting synthesis result.

[0080] Specifically, as discussed above, in the conventional display process of the display device, the start of the synthesis process of the display subsystem is controlled by the system synchronization signal of the display device. Only when the system synchronization signal arrives, the display subsystem starts to perform the display content synthesis process. Figure 3 The processing flow is shown.

[0081] However, the embodiment of the present application sets the operation of the display subsystem. When the user starts writing, the display subsystem enters the writing display operation mode through the interaction between the display subsystem and the input subsystem. In this writing display operation mode, the start of the display content synthesis operation of the display subsystem is not controlled by the system synchronization signal of the display device system, but is started in a timely manner according to the progress of the business.

[0082] See also Figure 5 As shown, in the current synchronization signal cycle, the display subsystem monitors the writing application's handwriting drawing and rendering processing in the current synchronization signal cycle. When the writing application completes the writing handwriting rendering processing in the current synchronization signal cycle, the display subsystem obtains the writing handwriting rendering result output by the writing application. At this time, the display subsystem no longer waits for the system synchronization signal, but immediately starts the synthesis processing of the writing handwriting rendering result of the writing application in the current synchronization signal cycle in the current synchronization signal cycle to obtain the writing handwriting synthesis result.

[0083] As mentioned above, under normal circumstances, the total time required for drawing, rendering, and synthesizing user handwriting is 13ms. Therefore, under normal circumstances, the drawing, rendering, and synthesis of handwriting can be completed within one synchronization signal cycle (taking 16.7ms as an example).

[0084] S408. The display subsystem determines whether the time when the synthesis processing of the handwriting rendering result of the writing application within the current synchronization signal cycle is completed exceeds the end time of the current synchronization signal cycle.

[0085] If the completion time does not exceed the end time of the current synchronization signal cycle, the subsequent step S411 is executed.

[0086] If the completion time exceeds the end time of the current synchronization signal cycle, the display subsystem further executes step S409 to determine whether the duration of the completion time exceeding the end time of the current synchronization cycle exceeds the set duration;

[0087] If the set time is exceeded, the display subsystem executes step S410 to cancel the synthesis processing of the writing handwriting rendering result in the next synchronization signal cycle of the current synchronization signal cycle.

[0088] Specifically, in some extreme cases, such as when the writing application renders too many handwritings, or when the CPU occupancy rate of the display device is too high, the handwriting rendering time may be too long, which may result in the inability to complete the synthesis of the handwriting rendering results of the writing application in the current synchronization signal cycle, which will affect the rendering and synthesis of the handwriting in the next synchronization signal cycle. In order to avoid this situation, the embodiment of the present application sets a frame loss mechanism.

[0089] Specifically, if the moment when the display subsystem completes the handwriting synthesis processing within the current synchronization signal cycle exceeds the end moment of the current synchronization signal cycle, it is determined whether the exceeding time exceeds the set time. The set time is the system synchronization signal offset set in the embodiment of the present application, and its specific value can be set according to actual conditions.

[0090] When the duration of the exceedance does not exceed the set duration, it means that the completion time of the writing handwriting synthesis in the current synchronization signal cycle is within the system synchronization signal offset range. At this time, it is considered that it will not affect the writing handwriting rendering and synthesis in the next synchronization signal cycle, so no processing is required.

[0091] However, when the duration exceeds the set duration, it means that the completion time of the handwriting synthesis in the current synchronization signal cycle has exceeded the system synchronization signal offset range and entered the next synchronization signal cycle. At this time, it will affect the handwriting rendering and synthesis in the next synchronization signal cycle. In this case, the embodiment of the present application performs frame drop processing, that is, discards the handwriting display in the next synchronization signal cycle. Correspondingly, in order to save processing resources, the display subsystem cancels the synthesis processing of the handwriting rendering result of the writing application in the next synchronization signal cycle of the current synchronization signal cycle, and waits for the next synchronization signal cycle to perform handwriting synthesis processing again.

[0092] For example, in Figure 5 In the processing flow shown, when there is too much content to be rendered or the system CPU occupancy rate is too high at that time, the rendering time will occasionally exceed 11.7ms. Adding the synthesis time of 5ms, the total rendering and synthesis time will exceed 16.7ms, that is, the processing time exceeds the duration of the current synchronization signal cycle, and frame loss will occur at this time. In order to prevent the occurrence of frame loss, the embodiment of the present application adjusts the offset of the system synchronization signal to 2ms. The offset of 2ms can increase the frame loss length to 18.7ms. Only when the total rendering and synthesis time exceeds 18.7ms (that is, when the rendering and synthesis time in the current synchronization signal cycle exceeds the current synchronization signal cycle time by more than 2ms) will frame loss processing be performed. For example, when the system rendering time is abnormal or the CPU is extremely occupied, the rendering time will occasionally exceed 13.7ms. Adding the synthesis time of 5m, the total time will exceed 18.7ms, which will affect the rendering and synthesis of the next frame. In order to avoid this phenomenon, active frame loss processing is performed, that is, in this extreme case, the synthesis operation is not performed on the next frame, but the synthesis processing of the frame is directly skipped.

[0093] The above frame dropping scheme can avoid the continuous impact on the writing handwriting rendering and synthesis of the subsequent synchronization signal cycles due to the long processing time of the current synchronization signal cycle.

[0094] S411, the display subsystem displays the obtained handwriting synthesis result.

[0095] Specifically, after completing the synthesis processing of the written handwriting, the display subsystem immediately projects the synthesis result of the written handwriting to the display screen of the display device or the screen of the display subsystem for display. That is, when the synthesis processing of the written handwriting is completed, the display screen of the display device or the display refresh of the built-in screen is triggered, so that the synthesis result of the written handwriting is immediately displayed on the display screen.

[0096] The display subsystem's delivery of handwriting synthesis results also breaks the limitation of the display device screen refresh cycle. The handwriting synthesis results of the display subsystem do not have to wait until the system synchronization signal arrives to be refreshed to the display screen for display. Instead, after the display subsystem completes the synthesis of the handwriting and obtains the handwriting synthesis results, it directly triggers the display screen refresh so that the handwriting synthesis results are displayed on the display screen.

[0097] Through the introduction of the above steps S405-S411, it can be known that the writing display method proposed in the embodiment of the present application can break the synchronous control of the display process synchronization mechanism of the display device on the rendering, synthesis, and refresh of the writing handwriting, that is, for the start of the rendering, synthesis, and refresh processing of the writing handwriting, only the rendering of the writing handwriting is controlled by the synchronization signal, and the subsequent synthesis of the writing handwriting rendering results and the display refresh of the writing handwriting synthesis results are all started by the display subsystem in a timely manner according to the processing progress, that is, when the previous sequence repair is completed, the subsequent processing is started immediately. This writing display scheme makes the entire writing handwriting display processing flow more compact, enables the display subsystem to start the writing handwriting synthesis earlier, and can refresh the writing handwriting synthesis results to the display screen for display earlier, that is, it can enable the user's writing handwriting to be displayed on the display screen of the display device faster, thereby reducing the delay of the writing handwriting display.

[0098] S412: When the input subsystem senses that the writing input event is finished, the input subsystem sends a writing event end signal to the display subsystem.

[0099] When the display subsystem receives the writing event end signal sent by the input subsystem, step S413 is executed to exit the writing display working mode.

[0100] Specifically, when the user finishes writing on the input device, for example, when the capacitive pen is lifted from the input device, the input subsystem can sense that the touch event ends, that is, the writing input event ends.

[0101] When the input subsystem senses that the writing input event has ended, it sends a writing event end signal to the display subsystem in the display device system. The purpose of the writing event end signal is to notify the display subsystem that the user's writing input scene has ended and should switch to the normal display scene.

[0102] When the display subsystem detects the writing event end signal sent by the input subsystem, it confirms that the user has finished writing. At this time, the display subsystem exits the writing display working mode. At this time, the start of the display content synthesis work of the display subsystem is controlled by the system synchronization signal of the display device, that is, the display content synthesis processing is started when the display subsystem receives the system synchronization signal.

[0103] The display subsystem exits the writing display working mode in time, which can avoid the problem of display device freeze and poor graphics effect when the user finishes writing due to the display subsystem's operation not complying with the display process synchronization mechanism of the display device.

[0104] To summarize, an embodiment of the present application proposes a writing display method, which includes: after the writing application completes the writing handwriting rendering process within the current synchronization signal cycle, within the current synchronization signal cycle, starting the synthesis processing of the writing handwriting rendering result of the writing application within the current synchronization signal cycle to obtain a writing handwriting synthesis result; and displaying the obtained writing handwriting synthesis result.

[0105] In the above-mentioned writing display method, the start of the synthesis processing of the display subsystem of the display device is not controlled by the system synchronization signal, but after the writing device completes the writing handwriting rendering, the synthesis of the writing handwriting rendering result is immediately started, and the writing handwriting synthesis result is put on the display screen for display. This writing display method makes the entire writing handwriting display processing flow more compact, enables the display subsystem to start the writing handwriting synthesis processing earlier, and can refresh the writing handwriting synthesis result to the display screen for display earlier, that is, it can make the user's writing handwriting displayed on the display screen of the display device faster, so it can reduce the delay of writing handwriting display.

[0106] Corresponding to the above-mentioned writing display method, an embodiment of the present application also proposes a writing display system, which includes: a display subsystem, which is used to start the synthesis processing of the writing handwriting rendering result of the writing application within the current synchronization signal cycle after the writing application completes the writing handwriting rendering processing within the current synchronization signal cycle, and obtain the writing handwriting synthesis result; and display the obtained writing handwriting synthesis result.

[0107] For more details, see Figure 6 As shown, the writing display system specifically includes:

[0108] Input subsystem 1, and display subsystem 2.

[0109] The input subsystem 1 is used to send a writing event trigger signal to the display subsystem 2 when sensing a writing input event, and to send the collected touch position information to the writing application;

[0110] The display subsystem 2 is used to start the synthesis processing of the writing handwriting rendering result of the writing application within the current synchronization signal cycle after the writing application completes the writing handwriting rendering processing within the current synchronization signal cycle to obtain the writing handwriting synthesis result; and put the obtained writing handwriting synthesis result on the display screen for display. In addition, when receiving the writing event trigger signal sent by the input subsystem 1, it is also used to send a synchronization trigger signal to the system, so that the system sends a system synchronization signal after receiving the synchronization trigger signal.

[0111] When the writing application receives the system synchronization signal sent by the system, it performs writing handwriting drawing and rendering processing according to the touch position information.

[0112] Optionally, the current synchronization signal cycle takes the moment when the system synchronization signal sent by the system is received as the starting moment;

[0113] The display subsystem 2 is also used for: when receiving the system synchronization signal sent by the system, starting to monitor the writing handwriting drawing and rendering processing of the writing application.

[0114] Optionally, the display subsystem 2 is further used for:

[0115] When a writing event trigger signal is detected, a writing display working mode is started; in the writing display working mode, when the writing application completes the writing handwriting rendering process within the current synchronization signal cycle, within the current synchronization signal cycle, a synthesis process of the writing handwriting rendering result of the writing application within the current synchronization signal cycle is started to obtain a writing handwriting synthesis result; and the obtained writing handwriting synthesis result is put on the display screen for display;

[0116] When a writing event end signal is detected, exiting the writing display working mode;

[0117] The writing event trigger signal is sent by the input subsystem 1 when sensing the occurrence of a writing input event, and the writing event end signal is sent by the input subsystem 1 when sensing the end of a writing input event.

[0118] Optionally, the display subsystem 2 is further used for:

[0119] When the synthesis processing of the handwriting rendering result of the writing application in the current synchronization signal cycle is completed, determining whether the completion time exceeds the end time of the current synchronization signal cycle;

[0120] If the completion time exceeds the end time of the current synchronization signal cycle, determining whether the duration of the completion time exceeding the end time of the current synchronization cycle exceeds a set duration;

[0121] If the set time period is exceeded, the synthesis processing of the handwriting rendering result of the writing application in the next synchronization signal cycle of the current synchronization signal cycle is canceled.

[0122] Specifically, for the specific working contents of each part of the above-mentioned writing display system, please refer to the introduction of the embodiment of the above-mentioned writing display method, which will not be repeated here.

[0123] The present application also provides a writing display device, see Figure 7 As shown, the device comprises:

[0124] The handwriting synthesis unit 100 is used to start synthesis processing of the handwriting rendering result of the writing application in the current synchronization signal cycle after the writing application completes the handwriting rendering processing in the current synchronization signal cycle to obtain the handwriting synthesis result;

[0125] The handwriting display unit 110 is used to display the obtained handwriting synthesis result.

[0126] As an optional implementation, the writing display device further includes:

[0127] A display synchronization unit, configured to send a synchronization trigger signal to the system when receiving a writing event trigger signal, so that the system sends a system synchronization signal after receiving the synchronization trigger signal;

[0128] The writing event trigger signal is sent by the input subsystem when it senses a writing input event; and the writing application starts to execute writing handwriting drawing and rendering processing when it receives a system synchronization signal sent by the system.

[0129] As an optional implementation manner, the current synchronization signal period takes the moment when the system synchronization signal sent by the system is received as the starting moment;

[0130] The handwriting synthesis unit 100 is further used to: when receiving the system synchronization signal sent by the system, start monitoring the handwriting drawing and rendering processing of the writing application.

[0131] As an optional implementation, the writing display device further includes:

[0132] A working mode setting unit, used to start the writing display working mode when a writing event trigger signal is detected; and to exit the writing display working mode when a writing event end signal is detected;

[0133] In the writing display working mode, when the writing application completes the writing handwriting rendering process in the current synchronization signal cycle, the synthesis process of the writing handwriting rendering result of the writing application in the current synchronization signal cycle is started in the current synchronization signal cycle to obtain the writing handwriting synthesis result; and the obtained writing handwriting synthesis result is put on the display screen for display;

[0134] The writing event trigger signal is sent by the input subsystem when it senses that a writing input event has occurred, and the writing event end signal is sent by the input subsystem when it senses that a writing input event has ended.

[0135] As an optional implementation manner, the handwriting synthesis unit 100 is further used for:

[0136] When the synthesis processing of the handwriting rendering result of the writing application in the current synchronization signal cycle is completed, determining whether the completion time exceeds the end time of the current synchronization signal cycle;

[0137] If the completion time exceeds the end time of the current synchronization signal cycle, determining whether the duration of the completion time exceeding the end time of the current synchronization cycle exceeds a set duration;

[0138] If the set time period is exceeded, the synthesis processing of the handwriting rendering result of the writing application in the next synchronization signal cycle of the current synchronization signal cycle is canceled.

[0139] Specifically, for the specific working contents of each unit of the above-mentioned writing display device, please refer to the introduction of the corresponding processing steps of the above-mentioned method embodiment, which will not be repeated here.

[0140] Another embodiment of the present application also provides a writing display device, see Figure 8 As shown, the device includes:

[0141] Memory 200 and processor 210;

[0142] The memory 200 is connected to the processor 210 and is used to store programs;

[0143] The processor 210 is used to implement the writing display method disclosed in any of the above embodiments by running the program stored in the memory 200.

[0144] Specifically, the above-mentioned writing display device may further include: a bus, a communication interface 220 , an input device 230 and an output device 240 .

[0145] The processor 210, the memory 200, the communication interface 220, the input device 230 and the output device 240 are connected to each other via a bus.

[0146] A bus may include a pathway that transfers information between components of a computer system.

[0147] The processor 210 may be a general-purpose processor, such as a general-purpose central processing unit (CPU), a microprocessor, etc., or an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the scheme of the present invention. It may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0148] The processor 210 may include a main processor, and may also include a baseband chip, a modem, and the like.

[0149] The memory 200 stores a program for executing the technical solution of the present invention, and may also store an operating system and other key services. Specifically, the program may include a program code, and the program code includes a computer operation instruction. More specifically, the memory 200 may include a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM), other types of dynamic storage devices that can store information and instructions, a disk storage, a flash, and the like.

[0150] The input device 230 may include a device for receiving data and information input by a user, such as a keyboard, a mouse, a camera, a scanner, a light pen, a voice input device, a touch screen, a pedometer, or a gravity sensor.

[0151] Output device 240 may include devices that allow information to be output to a user, such as a display screen, printer, speaker, etc.

[0152] The communication interface 220 may include any transceiver or the like to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Network (WLAN), etc.

[0153] The processor 210 executes the program stored in the memory 200 and calls other devices, which can be used to implement each step of any writing display method provided in the above embodiments of the present application.

[0154] Another embodiment of the present application further provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, each step of any one of the writing display methods provided in the above embodiments of the present application is implemented.

[0155] Specifically, the specific working contents of each part of the above-mentioned writing display device, as well as the specific processing contents of the computer program on the above-mentioned storage medium when being executed by the processor, can all be found in the contents of each embodiment of the above-mentioned writing display method, and will not be repeated here.

[0156] For the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0157] It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0158] The steps in the methods of each embodiment of the present application can be adjusted in sequence, combined and deleted according to actual needs, and the technical features recorded in each embodiment can be replaced or combined.

[0159] The modules and sub-modules in the devices and terminals of the various embodiments of the present application can be combined, divided and deleted according to actual needs.

[0160] In the several embodiments provided in the present application, it should be understood that the disclosed terminals, devices and methods can be implemented in other ways. For example, the terminal embodiments described above are only schematic, for example, the division of modules or submodules is only a logical function division, and there may be other division methods in actual implementation, for example, multiple submodules or modules can be combined or integrated into another module, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.

[0161] The modules or submodules described as separate components may or may not be physically separated, and the components of the modules or submodules may or may not be physical modules or submodules, that is, they may be located in one place, or they may be distributed on multiple network modules or submodules. Some or all of the modules or submodules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0162] In addition, each functional module or submodule in each embodiment of the present application may be integrated into one processing module, or each module or submodule may exist physically separately, or two or more modules or submodules may be integrated into one module. The above-mentioned integrated modules or submodules may be implemented in the form of hardware or in the form of software functional modules or submodules.

[0163] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0164] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly by hardware, software units executed by a processor, or a combination of the two. The software units may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0165] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0166] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A writing display method, characterized in that: include: When the input subsystem senses the occurrence of a writing input event, it sends a writing event trigger signal to the display subsystem; When the display subsystem receives a writing event trigger signal, it sends a synchronization trigger signal to the bottom layer of the display device system; so that after receiving the synchronization trigger signal, the bottom layer of the display device system sends a system synchronization signal to the writing application and the display subsystem, so that the system synchronization signal triggering process is performed in the display device system without passing through the writing application; The writing application starts to execute writing handwriting drawing and rendering processing when receiving the system synchronization signal sent by the system; When the writing application completes the writing handwriting rendering process in the current synchronization signal cycle, the display subsystem starts the synthesis process of the writing handwriting rendering result of the writing application in the current synchronization signal cycle in the current synchronization signal cycle to obtain the writing handwriting synthesis result; The display subsystem displays the obtained handwriting synthesis result.

2. The method according to claim 1, characterized in that The current synchronization signal cycle takes the time when the system synchronization signal sent by the system is received as the starting time; When receiving the system synchronization signal sent by the system, the display subsystem starts to monitor the writing handwriting drawing and rendering processing of the writing application.

3. The method according to claim 1, characterized in that: The method further comprises: When a writing event trigger signal is detected, the display subsystem starts a writing display working mode; in the writing display working mode, when the writing application completes the writing handwriting rendering process in the current synchronization signal cycle, in the current synchronization signal cycle, the synthesis process of the writing handwriting rendering result of the writing application in the current synchronization signal cycle is started to obtain a writing handwriting synthesis result; and the obtained writing handwriting synthesis result is put on the display screen for display; When a writing event end signal is detected, exiting the writing display working mode; The writing event trigger signal is sent by the input subsystem when it senses that a writing input event has occurred, and the writing event end signal is sent by the input subsystem when it senses that a writing input event has ended.

4. The method according to claim 1, characterized in that Also includes: When the display subsystem completes the synthesis processing of the handwriting rendering result of the writing application within the current synchronization signal cycle, it determines whether the completion time exceeds the end time of the current synchronization signal cycle; If the completion time exceeds the end time of the current synchronization signal cycle, determining whether the duration of the completion time exceeding the end time of the current synchronization cycle exceeds a set duration; If the set time period is exceeded, the synthesis processing of the handwriting rendering result of the writing application in the next synchronization signal cycle of the current synchronization signal cycle is canceled.

5. A writing display system, characterized in that: include: The input subsystem is used to send a writing event trigger signal to the display subsystem when sensing a writing input event; The display subsystem is configured to send a synchronization trigger signal to the bottom layer of the display device system when receiving a writing event trigger signal; so that the bottom layer of the display device system sends a system synchronization signal to the writing application and the display subsystem after receiving the synchronization trigger signal, so that the system synchronization signal triggering process is performed in the display device system without passing through the writing application; A writing application is used to start executing writing handwriting drawing and rendering processing when receiving a system synchronization signal sent by the system; when the writing application completes the writing handwriting rendering processing within the current synchronization signal cycle, the display subsystem is also used to: within the current synchronization signal cycle, start the synthesis processing of the writing handwriting rendering results of the writing application within the current synchronization signal cycle to obtain the writing handwriting synthesis result; and display the obtained writing handwriting synthesis result.

6. A writing display device, characterized in that: include: A handwriting synthesis unit is used to start synthesis processing of the handwriting rendering result of the writing application in the current synchronization signal cycle after the writing application completes the handwriting rendering processing in the current synchronization signal cycle to obtain the handwriting synthesis result; A handwriting display unit, used for displaying the obtained handwriting synthesis result; The device is also used for: When a writing event trigger signal is received, a synchronization trigger signal is sent to the bottom layer of the display device system, so that the bottom layer of the display device system sends a system synchronization signal after receiving the synchronization trigger signal, so that the system synchronization signal triggering process is performed in the display device system without passing through the writing application; The writing event trigger signal is sent by the input subsystem when it senses a writing input event; and the writing application starts to execute writing handwriting drawing and rendering processing when it receives a system synchronization signal sent by the system.

7. A writing display device, characterized in that: include: Memory and processor; The memory is connected to the processor and is used to store programs; The processor is used to implement the writing display method as described in any one of claims 1 to 4 by running the program in the memory.

8. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by the processor, the writing display method according to any one of claims 1 to 4 is implemented.

Images