Writing trajectory display method, device and storage medium
By displaying the writing trajectory on the first and second display layers of the smart tablet device, and combining hardware and software synthesis technology, the problem of insufficient display delay and bandwidth of the writing trajectory is solved, improving user experience and display clarity.
Patent Information
- Application Number
- CN202111653542.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-30
- Publication Date
- 2025-04-15
- Estimated Expiration
- 2041-12-30
AI Technical Summary
Smart tablet devices have delays when displaying writing tracks, resulting in poor user experience. At the same time, the problem of insufficient bandwidth is prone to when improving hardware layer resolution to improve clarity.
By displaying the first writing trajectory and the second writing trajectory respectively in the first area and the second area of the first display layer, and displaying the third writing trajectory on the second display layer, the combination of hardware synthesis and software synthesis can realize sub-region writing and high-resolution display to avoid insufficient bandwidth.
It realizes the timely display of writing trajectories, gives users a feeling of handwriting and hand, improves user experience, and avoids the problem of insufficient bandwidth without reducing resolution.
Smart Images

Figure CN114510159B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of interactive smart tablets, and in particular to a writing trajectory display method, device and storage medium. Background Art
[0002] When each operating system (such as Windows system, Android system or Linux system) displays a window, its window management service comes from different components and system windows. Taking the Android system as an example, each window corresponds to a Surface object (Surface is essentially a memory area), and each Surface object corresponds to a Layer value (level). If the Layer value is larger, the corresponding window will be displayed on the top, blocking other windows.
[0003] Each time the rendering program in each operating system updates the display screen, it needs to superimpose all the Surface objects corresponding to all the display windows on the display screen according to the size of their own Layer to form a bitmap file of the same size as the display screen, and render this bitmap file into an idle Framebuffer (Framebuffer is a video output device that drives a video display device from a memory buffer containing complete frame data, which is specifically a driver interface), and wait for the vsync signal (vertical synchronization signal) to enable the rendering program to use the idle Framebuffer as the currently displayed Framebuffer according to the vsync signal, so that the picture is displayed on the monitor, and the rendering update of the display screen is completed.
[0004] For electronic devices with touch-sensitive display screens, such as smart tablets, when a user writes by touch on the display screen, in the process of refreshing the display screen to display the user's writing trajectory using the above method, the superposition and synthesis of the writing trajectory of the Surface object and waiting for the vsync signal require a certain amount of time, so the writing trajectory display on the display screen will be delayed. As a result, the writing trajectory on the screen will not follow the user's writing and will not be displayed synchronously, resulting in a poor user experience.
[0005] In view of this, the relevant technical practice is: draw the writing track directly on the Framebuffer corresponding to an idle hardware layer. However, in order to improve user experience, not only the problem of writing track display delay should be considered, but also the clarity of the writing track should be improved. In order to improve the clarity of the writing track display, the hardware layer can be set to have a higher resolution (such as 3840×2160). However, if the resolution of the hardware layer is set higher, insufficient bandwidth will occur, resulting in abnormal or lost images displayed on the screen. Summary of the invention
[0006] Multiple aspects of the present application provide a writing trajectory display method, device and storage medium, which speed up the display of the writing trajectory on the writing interface, give the user a sense of handwriting following the hand in terms of visual effect, improve the user's experience, and at the same time realize writing in different areas of the entire writing interface without the problem of insufficient bandwidth.
[0007] The present application provides a writing track display method, including:
[0008] Receive user's writing operation;
[0009] Following the writing operation, displaying a first writing track in a first area of the first display layer, the first writing track corresponding to a plurality of first touch points sequentially generated by the writing operation;
[0010] If the writing operation satisfies the area update condition, the acceleration area on the first display layer is updated to a second area, and a second writing track following the writing operation is displayed in the second area, wherein the second writing track corresponds to a plurality of second touch points generated after the plurality of first touch points; wherein the display of the first writing track and the second writing track is synthesized by hardware;
[0011] A third writing track is displayed on the second display layer, wherein the display of the third writing track is synthesized by software, and the third writing track corresponds to the plurality of first touch points and the plurality of second touch points.
[0012] The present application also provides a writing track display device, including:
[0013] A receiving module, used for receiving a user's writing operation;
[0014] A first display module, configured to follow the writing operation and display a first writing track in a first area of a first display layer, wherein the first writing track corresponds to a plurality of first touch points sequentially generated by the writing operation;
[0015] a second display module, configured to update the acceleration area on the first display layer to a second area if the writing operation satisfies an area update condition, and display a second writing track following the writing operation in the second area, wherein the second writing track corresponds to a plurality of second touch points generated after the plurality of first touch points; wherein the display of the first writing track and the second writing track is synthesized by hardware;
[0016] The third display module is used to display a third writing track on the second display layer, wherein the display of the third writing track is synthesized by software, and the third writing track corresponds to the plurality of first touch points and the plurality of second touch points.
[0017] An embodiment of the present application also provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned writing trajectory display method when executing the computer program.
[0018] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program for executing the above-mentioned writing trajectory display method.
[0019] In the embodiment of the present application, by receiving the writing operation of the user, following the writing operation, the first writing track is displayed in the first area of the first display layer. If the writing operation meets the area update condition, the acceleration area on the first display layer is updated to the second area, and the second writing track following the writing operation is displayed in the second area, wherein the first writing track corresponds to the multiple first touch points generated in sequence by the writing operation, and the second writing track corresponds to the multiple second touch points generated after the multiple first touch points. In this way, writing in different areas of the entire writing interface is realized, and there is no need to write on the entire writing interface. Even if the resolution of the hardware layer is set to a higher level, there will be no problem of insufficient bandwidth. By displaying the third writing track on the second display layer, and synthesizing the display of the first writing track and the second writing track through hardware, and synthesizing the display of the third writing track through software, the third writing track corresponds to the multiple first touch points and the multiple second touch points, and the problem of the writing track on the screen not following the user's writing and correspondingly displaying synchronously is solved. It should be understood that the display response speed of the first writing trajectory and the second writing trajectory synthesized by hardware is faster than the display response speed of the third writing trajectory synthesized by software. Therefore, through the above setting, the display of the writing trajectory on the writing interface is accelerated, giving the user a feeling of handwriting following the hand in terms of visual effect, thereby improving the user's experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0021] Figure 1 A schematic diagram of a flow chart of a writing track display method provided in an embodiment of the present application;
[0022] Figure 2 A schematic diagram of the structure of a writing track display device provided in an embodiment of the present application;
[0023] Figure 3 Schematic diagram of a computer device provided by an embodiment of the present application. Detailed implementation manners
[0024] To make the objectives, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be clearly and completely described below in conjunction with specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only a part rather than all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
[0025] Regarding the problem that the writing trajectory on the screen does not follow the user's writing and is not synchronously displayed correspondingly, and the problem that if the resolution of the hardware layer is set relatively high, insufficient bandwidth will occur. In some embodiments of the present application, by receiving the user's writing operation, following the writing operation, a first writing trajectory is displayed in a first area of the first display layer. If the writing operation meets the area update condition, the acceleration area on the first display layer is updated to a second area, and a second writing trajectory following the writing operation is displayed in the second area. Among them, the first writing trajectory corresponds to a plurality of first touch points generated successively by the writing operation, and the second writing trajectory corresponds to a plurality of second touch points generated after the plurality of first touch points. In this way, writing in sub-areas of the entire writing interface is realized. The first writing trajectory and the second writing trajectory formed during the user's writing operation have a sequential order, and there is no need to write on the entire writing interface. Even if the resolution of the hardware layer is set relatively high, the problem of insufficient bandwidth will not occur (for example, originally writing the character "Zhang" directly on the entire interface, in order to avoid insufficient bandwidth, the resolution needs to be reduced. However, in the present application, it can be understood as writing "bow" first and then "long". In this way, when writing "bow" and "long", even without reducing the resolution, the problem of insufficient bandwidth will not occur). By displaying a third writing trajectory on the second display layer and synthesizing the display of the first writing trajectory and the second writing trajectory through hardware and the display of the third writing trajectory through software, the problem that the writing trajectory on the screen does not follow the user's writing and is not synchronously displayed correspondingly is solved. It should be understood that the display response speed of the first writing trajectory and the second writing trajectory synthesized through hardware is faster than the display response speed of the third writing trajectory synthesized through software. Therefore, through the above settings, the display of the writing trajectory on the writing interface is accelerated, giving the user a feeling that the handwriting follows the hand in the visual effect and improving the user experience.
[0026] The writing trajectory display method provided in the embodiment of the present application can be executed by a terminal device, which can be implemented by software and / or hardware. The terminal device can be composed of two or more physical entities, or it can be composed of one physical entity. The terminal device can be a computer, a mobile phone, a tablet, a projector or an interactive smart tablet, etc. In the embodiment, an interactive smart tablet is used as an example for description, wherein the interactive smart tablet can be an integrated device that controls the content displayed on the display tablet and realizes human-computer interaction through touch technology, which integrates one or more functions such as a projector, an electronic whiteboard, a screen, a stereo, a television, and a video conferencing terminal.
[0027] In an embodiment, the interactive smart tablet display screen is a touch screen, which includes a capacitive screen, an electromagnetic screen, or an infrared screen. The touch screen can receive touch operations input by a user through a finger or an input device. Among them, the input device includes but is not limited to: a capacitive pen, an electromagnetic pen and / or an infrared pen. In addition, the smart interactive tablet can establish a data connection with at least one external device. Among them, the external device includes but is not limited to: a stylus, a mouse. The communication method of the data connection between the external device and the smart interactive tablet is not limited in the embodiment, and can be connected through USB, the Internet, a local area network, Bluetooth, Wi-Fi or ZigBee protocol and other communication methods.
[0028] In an embodiment, the main controller of the interactive smart tablet runs the Android system. In addition, the computing module connected to the main controller can also run a PC system, such as a Windows system, that is, the user interface displayed by the interactive smart tablet can be either an Android system user interface or a Windows system user interface. The user can switch the interface display as needed.
[0029] Optionally, the interactive smart tablet is installed with writing application software such as electronic whiteboard software and annotation software. The writing application software can be pre-installed in the above-mentioned interactive smart tablet, or it can be downloaded and installed from a third-party device or server after the interactive smart tablet is started. Among them, the third-party device is not limited in the embodiment. The user can perform writing operations through the writing software installed on the smart interactive tablet. The following is an example of the writing track display process of the Android system. Of course, the operation process of the writing track display method on other operating systems such as window system, Linux system, etc. is similar to the operation process on the Android system, which will not be repeated here.
[0030] Figure 1 A flowchart of a writing track display method provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the method includes:
[0031] Step 101: Receive the writing operation of the user.
[0032] In this embodiment, when it is detected that the user performs a writing operation on the writing interface of the writing software of the intelligent interaction tablet, the intelligent interaction tablet can obtain the writing operation on the current writing interface, and this writing operation is a screen touch event within the range of the current writing interface. For this screen touch event, for example, it can be a piece of text written by the user, or a graphic drawn by the user, etc.
[0033] Step 102: Follow the writing operation and display a first writing trajectory in a first area of the first display layer. The first writing trajectory corresponds to a plurality of first touch points generated successively by the writing operation.
[0034] It should be understood that the first writing trajectory is formed according to a plurality of first touch points generated successively when the user performs a writing operation on the screen. After obtaining the current writing operation of the user, following this writing operation, the first area of the first display layer will display this first writing trajectory.
[0035] Step 103: If the writing operation meets the area update condition, update the acceleration area on the first display layer to a second area, and display a second writing trajectory following the writing operation in the second area. The second writing trajectory corresponds to a plurality of second touch points generated after a plurality of first touch points; wherein, the display of the first writing trajectory and the second writing trajectory is through hardware synthesis.
[0036] Among them, the area update condition includes: the first writing trajectory reaches the boundary of the first area, or the change value of the writing speed corresponding to the writing operation reaches a set threshold.
[0037] Specifically, for example, when the user is currently writing the character "bow" and finds that it reaches the boundary of the first area halfway through, at this time, the acceleration area on the first display layer will be updated to the second area, and then a second writing trajectory following the writing operation will be displayed in the second area of the first display layer, that is, the remaining half of the character "bow". Similarly, when the user is currently writing the character "bow" and finds that the change value of the user's writing speed reaches the set threshold during the writing process, the acceleration area on the first display layer will be updated to the second area, and then a second writing trajectory following the writing operation will be displayed in the second area of the first display layer, that is, the remaining half of the character "bow".
[0038] The "first area" and "second area" involved in the embodiments of the present application are only one implementation manner. Specifically, how many "areas" the first display layer needs to update is determined according to the actual situation. Specifically, when the area update condition of the acceleration area is not met, the area update stops.
[0039] It should be understood that the display of the first writing trajectory and the second writing trajectory is synthesized by hardware, that is, the first display layer represents a hardware layer. Since the above character "弓" is written separately in the first area and the updated second area of the first display layer, the data volume of the hardware layer during a single writing is reduced, and the problem of insufficient bandwidth caused by improving the resolution of the hardware layer is solved.
[0040] In the embodiment of the present application, in order to allocate appropriate memory space for each writing trajectory, before the writing trajectory is displayed in the acceleration area of the first display layer, memory space matching the size of the acceleration area can be allocated. Specifically, before the first writing trajectory is displayed in the first area of the first display layer, the first memory space matching the size of the first area can be allocated; before the second writing trajectory following the writing operation is displayed in the second area, the second memory space matching the size of the second area can be allocated.
[0041] Among them, the sizes of the first area and the second area can be determined according to the following method:
[0042] According to the display delay characteristics corresponding to the writing software, the size of the acceleration area is determined in the first display layer. The acceleration area includes the first area and the second area, and the writing operation is triggered during the use of the writing software.
[0043] Specifically, for example, when a writing operation is performed in the first writing software and the writing whiteboard in this first writing software has a high delay, then more parts need to be accelerated, and the acceleration area needs to be set larger (for example, when writing a "一", maybe at the beginning of the software layer of the first writing software, the hardware layer has already finished writing, then the accelerated part at this time is the entire "一", so the area that needs to be accelerated is large). On the contrary, when a writing operation is performed in the second writing software and the writing whiteboard in the second writing software is very sensitive and has a low delay, then fewer parts need to be accelerated. At this time, the acceleration area can be set relatively smaller.
[0044] For the positions of the first area and the second area, the embodiment of the present application obtains them through the following method:
[0045] According to the starting position of the writing operation, determine the position of the first area in the first display layer;
[0046] According to the end position of the first writing trajectory when the area update condition is met, determine the position of the second area in the first display layer.
[0047] In specific implementation, for example, assume that the starting position of the writing operation is at the center of the writing screen, then the position of the first region in the first display layer is determined to be the center of the writing screen. Assume that when writing follows the writing operation to the right half of the writing screen and the region update condition is satisfied, then the end position of the first writing trajectory is regarded as the position of the second region in the first display layer.
[0048] In the embodiment of the present application, to facilitate the user's writing operation, the first display layer can be initialized to a transparent color.
[0049] It should be noted that after the user draws a writing trajectory in the acceleration region of the first display layer, the first display layer can be composited with other hardware layers (such as a hardware mouse layer, etc.), and then wait for the vertical synchronization signal. After the vertical synchronization signal arrives, the writing trajectory is sent to the display screen for display. Based on this, in order to be able to smoothly display the first writing trajectory in the first region and the second writing trajectory in the second region. In the embodiment of the present application, displaying the first writing trajectory in the first region of the first display layer includes:
[0050] In response to the vertical synchronization signal, read the first writing trajectory drawn in the first memory space matching the first region to display the first writing trajectory in the first region of the first display layer.
[0051] Displaying the second writing trajectory following the writing operation in the second region includes:
[0052] In response to the vertical synchronization signal, read the second writing trajectory drawn in the second memory space matching the second region to display the second writing trajectory in the second region of the first display layer.
[0053] Step 104, display a third writing trajectory in the second display layer, where the display of the third writing trajectory is synthesized by software, and the third writing trajectory corresponds to a plurality of first touch points and a plurality of second touch points.
[0054] In specific implementation, after obtaining the user's current writing operation, the second display layer will display the third writing trajectory formed according to this writing operation. Among them, the third writing trajectory corresponds to a plurality of first touch points and a plurality of second touch points. For example, if the third writing trajectory is the character "Zhang", then at this time, a plurality of first touch points can form the character "Bow", and a plurality of second touch points can form the character "Long". It should be understood that the display of the third writing trajectory is synthesized by software, which means that the second display layer is a software layer.
[0055] Specifically, the display of the content on the first display layer does not require software synthesis, and the first writing track and the second writing track are written into the device file corresponding to the first display layer to display the first writing track and the second writing track. The display of the content on the second display layer requires software synthesis, so the third writing track is written into the device file corresponding to the second display layer to display the third writing track. Since the display of the content on the first display layer does not require software synthesis, the display speed of its writing track is faster than that of the second display layer.
[0056] The following is a brief explanation of this by taking the first display layer as the mouse cursor hardware display layer and the second display layer as the normal view layer as an example:
[0057] Assume that the current writing interface includes a mouse cursor hardware display layer, a media layer and at least one normal view layer. The display of the content on the normal view layer requires software synthesis, that is, the Suface objects corresponding to the multiple display windows located in the normal view layer superimpose their respective bitmap files into a bitmap file according to the size and position of their own Layer, and perform synthesis in a way that occupies the CPU, and then render this bitmap file and write it to the idle Framebuffer. The display of the content on the mouse cursor hardware display layer and the media layer does not require software synthesis. The display of the content on the mouse cursor hardware display layer and the media layer is synthesized and displayed through hardware synthesis (hardware composition abstraction layer, HWComposer), which is driven by one or more dedicated synthesis chips and the HWComposerHAL layer corresponds to its device file. The GPU synthesizes the content displayed on the Framebuffer, and then when refreshing the current writing interface, the Framebuffer synthesized by the software display layer and the Framebuffers on different hardware levels are superimposed and fused on the display through hardware synthesis, completing the superposition display of all levels on the display screen. That is, the display processing of the content on the ordinary view layer requires a soft layer synthesized by the GPU, and the result is submitted to HWComposer for display, while the display content on the mouse cursor hardware display layer and the media layer is processed by HWComposer itself for display. Then, the synthesis of the display content of the mouse cursor hardware display layer and the media layer will not affect the synthesis of the ordinary view layer, and because the priority of the mouse cursor hardware display layer is higher than that of the ordinary view layer, the response speed of the mouse cursor hardware display layer is faster than that of the ordinary view layer.
[0058] A specific embodiment is provided below to illustrate the technical solution of the present application:
[0059] S1. Determine the size of the first area of the first display layer according to a display delay characteristic corresponding to the current writing software.
[0060] S2. Allocate a first memory space that matches the size of the area.
[0061] S3. Initialize the first memory space to a transparent color, that is, initialize the first display layer to a transparent color.
[0062] S4. Determine the position of the first area in the first display layer according to the starting position of the user's writing operation.
[0063] S5. Based on the size and position of the first area of the first display layer, following the writing operation, display a first writing track in the first area of the first display layer.
[0064] S6. If the writing operation satisfies the region update condition, the acceleration region on the first display layer is updated to the second region, and the size and position of the second region are determined based on the above method.
[0065] S7. Displaying a second writing trajectory following the writing operation in the second area.
[0066] S8. Display the third writing track on the second display layer according to the writing operation, and synthesize the first display layer with other hardware layers, and send the track to the display screen for display after the vertical synchronization signal arrives.
[0067] In summary, the present application does not use the entire hardware layer as the writing layer, but uses the local area of the hardware layer containing the writing track as the writing layer, which reduces the data volume of the hardware layer and solves the problem of insufficient bandwidth when improving the resolution of the writing track. In addition, the present application does not limit the size of the local area, as long as it can display the writing track segment, and the size of the local area can be dynamically adjusted according to time and spatial position. In addition, the present application also solves the problem of high writing delay. By using the hardware layer as the writing layer, it avoids the problems of other windows being unable to refresh and screen tearing caused by using the Framebuffer synthesized by the software layer as the writing layer, and also ensures that the mouse can be used normally.
[0068] Based on the same inventive concept, a writing trajectory display device is also provided in the embodiments of the present application, such as the following embodiments. Since the principle of solving the problem by the writing trajectory display device is similar to that of the writing trajectory display method, the implementation of the writing trajectory display device can refer to the implementation of the writing trajectory display method, and the repeated parts will not be repeated. As used below, the term "unit" or "module" can be a combination of software and / or hardware that implements the predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived.
[0069] Figure 2 A schematic diagram of the structure of a writing track display device provided in an embodiment of the present application is shown in FIG. Figure 2As shown, the device comprises:
[0070] A receiving module, used for receiving a user's writing operation;
[0071] The first display module 201 is used to follow the writing operation and display a first writing track in a first area of the first display layer, where the first writing track corresponds to a plurality of first touch points sequentially generated by the writing operation.
[0072] The second display module 202 is used to update the acceleration area on the first display layer to the second area if the writing operation meets the area update condition, and display a second writing trajectory following the writing operation in the second area, and the second writing trajectory corresponds to multiple second touch points generated after the multiple first touch points; wherein the display of the first writing trajectory and the second writing trajectory is synthesized through hardware.
[0073] The third display module 203 is used to display a third writing track on the second display layer, wherein the display of the third writing track is synthesized by software, and the third writing track corresponds to a plurality of first touch points and a plurality of second touch points.
[0074] In the embodiment of the present application, the device further includes:
[0075] The first determination module is used to determine the size of the acceleration area in the first display layer according to the display delay characteristics corresponding to the writing software, the acceleration area includes the first area and the second area, and the writing operation is triggered during the use of the writing software.
[0076] In the embodiment of the present application, the device further includes:
[0077] A second determining module, configured to determine a position of the first area in the first display layer according to a starting position of the writing operation;
[0078] The third determination module is used to determine the position of the second area in the first display layer according to the end position of the first writing track when the area update condition is met.
[0079] In an embodiment of the present application, the area update condition includes: the first writing trajectory reaches the boundary of the first area, or the writing speed change value corresponding to the writing operation reaches a set threshold.
[0080] In the embodiment of the present application, the device further includes:
[0081] The allocation module is used to allocate memory space matching the size of the acceleration area.
[0082] In the embodiment of the present application, the first display module 201 is further used for:
[0083] In response to a vertical synchronization signal, reading a first writing track drawn in a first memory space matching the first area, so as to display the first writing track in a first area of the first display layer;
[0084] The second display module 202 is further used for:
[0085] In response to the vertical synchronization signal, a second writing track drawn in a second memory space matching the second area is read to display the second writing track in the second area of the first display layer.
[0086] In the embodiment of the present application, the first display layer is initialized as a transparent layer.
[0087] In order to achieve the above object, according to another aspect of the present application, a computer device is also provided. Figure 3 As shown, the computer device includes a memory, a processor, a communication interface and a communication bus. A computer program that can be executed on the processor is stored in the memory. When the processor executes the computer program, the steps in the above-mentioned embodiment method are implemented.
[0088] The processor may be a central processing unit (CPU). The processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or a combination of the above chips.
[0089] The memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transitory computer executable programs and units, such as the corresponding program units in the above method embodiments of the present application. The processor executes various functional applications of the processor and works data processing by running the non-transitory software programs, instructions and modules stored in the memory, that is, implementing the method in the above method embodiments.
[0090] The memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the processor, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0091] The one or more units are stored in the memory, and when executed by the processor, the method in the above embodiment is performed.
[0092] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program for executing the above method.
[0093] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.
[0094] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a microcontroller unit of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the microcontroller unit of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0095] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1A function specified in one or more boxes.
[0096] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0097] In a typical configuration, a computing device includes one or more microcontroller units (CPUs), input / output interfaces, network interfaces, and memory.
[0098] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0099] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.
[0100] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.
[0101] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims
1. A writing trajectory display method, characterized in that: include: Receive user's writing operation; Following the writing operation, displaying a first writing track in a first area of the first display layer, the first writing track corresponding to a plurality of first touch points sequentially generated by the writing operation; If the writing operation satisfies the area update condition, the acceleration area on the first display layer is updated to a second area, and a second writing track following the writing operation is displayed in the second area, wherein the second writing track corresponds to a plurality of second touch points generated after the plurality of first touch points; wherein the display of the first writing track and the second writing track is synthesized by hardware; Displaying a third writing track on the second display layer, wherein the display of the third writing track is synthesized by software, and the third writing track corresponds to the plurality of first touch points and the plurality of second touch points; Wherein, before displaying the first writing track in the first area of the first display layer, the method further includes: According to the display delay characteristics corresponding to the writing software, the size of the acceleration area is determined in the first display layer, the acceleration area includes the first area and the second area, and the writing operation is triggered during the use of the writing software.
2. The method according to claim 1, characterized in that The method further comprises: Determining a position of the first area in the first display layer according to a starting position of the writing operation; The position of the second area in the first display layer is determined according to the end position of the first writing track when the area update condition is met.
3. The method according to claim 1, characterized in that The area update condition includes: the first writing track reaches the boundary of the first area, or the writing speed change value corresponding to the writing operation reaches a set threshold.
4. The method according to claim 1, characterized in that: The method further comprises: Allocate memory space that matches the size of the acceleration area.
5. The method according to claim 4, characterized in that The displaying a first writing track in a first area of the first display layer includes: In response to a vertical synchronization signal, reading the first writing track drawn in a first memory space matching the first area, so as to display the first writing track in the first area of the first display layer; The displaying in the second area a second writing track following the writing operation includes: In response to a vertical synchronization signal, the second writing track drawn in a second memory space matching the second area is read to display the second writing track in the second area of the first display layer.
6. The method according to any one of claims 1 to 5, characterized in that: The first display layer is initialized as a transparent layer.
7. A writing track display device, characterized in that: include: A receiving module, used for receiving a user's writing operation; A first display module, configured to follow the writing operation and display a first writing track in a first area of a first display layer, wherein the first writing track corresponds to a plurality of first touch points sequentially generated by the writing operation; a second display module, configured to update the acceleration area on the first display layer to a second area if the writing operation satisfies an area update condition, and display a second writing track following the writing operation in the second area, wherein the second writing track corresponds to a plurality of second touch points generated after the plurality of first touch points; wherein the display of the first writing track and the second writing track is synthesized by hardware; a third display module, configured to display a third writing track on the second display layer, wherein the display of the third writing track is synthesized by software, and the third writing track corresponds to the plurality of first touch points and the plurality of second touch points; The first determination module is used to determine the size of the acceleration area in the first display layer according to the display delay characteristics corresponding to the writing software, the acceleration area includes the first area and the second area, and the writing operation is triggered during the use of the writing software.
8. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the writing trajectory display method according to any one of claims 1 to 6 is implemented.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program for executing the writing trajectory display method according to any one of claims 1 to 6.
Citation Information
Patent Citations
Dual system-based handwriting display method and system, storage medium and device
CN107422974A
Intelligent interactive system, writing trajectory display method, device, plate and medium
CN109032494A