Writing trajectory rendering method, device, writing screen device and storage medium

Abstract

The embodiment of the present application provides a writing trajectory rendering method, device, writing screen device and storage medium. In the embodiment of the present application, in response to a writing start operation on a book touch screen, the screen refresh service program is controlled to suspend the refresh operation of at least two graphics card caches, and the first graphics card cache to which the first screen data currently displayed on the touch screen is written is determined; in response to a writing sliding operation on the touch screen, the first screen data in the first graphics card cache is dynamically updated using the various track point information generated during the writing sliding operation, so as to display the updated first screen data on the touch screen; in response to a writing end operation on the touch screen, the screen refresh service program is started and controlled to generate the second screen data according to the first screen data and the complete writing trajectory information generated by the writing sliding operation and write it into the first graphics card cache, so as to display the second screen data on the touch screen. Thus, the writing delay time is reduced.

Description

Technical Field

[0001] The present application relates to the field of writing screen technology, and in particular to a writing trajectory rendering method, device, writing screen equipment and storage medium. Background Art

[0002] A writing screen device is a device with a touch screen that can support users to write on the touch screen and display the writing track. At present, the process of rendering the writing track on the touch screen by the writing screen device is: when the user slides on the touch screen, the touch point information generated by the sliding operation is obtained, and the touch point information generated by the sliding operation is rendered into the image data of the writing track by using the SurfaceFlinger screen refresh service program, and the image data of the writing track is written to the graphics card cache by using the screen refresh service program. The graphics card module obtains the image data of the writing track from the graphics card cache and displays it on the touch screen. Among them, the SurfaceFlinger screen refresh service program is a system service in the Android system, which provides image synthesis and refresh functions.

[0003] However, the image rendering process of the above writing trajectory takes a long time, resulting in a long writing delay and a poor writing experience. Summary of the invention

[0004] Multiple aspects of the present application provide a writing trajectory rendering method, apparatus, writing screen device and storage medium to reduce the time-consuming image rendering process of the writing trajectory, shorten the writing delay and improve the writing experience.

[0005] The embodiment of the present application provides a writing trajectory rendering method, which is applied to a writing screen device. The writing screen device includes a touch screen, a graphics card module and at least two graphics card caches. The graphics card module is respectively connected to the touch screen and the at least two graphics card caches in communication. The method includes: in response to a writing start operation on the touch screen of the writing screen device, controlling a screen refresh service program of the writing screen device to suspend the refresh operation on the at least two graphics card caches, and determining the first graphics card cache to which the first screen data currently displayed on the touch screen is written; in response to a writing sliding operation on the touch screen, dynamically updating the first screen data in the first graphics card cache using each track point information generated during the writing sliding operation to obtain the updated first screen data, so that the graphics card module reads the updated first screen data from the first graphics card cache and displays it on the touch screen; in response to a writing end operation on the touch screen, starting the screen refresh service program, and controlling the screen refresh service program to generate second screen data according to the first screen data and the complete writing trajectory information generated by the writing sliding operation and write it into the first graphics card cache, so that the graphics card module reads the second screen data from the first graphics card cache and displays it on the touch screen, wherein the complete writing trajectory information includes each track point information.

[0006] Further optionally, the first screen data in the first graphics card cache is dynamically updated using the track point information generated during the writing sliding operation to obtain updated first screen data, including: obtaining the track point information generated during the writing sliding operation, each track point information at least including the screen coordinates of the corresponding track point on the touch screen; for each time the track point information is obtained, updating the first screen data in the first graphics card cache according to the screen coordinates in the obtained track point information to obtain updated first screen data.

[0007] Further optionally, the first screen data in the first graphics card cache is updated according to the screen coordinates in the acquired trajectory point information to obtain the updated first screen data, including: generating image data of the local writing trajectory according to the screen coordinates in the acquired trajectory point information, and drawing the image data of the local writing trajectory as a new layer onto the first screen data in the first graphics card cache to obtain the updated first screen data; or, updating the pixel values ​​of the pixel points corresponding to the screen coordinates in the first screen data in the graphics card cache according to the screen coordinates in the acquired trajectory point information to obtain the updated first screen data.

[0008] Further optionally, if the first screen data includes at least screen menu data, the screen refresh service program is controlled to generate second screen data according to the first screen data and the complete writing trajectory information, including: generating image data of the complete writing trajectory according to the screen coordinates in the track point information contained in the complete writing trajectory information; controlling the screen refresh service program to synthesize the image data of the complete writing trajectory as a new layer onto the layer where the screen menu data is located; judging whether the image data of the complete writing trajectory and the screen menu data overlap in screen coordinates according to the screen coordinates corresponding to the track point information and the screen coordinates corresponding to the screen menu data; if so, moving the layer where the screen menu data is located above the layer where the image data of the complete writing trajectory is located to obtain the second screen data.

[0009] Further optionally, the above method also includes: in response to a writing start operation, writing the first screen data into a first temporary cache, and after generating each track point information, storing each track point information into a second temporary cache; generating image data of the complete writing track according to the screen coordinates of each track point information contained in the complete writing track information, including: obtaining each track point information contained in the complete writing track information from the second temporary cache, and generating image data of the complete writing track according to the screen coordinates of each track point information contained in the complete writing track information; controlling the screen refresh service program to synthesize the image data of the complete writing track as a new layer onto the layer where the screen menu data is located, including: controlling the screen refresh service program to read the screen menu data contained in the first screen data from the first temporary cache, and synthesizing the image data of the complete writing track as a new layer onto the layer where the screen menu data is located.

[0010] The embodiment of the present application also provides a writing trajectory rendering device, including: a control module, which is used to respond to a writing start operation on a touch screen of a writing screen device, control a screen refresh service program of the writing screen device to suspend the refresh operation of at least two graphics card caches, and determine the first graphics card cache to which the first screen data currently displayed on the touch screen is written; a processing module, which is used to respond to a writing sliding operation on the touch screen, dynamically update the first screen data in the first graphics card cache using each track point information generated during the writing sliding operation, and obtain the updated first screen data, so that the graphics card module can read the updated first screen data from the first graphics card cache and display it on the touch screen; the control module is also used to respond to a writing end operation on the touch screen, start the screen refresh service program, and control the screen refresh service program to generate second screen data according to the first screen data and the complete writing trajectory information generated by the writing sliding operation and write it into the first graphics card cache, so that the graphics card module can read the second screen data from the first graphics card cache and display it on the touch screen, and the complete writing trajectory information includes each track point information.

[0011] Further optionally, the processing module is used to dynamically update the first screen data in the first graphics card cache using the various track point information generated during the writing and sliding operation, and when the updated first screen data is obtained, it is specifically used to: obtain the various track point information generated during the writing and sliding operation, each track point information at least including the screen coordinates of the corresponding track point on the touch screen; for each time the track point information is obtained, update the first screen data in the first graphics card cache according to the screen coordinates in the obtained track point information, to obtain the updated first screen data.

[0012] Further optionally, the processing module is used to update the first screen data in the first graphics card cache according to the screen coordinates in the acquired trajectory point information, and when the updated first screen data is obtained, it is specifically used to: generate image data of the local writing trajectory according to the screen coordinates in the acquired trajectory point information, and draw the image data of the local writing trajectory as a new layer onto the first screen data in the first graphics card cache to obtain the updated first screen data; or, update the pixel value of the pixel point corresponding to the screen coordinates in the first screen data in the graphics card cache according to the screen coordinates in the acquired trajectory point information to obtain the updated first screen data.

[0013] Further optionally, if the first screen data includes at least screen menu data, the control module is used to control the screen refresh service program to generate the second screen data according to the first screen data and the complete writing trajectory information, and is specifically used to: generate image data of the complete writing trajectory according to the screen coordinates in the track point information contained in the complete writing trajectory information; control the screen refresh service program to synthesize the image data of the complete writing trajectory as a new layer onto the layer where the screen menu data is located; determine whether the image data of the complete writing trajectory and the screen menu data overlap in screen coordinates according to the screen coordinates corresponding to the track point information and the screen coordinates corresponding to the screen menu data; if so, move the layer where the screen menu data is located above the layer where the image data of the complete writing trajectory is located to obtain the second screen data.

[0014] Further optionally, the control module is also used to: respond to a writing start operation, write the first screen data into a first temporary cache, and after generating each track point information, store each track point information into a second temporary cache; the control module is used to generate image data of the complete writing track according to the screen coordinates in the each track point information contained in the complete writing track information, specifically for: obtaining each track point information contained in the complete writing track information from the second temporary cache, and generating image data of the complete writing track according to the screen coordinates in the each track point information contained in the complete writing track information; the control module is used to control the screen refresh service program to synthesize the image data of the complete writing track as a new layer onto the layer where the screen menu data is located, specifically for: controlling the screen refresh service program to read the screen menu data contained in the first screen data from the first temporary cache, and synthesize the image data of the complete writing track as a new layer onto the layer where the screen menu data is located.

[0015] An embodiment of the present application also provides a writing screen device, including: a memory and a processor; the memory is used to store a computer program; the processor is coupled to the memory, and is used to execute the computer program to execute the writing trajectory rendering method.

[0016] An embodiment of the present application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the processor implements a writing trajectory rendering method.

[0017] In the embodiment of the present application, in response to the writing start operation on the book touch screen, the screen refresh service program is controlled to suspend the refresh operation of at least two graphics card caches, and the first graphics card cache to which the first screen data currently displayed on the touch screen is written is determined; in response to the writing sliding operation on the touch screen, the first screen data in the first graphics card cache is dynamically updated using the information of each track point generated during the writing sliding operation, so as to display the updated first screen data on the touch screen; in response to the writing end operation on the touch screen, the screen refresh service program is started, and the screen refresh service program is controlled to generate the second screen data according to the first screen data and the complete writing track information generated by the writing sliding operation and write it into the first graphics card cache, so as to display the second screen data on the touch screen. Thus, the time consumption of the image rendering process of the writing track is greatly reduced, the writing delay time is reduced, and the writing experience is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0019] Figure 1 A flowchart of a writing trajectory rendering method provided by an exemplary embodiment of the present application;

[0020] Figure 2 A schematic diagram of an application scenario provided for an exemplary embodiment of the present application;

[0021] Figure 3 A schematic structural diagram of a writing screen device provided by an exemplary embodiment of the present application;

[0022] Figure 4 A schematic diagram of the structure of a writing trajectory rendering device provided by an exemplary embodiment of the present application;

[0023] Figure 5 A schematic structural diagram of another writing screen device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0025] In view of the technical problems that the existing image rendering process of writing tracks is time-consuming, resulting in long writing delays and poor writing experience, the embodiments of the present application provide a writing track rendering method, device, writing screen device and storage medium. In the embodiments of the present application, in response to the writing start operation on the book touch screen, the screen refresh service program is controlled to suspend the refresh operation of at least two graphics card caches, and the first graphics card cache to which the first screen data currently displayed on the touch screen is written is determined; in response to the writing sliding operation on the touch screen, the first screen data in the first graphics card cache is dynamically updated using the information of each track point generated during the writing sliding operation, so as to display the updated first screen data on the touch screen; in response to the writing end operation on the touch screen, the screen refresh service program is started, and the screen refresh service program is controlled to generate the second screen data according to the first screen data and the complete writing track information generated by the writing sliding operation and write it into the first graphics card cache, so as to display the second screen data on the touch screen. As a result, the time consumption of the image rendering process of the writing track is greatly reduced, the writing delay time is reduced, and the writing experience is improved.

[0026] The technical solutions provided by various embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0027] Figure 1 A flowchart of a writing trajectory rendering method provided for an exemplary embodiment of the present application. The method is executed by a writing trajectory rendering device, which may be composed of software and / or hardware and may generally be configured in a writing screen device. The writing screen device includes at least a touch screen, a graphics card module, and at least two graphics card caches, and the graphics card module is respectively connected to the touch screen and the at least two graphics card caches.

[0028] like Figure 1 As shown, the method may include the following steps:

[0029] 101. In response to a writing start operation on a touch screen of a writing screen device, control a screen refresh service program of the writing screen device to suspend refresh operations on at least two graphics card caches, and determine a first graphics card cache to which first screen data currently displayed on the touch screen is written.

[0030] 102. In response to a writing and sliding operation on the touch screen, the first screen data in the first graphics card cache is dynamically updated using information of each track point generated during the writing and sliding operation to obtain updated first screen data, so that the graphics card module can read the updated first screen data from the first graphics card cache and display it on the touch screen.

[0031] 103. In response to the writing end operation on the touch screen, start the screen refresh service program, and control the screen refresh service program to generate second screen data according to the first screen data and the complete writing trajectory information generated by the writing sliding operation and write it into the first graphics card cache, so that the graphics card module can read the second screen data from the first graphics card cache and display it on the touch screen, and the complete writing trajectory information includes information of each trajectory point.

[0032] In an embodiment of the present application, a user can perform touch operations on the touch screen through a stylus or a hand. Touch operations may include, but are not limited to: click operations, double sliding operations. Exemplarily, when the touch operation is a click operation, the touch trajectory may be a point; when the touch operation is a sliding operation, the shape of the touch trajectory may be a straight line and / or a curve. When a user performs a touch operation on the touch screen, the touch screen will receive a sensing signal such as an infrared signal or current information that reflects the position information of the touch point, and convert the sensing signal into a digital touch signal. The writing trajectory rendering device monitors in real time whether the touch screen generates a touch signal. If so, it determines that the user inputs a touch operation on the touch screen.

[0033] After confirming that the user is currently inputting a touch operation on the touch screen and that the user has not inputted a touch operation on the touch screen within a specified time period before the current moment, the writing trajectory rendering device confirms that the user has inputted a writing start operation on the touch screen. The specified time period is set according to actual application requirements, for example, 0.01 seconds.

[0034] After the writing trajectory rendering device confirms that the user has input a writing start operation on the touch screen, the writing trajectory rendering device responds to the writing start operation on the touch screen of the writing screen device, controls the screen refresh service program to suspend the refresh operation on at least two graphics card buffers, and determines the first graphics card buffer to which the first screen data currently displayed on the touch screen is written. Among them, the graphics card buffer may refer to a frame buffer (Frame Buffer, FB). The first graphics card buffer refers to the graphics card buffer of at least two graphics card buffers to which the screen data currently displayed on the touch screen has been written. It should be understood that after controlling the screen refresh service program to suspend the refresh operation on at least two graphics card buffers, the screen refresh service program no longer undertakes the image data rendering task, and no longer refreshes the image data in the graphics card buffer.

[0035] After determining that the first graphics card cache has written the first screen data currently displayed on the touch screen, the writing trajectory rendering device responds to the writing sliding operation on the touch screen, and dynamically updates the first screen data in the first graphics card cache using the trajectory point information generated during the writing sliding operation to obtain the updated first screen data.

[0036] This embodiment does not limit the dynamic update method. For example, the track point information generated within the specified time period can be obtained after a certain specified time period, and the track point information generated within the specified time period can be used to update the first screen data in the graphics card cache. Further optionally, in order to greatly reduce the writing delay, the writing track rendering device responds to the writing sliding operation on the touch screen, and uses the track point information generated during the writing sliding operation to dynamically update the first screen data in the first graphics card cache. An implementation process for obtaining the updated first screen data is: obtaining the track point information generated during the writing sliding operation, each track point information at least includes the screen coordinates of the corresponding track point on the touch screen; for each acquired track point information, the first screen data in the first graphics card cache is updated according to the screen coordinates in the acquired track point information to obtain the updated first screen data.

[0037] It is worth noting that the method of updating the first screen data in the graphics card cache each time the trajectory point information is obtained can, to a certain extent, realize real-time updating of the first screen data in the graphics card cache according to the generated trajectory point information. This dynamic update method can realize the real-time display of the changing writing trajectory on the touch screen following the user's writing and sliding operations, that is, rendering the writing trajectory while writing, which greatly reduces the writing delay.

[0038] This embodiment does not limit the method of updating the first screen data in the graphics card cache according to the screen coordinates in the acquired track point information for each acquired track point information. Several optional implementation methods are introduced below:

[0039] Method 1: Generate image data of the local writing trajectory according to the screen coordinates in the acquired trajectory point information, and draw the image data of the local writing trajectory as a new layer onto the first screen data in the first graphics card cache to obtain updated first screen data.

[0040] In method 1, when generating image data of a local writing trajectory, the local writing trajectory can be drawn according to the screen coordinates in the acquired trajectory point information, and the local writing trajectory can be colored to obtain the image data of the local writing trajectory.

[0041] Method 2: According to the screen coordinates in the acquired trajectory point information, the pixel values ​​of the pixel points corresponding to the screen coordinates in the first screen data in the graphics card cache are updated to obtain updated first screen data.

[0042] In mode 2, the pixel value of the updated pixel point can be set to any grayscale value between 0 and 255. Whenever the screen coordinates of a track point are obtained, the pixel value of the pixel point matching the track point in the first screen data is updated, and the visual effect can also show that the touch screen follows the user's writing and sliding operation to display the constantly changing writing track in real time.

[0043] In this embodiment, the image rendering task during the writing process and the image data refresh task in the graphics card cache are undertaken by the writing trajectory rendering device. After the writing trajectory is completed, it is switched back to the screen refresh service program to be responsible for the image rendering task and refresh the image data in the graphics card cache. Therefore, the writing trajectory rendering device responds to the writing end operation on the touch screen, starts the screen refresh service program, and controls the screen refresh service program to generate the second screen data according to the first screen data and the complete writing trajectory information generated by the writing sliding operation and write it into the first graphics card cache. So that the graphics card module can read the second screen data from the first graphics card cache and display it on the touch screen.

[0044] It is worth noting that the complete writing track information refers to the information of the writing track generated by the user during the entire process of performing the writing sliding operation on the touch screen. Since the complete writing track information includes the information of each track point, after the second screen data is displayed on the touch screen, the user can see the complete writing track on the touch screen.

[0045] Considering that the writing track may block the screen menu during the writing process. Various functional controls in the screen menu facilitate users to initiate different operations. After the writing is completed, if the writing track still blocks the screen menu on the touch screen, it will have an adverse effect on the normal use of the screen menu function. Therefore, further optionally, if the first screen data includes at least screen menu data, a method of controlling the screen refresh service program to generate the second screen data according to the first screen data and the complete writing track information is: according to the screen coordinates in the track point information contained in the complete writing track information, the image data of the complete writing track is generated; the screen refresh service program is controlled to synthesize the image data of the complete writing track as a new layer on the layer where the screen menu data is located; according to the screen coordinates corresponding to each track point information and the screen coordinates corresponding to the screen menu data, it is determined whether the image data of the complete writing track overlaps with the screen menu data in terms of the screen coordinates; if so, the layer where the screen menu data is located is moved above the layer where the image data of the complete writing track is located to obtain the second screen data.

[0046] Further optionally, in order to facilitate the rapid and accurate acquisition of the first screen data currently displayed on the touch screen before the start of writing and the track point information generated during the writing process after the writing is finished, the writing track rendering device can also respond to the writing start operation, write the first screen data into the first temporary cache, and after generating each track point information, store each track point information into the second temporary cache; generate image data of the complete writing track according to the screen coordinates of each track point information contained in the complete writing track information, including: obtaining each track point information contained in the complete writing track information from the second temporary cache, and generating image data of the complete writing track according to the screen coordinates of each track point information contained in the complete writing track information; controlling the screen refresh service program to synthesize the image data of the complete writing track as a new layer onto the layer where the screen menu data is located, including: controlling the screen refresh service program to read the screen menu data contained in the first screen data from the first temporary cache, and synthesizing the image data of the complete writing track as a new layer onto the layer where the screen menu data is located.

[0047] It should be noted that the first temporary buffer and the second temporary buffer may be the same frame buffer or different frame buffers.

[0048] For ease of understanding, combined Figure 2 For explanation. Before the user inputs a writing track on the touch screen of the writing screen device through a stylus, the screen image before writing displayed on the touch screen is rendered by the SurfaceFlinger screen refresh service program. When the user is in the process of writing the writing track on the touch screen, the screen image of the writing process displayed on the touch screen is rendered by the writing track rendering device provided in this embodiment. After writing is finished, the screen image before writing displayed on the touch screen is rendered by the SurfaceFlinger screen refresh service program. If the writing track covers the menu bar during the user's writing process, then after writing is finished, the SurfaceFlinger screen refresh service program moves the layer where the menu bar is located to above the layer where the writing track is located, so that the menu bar is not covered by the writing track.

[0049] The writing track rendering method provided by the embodiment of the present application responds to the writing start operation on the book touch screen, controls the screen refresh service program to suspend the refresh operation of at least two graphics card caches, and determines the first graphics card cache to which the first screen data currently displayed on the touch screen is written; responds to the writing sliding operation on the touch screen, dynamically updates the first screen data in the first graphics card cache using the information of each track point generated during the writing sliding operation, so as to display the updated first screen data on the touch screen; responds to the writing end operation on the touch screen, starts the screen refresh service program, and controls the screen refresh service program to generate the second screen data according to the first screen data and the complete writing track information generated by the writing sliding operation and writes it into the first graphics card cache, so as to display the second screen data on the touch screen. Thus, the time consumption of the image rendering process of the writing track is greatly reduced, the writing delay time is reduced, and the writing experience is improved.

[0050] For ease of understanding, a writing screen device in actual application is used as an example for explanation. Figure 3 As shown, the writing screen device includes: a hardware layer, an operating system layer and an application layer. Among them, the hardware layer at least includes: a touch screen, a graphics card module and a graphics card cache (displayed in the form of a frame cache). The operating system layer at least includes the SurfaceFlinger service program. The application layer is installed with a writing application, which integrates a writing trajectory rendering device.

[0051] like Figure 3 As shown in ① to ③, the writing trajectory rendering device responds to the writing start operation on the touch screen, notifies the SurfaceFlinger service program to stop refreshing, and determines the first graphics card cache to which the first screen data currently displayed on the touch screen is written.

[0052] like Figure 3 As shown in ④ to ⑤, the writing trajectory rendering device responds to the writing sliding operation on the touch screen, and dynamically updates the first screen data in the first graphics card cache using the various trajectory point information generated during the writing sliding operation.

[0053] like Figure 3 As shown in ⑥, when the display cycle arrives, the graphics card module reads the updated first screen data in the first graphics card cache and sends it to the touch screen for display.

[0054] like Figure 3 As shown in ⑦ and ⑧, the writing trajectory rendering device responds to the writing end operation on the touch screen and notifies the SurfaceFlinger service program to start refreshing.

[0055] like Figure 3As shown in ⑨ and ⑩, the SurfaceFlinger service program generates the second screen data according to the first screen data and the complete writing track information generated by the writing sliding operation and writes it into the first graphics card cache.

[0056] like Figure 3 In As shown, when the display cycle arrives, the graphics card module reads the second screen data in the first graphics card cache and sends it to the touch screen for display.

[0057] Figure 4 The structural diagram of a writing trajectory rendering device provided by an exemplary embodiment of the present application is shown in FIG.

[0058] The control module 41 is used to respond to a writing start operation on the touch screen of the writing screen device, control the screen refresh service program of the writing screen device to suspend the refresh operation of at least two graphics card caches, and determine the first graphics card cache to which the first screen data currently displayed on the touch screen is written;

[0059] The processing module 42 is used to respond to the writing and sliding operation on the touch screen, dynamically update the first screen data in the first graphics card cache using the information of each track point generated during the writing and sliding operation, and obtain the updated first screen data, so that the graphics card module reads the updated first screen data from the first graphics card cache and displays it on the touch screen;

[0060] The control module 41 is also used to respond to the writing end operation on the touch screen, start the screen refresh service program, and control the screen refresh service program to generate the second screen data according to the first screen data and the complete writing trajectory information generated by the writing sliding operation and write it into the first graphics card cache, so that the graphics card module can read the second screen data from the first graphics card cache and display it on the touch screen. The complete writing trajectory information includes information of each trajectory point.

[0061] Further optionally, the processing module 42 is used to dynamically update the first screen data in the first graphics card cache using the various track point information generated during the writing and sliding operation, and when the updated first screen data is obtained, it is specifically used to: obtain the various track point information generated during the writing and sliding operation, each track point information at least including the screen coordinates of the corresponding track point on the touch screen; for each time the track point information is obtained, update the first screen data in the first graphics card cache according to the screen coordinates in the obtained track point information, to obtain the updated first screen data.

[0062] Further optionally, the processing module 42 is used to update the first screen data in the first graphics card cache according to the screen coordinates in the acquired trajectory point information, and when the updated first screen data is obtained, it is specifically used to: generate image data of the local writing trajectory according to the screen coordinates in the acquired trajectory point information, and draw the image data of the local writing trajectory as a new layer onto the first screen data in the first graphics card cache to obtain the updated first screen data; or, update the pixel value of the pixel point corresponding to the screen coordinate in the first screen data in the graphics card cache according to the screen coordinates in the acquired trajectory point information to obtain the updated first screen data.

[0063] Further optionally, if the first screen data includes at least screen menu data, the control module 41 is used to control the screen refresh service program to generate the second screen data according to the first screen data and the complete writing trajectory information, and is specifically used to: generate image data of the complete writing trajectory according to the screen coordinates in the track point information contained in the complete writing trajectory information; control the screen refresh service program to synthesize the image data of the complete writing trajectory as a new layer onto the layer where the screen menu data is located; determine whether the image data of the complete writing trajectory and the screen menu data overlap in screen coordinates according to the screen coordinates corresponding to the track point information and the screen coordinates corresponding to the screen menu data; if so, move the layer where the screen menu data is located above the layer where the image data of the complete writing trajectory is located to obtain the second screen data.

[0064] Further optionally, the control module 41 is also used to: respond to a writing start operation, write the first screen data into a first temporary cache, and after generating each track point information, store each track point information into a second temporary cache; the control module 41 is used to generate image data of a complete writing track according to the screen coordinates in the each track point information contained in the complete writing track information, specifically to: obtain each track point information contained in the complete writing track information from the second temporary cache, and generate image data of the complete writing track according to the screen coordinates in the each track point information contained in the complete writing track information; the control module 41 is used to control the screen refresh service program to synthesize the image data of the complete writing track as a new layer onto the layer where the screen menu data is located, specifically to: control the screen refresh service program to read the screen menu data contained in the first screen data from the first temporary cache, and synthesize the image data of the complete writing track as a new layer onto the layer where the screen menu data is located.

[0065] about Figure 4 The specific implementation of the writing trajectory rendering device shown has been described in detail in the embodiment of the above method, and will not be elaborated here.

[0066] Figure 5 This is a schematic diagram of the structure of another writing screen device provided by an exemplary embodiment of the present application. Figure 5 The writing screen device includes: a memory 51 and a processor 52.

[0067] The memory 51 is used to store computer programs and can be configured to store various other data to support operations on the computing platform. Examples of such data include instructions for any application or method operating on the computing platform, contact data, phone book data, messages, pictures, videos, etc.

[0068] The memory 51 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0069] The processor 52 is coupled to the memory 51 and is used to execute the computer program in the memory 51, so as to: respond to a writing start operation on the touch screen of the writing screen device, control the screen refresh service program of the writing screen device to suspend the refresh operation of at least two graphics card caches, and determine the first graphics card cache to which the first screen data currently displayed on the touch screen is written; respond to a writing sliding operation on the touch screen, dynamically update the first screen data in the first graphics card cache using the information of each track point generated during the writing sliding operation, and obtain the updated first screen data, so that the graphics card module can read the updated first screen data from the first graphics card cache and display it on the touch screen; respond to a writing end operation on the touch screen, start the screen refresh service program, and control the screen refresh service program to generate the second screen data according to the first screen data and the complete writing track information generated by the writing sliding operation and write it into the first graphics card cache, so that the graphics card module can read the second screen data from the first graphics card cache and display it on the touch screen, and the complete writing track information includes the information of each track point.

[0070] Further optionally, the processor 52 is used to dynamically update the first screen data in the first graphics card cache using the various track point information generated during the writing sliding operation, and when the updated first screen data is obtained, it is specifically used to: obtain the various track point information generated during the writing sliding operation, each track point information at least including the screen coordinates of the corresponding track point on the touch screen; for each time the track point information is obtained, update the first screen data in the first graphics card cache according to the screen coordinates in the obtained track point information, to obtain the updated first screen data.

[0071] Further optionally, the processor 52 is used to update the first screen data in the first graphics card cache according to the screen coordinates in the acquired trajectory point information, and when the updated first screen data is obtained, it is specifically used to: generate image data of the local writing trajectory according to the screen coordinates in the acquired trajectory point information, and draw the image data of the local writing trajectory as a new layer onto the first screen data in the first graphics card cache to obtain the updated first screen data; or, update the pixel value of the pixel point corresponding to the screen coordinate in the first screen data in the graphics card cache according to the screen coordinates in the acquired trajectory point information to obtain the updated first screen data.

[0072] Further optionally, if the first screen data includes at least screen menu data, the processor 52 is used to control the screen refresh service program to generate the second screen data according to the first screen data and the complete writing trajectory information, and is specifically used to: generate image data of the complete writing trajectory according to the screen coordinates in the track point information contained in the complete writing trajectory information; control the screen refresh service program to synthesize the image data of the complete writing trajectory as a new layer onto the layer where the screen menu data is located; determine whether the image data of the complete writing trajectory and the screen menu data overlap in screen coordinates according to the screen coordinates corresponding to the track point information and the screen coordinates corresponding to the screen menu data; if so, move the layer where the screen menu data is located above the layer where the image data of the complete writing trajectory is located to obtain the second screen data.

[0073] Further optionally, the processor 52 is also used to: respond to a writing start operation, write the first screen data into a first temporary cache, and after generating each track point information, store each track point information into a second temporary cache; the processor 52 is used to generate image data of the complete writing track according to the screen coordinates in the each track point information contained in the complete writing track information, specifically to: obtain the each track point information contained in the complete writing track information from the second temporary cache, and generate image data of the complete writing track according to the screen coordinates in the each track point information contained in the complete writing track information; the processor 52 is used to control the screen refresh service program to synthesize the image data of the complete writing track as a new layer onto the layer where the screen menu data is located, specifically to: control the screen refresh service program to read the screen menu data contained in the first screen data from the first temporary cache, and synthesize the image data of the complete writing track as a new layer onto the layer where the screen menu data is located.

[0074] like Figure 5 As shown, the writing screen device also includes: a communication component 53, a display 55 (whose screen is a touch screen), a power component 55, an audio component 56, a graphics card module 57 and at least two graphics card caches 58 and other components. Figure 5Only some components are shown schematically, which does not mean that the writing screen device only includes Figure 5 In addition, Figure 5 The components in the dashed box are optional components, not mandatory components, and the specific components depend on the product form of the writing screen device. The writing screen device of this embodiment can be implemented as a terminal device such as a desktop computer, a laptop computer, a smart phone, or an IOT device, or a server device such as a conventional server, a cloud server, or a server array. If the writing screen device of this embodiment is implemented as a terminal device such as a desktop computer, a laptop computer, a smart phone, etc., it can include Figure 5 If the writing screen device of this embodiment is implemented as a server device such as a conventional server, a cloud server or a server array, it may not include Figure 5 Components within the dashed box.

[0075] The above-mentioned communication component is configured to facilitate wired or wireless communication between the device where the communication component is located and other devices. The device where the communication component is located can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G / LTE, 5G and other mobile communication networks, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0076] The above-mentioned display includes a screen, and the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

[0077] The power supply assembly provides power to various components of the device where the power supply assembly is located. The power supply assembly may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device where the power supply assembly is located.

[0078] The above-mentioned audio component can be configured to output and / or input audio signals. For example, the audio component includes a microphone (MIC), and when the device where the audio component is located is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in a memory or sent via a communication component. In some embodiments, the audio component also includes a speaker for outputting an audio signal.

[0079] It should be noted that the execution subject of each step of the method provided in the above embodiment can be the same device, or the method can be executed by different devices. For example, the execution subject of step 301 to step 302 can be device A; for another example, the execution subject of step 301 can be device A, and the execution subject of step 302 can be device B; and so on.

[0080] In addition, in some of the processes described in the above embodiments and the accompanying drawings, multiple operations that appear in a specific order are included, but it should be clearly understood that these operations may not be executed in the order in which they appear in this article or executed in parallel, and the sequence numbers of the operations, such as 301, 302, etc., are only used to distinguish between different operations, and the sequence numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this article are used to distinguish different messages, devices, modules, etc., do not represent the order of precedence, and do not limit the "first" and "second" to be different types.

[0081] Correspondingly, an embodiment of the present application also provides a computer-readable storage medium storing a computer program, which, when executed, can implement the various steps that can be performed by the writing screen device in the above method embodiment.

[0082] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0083] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0084] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0085] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0086] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0087] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0088] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0089] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0090] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A writing track rendering method, applied to a writing screen device, wherein the writing screen device comprises a touch screen, a graphics card module and at least two graphics card caches, wherein the graphics card module is respectively connected to the touch screen and the at least two graphics card caches in communication, characterized in that: The method is performed by a writing trajectory rendering device, and the method includes: In response to a writing start operation on the touch screen of the writing screen device, a screen refresh service program of the writing screen device is controlled to suspend the refresh operation of the at least two graphics card caches, and a first graphics card cache to which the first screen data currently displayed on the touch screen is written is determined, wherein the first graphics card cache refers to a graphics card cache of the at least two graphics card caches to which the screen data currently displayed on the touch screen has been written; In response to a writing and sliding operation on the touch screen, the first screen data in the first graphics card cache is dynamically updated using each track point information generated during the writing and sliding operation to obtain updated first screen data, so that the graphics card module reads the updated first screen data from the first graphics card cache and displays it on the touch screen; In response to a writing end operation on the touch screen, the screen refresh service program is started, and the screen refresh service program is controlled to generate second screen data according to the first screen data and the complete writing track information generated by the writing sliding operation and write the second screen data into the first graphics card cache, so that the graphics card module reads the second screen data from the first graphics card cache and displays it on the touch screen, wherein the complete writing track information includes the information of each track point; The method of dynamically updating the first screen data in the first graphics card cache using each track point information generated during the writing sliding operation to obtain the updated first screen data includes: Acquire information of each track point generated during the writing and sliding operation, where each track point information at least includes the screen coordinates of the corresponding track point on the touch screen; For each acquired track point information, the first screen data in the first graphics card cache is updated according to the screen coordinates in the acquired track point information to obtain updated first screen data.

2. The method according to claim 1, characterized in that The method of updating the first screen data in the first graphics card cache according to the screen coordinates in the acquired trajectory point information to obtain the updated first screen data includes: Generate image data of a local writing track according to the screen coordinates in the acquired track point information, and draw the image data of the local writing track as a new layer on the first screen data in the first graphics card cache to obtain updated first screen data; or According to the screen coordinates in the acquired trajectory point information, the pixel values ​​of the pixel points corresponding to the screen coordinates in the first screen data in the graphics card cache are updated to obtain the updated first screen data.

3. The method according to any one of claims 1-2, characterized in that: If the first screen data at least includes screen menu data, controlling the screen refresh service program to generate second screen data according to the first screen data and the complete writing track information includes: Generate image data of the complete writing trajectory according to the screen coordinates in the information of each trajectory point contained in the complete writing trajectory information; Controlling the screen refresh service program to synthesize the image data of the complete writing track as a new layer onto the layer where the screen menu data is located; According to the screen coordinates corresponding to each track point information and the screen coordinates corresponding to the screen menu data, determining whether the image data of the complete writing track and the screen menu data overlap in the screen coordinates; If so, the layer where the screen menu data is located is moved up to above the layer where the image data of the complete writing track is located to obtain the second screen data.

4. The method according to claim 3, characterized in that Also includes: In response to the writing start operation, the first screen data is written into a first temporary buffer, and after each track point information is generated, each track point information is stored into a second temporary buffer; Generating image data of the complete writing trajectory according to the screen coordinates of each track point information contained in the complete writing trajectory information, comprising: acquiring each track point information contained in the complete writing trajectory information from the second temporary buffer, and generating image data of the complete writing trajectory according to the screen coordinates of each track point information contained in the complete writing trajectory information; Controlling the screen refresh service program to synthesize the image data of the complete writing track as a new layer onto the layer where the screen menu data is located, including: The screen refresh service program is controlled to read the screen menu data contained in the first screen data from the first temporary buffer, and the image data of the complete writing track is synthesized as a new layer onto the layer where the screen menu data is located.

5. A writing trajectory rendering device, characterized in that: The device is configured in a writing screen device, the writing screen device includes a touch screen, a graphics card module and at least two graphics card caches, the graphics card module is respectively connected to the touch screen and the at least two graphics card caches in communication, and the device includes: a control module, configured to respond to a writing start operation on the touch screen of the writing screen device, control a screen refresh service program of the writing screen device to suspend a refresh operation on at least two graphics card caches, and determine a first graphics card cache to which first screen data currently displayed on the touch screen is written, wherein the first graphics card cache refers to a graphics card cache of the at least two graphics card caches to which the screen data currently displayed on the touch screen has been written; a processing module, configured to respond to a writing and sliding operation on the touch screen, obtain information of each track point generated during the writing and sliding operation, wherein each track point information includes at least a screen coordinate of the corresponding track point on the touch screen; for each acquired track point information, update the first screen data in the first graphics card cache according to the screen coordinates in the acquired track point information, and obtain updated first screen data, so that the graphics card module reads the updated first screen data from the first graphics card cache and displays it on the touch screen; The control module is also used to respond to the writing end operation on the touch screen, start the screen refresh service program, and control the screen refresh service program to generate second screen data according to the first screen data and the complete writing trajectory information generated by the writing sliding operation and write it into the first graphics card cache, so that the graphics card module can read the second screen data from the first graphics card cache and display it on the touch screen, and the complete writing trajectory information includes the information of each trajectory point.

6. The device according to claim 5, characterized in that The processing module is used to dynamically update the first screen data in the first graphics card cache using each track point information generated during the writing sliding operation, and when the updated first screen data is obtained, specifically to: Acquire each track point information generated during the writing and sliding operation, each track point information at least including the screen coordinates of the corresponding track point on the touch screen; for each acquired track point information, update the first screen data in the first graphics card cache according to the screen coordinates in the acquired track point information to obtain the updated first screen data.

7. The device according to claim 5, characterized in that The processing module is used to update the first screen data in the first graphics card cache according to the screen coordinates in the acquired trajectory point information, and when the updated first screen data is obtained, specifically to: Generate image data of the local writing track according to the screen coordinates in the acquired track point information, and draw the image data of the local writing track as a new layer on the first screen data in the first graphics card cache to obtain updated first screen data; or, According to the screen coordinates in the acquired trajectory point information, the pixel values ​​of the pixel points corresponding to the screen coordinates in the first screen data in the graphics card cache are updated to obtain the updated first screen data.

8. A writing screen device, characterized in that: include: Memory and processor; Memory for storing computer programs; The processor is coupled to the memory and is configured to execute a computer program for executing the steps of the method according to any one of claims 1 to 4.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the processor is caused to implement the steps in the method according to any one of claims 1 to 4.

Images