Electronic paper handwriting display method, device, equipment and storage medium

Abstract

The present invention discloses an electronic paper handwriting display method, device, equipment and storage medium, belonging to the field of computer technology. The method comprises: tracking and detecting the position of a stylus on an electronic paper, obtaining handwriting update coordinate data; obtaining simulated handwriting data and a handwriting area through a pre-created mirror interface according to the handwriting update coordinate data, wherein the mirror interface has the same content as the current electronic paper interface; based on a preset local refresh algorithm, the simulated handwriting data and the handwriting area are submitted for display to obtain the electronic paper handwriting display result. By using the mirror interface for local refresh, the speed of handwriting on the electronic paper is improved. Thus, smooth handwriting on the electronic paper is achieved, and the technical problems of handwriting display freeze or interface update stagnation during handwriting are solved. Compared with the prior art, it has the advantages of faster handwriting speed and parallel interface update.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to an electronic paper handwriting display method, device, equipment and storage medium. Background Art

[0002] Electronic paper is a display screen that looks like paper. It is composed of microcapsules with bistable properties. Each microcapsule contains many pigment particles with different colors and charges. When an electric field is applied, pigment particles with the same charge move up in the direction of the electric field. Changing the direction of the electric field can change the microcapsule to display different colors. Multiple microcapsules combined together can display different patterns.

[0003] Due to its paper-like display effect and the characteristics of not disappearing the displayed content when the power is off, electronic paper is widely used in electronic devices such as e-book readers and smart office notebooks. The traditional basic function of only supporting page turning for reading can no longer meet the needs of users. More and more users install third-party handwriting applications on their devices to take notes, draw, etc. However, compared with traditional LCD and other display devices, electronic paper has a slow refresh frame rate, which makes the display of handwriting data in third-party handwriting applications very slow and unsmooth.

[0004] To solve this problem, some device manufacturers currently obtain handwriting drawing information, then generate fitting handwriting data and prioritize handwriting refresh to increase handwriting speed. This method can indeed solve the problem of handwriting lag, but it also introduces new problems. When handwriting quickly, other content on the interface cannot be updated, resulting in stagnation in refreshing other interface content during handwriting. Summary of the invention

[0005] The main purpose of the present invention is to provide an electronic paper handwriting display method, device, equipment and storage medium, aiming to solve the problem of handwriting display freeze or interface update stagnation during handwriting.

[0006] To achieve the above object, the present invention provides an electronic paper handwriting display method, the electronic paper handwriting display method comprising the following steps:

[0007] Track and detect the position of the stylus on the electronic paper and obtain the updated coordinate data of the handwriting;

[0008] Update the coordinate data according to the handwriting, and obtain the simulated handwriting data and the handwriting area through the pre-created mirror interface, wherein the mirror interface has the same content as the current electronic paper interface;

[0009] Based on a preset local refresh algorithm, the simulated handwriting data and the handwriting area are submitted for display to obtain an electronic paper handwriting display result.

[0010] Optionally, before the step of tracking and detecting the position of the stylus on the electronic paper and acquiring handwriting update coordinate data, the step further includes:

[0011] Get the name of the first top-level window to be matched;

[0012] Determining whether the first top-level window name to be matched matches a preset configuration file, wherein the configuration file pre-stores a third-party handwriting application interface name;

[0013] If the name of the first top-level window to be matched matches the preset configuration file, determining whether it is detected that the stylus is close to or in contact with the electronic paper;

[0014] If it is detected that the stylus is close to or in contact with the electronic paper, it switches to the fast handwriting state and creates the mirror interface.

[0015] Optionally, if it is detected that the stylus is close to or in contact with the electronic paper, the step of switching to a fast handwriting state and creating the mirror interface includes:

[0016] If it is detected that the stylus is close to or in contact with the electronic paper, the state is switched to the fast handwriting state and a blank interface is created;

[0017] Obtain the content data of the current electronic paper interface through a preset remote call interface;

[0018] The content data of the current electronic paper interface is written into the blank interface to obtain the mirror interface.

[0019] Optionally, the step of updating the coordinate data according to the handwriting and obtaining simulated handwriting data and a handwriting area through a pre-created mirror interface includes:

[0020] Update the coordinate data according to the handwriting, draw on the mirror interface, and obtain the simulated handwriting data;

[0021] Based on a preset local area calculation algorithm, the handwriting area is calculated according to the handwriting update coordinate data and the pre-acquired stroke size data.

[0022] Optionally, after the step of updating the coordinate data according to the handwriting and obtaining the simulated handwriting data and the handwriting area through the pre-created mirror interface, the step further includes:

[0023] Receive electronic paper interface update instructions;

[0024] Based on the electronic paper interface update instruction, obtaining a non-handwritten area according to the electronic paper interface and the handwritten area;

[0025] Based on the local refresh algorithm and according to the electronic paper interface update instruction, the non-handwritten area is refreshed.

[0026] Optionally, after the step of submitting the simulated handwriting data and the handwriting area for display based on a preset local refresh algorithm to obtain the electronic paper handwriting display result, the method further includes:

[0027] Get the name of the second top-level window to be matched;

[0028] Determine whether the second top-level window name to be matched matches the configuration file;

[0029] If the second top-level window name to be matched does not match the configuration file, the mirror interface is removed and the electronic paper interface is refreshed.

[0030] Optionally, after the step of submitting the simulated handwriting data and the handwriting area for display based on a preset local refresh algorithm to obtain the electronic paper handwriting display result, the method further includes:

[0031] When it is detected that the stylus is lifted on the electronic paper, the mirror interface is removed and the electronic paper interface is refreshed.

[0032] In addition, to achieve the above-mentioned purpose, the present invention further provides an electronic paper handwriting display device, the electronic paper handwriting display device comprising:

[0033] A data acquisition module is used to track and detect the position of the stylus on the electronic paper and obtain the updated coordinate data of the handwriting;

[0034] A handwriting generation module, used for updating the coordinate data according to the handwriting, and obtaining the simulated handwriting data and the handwriting area through a pre-created mirror interface, wherein the mirror interface has the same content as the current electronic paper interface;

[0035] The handwriting display module is used to submit the simulated handwriting data and the handwriting area for display based on a preset local refresh algorithm to obtain an electronic paper handwriting display result.

[0036] An embodiment of the present invention also proposes a terminal device, which includes a memory, a processor, and an electronic paper handwriting display program stored in the memory and executable on the processor. When the electronic paper handwriting display program is executed by the processor, the steps of the electronic paper handwriting display method as described above are implemented.

[0037] The embodiment of the present invention further provides a computer-readable storage medium, on which an electronic paper handwriting display program is stored. When the electronic paper handwriting display program is executed by a processor, the steps of the electronic paper handwriting display method described above are implemented.

[0038] The embodiment of the present invention proposes an electronic paper handwriting display method, device, equipment and storage medium, which obtains handwriting update coordinate data by tracking and detecting the position of the stylus on the electronic paper; according to the handwriting update coordinate data, obtains simulated handwriting data and handwriting area through a pre-created mirror interface, and the mirror interface has the same content as the current electronic paper interface; based on a preset local refresh algorithm, the simulated handwriting data and handwriting area are submitted for display to obtain the electronic paper handwriting display result. By using the mirror interface for local refresh, the speed of handwriting on the electronic paper is improved. As a result, smooth handwriting on the electronic paper is achieved, and the technical problems of handwriting display freeze or interface update stagnation during handwriting are solved. Compared with the prior art, it has the advantages of faster handwriting speed and parallel interface update.

[0039] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 This is a schematic diagram of the functional modules of the terminal device to which the electronic paper handwriting display device of the present invention belongs;

[0041] Figure 2 A schematic diagram of a flow chart of a first exemplary embodiment of a method for displaying handwriting on an electronic paper according to the present invention;

[0042] Figure 3 is a flow chart of a second exemplary embodiment of the electronic paper handwriting display method of the present invention;

[0043] Figure 4 is a flow chart of a third exemplary embodiment of the electronic paper handwriting display method of the present invention;

[0044] Figure 5 is a flowchart of a fourth exemplary embodiment of the electronic paper handwriting display method of the present invention;

[0045] Figure 6 is a flowchart of a fifth exemplary embodiment of the electronic paper handwriting display method of the present invention;

[0046] Figure 7 is a flowchart of a sixth exemplary embodiment of the electronic paper handwriting display method of the present invention;

[0047] Figure 8 is a flow chart of a seventh exemplary embodiment of the electronic paper handwriting display method of the present invention;

[0048] Fig. 9It is a schematic diagram of the overall flow of another exemplary embodiment of the electronic paper handwriting display method of the present invention.

[0049] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0050] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0051] The main solution of the embodiment of the present invention is: track and detect the position of the stylus on the electronic paper, and obtain the handwriting update coordinate data; according to the handwriting update coordinate data, obtain the simulated handwriting data and the handwriting area through the pre-created mirror interface, and the mirror interface has the same content as the current electronic paper interface; based on the preset local refresh algorithm, submit the simulated handwriting data and the handwriting area for display to obtain the electronic paper handwriting display result. By using the mirror interface for local refresh, the speed of handwriting on the electronic paper is improved. In this way, smooth handwriting on the electronic paper is achieved, and the technical problems of handwriting display freeze or interface update stagnation during handwriting are solved. Compared with the existing technology, it has the advantages of faster handwriting speed and parallel interface update.

[0052] The embodiments of the present invention take into account that the relevant technical solution adopts a method of obtaining handwriting drawing information and then generating a fitted handwriting trace to prioritize handwriting refresh to improve the handwriting speed. This method can indeed solve the problem of handwriting lag, but it also introduces a new problem. While handwriting quickly, other content of the interface cannot be updated, resulting in stagnation in refreshing other interface content during handwriting.

[0053] Based on this, an embodiment of the present invention proposes a solution, which utilizes the characteristic of fast local parallel refresh of electronic paper and adopts a mirror interface local refresh method to achieve smooth handwriting on electronic paper, solves the technical problem of handwriting jamming and unsmoothness in third-party handwriting applications, and further solves the defect that other content of the interface cannot be updated while handwriting quickly, thereby improving the speed of handwriting on electronic paper.

[0054] Electronic paper has the characteristics of slow full-screen refresh and fast local parallel refresh. So as long as you know the rectangular area where the handwriting is updated each time, you can continuously submit small rectangular areas for local refresh when handwriting, and you can improve the handwriting display speed. Since the handwriting of third-party handwriting applications is generally gray or color, direct submission will reduce the refresh time of a single small rectangular area. In order to further improve the refresh speed of the handwriting, create a mirror interface with the same content as the current interface. The mirror interface draws simulated handwriting without grayscale by listening to the input information of the stylus, and calculates the update area of ​​the simulated handwriting through the coordinate information of the stylus. Finally, the simulated handwriting data and the update area are submitted for display through local refresh. As the stylus moves and executes in a loop, users can experience a smooth handwriting effect.

[0055] Since handwriting uses a local parallel refresh method, when the system interface is updated, it can also be submitted for refresh at the same time. Since when the refresh area overlaps with the handwriting refresh area, the handwriting refresh speed will be slowed down, so here only the non-overlapping area is refreshed. After the handwriting stops, all the contents of the current system interface will be updated to the latest.

[0056] Considering the convenience of user operation, it is necessary to automatically enter the fast handwriting state after entering the handwriting interface of a third-party application. This method writes the specified handwriting window name to the system configuration file in advance, obtains the top-level window name when the system task stack changes, and matches it with the configuration file. A successful match indicates that the handwriting interface has been entered. At this time, when writing, it automatically enters the fast handwriting state.

[0057] Specifically, refer to Figure 1 , Figure 1 The figure is a functional block diagram of the terminal device to which the electronic paper handwriting display device of the present invention belongs. The electronic paper handwriting display device can be a device that is independent of the terminal device and can display electronic paper handwriting, and it can be carried on the terminal device in the form of hardware or software. The terminal device can be a smart mobile device with data processing function such as a mobile phone or a tablet computer, and can also be a fixed terminal device or server with data processing function.

[0058] In this embodiment, the terminal device to which the electronic paper handwriting display apparatus belongs at least includes an output module 110 , a processor 120 , a memory 130 and a communication module 140 .

[0059] The memory 130 stores an operating system and an electronic paper handwriting display program. The electronic paper handwriting display device can obtain handwriting update coordinate data by tracking and detecting the position of the stylus on the electronic paper; according to the handwriting update coordinate data, the simulated handwriting data and the handwriting area are obtained through a pre-created mirror interface, and the mirror interface has the same content as the current electronic paper interface; based on a preset local refresh algorithm, the simulated handwriting data and the handwriting area are submitted for display to obtain the electronic paper handwriting display result. The simulated handwriting data is generated by the electronic paper handwriting display program, and the electronic paper handwriting display result and other information are stored in the memory 130; the output module 110 can be a display screen, etc. The communication module 140 can include a WIFI module, a mobile communication module, a Bluetooth module, etc., and communicates with an external device or server through the communication module 140.

[0060] When the electronic paper handwriting display program in the memory 130 is executed by the processor, the following steps are implemented:

[0061] Track and detect the position of the stylus on the electronic paper and obtain the updated coordinate data of the handwriting;

[0062] Update the coordinate data according to the handwriting, and obtain the simulated handwriting data and the handwriting area through the pre-created mirror interface, wherein the mirror interface has the same content as the current electronic paper interface;

[0063] Based on a preset local refresh algorithm, the simulated handwriting data and the handwriting area are submitted for display to obtain an electronic paper handwriting display result.

[0064] Furthermore, when the electronic paper handwriting display program in the memory 130 is executed by the processor, the following steps are also implemented:

[0065] Get the name of the first top-level window to be matched;

[0066] Determining whether the first top-level window name to be matched matches a preset configuration file, wherein the configuration file pre-stores a third-party handwriting application interface name;

[0067] If the name of the first top-level window to be matched matches the preset configuration file, determining whether it is detected that the stylus is close to or in contact with the electronic paper;

[0068] If it is detected that the stylus is close to or in contact with the electronic paper, it switches to the fast handwriting state and creates the mirror interface.

[0069] Furthermore, when the electronic paper handwriting display program in the memory 130 is executed by the processor, the following steps are also implemented:

[0070] If it is detected that the stylus is close to or in contact with the electronic paper, the state is switched to the fast handwriting state and a blank interface is created;

[0071] Obtain the content data of the current electronic paper interface through a preset remote call interface;

[0072] The content data of the current electronic paper interface is written into the blank interface to obtain the mirror interface.

[0073] Furthermore, when the electronic paper handwriting display program in the memory 130 is executed by the processor, the following steps are also implemented:

[0074] Update the coordinate data according to the handwriting, draw on the mirror interface, and obtain the simulated handwriting data;

[0075] Based on a preset local area calculation algorithm, the handwriting area is calculated according to the handwriting update coordinate data and the pre-acquired stroke size data.

[0076] Furthermore, when the electronic paper handwriting display program in the memory 130 is executed by the processor, the following steps are also implemented:

[0077] Receive electronic paper interface update instructions;

[0078] Based on the electronic paper interface update instruction, obtaining a non-handwritten area according to the electronic paper interface and the handwritten area;

[0079] Based on the local refresh algorithm and according to the electronic paper interface update instruction, the non-handwritten area is refreshed.

[0080] Furthermore, when the electronic paper handwriting display program in the memory 130 is executed by the processor, the following steps are also implemented:

[0081] Get the name of the second top-level window to be matched;

[0082] Determine whether the second top-level window name to be matched matches the configuration file;

[0083] If the second top-level window name to be matched does not match the configuration file, the mirror interface is removed and the electronic paper interface is refreshed.

[0084] Furthermore, when the electronic paper handwriting display program in the memory 130 is executed by the processor, the following steps are also implemented:

[0085] When it is detected that the stylus is lifted on the electronic paper, the mirror interface is removed and the electronic paper interface is refreshed.

[0086] This embodiment adopts the above scheme, specifically by tracking and detecting the position of the stylus on the electronic paper, to obtain the handwriting update coordinate data; according to the handwriting update coordinate data, through the pre-created mirror interface, to obtain the simulated handwriting data and the handwriting area, the mirror interface and the current electronic paper interface content are the same; based on the preset local refresh algorithm, the simulated handwriting data and the handwriting area are submitted for display to obtain the electronic paper handwriting display result. By using the mirror interface for local refresh, the speed of handwriting on the electronic paper is improved. In this way, smooth handwriting on the electronic paper is achieved, and the technical problems of handwriting display freeze or interface update stagnation during handwriting are solved. Compared with the prior art, it has the advantages of faster handwriting speed and parallel interface update.

[0087] Based on the above terminal device architecture but not limited to the above architecture, an embodiment of the method of the present invention is proposed.

[0088] Reference Figure 2 , Figure 2 The figure is a flow chart of a first exemplary embodiment of the electronic paper handwriting display method of the present invention. The electronic paper handwriting display method comprises:

[0089] Step S101, tracking and detecting the position of the stylus on the electronic paper, and obtaining handwriting update coordinate data;

[0090] The executor of the method of this embodiment is an electronic paper handwriting display service system, and may also be an electronic paper handwriting display device, or an electronic paper handwriting display equipment. This embodiment takes an electronic paper handwriting display device as an example, and the electronic paper handwriting display device can be integrated on a device with data processing function.

[0091] In order to solve the current problem of handwriting display freeze or interface update stagnation during handwriting, it is particularly important to increase the handwriting speed without affecting the interface update. In order to increase the handwriting speed on the electronic paper and realize the parallel update of the interface, the following steps are taken:

[0092] Firstly, a special electronic paper handwriting display device is integrated on a device with a data processing function, and handwriting can be displayed on the electronic paper through the electronic paper handwriting display device;

[0093] Finally, through the electronic paper handwriting display device, a tracking detection algorithm is used to track the position of the stylus on the electronic paper in real time based on the continuous position coordinate data, and obtain the handwriting update coordinate data. Common tracking detection algorithms can use Kalman filters, Bessel curve fitting, etc. These algorithms can help smooth and predict the trajectory of the stylus and improve the accuracy and fluency of the handwriting.

[0094] Step S102, updating the coordinate data according to the handwriting, obtaining the simulated handwriting data and the handwriting area through a pre-created mirror interface, wherein the mirror interface has the same content as the current electronic paper interface;

[0095] The electronic paper handwriting display device updates the coordinate data according to the handwriting, and obtains the simulated handwriting data and the handwriting area through the pre-created mirror interface, wherein the mirror interface has the same content as the current electronic paper interface, and the following steps are taken to achieve it:

[0096] First, the electronic paper handwriting display device uses the handwriting to update the coordinate data, simulates the handwriting effect on the pre-created mirror interface, and obtains simulated handwriting data. The specific implementation method includes converting the handwriting data into a drawing instruction, performing a drawing operation on the mirror interface, or displaying a virtual handwriting trajectory on the mirror interface to simulate the trajectory and speed of the stylus, etc. The simulated handwriting data may include information such as the starting point, end point, and pressure value of the stroke, wherein the mirror interface has the same content as the current electronic paper interface, and is actually an invisible memory space on a display screen, which is only used for drawing and submitting simulated handwriting;

[0097] Finally, the electronic paper handwriting display device calculates the handwriting area based on the handwriting update coordinate data and the pre-acquired stroke size data, where the handwriting area is generally a rectangle used to identify the position and size of the handwriting area. The update area is calculated while the handwriting is drawn, and as the pen moves, the small blocks of handwriting content and the corresponding update area are continuously submitted to the electronic paper display for refreshing.

[0098] Step S103, based on a preset local refresh algorithm, submitting the simulated handwriting data and the handwriting area for display, and obtaining an electronic paper handwriting display result.

[0099] The electronic paper handwriting display device submits the simulated handwriting data and the handwriting area for display based on a preset local refresh algorithm to obtain the electronic paper handwriting display result, which is achieved by taking the following steps:

[0100] First, the electronic paper handwriting display device displays the handwriting at the corresponding position on the electronic paper according to the position and size of the handwriting area. The specific implementation method may vary depending on the device and platform. The drawing operation can be performed using a graphics library, a drawing API, etc.

[0101] Finally, the electronic paper handwriting display device uses a preset local refresh algorithm to only update the area that needs to be updated, thereby improving display efficiency and response speed to obtain the electronic paper handwriting display result. This can be achieved by comparing the difference between the new handwriting area and the last drawn area, and only updating the changed part. The effect of local refresh can be optimized by combining double buffering technology or incremental drawing methods. According to the simulated handwriting data obtained in real time, the handwriting area is continuously updated and local refresh is performed, thereby achieving the effect of real-time display of electronic paper handwriting.

[0102] This embodiment uses the above scheme to track and detect the position of the stylus on the electronic paper to obtain the handwriting update coordinate data; according to the handwriting update coordinate data, the simulated handwriting data and the handwriting area are obtained through the pre-created mirror interface, and the mirror interface has the same content as the current electronic paper interface; based on the preset local refresh algorithm, the simulated handwriting data and the handwriting area are submitted for display to obtain the electronic paper handwriting display result. By using the mirror interface for local refresh, the speed of handwriting on the electronic paper is improved. In this way, smooth handwriting on the electronic paper is achieved, and the technical problems of handwriting display freeze or interface update stagnation during handwriting are solved. Compared with the existing technology, it has the advantages of faster handwriting speed and parallel interface update.

[0103] Reference Figure 3 , Figure 3 FIG. 4 is a flow chart of a second exemplary embodiment of the electronic paper handwriting display method of the present invention.

[0104] Based on the first exemplary embodiment described above, before the step S101 of tracking and detecting the position of the stylus on the electronic paper and acquiring the handwriting update coordinate data, the step further includes:

[0105] Step S001, obtaining the name of the first top-level window to be matched;

[0106] Step S002, determining whether the first top-level window name to be matched matches a preset configuration file, wherein the configuration file pre-stores a third-party handwriting application interface name;

[0107] Step S003, if the first to-be-matched top-level window name matches the preset configuration file, determining whether it is detected that the stylus is close to or in contact with the electronic paper;

[0108] Step S004: if it is detected that the stylus is close to or in contact with the electronic paper, the state is switched to a fast handwriting state, and the mirror interface is created.

[0109] Specifically, the electronic paper handwriting display device creates a mirror interface according to the name of the first top-level window to be matched, and takes the following steps to implement:

[0110] First, the electronic paper handwriting display device obtains the name of the first top-level window to be matched. For example, if the electronic paper handwriting display device is equipped with an Android system, the name of the first top-level window to be matched can be obtained by monitoring the changes of the system task stack through TaskStackListener of ActivityManager;

[0111] Secondly, the electronic paper handwriting display device uses the corresponding API or code to read the preset configuration file, obtain the third-party handwriting application interface name stored therein, and compare the first top-level window name to be matched with the third-party handwriting application interface name pre-stored in the configuration file. If the two match, it is considered that the target application is currently running, otherwise it is considered that the target application is not currently running. The configuration file can be an XML configuration file. When the window changes, the configuration information in the XML configuration file is read for matching. The XML configuration file can also be updated through the network after the device is connected to the network. The user does not need to perform additional operations during the entire process.

[0112] Then, after determining that the name of the first top-level window to be matched matches the preset configuration file, the electronic paper handwriting display device uses an appropriate API or library function to monitor input devices related to the stylus input (such as a touch screen, a digital tablet, etc.), and monitors events on the input device in real time, including the stylus touching the electronic paper, leaving the electronic paper, etc., and updates the detection status of the stylus according to the type of input event. If it is detected that the stylus touches the electronic paper, the flag bit is set to indicate that it has been detected; if it is detected that the stylus leaves the electronic paper, the flag bit is set to indicate that it has not been detected. According to the value of the flag bit, it is determined whether the stylus is detected to be close to or touching the electronic paper, and a Boolean value or other data type representing the result can be returned as needed;

[0113] Finally, after detecting that the stylus is close to or in contact with the electronic paper, the electronic paper handwriting display device switches to the fast handwriting state and creates a new window as a mirror interface according to the preset parameters. That is, entering the fast handwriting state requires two conditions to be met: one is that the window matches the configuration file successfully, and the other is that the stylus pen writing event is detected.

[0114] This embodiment adopts the above scheme, specifically by obtaining the name of the first top-level window to be matched; judging whether the name of the first top-level window to be matched matches a preset configuration file, in which the name of the third-party handwriting application interface is pre-stored; if the name of the first top-level window to be matched matches the preset configuration file, judging whether the stylus is detected to be close to or in contact with the electronic paper; if the stylus is detected to be close to or in contact with the electronic paper, switching to the fast handwriting state and creating the mirror interface. By obtaining the name of the first top-level window to be matched, a mirror interface is created. Thus, the fast handwriting state is entered, and the mirror interface is obtained, which provides support for obtaining simulated handwriting data and handwriting areas.

[0115] Reference Figure 4 , Figure 4 FIG. 4 is a flow chart of a third exemplary embodiment of the electronic paper handwriting display method of the present invention.

[0116] Based on the above second exemplary embodiment, in step S004, if it is detected that the stylus is close to or in contact with the electronic paper, switching to the fast handwriting state and creating the mirror interface may include:

[0117] Step S0041, if it is detected that the stylus is close to or in contact with the electronic paper, switching to the fast handwriting state and creating a blank interface;

[0118] Step S0042, obtaining content data of the current electronic paper interface through a preset remote call interface;

[0119] Step S0043, writing the content data of the current electronic paper interface into the blank interface to obtain the mirror interface.

[0120] Specifically, the following steps are taken to achieve this:

[0121] First, after detecting that the stylus is close to or in contact with the electronic paper, the electronic paper handwriting display device switches to a fast handwriting state, and creates a blank interface that can be drawn according to a preset configuration. The blank interface can be created using a graphics library or a drawing API, wherein the blank interface can be a Canvas canvas that is consistent with the screen resolution;

[0122] Then, the electronic paper handwriting display device obtains the content data of the current electronic paper interface through a preset remote call interface, wherein the content data of the current electronic paper interface may be a URL address of an image file, a binary data stream or other forms of data;

[0123] Finally, the electronic paper handwriting display device writes the electronic paper screen content data into the blank interface according to the data format and the requirements of the blank interface to obtain a mirror interface. For example, the current electronic paper interface content in SurfaceFlinger is obtained through the system remote call interface and written into the Canvas canvas. Some format conversion and data processing may be required during the writing process, such as adjusting the image size and ratio.

[0124] This embodiment adopts the above scheme, specifically by switching to the fast handwriting state and creating a blank interface if the stylus is detected to be close to or in contact with the electronic paper; obtaining the content data of the current electronic paper interface through a preset remote call interface; writing the content data of the current electronic paper interface into the blank interface to obtain the mirror interface. By creating a blank interface and writing the content data of the current electronic paper interface into it, a mirror interface is created. Thus, the fast handwriting state is entered, and the mirror interface is obtained, which provides support for obtaining simulated handwriting data and handwriting areas.

[0125] Reference Figure 5 , Figure 5 FIG. 4 is a flow chart of a fourth exemplary embodiment of the electronic paper handwriting display method of the present invention.

[0126] Based on the first exemplary embodiment, the step S102, updating the coordinate data according to the handwriting, obtaining the simulated handwriting data and the handwriting area through the pre-created mirror interface, wherein the mirror interface has the same content as the current electronic paper interface, may include:

[0127] Step S1021, updating the coordinate data according to the handwriting, drawing on the mirror interface, and obtaining the simulated handwriting data;

[0128] Step S1022, based on a preset local area calculation algorithm, the handwriting area is calculated according to the handwriting update coordinate data and the pre-acquired stroke size data.

[0129] Specifically, the electronic paper handwriting display device updates the coordinate data according to the handwriting, obtains the simulated handwriting data and the handwriting area through the pre-created mirror interface, and takes the following steps to achieve:

[0130] First, the electronic paper handwriting display device updates the coordinate data according to the handwriting, and draws on the mirror interface. The drawing functions provided by the blank interface object, such as drawing lines, filling shapes, adding text, etc., can be used to obtain simulated handwriting data. At the same time, as the handwriting data is updated, the simulated handwriting on the mirror interface is continuously updated. After each update of the coordinate data, the handwriting can be drawn on the mirror interface to achieve a real-time simulation effect;

[0131] Finally, the electronic paper handwriting display device calculates the handwriting area based on the preset local area calculation algorithm and the handwriting update coordinate data and stroke size data. The algorithm may divide the continuous handwriting into different areas according to certain rules and conditions to determine the boundary of the handwriting area. According to the calculated handwriting area, it is drawn on the mirror interface, and the drawing functions provided by the blank interface object can be used, such as drawing rectangles, filling colors, etc. At the same time, as the handwriting data is updated, the handwriting area on the mirror interface is continuously updated. The handwriting area can be recalculated and drawn after each update of the coordinate data.

[0132] This embodiment uses the above scheme, specifically by drawing on the mirror interface according to the handwriting update coordinate data, to obtain the simulated handwriting data; based on the preset local area calculation algorithm, the handwriting area is calculated according to the handwriting update coordinate data and the pre-acquired stroke size data. The simulated handwriting data and the handwriting area are obtained through the handwriting update coordinate data and the pre-created mirror interface. Thus, the simulated handwriting data and the handwriting area are obtained, which provides support for obtaining the electronic paper handwriting display result.

[0133] Reference Figure 6 , Figure 6 FIG. 5 is a flow chart of a fifth exemplary embodiment of the electronic paper handwriting display method of the present invention.

[0134] Based on the first exemplary embodiment, the step S102, updating the coordinate data according to the handwriting, obtaining the simulated handwriting data and the handwriting area through the pre-created mirror interface, and the mirror interface and the current electronic paper interface content being the same, may include:

[0135] Step S1041, receiving an electronic paper interface update instruction;

[0136] Step S1042, based on the electronic paper interface update instruction, obtaining a non-handwritten area according to the electronic paper interface and the handwritten area;

[0137] Step S1043: Based on the local refresh algorithm and according to the electronic paper interface update instruction, the display of the non-handwritten area is refreshed.

[0138] Specifically, the following steps are taken to achieve this:

[0139] First, the electronic paper handwriting display device receives an electronic paper interface update instruction;

[0140] Then, the electronic paper handwriting display device determines the area not covered by handwriting according to the electronic paper interface update instruction, the known electronic paper interface and the handwriting area, and obtains the non-handwriting area through an appropriate calculation method, which can be achieved based on the coordinate information of the handwriting area and the position and size of the interface element;

[0141] Finally, the electronic paper handwriting display device is based on a local refresh algorithm and, according to the electronic paper interface update instruction, performs a display refresh on the non-handwritten area. A local refresh is to refresh only the changed area without re-rendering the entire electronic paper interface. The local refresh can be achieved by using related functions or methods provided by a graphics library or a drawing engine. For example, the update area of ​​each layer is obtained through the system display framework. A frame may have multiple rectangular areas. The rectangular area that overlaps with the handwritten area in the mirror interface is removed, and the remaining non-handwritten area is submitted for display in a local refresh manner.

[0142] This embodiment adopts the above scheme, specifically by receiving an electronic paper interface update instruction; based on the electronic paper interface update instruction, obtaining a non-handwritten area according to the electronic paper interface and the handwritten area; based on the local refresh algorithm, according to the electronic paper interface update instruction, refreshing the display of the non-handwritten area. The non-handwritten area is refreshed by the received electronic paper interface update instruction. Thus, the technical problem of interface update stagnation during handwriting is solved, and compared with the prior art, it has the advantage that the interface can be updated in parallel.

[0143] Reference Figure 7 , Figure 7 FIG. 6 is a flow chart of a sixth exemplary embodiment of the electronic paper handwriting display method of the present invention.

[0144] Based on the first exemplary embodiment described above, the step S103, based on a preset local refresh algorithm, submits the simulated handwriting data and the handwriting area for display, and obtains the electronic paper handwriting display result, further includes:

[0145] Step S1051, obtaining the name of the second top-level window to be matched;

[0146] Step S1052, determining whether the second top-level window name to be matched matches the configuration file;

[0147] Step S1053: If the second top-level window name to be matched does not match the configuration file, the mirroring interface is removed and the electronic paper interface is refreshed.

[0148] Specifically, the following steps are taken to achieve this:

[0149] First, the electronic paper handwriting display device obtains the name of the second top-level window to be matched;

[0150] Then, the electronic paper handwriting display device uses the corresponding API or code to read the preset configuration file, obtain the third-party handwriting application interface name stored therein, and compare the second top-level window name to be matched with the third-party handwriting application interface name pre-stored in the configuration file. If the two match, it is considered that the currently running application is the target application, otherwise it is considered that the currently running application is not the target application;

[0151] Finally, if the second top-level window name to be matched does not match the configuration file, the electronic paper handwriting display device can use relevant functions or APIs to remove the mirror interface, recycle the Canvas resources in time, and update the current electronic paper interface through system remote calls to display the latest real content of the interface.

[0152] This embodiment adopts the above scheme, specifically by obtaining the name of the second top-level window to be matched; judging whether the second top-level window name to be matched matches the configuration file; if the second top-level window name to be matched does not match the configuration file, removing the mirror interface and refreshing the electronic paper interface. By obtaining the second top-level window name to be matched, the mirror interface is removed and the electronic paper interface is refreshed. Thus, the fast handwriting state is exited, and the handwriting on the electronic paper is ended.

[0153] Reference Figure 8 , Figure 8 FIG. 4 is a flow chart of a seventh exemplary embodiment of the electronic paper handwriting display method of the present invention.

[0154] After the step of submitting the simulated handwriting data and the handwriting area for display based on the preset local refresh algorithm to obtain the electronic paper handwriting display result, the method further includes:

[0155] When it is detected that the stylus is lifted on the electronic paper, the mirror interface is removed and the electronic paper interface is refreshed

[0156] Based on the first exemplary embodiment, the step S103, based on a preset local refresh algorithm, submits the simulated handwriting data and the handwriting area for display, and obtains the electronic paper handwriting display result, may include:

[0157] Step S106, when it is detected that the stylus is lifted on the electronic paper, the mirror interface is removed and the electronic paper interface is refreshed.

[0158] Specifically, the following steps are taken to achieve this:

[0159] First, the electronic paper handwriting display device uses appropriate sensing technology or algorithms to detect the action of the stylus being lifted on the electronic paper, and can determine whether the stylus has been lifted by monitoring the changes in the capacitance and electromagnetic parameters of the touch screen;

[0160] Finally, when the stylus is detected to be lifted, the electronic paper handwriting display device can use relevant functions or APIs to remove the mirror interface, recycle the Canvas resources in time, and update the current electronic paper interface through system remote calls to display the latest real content of the interface.

[0161] In addition, the mirror interface does not affect the input response and interface drawing of the electronic paper interface. When the simulated handwriting data is submitted for display, the third-party handwriting application will also draw, but it will be filtered when submitting. On the one hand, the handwriting drawn by the third-party handwriting application just overlaps with the simulated handwriting area of ​​the mirror interface and will not be submitted, so that the refresh speed of the handwriting on the mirror interface will not be affected by the overlapping of the submitted area; on the other hand, the update of other content on the electronic paper interface will not overlap with the handwriting area of ​​the mirror interface, so its submission and update will not be intercepted, achieving the purpose of synchronously updating other content during fast handwriting.

[0162] This embodiment uses the above solution, specifically, when the stylus is detected to be lifted on the electronic paper, the mirror interface is removed and the electronic paper interface is refreshed. By detecting the stylus lifting action, the mirror interface is removed and the electronic paper interface is refreshed. Thus, the fast handwriting state is exited and the handwriting on the electronic paper is ended.

[0163] As another exemplary embodiment, this embodiment can realize the handwriting display on the electronic paper through the electronic paper handwriting display device. The process of the electronic paper handwriting display method is as follows: Fig. 9 As shown:

[0164] First, the electronic paper handwriting display device confirms that it is currently entering the handwriting function interface of the third-party software through the system window information and the window name in the configuration file;

[0165] Secondly, before handwriting starts, the electronic paper handwriting display device creates a mirror interface with the same content as the current system interface according to the current system interface;

[0166] Then, when handwriting, the electronic paper handwriting display device uses the third-party handwriting application of the current system interface and the mirror interface to draw handwriting at the same time, the mirror interface draws simulated handwriting and calculates the handwriting drawing area, and uses the local refresh method to submit the drawn handwriting content for fast refresh, and the system interface also submits updates that do not overlap with the handwriting area in the local refresh method;

[0167] Finally, after the handwriting is completed, the electronic paper handwriting display device removes the mirror interface and immediately updates the current system interface content to ensure that the latest content of the system interface is displayed on the screen.

[0168] This embodiment adopts the above scheme, specifically by tracking and detecting the position of the stylus on the electronic paper, to obtain the handwriting update coordinate data; according to the handwriting update coordinate data, through the pre-created mirror interface, to obtain the simulated handwriting data and the handwriting area, the mirror interface and the current electronic paper interface content are the same; based on the preset local refresh algorithm, the simulated handwriting data and the handwriting area are submitted for display to obtain the electronic paper handwriting display result. By using the mirror interface for local refresh, the speed of handwriting on the electronic paper is improved. In this way, smooth handwriting on the electronic paper is achieved, and the technical problems of handwriting display freeze or interface update stagnation during handwriting are solved. Compared with the prior art, it has the advantages of faster handwriting speed and parallel interface update.

[0169] In addition, the present invention also provides an electronic paper handwriting display device, the electronic paper handwriting display device comprising:

[0170] A data acquisition module is used to track and detect the position of the stylus on the electronic paper and obtain the updated coordinate data of the handwriting;

[0171] A handwriting generation module, used for updating the coordinate data according to the handwriting, and obtaining the simulated handwriting data and the handwriting area through a pre-created mirror interface, wherein the mirror interface has the same content as the current electronic paper interface;

[0172] The handwriting display module is used to submit the simulated handwriting data and the handwriting area for display based on a preset local refresh algorithm to obtain an electronic paper handwriting display result.

[0173] The principle of implementing handwriting display on electronic paper in this embodiment can be referred to the above embodiments, which will not be described in detail here.

[0174] In addition, an embodiment of the present invention also proposes a terminal device, which includes a memory, a processor, and an electronic paper handwriting display program stored in the memory and executable on the processor. When the electronic paper handwriting display program is executed by the processor, the steps of the electronic paper handwriting display method as described above are implemented.

[0175] Since all the technical solutions of all the aforementioned embodiments are adopted when the electronic paper handwriting display program is executed by the processor, it at least has all the beneficial effects brought by all the technical solutions of all the aforementioned embodiments, which will not be described one by one here.

[0176] The embodiment of the present invention further provides a computer-readable storage medium, on which an electronic paper handwriting display program is stored. When the electronic paper handwriting display program is executed by a processor, the steps of the electronic paper handwriting display method described above are implemented.

[0177] Since the electronic paper handwriting display program adopts all the technical solutions of all the aforementioned embodiments when executed by the processor, it at least has all the beneficial effects brought by all the technical solutions of all the aforementioned embodiments, which will not be described one by one here.

[0178] Compared with the prior art, the electronic paper handwriting display scheme proposed in the embodiment of the present invention obtains the handwriting update coordinate data by tracking and detecting the position of the stylus on the electronic paper; according to the handwriting update coordinate data, the simulated handwriting data and the handwriting area are obtained through the pre-created mirror interface, and the mirror interface is the same as the current electronic paper interface content; based on the preset local refresh algorithm, the simulated handwriting data and the handwriting area are submitted for display to obtain the electronic paper handwriting display result. Thereby solving the problem of handwriting display freeze or interface update stagnation during handwriting. Based on the scheme of the present invention, starting from the problem that handwriting cannot be smoothly written on electronic paper or the interface update stagnates during handwriting in the real world, an electronic paper handwriting display scheme is designed, and the effectiveness of the electronic paper handwriting display method of the present invention is verified in the electronic paper handwriting display result. Finally, the efficiency of handwriting on electronic paper is significantly improved by the method of the present invention.

[0179] Compared with the existing technology, the embodiment of the present invention has the following advantages:

[0180] 1. Improved the handwriting speed of third-party handwriting applications;

[0181] 2. Ability to update other contents of the interface in parallel while writing quickly.

[0182] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0183] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0184] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present invention.

[0185] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. An electronic paper handwriting display method, characterized in that: The electronic paper handwriting display method comprises the following steps: Track and detect the position of the stylus on the electronic paper and obtain the updated coordinate data of the handwriting; According to the handwriting update coordinate data, simulated handwriting data and a handwriting area are obtained through a pre-created mirror interface, wherein the mirror interface has the same content as the current electronic paper interface, the simulated handwriting data is non-grayscale data, and the handwriting area includes a plurality of sub-handwriting areas; Based on a preset local refresh algorithm, the simulated handwriting data and the handwriting area are submitted for display to obtain an electronic paper handwriting display result; The step of updating the coordinate data according to the handwriting and obtaining the simulated handwriting data and the handwriting area through the pre-created mirror interface includes: Update the coordinate data according to the handwriting, draw on the mirror interface, and obtain the simulated handwriting data; Based on a preset local area calculation algorithm, the handwriting area is calculated according to the handwriting update coordinate data and the pre-acquired stroke size data; Wherein, after the step of updating the coordinate data according to the handwriting and obtaining the simulated handwriting data and the handwriting area through the pre-created mirror interface, the following steps are further included: Receive electronic paper interface update instructions; Based on a preset system display framework and the electronic paper interface update instruction, obtaining a non-handwritten area according to the electronic paper interface and the handwritten area; Based on the local refresh algorithm and according to the electronic paper interface update instruction, the non-handwritten area is refreshed.

2. The electronic paper handwriting display method according to claim 1, characterized in that: Before the step of tracking and detecting the position of the stylus on the electronic paper and obtaining the handwriting update coordinate data, the method further includes: Get the name of the first top-level window to be matched; Determining whether the first top-level window name to be matched matches a preset configuration file, wherein the configuration file pre-stores a third-party handwriting application interface name; If the name of the first top-level window to be matched matches the preset configuration file, determining whether it is detected that the stylus is close to or in contact with the electronic paper; If it is detected that the stylus is close to or in contact with the electronic paper, it switches to the fast handwriting state and creates the mirror interface.

3. The electronic paper handwriting display method according to claim 2, characterized in that: If the stylus is detected to be close to or in contact with the electronic paper, the step of switching to a fast handwriting state and creating the mirror interface includes: If it is detected that the stylus is close to or in contact with the electronic paper, the state is switched to the fast handwriting state and a blank interface is created; Obtain the content data of the current electronic paper interface through a preset remote call interface; The content data of the current electronic paper interface is written into the blank interface to obtain the mirror interface.

4. The electronic paper handwriting display method according to claim 2, characterized in that: After the step of submitting the simulated handwriting data and the handwriting area for display based on the preset local refresh algorithm to obtain the electronic paper handwriting display result, the method further includes: Get the name of the second top-level window to be matched; Determine whether the second top-level window name to be matched matches the configuration file; If the second top-level window name to be matched does not match the configuration file, the mirror interface is removed and the electronic paper interface is refreshed.

5. The electronic paper handwriting display method according to claim 1, characterized in that: After the step of submitting the simulated handwriting data and the handwriting area for display based on the preset local refresh algorithm to obtain the electronic paper handwriting display result, the method further includes: When it is detected that the stylus is lifted on the electronic paper, the mirror interface is removed and the electronic paper interface is refreshed.

6. An electronic paper handwriting display device, characterized in that: The electronic paper handwriting display device comprises: A data acquisition module is used to track and detect the position of the stylus on the electronic paper and obtain the updated coordinate data of the handwriting; A handwriting generation module, used for updating the coordinate data according to the handwriting, obtaining simulated handwriting data and a handwriting area through a pre-created mirror interface, wherein the mirror interface has the same content as the current electronic paper interface, the simulated handwriting data is non-grayscale data, and the handwriting area includes a plurality of sub-handwriting areas; A handwriting display module, used for submitting the simulated handwriting data and the handwriting area for display based on a preset local refresh algorithm to obtain an electronic paper handwriting display result; Wherein, the handwriting generation module is also used for: Update the coordinate data according to the handwriting, draw on the mirror interface, and obtain the simulated handwriting data; Based on a preset local area calculation algorithm, the handwriting area is calculated according to the handwriting update coordinate data and the pre-acquired stroke size data; Wherein, after the step of updating the coordinate data according to the handwriting and obtaining the simulated handwriting data and the handwriting area through the pre-created mirror interface, the following steps are further included: Receive electronic paper interface update instructions; Based on a preset system display framework and the electronic paper interface update instruction, obtaining a non-handwritten area according to the electronic paper interface and the handwritten area; Based on the local refresh algorithm and according to the electronic paper interface update instruction, the non-handwritten area is refreshed.

7. A terminal device, characterized in that: The terminal device includes a memory, a processor, and an electronic paper handwriting display program stored in the memory and executable on the processor. When the electronic paper handwriting display program is executed by the processor, the steps of the electronic paper handwriting display method as described in any one of claims 1 to 5 are implemented.

8. A computer readable storage medium, characterized in that: The computer-readable storage medium stores an electronic paper handwriting display program, and when the electronic paper handwriting display program is executed by the processor, the steps of the electronic paper handwriting display method according to any one of claims 1 to 5 are implemented.

Images