Writing stroke processing method, apparatus, interactive device and storage medium

By separating the dynamic writing layer and the static element layer, the problem of handwriting backup during writing and erasing operations of interactive devices is solved, efficient handwriting processing is achieved, and user experience and device efficiency are improved.

WO2025213458A1PCT designated stage Publication Date: 2025-10-16GUANGZHOU SHIZHEN INFORMATION TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/087515
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-12
Publication Date
2025-10-16

AI Technical Summary

Technical Problem

When existing interactive devices are performing writing and erasing operations at the same time, the handwriting needs to be backed up to avoid accidentally erasing the content being written, which makes the processing operation complicated and resource redundant, affecting efficiency.

Method used

A dynamic writing layer is used to respond to writing operations, and a static element layer is used to respond to erasing operations. After the writing operation is completed, the handwriting is transferred to the static element layer for erasing, thereby avoiding backup handwriting processing.

Benefits of technology

It simplifies handwriting processing operations, reduces computing resource usage of interactive devices, and improves handwriting processing efficiency and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024087515_16102025_PF_FP_ABST
    Figure CN2024087515_16102025_PF_FP_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of interactive devices. Provided are a writing stroke processing method, an apparatus, an interactive device and a storage medium. The method comprises: displaying a writing application interface, the writing application interface being provided with a dynamic writing layer and a static element layer, and the dynamic writing layer being located above the static element layer; acquiring a touch event detected by a touch-sensitive display screen, and determining the operation type of a touch operation corresponding to the touch event, the term "operation type" comprising a writing operation and an erasing operation; when the touch operation is a writing operation, responding to the touch event by means of the dynamic writing layer, updating a first writing stroke corresponding to the touch operation in the dynamic writing layer, and, after the touch operation is finished, adding the first writing stroke to the static element layer and deleting the first writing stroke in the dynamic writing layer; and, when the touch operation is an erasing operation, responding to the touch event by means of the static element layer, and erasing a second writing stroke in the static element layer on the basis of an erasing area generated by the touch event.
Need to check novelty before this filing date? Find Prior Art

Description

A handwriting processing method and device, an interactive device, and a storage medium TECHNICAL FIELD

[0001] The present application relates to the technical field of interactive devices, and in particular to a handwriting processing method and device, an interactive device, and a storage medium. BACKGROUND

[0002] With the popularity of interactive devices, many interactive devices with touch functions provide writing functions. A whiteboard application is one of the applications that implement the writing function of an interactive device. When the interactive device starts the whiteboard application, a user can write on the screen by using a stylus or a finger, and the screen generates corresponding handwriting according to the sliding track of the stylus or the finger. The user can also erase on the screen by using the stylus or the finger, and the screen erases the corresponding handwriting according to the sliding track of the stylus or the finger.

[0003] In related technologies, in order to meet the requirement of writing and erasing at the same time, when the interactive device simultaneously receives a writing operation and an erasing operation, the handwriting generated by the writing operation is drawn on the background of the screen and a backup cache area, and the content in the backup cache area at a position corresponding to the erasing area generated by the erasing operation is used to replace the content of the erasing area in the screen, so as to avoid erasing the handwriting being written. This solution requires the interactive device to back up the handwriting, which leads to complex processing operations of the handwriting, redundant use of resources by the interactive device, and further affects the processing efficiency of the handwriting.

[0004] SUMMARY

[0005] The present application provides a handwriting processing method and device, an interactive device, and a storage medium, to respond to a writing operation through a dynamic writing layer and respond to an erasing operation through a static element layer, without backing up handwriting, so as to avoid erasing handwriting being written, solve the problem of backing up handwriting by the interactive device in related technologies, simplify the processing operations of the handwriting, reduce the computing resources used by the interactive device, and be beneficial to improving the processing efficiency of the handwriting.

[0006] In a first aspect, the present application provides a handwriting processing method applied to an interactive device, and the method comprises the following steps.

[0007] displaying a writing application interface of a writing application, the writing application interface being provided with a dynamic writing layer and a static element layer, the dynamic writing layer being located above the static element layer;

[0008] receiving a first moving operation in the writing application interface; and synchronously drawing first handwriting corresponding to the first moving operation in the dynamic writing layer when the first moving operation is received.

[0009] In the process of receiving the first movement operation, a second movement operation is received; the second movement operation covers a second stroke displayed in the static element layer, and the second movement operation partially overlaps the first stroke, and an area of a touch point of the second movement operation is greater than or equal to a preset area threshold;

[0010] According to the second movement operation, the second stroke displayed in the static element layer is erased;

[0011] After the first movement operation ends, the first stroke is added to the static element layer and the first stroke of the dynamic writing layer is deleted, and the writing application interface is updated.

[0012] Through the above technical means, the writing operation and the erasing operation are processed in isolation, and the problem that the interactive device needs to backup the stroke in the related art is solved, the processing operation of the stroke is simplified, the computing resources used by the interactive device are reduced, and the processing efficiency of the stroke is improved.

[0013] Optionally, the method further includes:

[0014] In the process of receiving the first movement operation, a third movement operation is received; an interval between a starting time of the third movement operation and a starting time of the first movement operation is greater than a preset first time threshold, and an area of a touch point of the third movement operation is less than a preset area threshold;

[0015] When the third movement operation is received, a third stroke corresponding to the third movement operation is synchronously drawn in the dynamic writing layer;

[0016] After the third movement operation ends, the third stroke is added to the static element layer and the third stroke in the dynamic writing layer is deleted.

[0017] Through the above technical means, the interval between the starting times of the multiple writing operations received at the same time is compared with the maximum time difference of the multiple fingers contacting the display screen in the multi-finger zooming movement, so that the multiple writing operations corresponding to the multi-person writing operation are accurately identified, and then the strokes corresponding to the multiple writing operations are correspondingly drawn in the dynamic writing layer, the accurate and rapid response to the multi-person writing operation is realized, the interactive experience is improved, and the interactive efficiency is ensured.

[0018] Optionally, the method further includes:

[0019] In the process of receiving the first moving operation, a fourth moving operation is received; a time interval between a starting time of the fourth moving operation and a starting time of the first moving operation is less than a preset first time threshold, a distance between a starting position of the fourth moving operation and a position of the first moving operation at the same time is less than a preset distance threshold, and an area of a touch point of the fourth moving operation is less than a preset area threshold;

[0020] clearing the first handwriting in the dynamic writing layer;

[0021] updating a display state of the second handwriting displayed by the static element layer according to a position change state of the touch point of the first moving operation and the fourth moving operation.

[0022] By the above technical means, the time interval and the distance between the starting positions of the multiple writing operations received at the same time are compared with the maximum time difference and the maximum distance of the multiple fingers contacting the display screen during the multiple finger zooming and moving operation respectively, so as to accurately identify that the multiple writing operations correspond to the multiple finger zooming and moving operation, and then zoom or move the second handwriting displayed in the static element layer, thereby realizing accurate and rapid response to the multiple finger zooming and moving operation, improving the interactive experience, and ensuring the interactive efficiency.

[0023] Optionally, the updating of the display state of the second handwriting displayed by the static element layer according to the position change state of the touch point of the first moving operation and the fourth moving operation comprises:

[0024] updating a display position or a display size of the second handwriting displayed by the static element layer according to the position change state of the touch point of the first moving operation and the fourth moving operation.

[0025] By the above technical means, the position change direction of the touch point of the first moving operation and the fourth moving operation can be accurately identified as the multiple finger moving operation or the multiple finger zooming operation, and then the display position of the second handwriting is accurately moved or the display size of the second handwriting is accurately zoomed according to the operation type and the position change amount, which is beneficial to improving the interactive experience.

[0026] Optionally, the method further comprises:

[0027] In the process of receiving the first moving operation, a multiple finger zooming and moving operation is received; a distance between a starting position of the multiple finger zooming and moving operation and a position of the first moving operation at the same time is greater than a preset distance threshold;

[0028] zooming or moving the second handwriting displayed in the static element layer by the static element layer in response to the multiple finger zooming and moving operation.

[0029] Through the above-mentioned technical means, while the dynamic writing layer responds to writing operations, the static element layer can respond to multi-finger zooming and moving operations, avoiding multi-finger zooming and moving operations affecting the display of handwriting being written, realizing the function of moving or zooming while writing in the whiteboard application, enriching the interactive function of the whiteboard application, and helping to improve the interactive experience.

[0030] Optionally, after the first movement operation is completed, adding the first handwriting to the static element layer and deleting the first handwriting from the dynamic writing layer includes:

[0031] After the first movement operation is completed, obtaining the parameters of the second handwriting scaling or movement;

[0032] According to the parameters, the first handwriting is adjusted and then added to the static element layer, and the first handwriting in the dynamic writing layer is deleted.

[0033] Through the above technical means, the static element layer can adjust the display size or display position of the first handwriting to be added based on the scaling ratio or movement distance of the second handwriting to ensure the unified display of the first handwriting and the second handwriting in the static element layer, which is conducive to improving the interactive experience.

[0034] Optionally, the writing application interface is further provided with a background layer, the background layer is located below the static element layer, and the background layer is used to display a background image.

[0035] Through the above-mentioned technical means, a background image can be set in the background layer, so that when the static element layer responds to the erasing operation, the corresponding second handwriting or non-handwriting element can be processed based on the erasing operation, without the need for background stripping processing, which simplifies the complexity of the erasing operation and improves the response speed of the erasing operation.

[0036] In a second aspect, the present application provides a handwriting processing method, applied to an interactive device, the method comprising:

[0037] Displaying a writing application interface of a writing application, wherein the writing application interface is provided with a dynamic writing layer and a static element layer, wherein the dynamic writing layer is located above the static element layer;

[0038] receiving at least one touch event detected by the touch-sensitive display screen, and determining an operation type of a touch operation corresponding to the touch event, the operation type including a writing operation and an erasing operation;

[0039] In a case that the touch operation is a writing operation, the dynamic writing layer is used to update the handwriting corresponding to the writing operation in response to the touch event, and the handwriting corresponding to the writing operation is added to the static element layer and deleted from the dynamic writing layer after the writing operation is completed.

[0040] In a case that the touch operation is an erasing operation, the static element layer is used to erase the second handwriting in the static element layer according to an erasing area generated by the touch event.

[0041] By using the above technical means, the writing operation and the erasing operation are processed separately, the handwriting being written can be prevented from being erased without backing up the handwriting, the problem that the interactive device needs to back up the handwriting in the related art is solved, the processing operation of the handwriting is simplified, the computing resources used by the interactive device are reduced, and the processing efficiency of the handwriting is improved.

[0042] Optionally, the method further includes:

[0043] In a case that the touch operations corresponding to the multiple touch events are writing operations, if the interval between the starting time of each writing operation is greater than a preset first time threshold, the dynamic writing layer is used to update the handwriting corresponding to the writing operation in response to the multiple touch events.

[0044] Optionally, the method further includes:

[0045] In a case that the touch operations corresponding to the multiple touch events are writing operations, if the interval between the starting time of two writing operations is less than a preset first time threshold, and the distance between the starting position of one writing operation and the position of the other writing operation at the same time is less than a preset distance threshold, it is determined that the two writing operations trigger a multi-finger zoom operation or a multi-finger moving operation.

[0046] The dynamic writing layer is used to clear the handwriting corresponding to the two writing operations displayed in the dynamic writing layer.

[0047] The static element layer is used to scale or move the second handwriting displayed in the static element layer in response to the touch event corresponding to the multi-finger zoom operation or the multi-finger moving operation.

[0048] Optionally, the receiving of the at least one touch event detected by the touch-sensitive display screen and the determination of the operation type of the touch operation corresponding to the touch event include:

[0049] The dynamic writing layer is used to receive the touch event and determine the operation type of the touch operation corresponding to the touch event.

[0050] Through the technical means, the dynamic writing layer can directly receive the touch event transmitted by the touch-sensitive display screen, and determine the operation type of the touch operation of the touch event, thereby improving the response speed of the touch event and realizing low latency of writing or erasing.

[0051] Optionally, the touch event corresponding to the touch operation includes a touch start event, a touch movement event and a touch end event, and the touch identifiers of the touch start event, the touch movement event and the touch end event in the same touch operation are the same;

[0052] Correspondingly, the operation type of the touch operation corresponding to the touch event is determined, including:

[0053] In the case of obtaining the touch start event, the operation type of the corresponding touch operation is determined according to the touch information of the touch start event, and the touch identifier of the touch start event is saved as the operation identifier of the corresponding writing operation or erasing operation;

[0054] In the case of obtaining the touch movement event or the touch end event, the touch identifier of the touch movement event or the touch end event is compared with the saved operation identifier, and the operation type of the touch operation corresponding to the touch movement event or the touch end event is determined.

[0055] Through the technical means, the touch identifier of the touch start event can be saved as the operation identifier of the corresponding writing operation or erasing operation, so that the touch movement event and the touch end event corresponding to the writing operation or the erasing operation can be quickly determined by the touch identifier of the touch movement event and the touch end event and the currently saved operation identifier, which is beneficial to improve the response speed of the touch event.

[0056] Optionally, the operation type of the touch operation corresponding to the touch event is determined according to the touch information of the touch start event, including:

[0057] The touch area of the touch start event is compared with a preset area threshold, and the operation type of the touch operation corresponding to the touch start event is determined according to the comparison result.

[0058] Through the technical means, the operation type of the touch operation corresponding to the touch start event can be quickly determined based on the touch area of the touch start event, and the recognition of the touch object can also be realized without installing the elastic wave module on the touch-sensitive display screen, which is beneficial to reduce the implementation cost of the interactive device.

[0059] Optionally, the erasing operation is triggered by a palm, and the preset area threshold is the minimum area of the palm.

[0060] Correspondingly, the operation type of the touch operation corresponding to the touch event is determined according to the comparison result, including:

[0061] In a case that the touch area is greater than or equal to a preset area threshold, the touch operation corresponding to the touch starting event is determined as an erasing operation.

[0062] In a case that the touch area is less than the preset area threshold, the touch operation corresponding to the touch starting event is determined as a writing operation.

[0063] Optionally, the updating the handwriting corresponding to the writing operation in the dynamic writing layer comprises:

[0064] In a case that the touch starting event is acquired, a first handwriting point is drawn in the dynamic writing layer according to the touch coordinates of the touch starting event;

[0065] In a case that the touch moving event is acquired, a second handwriting point is drawn in the dynamic writing layer according to the touch coordinates of the touch moving event, and the second handwriting point and a handwriting point corresponding to a previous touch event are connected to form a handwriting segment according to the touch identifier of the touch moving event;

[0066] In a case that the touch ending event is acquired, a third handwriting point is drawn in the dynamic writing layer according to the touch coordinates of the touch ending event, and the third handwriting point and the second handwriting point corresponding to a previous touch moving event are connected to form handwriting corresponding to the writing operation according to the touch identifier of the touch ending event.

[0067] Through the above technical means, the handwriting point drawn by the touch event can be connected with the handwriting point drawn by the previous touch event according to the touch identifier of the touch event, so as to ensure the accuracy of the handwriting when multiple writing operations are triggered at the same time.

[0068] Optionally, the adding the handwriting of the writing operation to the static element layer and deleting the corresponding handwriting in the dynamic writing layer after the writing operation is ended comprises:

[0069] After the third handwriting point and the corresponding second handwriting point are connected to form handwriting corresponding to the writing operation, the handwriting of the writing operation is added to the static element layer and the corresponding handwriting in the dynamic writing layer is deleted through the dynamic writing layer.

[0070] Through the above technical means, the timing of the end of the touch operation can be accurately judged based on the connection action of the third handwriting point and the corresponding second handwriting point, and the first handwriting finally generated by the touch operation is added to the static element layer in time, so as to avoid that the user needs to wait for a certain time before the handwriting of the completed writing can be erased from the writing application interface, which is beneficial to improve the user experience.

[0071] Optionally, in the case that the touch operation is an erasing operation, the static element layer responds to the touch event, and erases a second handwriting in the static element layer according to an erasing area generated by the touch event, including:

[0072] In the case that the dynamic writing layer determines that the touch operation is an erasing operation, the dynamic writing layer transmits the touch event to the static element layer;

[0073] The static element layer receives and responds to the touch event, determines an erasing area according to touch coordinates of the touch event, and erases a second handwriting in the static element layer according to the erasing area.

[0074] By the above technical means, the dynamic writing layer transmits the touch event corresponding to the erasing operation to the static element layer, the static element layer responds to the touch event of the erasing operation, the processing of the erasing operation and the writing operation is isolated, and the response speed of the touch event is improved.

[0075] Optionally, the determination of the erasing area according to the touch coordinates of the touch event includes:

[0076] According to the touch identifier of the touch event, a previous touch event corresponding to the touch operation is determined;

[0077] According to the touch coordinates of the touch event and the touch coordinates of the previous touch event, an erasing endpoint is determined, and an erasing area is determined according to the erasing endpoint.

[0078] By the above technical means, the erasing area corresponding to the touch event can be accurately generated based on the touch identifier of the touch event, and the accuracy of erasing handwriting when multiple erasing operations are triggered at the same time is ensured.

[0079] Optionally, the erasing of the second handwriting in the static element layer according to the erasing area generated by the touch event includes:

[0080] If the second handwriting is located in the erasing area, the second handwriting is deleted from the static element layer;

[0081] If a first line segment of the second handwriting is located in the erasing area, the first line segment is deleted from the static element layer, a remaining handwriting segment is saved as a new second handwriting in the static element layer, and the original second handwriting is deleted.

[0082] Optionally, after the static element layer responds to the touch event, the method further includes:

[0083] If a non-stroke element in the static element layer is located in the erasing area, the non-stroke element is deleted from the static element layer.

[0084] Through the above technical means, the static element layer can perform erasing processing on the non-stroke element, thereby enriching the erasing function of the whiteboard application.

[0085] Through the above technical means, the background is set in the background layer, so that the static element layer can process the corresponding second stroke or non-stroke element based on the erasing operation when responding to the erasing operation, without the need for background stripping processing, thereby simplifying the complexity of the erasing operation and improving the response speed of the erasing operation.

[0086] In a third aspect, the present application provides a stroke processing device applied to an interactive device, the device comprising:

[0087] A first interface display module is configured to display a writing application interface of a writing application, the writing application interface being provided with a dynamic writing layer and a static element layer, the dynamic writing layer being located above the static element layer;

[0088] A first stroke drawing module is configured to receive a first movement operation in the writing application interface; when the first movement operation is received, a first stroke corresponding to the first movement operation is synchronously drawn in the dynamic writing layer;

[0089] A first operation receiving module is configured to receive a second movement operation in the process of receiving the first movement operation; the second movement operation covers a second stroke displayed in the static element layer, and the second movement operation partially overlaps the first stroke, and an area of a touch point of the second movement operation is greater than or equal to a preset area threshold;

[0090] A first stroke erasing module is configured to erase the second stroke displayed in the static element layer according to the second movement operation;

[0091] A first interface updating module is configured to add the first stroke to the static element layer and delete the first stroke of the dynamic writing layer after the first movement operation ends, and update the writing application interface.

[0092] In a fourth aspect, the present application provides a stroke processing device applied to an interactive device, the device comprising:

[0093] A second interface display module is configured to display a writing application interface of a writing application, the writing application interface being provided with a dynamic writing layer and a static element layer, the dynamic writing layer being located above the static element layer;

[0094] The operation type judging module is configured to receive at least one touch event detected by the touch-sensitive display, determine an operation type of a touch operation corresponding to the touch event, the operation type including a writing operation and an erasing operation.

[0095] The second handwriting drawing module is configured to, in a case where the touch operation is a writing operation, update handwriting corresponding to the writing operation in the dynamic writing layer by responding to the touch event through the dynamic writing layer, and add the handwriting of the writing operation to the static element layer and delete the corresponding handwriting in the dynamic writing layer after the writing operation ends.

[0096] The second handwriting erasing module is configured to, in a case where the touch operation is an erasing operation, erase second handwriting in the static element layer according to an erasing area generated by the touch event by responding to the touch event through the static element layer.

[0097] In a fifth aspect, the present application provides an interactive device, comprising:

[0098] one or more processors; a memory storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the handwriting processing method according to the first aspect.

[0099] In a sixth aspect, the present application provides a storage medium containing computer executable instructions, when the computer executable instructions are executed by a computer processor, the computer executable instructions are used to execute the handwriting processing method according to the first aspect.

[0100] In the present application, the touch event with the operation type of writing operation is responded through the dynamic writing layer to draw handwriting generated by the corresponding writing operation on the dynamic writing layer, and the touch event with the operation type of erasing operation is responded through the static element layer to erase second handwriting on the static element layer, so that the handwriting being written is avoided from being erased. The corresponding handwriting is transferred to the static element layer after the writing operation ends, so that the handwriting can be erased by the subsequent erasing operation. Through the above technical means, the processing isolation of the input writing operation and the erasing operation is realized, the handwriting being written is avoided from being erased without backing up the handwriting, the problem that the interactive device needs to back up the handwriting in the related art is solved, the handwriting processing operation is simplified, the computing resources used by the interactive device are reduced, and the handwriting processing efficiency is improved. BRIEF DESCRIPTION OF DRAWINGS

[0101] FIG. 1 is a flowchart of a handwriting processing method provided by an embodiment of the present application;

[0102] FIG. 2 is a hierarchical diagram of a dynamic writing layer and a static element layer provided by an embodiment of the present application;

[0103] FIG. 3 is a schematic diagram of a writing application interface according to an embodiment of the present application;

[0104] FIG. 4 is a flowchart of another handwriting processing method according to an embodiment of the present application;

[0105] FIG. 5 is a schematic diagram of a dynamic writing layer according to an embodiment of the present application;

[0106] FIG. 6 is another schematic diagram of a dynamic writing layer according to an embodiment of the present application;

[0107] FIG. 7 is a schematic diagram of a dynamic writing layer according to an embodiment of the present application;

[0108] FIG. 8 is a schematic diagram of a dynamic writing layer according to an embodiment of the present application;

[0109] FIG. 9 is a schematic diagram of a dynamic writing layer according to an embodiment of the present application;

[0110] FIG. 10 is a schematic diagram of a static element layer according to an embodiment of the present application;

[0111] FIG. 11 is a schematic diagram of a dynamic writing layer according to an embodiment of the present application;

[0112] FIG. 12 is a schematic diagram of a static element layer according to an embodiment of the present application;

[0113] FIG. 13 is a schematic diagram of a static element layer according to an embodiment of the present application;

[0114] FIG. 14 is a schematic diagram of a static element layer according to an embodiment of the present application;

[0115] FIG. 15 is a schematic diagram of a static element layer according to an embodiment of the present application;

[0116] FIG. 16 is a schematic diagram of a handwriting processing apparatus according to an embodiment of the present application;

[0117] FIG. 17 is a schematic diagram of another handwriting processing apparatus according to an embodiment of the present application;

[0118] FIG. 18 is a schematic diagram of an interactive device according to an embodiment of the present application. DETAILED DESCRIPTION

[0119] In order to make the purposes, technical solutions and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the drawings. It can be understood that the specific embodiments described here are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, only the parts related to the present application are shown in the drawings, but not all the contents. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the operations (or steps) as sequential processes, many of the operations can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when the operations are completed, but can also have additional steps not included in the drawings. The process can correspond to a method, function, procedure, subroutine, etc.

[0120] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be exchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally a class, not limited to the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification and claims indicates at least one of the connected objects, and the character " / ", generally indicates that the front and rear associated objects are in an "or" relationship.

[0121] In a teaching, a conference or the like scene, a user can use a whiteboard application installed on an interactive device to make a board book or write, so as to deepen the understanding of the audience on the teaching content or the conference content. In actual application, there may be a need to erase the writing due to writing errors or insufficient space, and even in some special scenarios, there is a need to write and erase at the same time. For example, in a classroom interactive teaching, student A and student B are writing answers at the same time through the whiteboard application of the interactive device, student A is writing, and student B is erasing the content written by himself due to writing errors. In the previous scheme, the whiteboard application cannot support the functions of writing and erasing at the same time. In order to solve this problem, the related technology realizes the effect of writing and erasing at the same time by combining gesture erasing. However, in the scene of writing and erasing at the same time, when the writing areas of the two students are relatively close, student B may mistakenly erase the content being written by student A, resulting in that student A needs to write on the whiteboard application again, and the use experience is poor. For example, in order to meet the need of writing and erasing at the same time, the interactive device can confirm the writing to be displayed through the overlapping area of the writing track generated by the writing operation and the erasing track generated by the erasing operation, but this way involves a complex calculation process, and the processing efficiency is low, and even the content being written may be mistakenly erased. In order to solve the foregoing problem, another existing implementation scheme is to backup the first background picture actually displayed on the screen to a backup cache area, and when the writing operation and the erasing operation are detected, the writing track generated by the writing operation is drawn on the first background picture and at the corresponding position of the second background picture of the backup cache area at the same time, that is, the writing track generated by the writing operation is backed up to the backup cache area. After the erasing area in the first background picture is erased based on the erasing operation, the content at the corresponding position of the second background picture is used to replace the content of the erasing area in the first background picture, so as to restore the writing being written and part of the background erased by the erasing operation in the first background picture, and realize the erasing effect while avoiding erasing the writing being written. However, this implementation method not only needs to backup the writing, but also needs to backup the background picture of the screen, so as to realize the restoration of the writing and the background picture, although the writing being written is avoided from being mistakenly erased, the processing operation is complex and redundant resources are used, and the processing efficiency is low.

[0122] To solve the above problems, the embodiment provides a writing processing method, which responds to a writing operation through a dynamic writing layer and responds to an erasing operation through a static element layer, without backing up the writing and avoiding erasing the writing being written, simplifying the processing operation of the writing, reducing the calculation resources used by the interactive device, and being beneficial to improving the processing efficiency of the writing.

[0123] In addition, in the case that multiple touch operations are input, the multiple touch operations are determined to correspond to multi-person writing or multi-finger zooming and moving based on the starting time and touch position corresponding to the multiple touch operations, and the handwriting of the dynamic writing layer or the handwriting of the static element layer is added or adjusted, so that the multi-person writing or multi-finger zooming and moving can be automatically and accurately realized according to any multi-point touch operation input by the user without manually setting the function enabled by the multi-point moving operation to eliminate the interaction conflict, and the setting of the function enabled state when the multi-point moving operation is used to realize different interaction targets is cancelled, the interaction experience is improved, and the interaction efficiency is ensured.

[0124] The handwriting processing method provided in the embodiment can be executed by a handwriting processing device. The handwriting processing device can be implemented in software and / or hardware, and can be composed of two or more physical entities or one physical entity. In the embodiment, the handwriting processing device has a touch function and supports multiple touch objects to simultaneously input touch operations on a display screen. For example, the handwriting processing device can be an interactive device, a smart digital device such as a digitizer, or a device with a touch function such as a smart phone, a smart learning machine, a tablet computer, a notebook computer, etc. The interactive device is an integrated device that controls and realizes human-computer interaction operation on the content displayed on the display panel through touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound, a television and a video conference terminal, etc.

[0125] The handwriting processing device is installed with at least one type of operating system, wherein the operating system includes but is not limited to an Android system, a Linux system and a Windows system. The handwriting processing device can install at least one application based on the operating system, and the application can be an application provided by the operating system or an application downloaded from a third-party device or server. In this embodiment, the handwriting processing device has at least one application that can execute the handwriting processing method, for example, when the handwriting processing device is an interactive device, the application can be a whiteboard application installed in the interactive device. The whiteboard application is an application for user writing, multimedia display and interaction, etc. The whiteboard application can present a writing interface during use, and the writing interface can generate writing traces according to the writing operation input by the user on the writing interface, and can also insert multimedia elements such as graphics, pictures and tables on the writing interface according to various touch operations of the user. In the writing interface, the user can realize similar writing, drawing, erasing and other operations as the physical whiteboard, and further has better digital functions such as moving, saving, zooming, inserting pictures, color adjusting and stroke thickness setting. In actual application, the whiteboard application can also be named as a whiteboard writing application, a writing application, an electronic whiteboard application, a collaborative whiteboard application, etc. Regardless of the name, as long as the application is used to realize the above functions, it is equivalent to the whiteboard application of the present application. It should be noted that the whiteboard application is only one application example provided in this embodiment, and should not be understood as the technical solution provided in this embodiment can only be applied to the scenario of the whiteboard application. For example, the technical solution provided in this embodiment can also be applied to a drawing application or other applications that can provide writing functions for users.

[0126] For ease of understanding, the interactive device is taken as an example to describe the handwriting processing method provided in this embodiment.

[0127] FIG. 1 shows a flowchart of a handwriting processing method provided in this embodiment. Referring to FIG. 1, the handwriting processing method specifically includes the following steps.

[0128] S110, a writing application interface of a writing application is displayed, and the writing application interface is provided with a dynamic writing layer and a static element layer, and the dynamic writing layer is located on the upper layer of the static element layer.

[0129] The writing application is an application for user to perform writing, multimedia presentation and interaction, etc. operations, such as the whiteboard application described in the above embodiments. The writing application interface is an interface of the writing application for displaying writing traces. The embodiments are described by taking the writing application as the whiteboard application. The interaction device can display the writing application interface in the display screen after starting the whiteboard application. The writing application interface can display writing traces and other non-trace elements such as pictures, texts, tables or background pictures, etc. In addition to the writing traces being written in the dynamic writing layer, the rest of the elements including the writing traces that have been written are displayed in the static element layer. The dynamic writing layer can be understood as a transparent layer. The area of the dynamic writing layer except the writing traces is transparent. From the visual level, when the user looks at the writing application interface, the writing traces in the dynamic writing layer and the area in the static element layer that is not covered by the writing traces in the dynamic writing layer can be seen, that is, the background, writing traces and non-trace elements displayed in the writing application interface can be seen. Therefore, the setting of the dynamic writing layer and the static element layer does not affect the display effect of the writing application interface on the writing traces. In order to more intuitively understand the display effect of the writing application interface, the embodiments are described by taking the hierarchical diagram of the dynamic writing layer and the static element layer shown in FIG. 2 and the schematic diagram of the writing application interface shown in FIG. 3 as examples. As shown in FIG. 2, the first writing trace 111 is displayed in the dynamic writing layer 11, and the second writing trace 121 is displayed in the static element layer 12. The static element layer 12 is located below the dynamic writing layer 11. As shown in FIG. 3, since the first writing trace 111 and the second writing trace 121 have no overlapping part, the first writing trace 111 and the second writing trace 121 are displayed on the writing application interface 10 at the same time. In the embodiments, the written writing traces and the writing traces in writing are displayed in the static element layer and the dynamic writing layer respectively. When the writing traces are erased, only the written writing traces in the static element layer can be erased, and the writing traces in the dynamic writing layer are not erased. In addition, the writing traces in writing do not need to be backed up, which simplifies the processing operation of the writing traces and the computing resources used.

[0130] It should be noted that the background picture belongs to a kind of non-handwriting elements, when the static element layer displays the background picture and other types of non-handwriting elements, if the static element layer supports erasing the non-handwriting elements, it can be determined whether the current erased non-handwriting element is the background picture, and the non-handwriting element is erased in the case of not being the background picture, so as to avoid erasing part of the area of the background picture and ensure the integrity of the background picture. In the embodiment, the background picture is stripped from the non-handwriting elements that can be erased in the static element layer, and then the static element layer is erased, so that part of the area of the background picture can be avoided from being erased without backing up the background picture, and the storage resources of the interactive device are saved. In an embodiment, since the background picture is stripped every time the static element layer is erased, and then the remaining non-handwriting elements are erased, the operation is relatively complex. Therefore, the background layer can also be set in the writing application interface, and the background layer is located below the static element layer. The background layer is used to display the background picture. The static element layer can also be regarded as a transparent layer, and the area of the static element layer except the handwriting and non-handwriting elements is a transparent area. From the visual level, when the user looks at the writing application interface, the handwriting in the dynamic writing layer, the handwriting and non-handwriting elements in the static element layer, and the background picture in the background layer can be seen. The static element layer is not provided with the background picture, so when the static element layer is erased, the handwriting or non-handwriting elements displayed in the static element layer can be directly erased, without the need for background picture stripping processing, which simplifies the complexity of the erasing processing and improves the erasing processing efficiency. Moreover, the background picture in the background layer is always displayed at the bottom of the dynamic writing layer and the static element layer, and erasing and writing will not affect the integrity of the background picture, so the whiteboard application does not need to back up the background picture, and does not need to consider the combination of the handwriting and the background picture, which simplifies the logic of handwriting processing, saves the storage resources of the interactive device, and is beneficial to improve the handwriting processing efficiency.

[0131] S120, receiving a first moving operation in the writing application interface; when the first moving operation is received, synchronously drawing first handwriting corresponding to the first moving operation in the dynamic writing layer.

[0132] The first movement operation is a first writing operation received by the whiteboard application without receiving any touch operation, and the writing operation is a touch operation received by the whiteboard application when a user writes on the writing application interface. The whiteboard application can determine whether the currently received touch operation is a writing operation according to the area of the touch point of the touch operation. For example, the whiteboard application sets that a finger can erase the handwriting in the writing application interface, and a stylus can write handwriting in the writing application interface, and the contact area of the finger is larger than that of the stylus. Therefore, the maximum contact area of the finger can be preset as a preset area threshold, and in a case where the area of the touch point of the touch operation is less than the preset area threshold, it is determined that the touch operation is a writing operation. Alternatively, the whiteboard application sets that a palm can erase the handwriting in the writing application interface, and a finger can write handwriting in the writing application interface, and the contact area of the palm is larger than that of the finger. The maximum contact area of the palm can be preset as a preset area threshold, and in a case where the area of the touch point of the touch operation is less than the preset area threshold, it is determined that the touch operation is a writing operation.

[0133] If only the writing operation is received at the current time, it is determined that the writing operation is the first movement operation. When it is determined that the first movement operation is received, the whiteboard application transmits the first movement operation to the dynamic writing layer, and the dynamic writing layer responds to the first movement operation to draw a first handwriting corresponding to the first movement operation in the dynamic writing layer according to the position of the touch point of the first movement operation in the writing application interface.

[0134] S130, in the process of receiving the first movement operation, a second movement operation is received; the second movement operation covers the second handwriting displayed in the static element layer, and the second movement operation partially overlaps the first handwriting, and the area of the touch point of the second movement operation is greater than or equal to the preset area threshold.

[0135] The second movement operation is an erasing operation that covers the second handwriting displayed in the static element layer and partially overlaps the first handwriting generated by the first movement operation, and the erasing operation is a touch operation received by the whiteboard application when a user inputs to erase the handwriting displayed in the writing application interface. For example, when the whiteboard application receives the first movement operation and then receives another touch operation, the whiteboard application can compare the area of the touch point of the touch operation with the preset area threshold, and in a case where the area of the touch point of the touch operation is greater than the preset area threshold, it is determined that the touch operation is an erasing operation. If the position of the touch point of the erasing operation overlaps the positions of the second handwriting and the first handwriting, it is determined that the erasing operation is the second movement operation. If the position of the touch point of the erasing operation does not overlap the position of the second handwriting, it is determined that the erasing operation will not erase any handwriting, and the erasing operation can be ignored. In addition, the static element layer can also carry elements such as graphics, pictures, and tables, and if the erasing operation overlaps the elements such as graphics, pictures, and tables, the elements can be erased.

[0136] S140, erasing the second handwriting displayed in the static element layer according to the second moving operation.

[0137] For example, after confirming that the erasing operation is the second moving operation, the whiteboard application transmits the second moving operation to the static element layer, and the static element layer responds to the second moving operation to erase the second handwriting displayed at the corresponding position in the static element layer according to the position of the touch point of the second moving operation.

[0138] It can be understood that although the erasing track generated by the second moving operation partially overlaps the first handwriting generated by the first moving operation, the first handwriting is drawn on the dynamic writing layer, and when the static element layer responds to the second moving operation, only the second handwriting drawn at the corresponding position will be erased based on the erasing track, and the first handwriting being written will not be erased, avoiding the handwriting being written on the dynamic writing layer from being erased, and without the need to backup the handwriting being written, simplifying the processing operation of the handwriting and the computing resources used.

[0139] S150, adding the first handwriting to the static element layer and deleting the first handwriting of the dynamic writing layer after the first moving operation ends, and updating the writing application interface.

[0140] For example, after the first moving operation ends, the first handwriting finally generated by the first moving operation can be added to the corresponding position in the static element layer according to the pixel coordinates of the first handwriting in the dynamic writing layer, so that the user can erase the first handwriting in the static element layer through the erasing operation, ensuring the normal use of the erasing function of the whiteboard application. After the first handwriting is added to the static element layer, the first handwriting of the dynamic writing layer can be deleted, saving the storage resources of the dynamic writing layer. Since the pixel coordinates of the first handwriting do not change when the first handwriting is transferred from the dynamic writing layer to the static element layer, the user will not perceive the change of the display layer of the first handwriting when watching the writing application interface, ensuring the viewing experience of the user. After the first handwriting is transferred to the static element layer, the writing application interface is re-rendered according to the handwriting drawn on the static element layer and the dynamic element layer to update the display content of the writing application interface.

[0141] In addition to providing the function of writing while erasing, the whiteboard application also provides the functions of multi-person writing and multi-finger zooming and moving, wherein the multi-person writing can support multiple users to write traces in the writing application interface at the same time, and the multi-finger zooming and moving can support a user to zoom or move the traces in the writing application interface using multiple fingers. In the case that the writing operation is triggered by a finger and the erasing operation is triggered by a palm, the multi-person writing or the multi-finger zooming and moving will cause the whiteboard application to simultaneously receive multiple writing operations. Fine judgment can be made based on the starting time and the touch position corresponding to the multiple writing operations to determine that the multiple writing operations correspond to triggering the multi-person writing operation or the multi-finger zooming and moving operation, and to correspondingly add the traces of the dynamic writing layer or adjust the traces of the static element layer.

[0142] In this embodiment, the implementation process of determining that the multiple writing operations correspond to triggering the multi-person writing operation is that: in the process of receiving the first moving operation, the third moving operation is received; the interval between the starting time of the third moving operation and the starting time of the first moving operation is greater than the preset first time threshold, and the area of the touch point of the third moving operation is less than the preset area threshold; when the third moving operation is received, the third handwriting corresponding to the third moving operation is synchronously drawn in the dynamic writing layer; after the third moving operation ends, the third handwriting is added to the static element layer and the third handwriting in the dynamic writing layer is deleted. The third moving operation is other writing operation in the multiple writing operations triggering the multi-person writing operation except the first moving operation. The first time threshold is the maximum time difference when multiple fingers just touch the display screen during multi-finger zooming movement, and the preset area threshold is the minimum area of the palm. For example, after the whiteboard application receives the first moving operation, another touch operation is received. The whiteboard application compares the area of the touch point of the touch operation with the preset area threshold. If the touch operation is less than the preset area threshold, it is determined that the touch operation is a writing operation. The whiteboard application obtains the starting time of the first moving operation and the writing operation, calculates the interval between the starting times of the two operations, and if the interval is greater than the first time threshold, it indicates that the first moving operation and the writing operation are not input during multi-finger zooming movement, but are input during multi-person writing, and then it is determined that the writing operation is the third moving operation. After the whiteboard application determines that the currently received writing operation is the third moving operation, the third moving operation is transmitted to the dynamic writing operation, and the dynamic writing layer responds to the third moving operation to draw the third handwriting at the corresponding position of the dynamic writing layer according to the position of the touch point of the third moving operation. After the third moving operation ends, the third handwriting finally generated by the third moving operation is added to the corresponding position in the static element layer according to the pixel coordinates of the third handwriting in the dynamic writing layer, so that the third handwriting in the static element layer can be erased by a subsequent user through an erasing operation, ensuring the normal use of the erasing function of the whiteboard application. After the third handwriting is added to the static element layer, the third handwriting of the dynamic writing layer can be deleted, saving the storage resources of the dynamic writing layer. In this embodiment, the interval between the starting times of the multiple writing operations received at the same time is compared with the maximum time difference when multiple fingers touch the display screen during multi-finger zooming movement, to accurately identify that the multiple writing operations correspond to triggering the multi-person writing operation, and then the handwriting corresponding to each writing operation is drawn in the dynamic writing layer, achieving accurate and rapid response to the multi-person writing operation, improving the interaction experience and ensuring the interaction efficiency.

[0143] In this embodiment, the implementation process of determining that the multiple writing operations correspond to triggering the multi-finger movement zoom operation is as follows: in the process of receiving the first movement operation, the fourth movement operation is received; the interval between the starting time of the fourth movement operation and the starting time of the first movement operation is less than the preset first time threshold, the distance between the starting position of the fourth movement operation and the position of the first movement operation at the same time is less than the preset distance threshold, and the area of the touch point of the fourth movement operation is less than the preset area threshold; the first trace in the dynamic writing layer is cleared; and the display state of the second trace displayed by the static element layer is updated according to the position change state of the touch points of the first movement operation and the fourth movement operation. The fourth movement operation is the other writing operation in the multiple writing operations that trigger the multi-finger movement zoom operation, except for the first movement operation. The preset distance threshold is the maximum distance when the multi-finger just contacts the display screen during multi-finger zoom movement. It can be understood that when a user uses multi-finger zoom or movement to write a trace in the application interface, the multiple fingers almost contact the display screen at the same time, and the distance between the multiple fingers will not exceed the distance when the fingers are spread. Therefore, in this embodiment, the starting time and the touch position of the writing operations received at the same time are used to determine whether the multiple writing operations correspond to triggering the multi-user writing operation or the multi-finger zoom movement operation. For example, after the whiteboard application receives the first movement operation, another touch operation is received. The whiteboard application compares the area of the touch point of the touch operation with the preset area threshold. If the touch operation is less than the preset area threshold, it is determined that the touch operation is a writing operation. The whiteboard application obtains the starting time of the first movement operation and the writing operation, calculates the interval between the starting times of the two operations, and obtains the starting position of the writing operation at the starting time and the touch point position of the first movement operation at the same time, and calculates the distance between the starting position and the touch point position. If the interval is less than the first time threshold and the distance is less than the preset distance threshold, it indicates that the writing operation and the first movement operation are input during multi-finger zoom movement, and it is further determined that the writing operation is the fourth movement operation. After the whiteboard application determines that the currently received writing operation is the fourth movement operation, it is known that the first movement operation and the fourth movement operation correspond to triggering the multi-finger zoom movement operation, and the first trace generated by the first movement operation in the dynamic writing layer is cleared to avoid false response. The first movement operation and the fourth movement operation are transmitted to the static element layer, and the static element layer responds to the first movement operation and the fourth movement operation to update the display state of the second trace displayed in the static element layer according to the position change state of the touch points of the first movement operation and the fourth movement operation. In this embodiment, the interval between the starting times of the multiple writing operations received at the same time and the distance between the starting positions are compared with the maximum time difference and the maximum distance when the multi-finger contacts the display screen during multi-finger zoom movement, respectively, to accurately identify that the multiple writing operations correspond to triggering the multi-finger movement zoom operation, and then to zoom or move the second trace displayed in the static element layer, thereby realizing accurate and rapid response to the multi-finger movement zoom operation, improving the interactive experience, and ensuring the interactive efficiency.

[0144] The static element layer can update the display position or display size of the second trace displayed by the static element layer according to the position change state of the touch point of the first moving operation and the fourth moving operation when responding to the first moving operation and the fourth moving operation. For example, the static element layer can determine whether the position of the touch point of the first moving operation and the fourth moving operation changes in the same direction or in the opposite direction according to the position of the touch point of the first moving operation and the fourth moving operation. When the position of the touch point changes in the same direction, it can be determined that the first moving operation and the fourth moving operation correspond to triggering a multi-finger moving operation, and then the moving distance of the second trace is determined according to the position change amount of the touch point of the first moving operation and the fourth moving operation, and the display position of the second trace is updated based on the moving distance. When the position of the touch point changes in the opposite direction, it can be determined that the first moving operation and the fourth moving operation correspond to triggering a multi-finger zooming operation, and then the zooming ratio of the second trace is determined according to the position change amount of the touch point of the first moving operation and the fourth moving operation, and the display size of the second trace is updated based on the zooming ratio. The multi-finger moving operation is a touch operation of moving the trace in the writing application interface by multi-finger, and the multi-finger zooming operation is a touch operation of zooming the trace in the writing application interface by multi-finger. In this embodiment, the position change direction of the touch point of the first moving operation and the fourth moving operation is used to accurately identify the touch operation input by the user as a multi-finger moving operation or a multi-finger zooming operation, and then the display position of the second trace is accurately moved or the display size of the second trace is accurately zoomed according to the operation type and the position change amount, which is beneficial to improving the interaction experience.

[0145] In an embodiment, since the writing operation is responded by the dynamic writing layer and the multi-finger scaling movement operation is responded by the static element layer, i.e. the static element layer does not affect the writing trace in the dynamic writing layer in response to the multi-finger scaling movement operation, the whiteboard application can realize the function of scaling or moving while writing. In this embodiment, the implementation process of the whiteboard application of scaling or moving the writing trace while writing is as follows: in the process of receiving the first movement operation, the multi-finger scaling operation or the multi-finger movement operation is received; the distance between the starting position of the multi-finger scaling operation or the multi-finger movement operation and the position of the first movement operation at the same time is greater than the preset distance threshold; the second writing trace displayed in the static element layer is scaled or moved by responding to the multi-finger scaling operation or the multi-finger movement operation through the static element layer. For example, the whiteboard application receives two touch operations after receiving the first movement operation, and if the area of the touch points of the two touch operations is less than the preset area threshold, it is determined that the two touch operations are writing operations. If the interval between the starting time of the two writing operations is less than the preset first time threshold and the distance between the starting position of one writing operation and the position of the other writing operation at the same time is less than the preset distance threshold, it can be determined that the two writing operations correspond to the multi-finger scaling operation or the multi-finger movement operation. The distance between the starting position corresponding to the multi-finger scaling operation or the multi-finger movement operation and the position at the same time of the first movement operation is compared with the preset distance threshold, and if the distance between the starting position and the position at the same time is greater than the preset distance threshold, it indicates that the first movement operation is not input by the multi-finger scaling operation or the multi-finger movement operation corresponding to the two writing operations, and at this time the dynamic writing layer can continue to process the first movement operation. The multi-finger scaling operation or the multi-finger movement operation is transmitted to the static element layer, and the static element layer responds to adjust the display position or the display size of the second writing trace displayed in the static element layer according to the position change state of the touch points of the multi-finger scaling operation or the multi-finger movement operation. In this embodiment, the writing operation is responded by the dynamic writing layer at the same time, and the multi-finger scaling movement operation is responded by the static element layer, which avoids the influence of the multi-finger scaling movement operation on the display of the writing trace being written, realizes the function of moving or scaling while writing of the whiteboard application, enriches the interactive function of the whiteboard application, and is beneficial to improving the interactive experience.

[0146] After the first moving operation ends, the first stroke generated by the first moving operation is added to the static element layer. In order to ensure the unified display of the first stroke and the second stroke in the static element layer, the parameters of the scaling or moving of the second stroke are obtained after the first moving operation ends; the first stroke is adjusted and added to the static element layer according to the parameters, and the first stroke in the dynamic writing layer is deleted. For example, the static element layer can save the scaling ratio or moving distance of the second stroke when responding to the multi-finger scaling operation or multi-finger moving operation. After the first moving operation ends, the static element layer can obtain the first stroke transmitted by the dynamic writing layer, and the static element layer can obtain the saved scaling ratio or moving distance, and draw the first stroke on the static element layer according to the adjusted display size of the first stroke according to the scaling ratio or the adjusted display position of the first stroke according to the moving distance. After the first stroke is added to the static element layer, the dynamic writing layer deletes the first stroke corresponding to the first stroke from the dynamic writing layer. In this embodiment, the display size or display position of the first stroke to be added is adjusted based on the scaling ratio or moving distance of the second stroke by the static element layer, so as to ensure the unified display of the first stroke and the second stroke in the static element layer, and improve the interactive experience.

[0147] On the basis of the above-mentioned embodiments, FIG. 4 is a flowchart of another stroke processing method provided by the embodiments of the present application. As shown in FIG. 4, the steps of the stroke processing method include:

[0148] S210, displaying a writing application interface of a writing application, the writing application interface being provided with a dynamic writing layer and a static element layer, and the dynamic writing layer being located above the static element layer.

[0149] In this embodiment, the completed strokes and the strokes in writing are displayed on the static element layer and the dynamic writing layer respectively, so that when the strokes are erased, only the completed strokes on the static element layer can be erased, and the strokes in writing on the dynamic writing layer are not erased, and the strokes in writing do not need to be backed up, thereby simplifying the processing operation of the strokes and the used computing resources.

[0150] S220, receiving at least one touch event detected by a touch-sensitive display screen, and determining the operation type of a touch operation corresponding to the touch event, the operation type including a writing operation and an erasing operation.

[0151] In the embodiment, the touch operation is an operation input by a user touching the interactive device. When the user inputs a touch operation on the touch-sensitive display screen of the interactive device, the touch-sensitive display screen can detect a touch event corresponding to the touch operation triggered by the touch operation, and send the touch event to the whiteboard application for processing of the touch event received by the whiteboard application. The touch-sensitive display screen can be a multi-point capacitive touch screen, an infrared touch screen, etc., and the touch-sensitive display screen allows detection of multiple touch bodies touching at the same time, and the touch bodies can be fingers, palms, styluses, etc., which can be recognized by the touch-sensitive display screen. When the user inputs a touch operation on the touch-sensitive display screen using a touch body, the touch-sensitive display screen can collect the coordinates and area of the touch point of the touch body in the touch-sensitive display screen, and if the touch-sensitive display screen is provided with an elastic wave module, the touch-sensitive display screen can also collect the material of the touch body. The touch-sensitive display screen can generate a corresponding touch event based on the touch coordinates, touch area and / or touch body material of the touch operation, and send the touch event to the whiteboard application.

[0152] After the whiteboard application obtains the touch event, the whiteboard application can determine the operation type of the touch operation as a writing operation or an erasing operation according to the touch area or the touch body material of the touch event. For example, a finger can erase the handwriting in the writing application interface, a stylus can write handwriting in the writing application interface, and the touch area of the finger is larger than that of the stylus. Therefore, the minimum contact area of the finger can be pre-set as a preset area threshold. When the touch area of the touch event is greater than or equal to the preset area threshold, it is determined that the touch event corresponds to a touch operation triggered by the finger, and it is further determined that the operation type of the touch operation is an erasing operation. When the touch area of the touch event is less than the preset area threshold, it is determined that the touch event corresponds to a touch operation triggered by the stylus, and it is further determined that the operation type of the touch operation is a writing operation. Alternatively, if the touch body material of the touch event is a stylus, it is determined that the touch event corresponds to a touch operation triggered by the stylus, and it is further determined that the operation type of the touch operation is a writing operation. If the touch body material of the touch event is a finger, it is determined that the touch event corresponds to a touch operation triggered by the finger, and it is further determined that the operation type of the touch operation is an erasing operation. In another embodiment, a palm can erase the handwriting in the writing application interface, and a finger can write handwriting in the writing application interface. The touch area of the palm is larger than that of the stylus, and therefore the minimum contact area of the palm can be pre-set as a preset area threshold. When the touch area of the touch event is greater than or equal to the preset area threshold, it is determined that the touch event corresponds to a touch operation triggered by the palm, and it is further determined that the operation type of the touch operation is an erasing operation. When the touch area of the touch event is less than the preset area threshold, it is determined that the touch event corresponds to a touch operation triggered by the finger, and it is further determined that the operation type of the touch operation is a writing operation.

[0153] In an embodiment, the touch operation covers the whole process of the falling, moving and lifting of the touch object, and thus the touch events corresponding to the touch operation can include a touch start event, a touch move event and a touch end event during the process of the user inputting the touch operation. The touch-sensitive display screen assigns the same touch identifier to the touch start event, the touch move event and the touch end event belonging to the same touch operation, so that the subsequent whiteboard application can identify the touch events corresponding to each touch operation based on the touch identifier. The touch start event is triggered when the touch object just falls on the touch-sensitive display screen, the touch move event is triggered when the touch object moves on the touch-sensitive display screen, and the touch end event is triggered when the touch object is lifted on the touch-sensitive display screen. Taking specific examples, in the Android, Window and other operating systems, the touch-sensitive display screen can detect a Down event, a Move event and an Up event during the process of the touch object contacting the touch-sensitive display screen to input the touch operation, the Down event being the touch start event, the Move event being the touch move event, and the Up event being the touch end event. In the IOS system, the touch-sensitive display screen can detect a TouchBegin event, a TouchMoved event and a TouchEnd event during the process of the touch object contacting the touch-sensitive display screen to input the touch operation, the TouchBegin event being the touch start event, the TouchMoved event being the touch move event, and the TouchEnd event being the touch end event.

[0154] In this embodiment, in the case of obtaining the touch start event, the operation type of the corresponding touch operation is determined according to the touch information of the touch start event, and the touch identifier of the touch start event is saved as the operation identifier of the corresponding writing operation or erasing operation. The touch information includes the touch area and / or the material of the touch object. For example, the touch-sensitive display screen determines that the current touch object inputs a touch operation and generates the touch identifier of the touch operation when detecting that the touch object falls on the screen, obtains the touch coordinates and the touch area of the touch object on the screen, and identifies the material of the touch object according to the elastic wave generated by the touch object, generates the touch start event based on the touch identifier, the touch coordinates, the touch area and the material of the touch object, and transmits the touch start event to the whiteboard application. The whiteboard application determines that the touch object of the corresponding touch operation is a finger or a stylus according to the touch area or the material of the touch start event, and further determines that the touch operation is an erasing operation or a writing operation.

[0155] In determining the operation type of the touch operation corresponding to the touch start event, the touch area of the touch start event can be compared with a preset area threshold, and the operation type of the touch operation corresponding to the touch start event is determined according to the comparison result. For example, in the case of palm triggering an erasing operation and finger triggering a writing operation, the minimum contact area of the palm can be preset as the preset area threshold. In the case that the touch area is greater than or equal to the preset area threshold, the touch operation corresponding to the touch start event is determined as the erasing operation; in the case that the touch area is less than the preset area threshold, the touch operation corresponding to the touch start event is determined as the writing operation. The embodiment can quickly determine the operation type of the corresponding touch operation through the touch area of the touch start event, and the recognition of the touch object can be realized without installing the elastic wave module on the touch-sensitive display screen, which is beneficial to reduce the implementation cost of the interactive device.

[0156] If the touch operation corresponding to the touch start event is the erasing operation, the touch identifier of the touch start event can be saved as the operation identifier of the erasing operation, and if the touch operation corresponding to the touch start event is the writing operation, the touch identifier of the touch start event can be saved as the operation identifier of the writing operation. In order to determine that the touch operation corresponding to the touch moving event or the touch end event is the writing operation or the erasing operation according to the operation identifier of each writing operation and erasing operation when the whiteboard application receives the touch moving event or the touch end event generated by the touch operation.

[0157] In the case of obtaining the touch moving event or the touch end event, the touch identifier of the touch moving event or the touch end event is compared with the saved operation identifier to determine the operation type of the touch operation corresponding to the touch moving event or the touch end event. For example, when the touch body moves on the screen, the touch-sensitive display screen determines that the touch operation input by the touch body at the last time has not ended and obtains the touch identifier corresponding to the touch operation, obtains the touch coordinates and the touch area of the touch body on the screen, generates a touch moving event based on the touch identifier, the touch coordinates and the touch area, and transmits the touch moving event to the whiteboard application. The whiteboard application compares the touch identifier of the touch moving event with the operation identifiers of the currently saved writing operation and erasing operation respectively. If the touch identifier is the same as the operation identifier of a writing operation, it is determined that the touch operation corresponding to the touch moving event is a writing operation. If the touch identifier is the same as the operation identifier of an erasing operation, it is determined that the touch operation corresponding to the touch moving event is an erasing operation. When the touch body leaves the screen, the touch-sensitive display screen determines that the touch operation input by the touch body at the last time will end and obtains the touch identifier corresponding to the touch operation, obtains the touch coordinates and the touch area of the touch body on the screen, generates a touch end event based on the touch identifier, the touch coordinates and the touch area, and transmits the touch end event to the whiteboard application. The whiteboard application compares the touch identifier of the touch end event with the operation identifiers of the currently saved writing operation and erasing operation respectively. If the touch identifier is the same as the operation identifier of a writing operation, it is determined that the touch operation corresponding to the touch end event is a writing operation. If the touch identifier is the same as the operation identifier of an erasing operation, it is determined that the touch operation corresponding to the touch end event is an erasing operation. In this embodiment, the touch identifier of the touch start event is saved as the operation identifier of the corresponding writing operation or erasing operation, so that the touch moving event and the touch end event are compared with the currently saved operation identifier in the future, the writing operation or the erasing operation corresponding to the touch moving event and the touch end event is quickly determined, and the response speed of the touch event is improved. Moreover, the touch-sensitive display screen does not need to identify the material of the touch body, the computing resources of the touch-sensitive display screen are saved, and the detection efficiency of the touch event is improved.

[0158] After the whiteboard application determines the operation type of the touch operation corresponding to the touch end event, the touch end event indicates that the corresponding touch operation will end and no new touch event will be generated subsequently, so it is not necessary to determine whether the touch operation is a writing operation or an erasing operation. Therefore, the operation identifier same as the touch identifier of the touch end event can be deleted from the record, so that the whiteboard application only records the operation identifier of the writing operation or the erasing operation currently input, and the storage resources of the interactive device are saved. Moreover, when the whiteboard application receives the touch moving event or the touch end event, it only needs to compare the operation identifier of the writing operation or the erasing operation currently input, and the determination efficiency of the operation type is improved.

[0159] In an embodiment, in order to improve the response speed of the touch event, realize low latency of writing or erasing, the data receiving source of the dynamic writing layer can be set to be independent of other service layers, and the touch event transmitted by the touch-sensitive display screen can be directly received by the dynamic writing layer. After the dynamic writing layer receives the touch event, the operation type of the touch operation corresponding to the touch event can be determined. For example, when the touch-sensitive display screen detects a touch start event, a touch movement event or a touch end event, the touch start event, the touch movement event or the touch end event can be transmitted to the dynamic writing layer. The dynamic writing layer can determine the operation type of the touch operation corresponding to the touch start event according to the touch area or the touch material of the touch start event, and can determine the operation type of the touch operation corresponding to the touch movement event or the touch end event according to the touch identifier of the touch movement event or the touch end event.

[0160] S230, in the case of a writing operation, the dynamic writing layer responds to the touch event, updates the handwriting corresponding to the writing operation in the dynamic writing layer, and after the writing operation ends, adds the handwriting of the writing operation to the static element layer and deletes the corresponding handwriting in the dynamic writing layer.

[0161] The embodiment is described by taking the dynamic writing layer receiving the touch event as an example. In the case of determining that the touch operation corresponding to the touch event is a writing operation, the dynamic writing layer draws the corresponding handwriting point in the dynamic writing layer according to the touch coordinates of the touch event, and updates the handwriting generated by the writing operation corresponding to the touch event according to the handwriting point. After the touch operation ends, it indicates that the handwriting generated by the writing operation has been completed, and at this time, the drawn handwriting can be transferred from the dynamic writing layer to the static element layer. From the display effect, the user can still see the handwriting through the writing application interface, but the handwriting is located in the static element layer at this time, that is, the subsequent input erasing operation can erase the handwriting, so as to ensure that the erasing function of the whiteboard application can be normally used.

[0162] The whiteboard application supports the function of writing while erasing, so when two users write and erase traces in the writing application interface respectively, the whiteboard application receives two touch operations at the same time, and when one of the touch operations is a writing operation and the other is an erasing operation, the dynamic writing layer responds to the writing operation and the static element layer responds to the erasing operation, so as to draw new traces on the dynamic writing layer while erasing old traces of the static element layer. The whiteboard application also supports the functions of multi-person writing and multi-finger zooming and moving. When a writing operation is triggered by a finger and an erasing operation is triggered by a palm, multi-person writing or multi-finger zooming and moving will cause the whiteboard application to receive multiple touch events at the same time, and determine that the touch operations corresponding to the multiple touch events are writing operations. In this case, the starting time and touch position corresponding to the multiple writing operations can be finely judged to determine that the multiple writing operations correspond to multi-person writing operations or multi-finger zooming and moving operations, and the traces of the dynamic writing layer or the traces of the static element layer are added or adjusted accordingly.

[0163] In this embodiment, when the touch operations corresponding to the multiple touch events are writing operations, if the interval of the starting time of each writing operation is greater than a preset first time threshold, the dynamic writing layer responds to the multiple touch events to update the traces corresponding to the writing operations. The first time threshold is the maximum time difference when multiple fingers just contact the display screen during multi-finger zooming and moving. It can be understood that when a user uses multiple fingers to zoom or move the traces in the writing application interface, the multiple fingers almost contact the display screen at the same time, and when multiple people write in the writing application interface, the time difference of the pen drop will be greater than the first time threshold. Therefore, when the interval of the starting time of the multiple writing operations is greater than the preset first time threshold, it can be determined that the multiple writing operations correspond to multi-person writing operations, and then the dynamic writing layer responds to the touch events corresponding to each writing operation to update the traces corresponding to the writing operations.

[0164] In a case where the touch operations corresponding to the multiple touch events are writing operations, if the interval between the starting time of the two writing operations is less than a preset first time threshold, and the distance between the starting position of one of the two writing operations and the position of the other writing operation at the same time is less than a preset distance threshold, it is determined that the two writing operations correspond to triggering a multi-finger zoom operation or a multi-finger movement operation; the dynamic writing layer is used to clear the traces corresponding to the two writing operations displayed in the dynamic writing layer; the static element layer is used to respond to the touch events corresponding to the multi-finger zoom operation or the multi-finger movement operation, and the second traces displayed in the static element layer are zoomed or moved. The preset distance threshold is the maximum distance when the multi-finger is just in contact with the display screen during multi-finger zooming and moving. It can be understood that when a user uses multi-finger to zoom or move the traces in the writing application interface, the multiple fingers are almost in contact with the display screen at the same time, and the distance between the multiple fingers will not exceed the distance when the fingers are spread. However, when multiple people write in the writing application interface, the distance between the pens will exceed the preset distance threshold. Therefore, in a case where the interval between the starting time of the two writing operations is less than the preset first time threshold, and the distance between the starting position of one of the two writing operations and the position of the other writing operation at the same time is less than the preset distance threshold, it can be determined that the two writing operations correspond to triggering a multi-finger zoom operation or a multi-finger movement operation. If the dynamic writing layer has responded to the two writing operations and drawn traces, the corresponding traces are cleared from the dynamic writing layer, and the touch events corresponding to the triggered multi-finger zoom operation or multi-finger movement operation are transmitted to the static element layer. The static element layer responds to the touch events of the multi-finger zoom operation or the multi-finger movement operation, determines the position change direction and the position change amount of the touch point according to the touch coordinates of the touch events, and determines the zooming or moving processing of the second traces according to the position change direction and the position change amount.

[0165] When the dynamic writing layer responds to the writing operation, the touch starting event, the touch moving event and the touch ending event of the writing operation are sequentially obtained, and the dynamic writing layer sequentially responds to the touch starting event, the touch moving event and the touch ending event of the writing operation to gradually update the traces generated by the writing operation. For example, when the touch starting event is obtained, the dynamic writing layer draws a first trace point in the dynamic writing layer according to the touch coordinates of the touch starting event. The first trace point is a trace point drawn according to the touch starting event. FIG. 5 is a schematic diagram of the dynamic writing layer provided by an embodiment of the present application. As shown in FIG. 5, when a user uses a finger 20 to contact the screen at the (x, y) position of the touch-sensitive display screen, the touch-sensitive display screen generates a touch starting event containing the touch coordinates (x, y) in response. The dynamic writing layer 11 can determine that the touch operation corresponding to the touch starting event is triggered by the stylus, and can draw a first trace point A at the corresponding position of the dynamic writing layer according to the touch coordinates (x, y) of the touch starting event. At this time, the user can see the first trace point A in the writing application interface.

[0166] From the above, in the multi-person writing scenario, two or more users use fingers to write on the touch-sensitive display, at which time the interactive device can receive two or more writing operations and determine that the writing operations correspond to triggering the multi-person writing operation, and accordingly, the dynamic writing layer can respond to the multi-person writing operation to draw two or more strokes at the same time. In order to ensure that the dynamic writing layer accurately draws the strokes corresponding to the writing of each finger, the stroke points drawn by the touch events belonging to the same touch operation can be connected according to the touch identifiers of the touch events, so as to avoid the stroke points of different writing operations being connected together and causing inaccurate drawing of the strokes. For example, in the case of obtaining a touch movement event, a second stroke point is drawn in the dynamic writing layer according to the touch coordinates of the touch movement event, and the second stroke point and a stroke point corresponding to a previous touch event are connected to form a stroke according to the touch identifier of the touch movement event. The previous touch event of the touch movement event is a touch event triggered by the corresponding touch operation at the previous time, which can be a touch start event or a touch movement event. This embodiment is described by taking the previous touch event as a touch start event. The second stroke point is a stroke point drawn according to the corresponding touch movement event. FIGS. 6 and 7 are schematic diagrams of a dynamic writing layer provided by an embodiment of the present application. As shown in FIGS. 6 and 7, it is assumed that a first finger 21 and a second finger 22 simultaneously input touch operations on the touch-sensitive display, and the dynamic writing layer 11 simultaneously receives a first touch movement event of a first touch operation input by the first finger 21 and a second touch movement event of a second touch operation input by the second finger 22. The dynamic writing layer 11 draws a second stroke point B1 in the dynamic writing layer 11 according to the touch coordinates of the first touch movement event, and determines a first stroke point A1 to be a stroke point drawn according to a previous touch event triggered by the first touch operation according to the touch identifier of the first touch movement event, and then connects the second stroke point B1 and the first stroke point A1 to form a stroke segment C1 written by the first touch body. The dynamic writing layer 11 draws a second stroke point B2 in the dynamic writing layer 11 according to the touch coordinates of the second touch movement event, and determines a first stroke point A2 to be a stroke point drawn according to a previous touch event triggered by the second touch operation according to the touch identifier of the second touch movement event, and then connects the second stroke point B2 and the first stroke point A2 to form a stroke segment C2 written by the second touch body. In this embodiment, the touch identifier of the touch movement event is used to connect the stroke point drawn by the touch movement event and the stroke point drawn according to the corresponding previous touch event, to form a stroke segment generated by the corresponding touch operation, thereby ensuring the accuracy of the writing strokes when multiple writing operations are triggered at the same time.

[0167] Similarly, in the case of obtaining the touch end event, a third stroke point is drawn in the dynamic writing layer according to the touch coordinates of the touch end event, and the third stroke point is connected with the second stroke point corresponding to the last touch moving event according to the touch identifier of the touch end event to form a stroke. The last touch moving event of the touch end event is the touch moving event triggered by the touch operation at the last time, and the third stroke point is the stroke point drawn corresponding to the touch end event. FIG. 8 and FIG. 9 are schematic diagrams of the dynamic writing layer provided by the embodiment of the present application. As shown in FIG. 8 and FIG. 9, the dynamic writing layer 11 simultaneously receives the first touch end event of the first touch operation input by the first finger 21 and the second touch event of the second touch operation input by the second finger 22. It can be understood that when the first finger 21 and the second finger 22 leave the screen at different time points, the dynamic writing layer receives a touch moving event and a touch end event; when the first finger and the second finger leave the screen at the same time point, the dynamic writing layer can simultaneously receive two touch end events. Therefore, the second touch event can be a touch end event or a touch moving event, and the embodiment takes the second touch event as a touch moving event as an example for description. The dynamic writing layer 11 draws a third stroke point D1 in the dynamic writing layer 11 according to the touch coordinates of the first touch end event, determines the second stroke point B1 as the stroke point drawn by the last touch moving event triggered by the first touch operation according to the touch identifier of the first touch end event, and then connects the third stroke point D1 and the second stroke point B1. Since the touch event triggered by the first touch operation previously has drawn a stroke segment C1, the third stroke point D1, the second stroke point B1 and the stroke segment C1 can be connected to form the stroke E1 finally generated by the first touch operation. The dynamic writing layer 11 draws a second stroke point D2 in the dynamic writing layer 11 according to the touch coordinates of the second touch event, determines the second stroke point B2 as the stroke point drawn by the last touch moving event triggered by the second touch operation according to the touch identifier of the second touch event, and then connects the second stroke point D2 and the second stroke point B2. Since the touch event triggered by the second touch operation previously has drawn a stroke segment C2, the third stroke point D2, the second stroke point B2 and the stroke segment C2 can be connected to form the stroke segment E2 newly generated by the second touch operation. The embodiment connects the stroke point drawn by the touch end event with the stroke point drawn by the corresponding last touch moving event based on the touch identifier of the touch end event to form the stroke finally generated by the corresponding writing operation, thereby ensuring the accuracy of the writing stroke when multiple writing operations are triggered at the same time. Moreover, no matter which two types of touch events are received by the dynamic writing layer at the same time, as long as the dynamic writing layer connects the stroke point of the touch event with the stroke point of the corresponding last touch event based on the touch identifier of the touch event, the accuracy of the writing stroke can be ensured.

[0168] In this embodiment, when connecting the touch event drawn stroke point with the stroke point drawn by the previous touch event, in order to improve the smoothness and fluency of the writing stroke, all the stroke points previously drawn by the corresponding touch operation can be obtained according to the touch identifier of the touch event, a smooth stroke is fitted according to the obtained stroke points and the currently drawn stroke point, and the latest fitted stroke is updated as the stroke generated by the touch operation.

[0169] After the touch operation ends, the stroke finally generated by the touch operation is added to the corresponding position in the static element layer according to the pixel coordinates of the corresponding stroke in the dynamic writing layer, so that the user can erase the stroke in the static element layer through an erasing operation, ensuring the normal use of the erasing function of the whiteboard application. After the stroke finally generated by the touch operation is added to the static element layer, the corresponding stroke in the dynamic writing layer can be deleted, saving the storage resources of the dynamic writing layer. Since the pixel coordinates of the stroke do not change when it is transferred from the dynamic writing layer to the static element layer, the user will not perceive the change of the display layer of the stroke when watching the writing application interface, ensuring the viewing experience of the user.

[0170] As can be seen from the above, the touch end event is the last touch event triggered before the touch operation ends, and thus the dynamic writing layer, in response to the touch end event, connects the third stroke point drawn by the touch end event with the second stroke point drawn by the last touch move event to form a stroke corresponding to the stroke, determines that the touch operation corresponding to the touch end event ends, and determines that the stroke is the stroke finally generated by the touch operation. In this regard, the dynamic writing layer can add the stroke formed by connecting the third stroke point with the corresponding second stroke point to the static element layer and delete the stroke in the dynamic writing layer. For example, FIG. 10 is a schematic diagram of a static element layer according to an embodiment of the present application. Referring to FIGS. 9 and 10, after the dynamic writing layer 11 connects the third stroke point D1 with the second stroke point B1 to form a stroke E1 finally generated by the first touch operation with the third stroke point D1, the second stroke point B1 and the stroke segment C1, the dynamic writing layer 11 adds the stroke E1 to the corresponding position in the static element layer 12 according to the pixel coordinates of the stroke E1 in the dynamic writing layer 11, and obtains the stroke E1 shown in the static element layer 12 shown in FIG. 10. Since the dynamic writing layer 11 has not received the touch end event of the second touch operation, the stroke segment E2 is not the stroke finally generated by the second touch operation, and thus the stroke segment E2 does not need to be added to the static element layer 12. FIG. 11 is a schematic diagram of a dynamic writing layer according to an embodiment of the present application. Referring to FIG. 11, after the stroke E1 is added to the static element layer 12, the dynamic writing layer 11 deletes the stroke E1, and at this time, the dynamic writing layer 11 only displays the stroke segment E2. This embodiment accurately determines the timing of the end of the touch operation through the connecting action of the third stroke point and the corresponding second stroke point, and timely adds the stroke finally generated by the touch operation to the static element layer, so as to avoid the need for the user to wait for a certain period of time before erasing the completed stroke from the writing application interface, and is beneficial to improving the user experience.

[0171] In a case where the touch operation is an erasing operation, the static element layer responds to the touch event, and erases the second stroke in the static element layer according to the erasing area generated by the touch event.

[0172] For example, when the whiteboard application determines that the touch operation corresponding to the currently received touch event is an erasing operation, the whiteboard application can generate an erasing area corresponding to the touch event through the static element layer, and erase the second handwriting in the static element layer according to the erasing area. The erasing area is an area in which handwriting or elements in the corresponding area are erased. In this embodiment, the static element layer responds to the erasing operation to erase only the second handwriting in the static element layer, thereby avoiding erasing the handwriting being written in the dynamic writing layer. It should be noted that the handwriting generated by the writing operation being performed is drawn in the dynamic writing layer, and the handwriting generated by the received writing operation is drawn in the static element layer, that is, the whiteboard application does not perform backup processing on the handwriting generated by the same writing operation, thereby saving storage resources of the whiteboard application, simplifying handwriting processing operations, reducing computing resources used by the interactive device, and improving handwriting processing efficiency.

[0173] In this embodiment, when the dynamic writing layer determines that the touch operation is an erasing operation, the dynamic writing layer transmits the touch event to the static element layer; and the static element layer receives and responds to the touch event, determines an erasing area according to touch coordinates of the touch event, and erases the second handwriting in the static element layer according to the erasing area. For example, after the dynamic writing layer receives the touch event transmitted by the touch-sensitive display screen, the dynamic writing layer determines that the touch operation corresponding to the touch event is a writing operation or an erasing operation according to a touch identifier, a touch area, or a touch material of the touch event. When the dynamic writing layer determines that the touch operation is an erasing operation, the dynamic writing layer does not respond to the touch event but transmits the touch event to the static element layer, and the static element layer responds to the touch event of the erasing operation, thereby achieving processing isolation of the erasing operation and the writing operation, and improving the response speed of the touch event. After the static element layer receives the touch event, the static element layer can determine an erasing area according to touch coordinates of the touch event, and erase the second handwriting at a corresponding position in the static element layer according to the erasing area.

[0174] In some scenarios, more than two users can use their palms to erase on the touch- sensitive display screen, and the interaction device can receive more than two erase operations, and the static element layer can receive touch events of multiple different touch identifiers at the same time. To ensure that the static element layer accurately erases the second handwriting, the last touch event corresponding to the touch operation can be determined according to the touch identifier of the touch event, the erase end point can be determined according to the touch coordinates of the touch event and the touch coordinates of the last touch event, and the erase area can be determined according to the erase end point. The erase end point can be understood as the end point of the erase area. For example, FIG. 12 is a schematic diagram of a static element layer provided in an embodiment of the present application. As shown in FIG. 12, it is assumed that a first finger and a second finger input touch operations on the touch- sensitive display screen at the same time, and the static element layer 12 can receive a third touch event of a third touch operation input by the first finger and a fourth touch event of a fourth touch operation input by the second finger at the same time. The static element layer 12 obtains the last touch event of the third touch operation according to the touch identifier of the third touch event, determines the erase end point G1 according to the touch coordinates of the third touch event and a preset eraser shape, determines the erase end point G2 according to the touch coordinates of the last touch event and the preset eraser shape, and determines the surrounding area formed by the erase end points G1 and G2 as the erase area F1 generated by the third touch event. The static element layer 12 obtains the last touch event of the fourth touch operation according to the touch identifier of the fourth touch event, determines the erase end point G3 according to the touch coordinates of the fourth touch event and the preset eraser shape, determines the erase end point G4 according to the touch coordinates of the last touch event and the preset eraser shape, and determines the surrounding area formed by the erase end points G3 and G4 as the erase area F2 generated by the fourth touch event. According to the touch identifier of the touch event, the embodiment can accurately generate the erase area corresponding to the touch event, and ensure the accuracy of erasing handwriting when multiple erase operations are triggered at the same time.

[0175] It should be noted that FIG. 12 shows that the eraser shape is a circle, but the shape can also be a square or a triangle, etc. In addition to generating the erase end point according to the touch coordinates and the preset eraser shape, the static element layer can also generate the erase end point according to the touch coordinates and the touch area.

[0176] In an embodiment, when the static element layer is subjected to erasing processing based on the erasing area, if the second handwriting is located in the erasing area, the second handwriting is deleted from the static element layer. Referring to FIG. 12, the second handwriting E4 is entirely located in the erasing area F2, and thus the second handwriting E4 can be deleted from the static element layer 12. If a first line segment of the second handwriting is located in the erasing area, the first line segment is deleted from the static element layer, the remaining handwriting segment is saved as a new second handwriting in the static element layer, and the original second handwriting is deleted. The first line segment is a partial line segment of the second handwriting. Referring to FIG. 12, a partial line segment of the second handwriting E3 is located in the erasing area F1, and thus the partial line segment of the second handwriting E3 located in the erasing area F1 can be deleted. FIG. 13 is a schematic diagram of the static element layer according to an embodiment of the present application. As shown in FIG. 13, after the partial line segment of the second handwriting E3 located in the erasing area F1 is deleted, the second handwriting E3 becomes a handwriting segment E5 and a handwriting segment E6, the handwriting segment E5 and the handwriting segment E6 can be saved as a new second handwriting in the static element layer 12, and the original second handwriting E3 in the static element layer 12 is deleted.

[0177] In an embodiment, the static element layer displays not only the second handwriting but also a non-handwriting element. The non-handwriting element is an element other than handwriting, such as text, an icon, and the like. Since the static element layer responds to the erasing operation in this embodiment, the non-handwriting element can also be erased in the case where the erasing operation hits the non-handwriting element. Specifically, if the non-handwriting element in the static element layer is located in the erasing area, the non-handwriting element is deleted from the static element layer. FIG. 14 and FIG. 15 are schematic diagrams of the static element layer according to an embodiment of the present application. As shown in FIG. 14 and FIG. 15, part of the text in the text element H1 in the static element layer 12 is located in the erasing area F3, and thus the part of the text can be deleted from the static element layer 12, obtaining the static element layer 12 shown in FIG. 15. This embodiment erases the non-handwriting element through the static element layer, enriching the erasing function of the whiteboard application.

[0178] To sum up, the handwriting processing method according to the embodiments of the present application responds to a touch event of an operation type of a writing operation through the dynamic writing layer to draw handwriting corresponding to the writing operation on the dynamic writing layer, and responds to a touch event of an operation type of an erasing operation through the static element layer to erase a second handwriting on the static element layer, avoiding erasing handwriting being written. The corresponding handwriting is transferred to the static element layer after the writing operation is completed, so that subsequent erasing operations can erase the handwriting. Through the above technical means, the processing of the input writing operation and the erasing operation is isolated, the handwriting being written can be avoided to be erased without backing up the handwriting, the problem that the interactive device needs to back up the handwriting in the related art is solved, the processing operation of the handwriting is simplified, the computing resources used by the interactive device are reduced, and the handwriting processing efficiency is improved.

[0179] On the basis of the above-mentioned embodiments, Fig. 16 is a structural schematic diagram of a handwriting processing device provided by the embodiments of the present application. Referring to Fig. 16, the handwriting processing device provided by the embodiments of the present application specifically comprises: a first interface display module 31, a first handwriting drawing module 32, a first operation receiving module 33, a first handwriting erasing module 34, and a first interface updating module 35.

[0180] The first interface display module 31 is configured to display a writing application interface of a writing application, the writing application interface being provided with a dynamic writing layer and a static element layer, the dynamic writing layer being located on an upper layer of the static element layer.

[0181] The first handwriting drawing module 32 is configured to receive a first movement operation on the writing application interface, and draw a first handwriting corresponding to the first movement operation in the dynamic writing layer synchronously when the first movement operation is received.

[0182] The first operation receiving module 33 is configured to receive a second movement operation in the process of receiving the first movement operation, the second movement operation covering a second handwriting displayed in the static element layer and partially overlapping the first handwriting, and an area of a touch point of the second movement operation being greater than or equal to a preset area threshold.

[0183] The first handwriting erasing module 34 is configured to erase the second handwriting displayed in the static element layer according to the second movement operation.

[0184] The first interface updating module 35 is configured to add the first handwriting to the static element layer and delete the first handwriting of the dynamic writing layer after the first movement operation ends, and update the writing application interface.

[0185] On the basis of the above-mentioned embodiments, the handwriting processing device further comprises a third handwriting drawing module, the second handwriting drawing module comprising: a first operation receiving unit configured to receive a third movement operation in the process of receiving the first movement operation, an interval between a starting moment of the third movement operation and a starting moment of the first movement operation being greater than a preset first time threshold, and an area of a touch point of the third movement operation being less than the preset area threshold; a first handwriting drawing unit configured to draw a third handwriting corresponding to the third movement operation in the dynamic writing layer synchronously when the third movement operation is received; and a first handwriting transferring unit configured to add the third handwriting to the static element layer and delete the third handwriting in the dynamic writing layer after the third movement operation ends.

[0186] On the basis of the above-mentioned embodiments, the handwriting processing apparatus further comprises a first zooming and moving module, the handwriting zooming and moving module comprising: a second operation receiving unit configured to receive a fourth moving operation in the process of receiving the first moving operation; the fourth moving operation starting at an interval of a starting time of the first moving operation being less than a preset first time threshold, a distance between a starting position of the fourth moving operation and a position of the first moving operation at the same time being less than a preset distance threshold, and an area of a touch point of the fourth moving operation being less than a preset area threshold; a first handwriting clearing unit configured to clear the first handwriting in the dynamic writing layer; and a first handwriting adjusting unit configured to update a display state of the second handwriting displayed by the static element layer according to a position change state of the touch point of the first moving operation and the fourth moving operation.

[0187] On the basis of the above-mentioned embodiments, the first handwriting adjusting unit comprises a position and size updating sub-unit configured to update a display position or a display size of the second handwriting displayed by the static element layer according to the position change state of the touch point of the first moving operation and the fourth moving operation.

[0188] On the basis of the above-mentioned embodiments, the handwriting processing apparatus further comprises a second zooming and moving module, the second zooming and moving module comprising: a third operation receiving unit configured to receive a multi-finger zooming operation or a multi-finger moving operation in the process of receiving the first moving operation; a distance between a starting position of the multi-finger zooming operation or the multi-finger moving operation and a position of the first moving operation at the same time being greater than a preset distance threshold; and a second handwriting adjusting unit configured to zoom or move the second handwriting displayed in the static element layer by the static element layer in response to the multi-finger zooming operation or the multi-finger moving operation.

[0189] On the basis of the above-mentioned embodiments, the first interface updating module 35 comprises: a parameter obtaining unit configured to obtain parameters of the second handwriting zooming or moving after the first moving operation ends; and a third handwriting adjusting unit configured to add the first handwriting adjusted according to the parameters to the static element layer and delete the first handwriting in the dynamic writing layer.

[0190] On the basis of the above-mentioned embodiments, the writing application interface further comprises a background layer, the background layer being located below the static element layer and used for displaying a background picture.

[0191] On the basis of the above-mentioned embodiments, FIG. 17 is a structural schematic diagram of a handwriting processing apparatus provided in an embodiment of the present application. Referring to FIG. 17, the handwriting processing apparatus provided in the embodiment specifically comprises a second interface display module 41, an operation type judging module 42, a second handwriting drawing module 43, and a second handwriting erasing module 44.

[0192] The second interface display module 41 is configured to display a writing application interface of a writing application, the writing application interface being provided with a dynamic writing layer and a static element layer, and the dynamic writing layer being located on an upper layer of the static element layer.

[0193] The operation type determination module 42 is configured to receive at least one touch event detected by the touch-sensitive display screen, and determine an operation type of a touch operation corresponding to the touch event, the operation type including a writing operation and an erasing operation.

[0194] The second handwriting drawing module 43 is configured to, in a case where the touch operation is the writing operation, update handwriting corresponding to the writing operation in the dynamic writing layer by responding to the touch event through the dynamic writing layer, and add the handwriting of the writing operation to the static element layer and delete the corresponding handwriting in the dynamic writing layer after the writing operation is ended.

[0195] The second handwriting erasing module 44 is configured to, in a case where the touch operation is the erasing operation, erase the second handwriting in the static element layer according to an erasing area generated by the touch event by responding to the touch event through the static element layer.

[0196] On the basis of the above embodiment, the handwriting processing apparatus further includes a fourth handwriting drawing module configured to, in a case where touch operations corresponding to a plurality of touch events are writing operations, update handwriting corresponding to the writing operations by responding to the plurality of touch events through the dynamic writing layer if intervals of starting moments of the writing operations are greater than a preset first time threshold.

[0197] On the basis of the above embodiment, the handwriting processing apparatus further includes a third scaling and moving module, the third scaling and moving module including: a trigger type determination unit configured to, in a case where touch operations corresponding to a plurality of touch events are writing operations, determine that the writing operations correspond to a multi-finger scaling operation or a multi-finger moving operation if an interval of starting moments of the writing operations is less than a preset first time threshold and a distance between a starting position of one of the writing operations and a position of the other writing operation at the same moment is less than a preset distance threshold; a second handwriting clearing unit configured to clear handwriting corresponding to the two writing operations displayed in the dynamic writing layer through the dynamic writing layer; and a fourth handwriting adjusting unit configured to scale or move the second handwriting displayed in the static element layer by responding to touch events corresponding to the multi-finger scaling operation or the multi-finger moving operation through the static element layer.

[0198] On the basis of the above embodiment, the operation type determination module 42 includes a first type determination unit configured to receive the touch event through the dynamic writing layer and determine the operation type of the touch operation corresponding to the touch event.

[0199] Based on the above embodiment, the touch events corresponding to the touch operation include a touch start event, a touch move event and a touch end event, and the touch identifiers of the touch start event, the touch move event and the touch end event in the same touch operation are the same; accordingly, the operation type judgment module 42 includes: a second type determination unit, which is configured to determine the operation type of the corresponding touch operation according to the touch information of the touch start event when a touch start event is obtained, and save the touch identifier of the touch start event as the operation identifier corresponding to the writing operation or the erasing operation; a third type determination unit, which is configured to compare the touch identifier of the touch move event or the touch end event with the saved operation identifier when a touch move event or a touch end event is obtained, to determine the operation type of the touch operation corresponding to the touch move event or the touch end event.

[0200] Based on the above embodiment, the second type determination unit includes: an area comparison subunit, configured to compare the touch area of ​​the touch start event with a preset area threshold, and determine the operation type of the touch operation corresponding to the touch start event based on the comparison result.

[0201] Based on the above embodiment, the erasing operation is triggered by the palm, and the preset area threshold is the minimum area of ​​the palm; accordingly, the area comparison subunit also includes: when the touch area is greater than or equal to the preset area threshold, determining that the touch operation corresponding to the touch start event is an erasing operation; when the touch area is less than the preset area threshold, determining that the touch operation corresponding to the touch start event is a writing operation.

[0202] Based on the above embodiment, the second handwriting drawing module 43 includes: a first drawing unit, which is configured to draw a first handwriting point in the dynamic writing layer according to the touch coordinates of the touch start event when a touch start event is obtained; a second drawing unit, which is configured to draw a second handwriting point in the dynamic writing layer according to the touch coordinates of the touch move event when a touch move event is obtained, and connect the second handwriting point with the handwriting point corresponding to the previous touch event according to the touch identifier of the touch move event to form a handwriting; a third drawing unit, which is configured to draw a third handwriting point in the dynamic writing layer according to the touch coordinates of the touch end event when a touch end event is obtained, and connect the third handwriting point with the second handwriting point corresponding to the previous touch move event according to the touch identifier of the touch end event to form the handwriting of the corresponding writing operation.

[0203] Based on the above embodiment, the second handwriting drawing module 43 includes: a second handwriting transfer unit, which is configured to add the handwriting of the writing operation to the static element layer through the dynamic writing layer and delete the corresponding handwriting in the dynamic writing layer after the third handwriting point is connected with the corresponding second handwriting point to form the handwriting of the corresponding writing operation.

[0204] On the basis of the above-mentioned embodiments, the second handwriting erasing module 44 comprises: a touch event transmission unit configured to transmit the touch event to the static element layer through the dynamic writing layer in the case that the dynamic writing layer determines the touch operation as an erasing operation; and a touch event response unit configured to receive and respond to the touch event through the static element layer, determine an erasing area according to the touch coordinates of the touch event, and erase the second handwriting in the static element layer according to the erasing area.

[0205] On the basis of the above-mentioned embodiments, the touch event response unit comprises: an event determination sub-unit configured to determine a previous touch event corresponding to the touch operation according to the touch identifier of the touch event; and an erasing area determination sub-unit configured to determine an erasing endpoint according to the touch coordinates of the touch event and the touch coordinates of the previous touch event, and determine the erasing area according to the erasing endpoint.

[0206] On the basis of the above-mentioned embodiments, the second handwriting erasing module 44 comprises: a first erasing unit configured to delete the second handwriting from the static element layer if the second handwriting is located in the erasing area; and a second erasing unit configured to delete the first line segment from the static element layer if the first line segment of the second handwriting is located in the erasing area, save the remaining handwriting segment as a new second handwriting in the static element layer, and delete the original second handwriting.

[0207] On the basis of the above-mentioned embodiments, the handwriting processing apparatus further comprises an element erasing module configured to delete the non-handwriting element from the static element layer if the non-handwriting element in the static element layer is located in the erasing area after responding to the touch event through the static element layer.

[0208] In summary, the handwriting processing apparatus provided by the embodiments of the present application responds to a touch event with an operation type of a writing operation through a dynamic writing layer to draw a first handwriting corresponding to the writing operation on the dynamic writing layer, responds to a touch event with an operation type of an erasing operation through a static element layer to erase a second handwriting on the static element layer, and avoids erasing the first handwriting being written. The first handwriting is transferred to the static element layer after the writing operation is completed, so that the subsequent erasing operation can erase the first handwriting. Through the above technical means, the processing of the writing operation and the erasing operation is isolated, the first handwriting being written can be avoided to be erased without backing up the handwriting, the problem that the interactive device needs to back up the handwriting in the related art is solved, the processing operation of the handwriting is simplified, the computing resources used by the interactive device are reduced, and the processing efficiency of the handwriting is improved.

[0209] The handwriting processing apparatus provided by the embodiments of the present application can be used to execute the handwriting processing method provided by the above-mentioned embodiments, and has the corresponding functions and advantages.

[0210] Fig. 18 is a structural schematic diagram of an interactive device according to an embodiment of the present application. Referring to Fig. 18, the interactive device comprises a processor 51, a memory 52, a communication device 53, an input device 54 and an output device 55. The number of processors 51 in the handwriting processing device can be one or more, and the number of memories 52 in the handwriting processing device can be one or more. The processor 51, the memory 52, the communication device 53, the input device 54 and the output device 55 of the handwriting processing device can be connected through a bus or other means.

[0211] The memory 52, as a computer readable storage medium, can be used to store software programs, computer executable programs and modules, such as program instructions / modules of the handwriting processing method according to any embodiment of the present application (for example, the first interface display module 31, the first handwriting drawing module 32, the first operation receiving module 33, the first handwriting erasing module 34 and the first interface updating module 35 in the handwriting processing device, or the second interface display module 41, the operation type judgment module 42, the second handwriting drawing module 43 and the second handwriting erasing module 44). The memory 52 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system and application programs required by at least one function; the data storage area can store data created according to the use of the device, etc. In addition, the memory 52 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device or other non-volatile solid-state memory device. In some examples, the memory can further include a memory remotely arranged with respect to the processor, which can be connected to the device through a network. Examples of the above network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.

[0212] The communication device 53 is used for data transmission.

[0213] The processor 51 executes various function applications and data processing of the device by running the software programs, instructions and modules stored in the memory 52, that is, implements the handwriting processing method described above.

[0214] The input device 54 can be used to receive input digital or character information, and generate key signal input related to user settings and function control of the device. The output device 55 can include a display device such as a display screen.

[0215] The interactive device provided above can be used to execute the handwriting processing method provided by the above embodiments, and has corresponding functions and advantages.

[0216] The embodiment of the application further provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to perform a handwriting processing method, the handwriting processing method comprising: displaying a handwriting application interface of a handwriting application, the handwriting application interface being provided with a dynamic writing layer and a static element layer, the dynamic writing layer being located on the upper layer of the static element layer; receiving a first moving operation on the handwriting application interface; when the first moving operation is received, synchronously drawing a first handwriting corresponding to the first moving operation in the dynamic writing layer; in the process of receiving the first moving operation, a second moving operation is received; the second moving operation covers a second handwriting displayed in the static element layer, and the second moving operation partially overlaps the first handwriting, and an area of a touch point of the second moving operation is greater than or equal to a preset area threshold; according to the second moving operation, the second handwriting displayed in the static element layer is erased; after the first moving operation ends, the first handwriting is added to the static element layer and the first handwriting of the dynamic writing layer is deleted, and the handwriting application interface is updated.

[0217] The computer executable instructions, when executed by the computer processor, are used to perform another handwriting processing method, the handwriting processing method comprising: displaying a handwriting application interface of a handwriting application, the handwriting application interface being provided with a dynamic writing layer and a static element layer, the dynamic writing layer being located on the upper layer of the static element layer; receiving at least one touch event detected by a touch-sensitive display screen, determining an operation type of a touch operation corresponding to the touch event, the operation type comprising a writing operation and an erasing operation; in the case that the touch operation is the writing operation, responding to the touch event through the dynamic writing layer, updating handwriting corresponding to the writing operation in the dynamic writing layer, after the writing operation ends, adding the handwriting of the writing operation to the static element layer and deleting the corresponding handwriting in the dynamic writing layer; in the case that the touch operation is the erasing operation, responding to the touch event through the static element layer, erasing a second handwriting in the static element layer according to an erasing area generated by the touch event.

[0218] Storage medium - any type of memory device or storage device. The term "storage medium" is intended to include an installation medium, e.g., a CD-ROM, floppy disks, or tape apparatus; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; or a non-volatile memory such as a magnetic medium (e.g., a hard drive or optical storage); registers or other similar types of memory elements, etc. The memory medium can also include other types of storage medium or combinations thereof. In addition, the memory medium can reside in a first computer system's main memory, or in a second different computer system's memory, which second computer system can provide the first computer system with an interface in order to perform a program stored in the memory medium. The term "storage medium" can also be synonymous with a "memory medium" where the two terms are used interchangeably. The memory medium can store program instructions executable by one or more processors (e.g., as a computer program).

[0219] Of course, the storage medium provided by the embodiments of the present application includes computer executable instructions, and the computer executable instructions are not limited to the handwriting processing method described above, but can also perform the related operations in the handwriting processing method provided by any of the embodiments of the present application.

[0220] The handwriting processing apparatus, storage medium and interactive device provided in the above embodiments can execute the handwriting processing method provided by any of the embodiments of the present application, and the technical details not described in detail in the above embodiments can be referred to the handwriting processing method provided by any of the embodiments of the present application.

[0221] The above are only the preferred embodiments of the present application and the technical principles used. The present application is not limited to the specific embodiments herein, and various obvious changes, re-adjustments and replacements made by those skilled in the art will not deviate from the protection scope of the present application. Therefore, although the present application has been described in more detail through the above embodiments, the present application is not limited to the above embodiments, and can include more other equivalent embodiments without deviating from the concept of the present application, and the scope of the present application is determined by the scope of the claims.

Claims

1. A handwriting processing method, wherein: Applied to an interactive device, the method includes: Displaying a writing application interface of a writing application, wherein the writing application interface is provided with a dynamic writing layer and a static element layer, wherein the dynamic writing layer is located above the static element layer; receiving a first movement operation in the writing application interface; upon receiving the first movement operation, synchronously drawing a first handwriting corresponding to the first movement operation in the dynamic writing layer; During the process of receiving the first movement operation, a second movement operation is received; the second movement operation covers a second handwriting displayed in the static element layer, and the second movement operation partially overlaps with the first handwriting, and an area of ​​a touch point of the second movement operation is greater than or equal to a preset area threshold; Erasing the second handwriting displayed in the static element layer according to the second movement operation; After the first movement operation is completed, the first handwriting is added to the static element layer, the first handwriting in the dynamic writing layer is deleted, and the writing application interface is updated.

2. The handwriting processing method according to claim 1, wherein: The method further comprises: During the process of receiving the first movement operation, a third movement operation is received; the interval between the start time of the third movement operation and the start time of the first movement operation is greater than a preset first time threshold, and the area of ​​the touch point of the third movement operation is smaller than a preset area threshold; When the third movement operation is received, synchronously drawing a third handwriting corresponding to the third movement operation in the dynamic writing layer; After the third movement operation is completed, the third handwriting is added to the static element layer and the third handwriting in the dynamic writing layer is deleted.

3. The handwriting processing method according to claim 1, wherein: The method further comprises: During the process of receiving the first move operation, a fourth move operation is received; the interval between the start time of the fourth move operation and the start time of the first move operation is less than a preset first time threshold, the distance between the starting position of the fourth move operation and the position of the first move operation at the same time is less than a preset distance threshold, and the area of ​​the touch point of the fourth move operation is less than a preset area threshold; clearing the first handwriting in the dynamic writing layer; The display state of the second handwriting displayed on the static element layer is updated according to the position change state of the touch point of the first movement operation and the fourth movement operation.

4. The handwriting processing method according to claim 3, wherein: The updating of the display state of the second handwriting displayed on the static element layer according to the position change state of the touch point caused by the first movement operation and the fourth movement operation includes: The display position or display size of the second handwriting displayed in the static element layer is updated according to the position change status of the touch point of the first movement operation and the fourth movement operation.

5. The handwriting processing method according to claim 1, wherein: The method further comprises: During the process of receiving the first movement operation, a multi-finger zoom operation or a multi-finger move operation is received; the distance between the starting position of the multi-finger zoom operation or the multi-finger move operation and the position of the first movement operation at the same time is greater than a preset distance threshold; The second handwriting displayed in the static element layer is scaled or moved in response to the multi-finger zooming operation or the multi-finger moving operation through the static element layer.

6. The handwriting processing method according to claim 5, wherein: After the first movement operation is completed, adding the first handwriting to the static element layer and deleting the first handwriting from the dynamic writing layer includes: After the first movement operation is completed, obtaining the parameters of the second handwriting scaling or movement; According to the parameters, the first handwriting is adjusted and then added to the static element layer, and the first handwriting in the dynamic writing layer is deleted.

7. The handwriting processing method according to claim 1, wherein: The writing application interface is further provided with a background layer, which is located below the static element layer and is used to display a background image.

8. A handwriting processing method, wherein: Applied to an interactive device, the method includes: Displaying a writing application interface of a writing application, wherein the writing application interface is provided with a dynamic writing layer and a static element layer, wherein the dynamic writing layer is located above the static element layer; receiving at least one touch event detected by the touch-sensitive display screen, and determining an operation type of a touch operation corresponding to the touch event, the operation type including a writing operation and an erasing operation; In a case where the touch operation is a writing operation, responding to the touch event through the dynamic writing layer, updating the handwriting corresponding to the writing operation in the dynamic writing layer, and after the writing operation ends, adding the handwriting of the writing operation to the static element layer and deleting the corresponding handwriting in the dynamic writing layer; In the case that the touch operation is an erasing operation, the static element layer responds to the touch event, and the second handwriting in the static element layer is erased according to the erasing area generated by the touch event.

9. The handwriting processing method according to claim 8, wherein: The method further comprises: In the case where the touch operations corresponding to the multiple touch events are writing operations, if the interval between the start times of the writing operations is greater than the expected If the first time threshold is set, the dynamic writing layer responds to the multiple touch events to update the handwriting of the corresponding writing operation.

10. The handwriting processing method according to claim 8, wherein: The method further comprises: In a case where the touch operations corresponding to the multiple touch events are writing operations, if the interval between the start times of two writing operations is less than a preset first time threshold, and the distance between the starting position of one of the two writing operations and the position of the other writing operation at the same time is less than a preset distance threshold, then it is determined that the two writing operations correspond to triggering a multi-finger zoom operation or a multi-finger move operation; clearing, through the dynamic writing layer, the handwriting corresponding to the two writing operations displayed in the dynamic writing layer; The second handwriting displayed in the static element layer is scaled or moved by the static element layer in response to a touch event corresponding to the multi-finger zoom operation or the multi-finger move operation.

11. The handwriting processing method according to claim 8, wherein: The receiving at least one touch event detected by the touch-sensitive display screen and determining the operation type of the touch operation corresponding to the touch event includes: A touch event is received through the dynamic writing layer, and an operation type of the touch operation corresponding to the touch event is determined.

12. The handwriting processing method according to claim 8, wherein: The touch events corresponding to the touch operation include a touch start event, a touch move event, and a touch end event, and the touch start event, the touch move event, and the touch end event in the same touch operation have the same touch identifier; Accordingly, determining the operation type of the touch operation corresponding to the touch event includes: In the case of acquiring a touch start event, determining an operation type corresponding to the touch operation according to touch information of the touch start event, and saving a touch identifier of the touch start event as an operation identifier corresponding to a writing operation or an erasing operation; When a touch move event or a touch end event is obtained, the touch identifier of the touch move event or the touch end event is compared with the saved operation identifier to determine the operation type of the touch operation corresponding to the touch move event or the touch end event.

13. The handwriting processing method according to claim 12, wherein: The determining the operation type of the corresponding touch operation according to the touch information of the touch start event includes: The touch area of ​​the touch start event is compared with a preset area threshold, and the operation type of the touch operation corresponding to the touch start event is determined according to the comparison result.

14. The handwriting processing method according to claim 13, wherein: The erasing operation is triggered by a palm, and the preset area threshold is the minimum area of ​​a palm; Accordingly, determining the operation type of the touch operation corresponding to the touch start event according to the comparison result includes: When the touch area is greater than or equal to a preset area threshold, determining that the touch operation corresponding to the touch start event is an erase operation; When the touch area is smaller than a preset area threshold, it is determined that the touch operation corresponding to the touch start event is a writing operation.

15. The handwriting processing method according to claim 12, wherein: The updating of the handwriting corresponding to the writing operation in the dynamic writing layer includes: When the touch start event is acquired, drawing a first handwriting point in the dynamic writing layer according to the touch coordinates of the touch start event; When the touch movement event is acquired, drawing a second handwriting point in the dynamic writing layer according to the touch coordinates of the touch movement event, and connecting the second handwriting point with the handwriting point corresponding to the previous touch event according to the touch identifier of the touch movement event to form a handwriting segment; When the touch end event is obtained, a third handwriting point is drawn in the dynamic writing layer according to the touch coordinates of the touch end event, and the third handwriting point is connected with the second handwriting point corresponding to the previous touch movement event according to the touch identifier of the touch end event to form the handwriting of the corresponding writing operation.

16. The handwriting processing method according to claim 15, wherein: After the writing operation is completed, adding the handwriting of the writing operation to the static element layer and deleting the corresponding handwriting in the dynamic writing layer includes: After the third handwriting point is connected with the corresponding second handwriting point to form handwriting corresponding to the writing operation, the handwriting of the writing operation is added to the static element layer through the dynamic writing layer and the corresponding handwriting in the dynamic writing layer is deleted.

17. The handwriting processing method according to claim 11, wherein: When the touch operation is an erasing operation, responding to the touch event through the static element layer and erasing the second handwriting in the static element layer according to the erasing area generated by the touch event includes: When the dynamic writing layer determines that the touch operation is an erase operation, transmitting the touch event to the static element layer through the dynamic writing layer; The touch event is received and responded to through the static element layer, an erasure area is determined according to the touch coordinates of the touch event, and the second handwriting in the static element layer is erased according to the erasure area.

18. The handwriting processing method according to claim 17, wherein: The determining of the erasure area according to the touch coordinates of the touch event includes: determining, according to the touch identifier of the touch event, a previous touch event corresponding to the touch operation; Determine an erasing endpoint based on the touch coordinates of the touch event and the touch coordinates of the previous touch event, and determine Erase area.

19. The handwriting processing method according to claim 8, wherein: Erasing the second handwriting in the static element layer according to the erasing area generated by the touch event includes: If the second handwriting is located within the erasure area, deleting the second handwriting from the static element layer; If the first line segment of the second handwriting is located in the erasure area, the first line segment is deleted from the static element layer, the remaining handwriting segment is saved as a new second handwriting in the static element layer, and the original second handwriting is deleted.

20. The handwriting processing method according to claim 8, wherein: After responding to the touch event through the static element layer, the method further includes: If the non-handwriting element in the static element layer is located in the erasure area, the non-handwriting element is deleted from the static element layer.

21. A handwriting processing device, wherein: Applied to an interactive device, the apparatus comprises: A first interface display module is configured to display a writing application interface of a writing application, wherein the writing application interface is provided with a dynamic writing layer and a static element layer, wherein the dynamic writing layer is located above the static element layer; A first handwriting drawing module is configured to receive a first movement operation in the writing application interface; when the first movement operation is received, synchronously draw a first handwriting corresponding to the first movement operation in the dynamic writing layer; a first operation receiving module configured to receive a second movement operation during the process of receiving the first movement operation; the second movement operation covers a second handwriting displayed in the static element layer, the second movement operation partially overlaps with the first handwriting, and the area of ​​the touch point of the second movement operation is greater than or equal to a preset area threshold; A first handwriting erasing module is configured to erase the second handwriting displayed in the static element layer according to the second movement operation; The first interface updating module is configured to add the first handwriting to the static element layer and delete the first handwriting from the dynamic writing layer after the first movement operation is completed, thereby updating the writing application interface.

22. A handwriting processing device, wherein: Applied to an interactive device, the apparatus comprises: A second interface display module is configured to display a writing application interface of a writing application, wherein the writing application interface is provided with a dynamic writing layer and a static element layer, and the dynamic writing layer is located above the static element layer; an operation type determination module, configured to receive at least one touch event detected by the touch-sensitive display screen, and determine an operation type of the touch operation corresponding to the touch event, wherein the operation type includes a writing operation and an erasing operation; a second handwriting drawing module configured to, when the touch operation is a writing operation, respond to the touch event through the dynamic writing layer, update the handwriting corresponding to the writing operation in the dynamic writing layer, and add the handwriting of the writing operation to the static element layer and delete the corresponding handwriting in the dynamic writing layer after the writing operation ends; The second handwriting erasing module is configured to respond to the touch event through the static element layer when the touch operation is an erasing operation, and erase the second handwriting in the static element layer according to the erasing area generated by the touch event.

23. An interactive device, wherein: include: one or more processors; The memory stores one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the handwriting processing method according to any one of claims 1 to 20.

24. A storage medium comprising computer-executable instructions, wherein: The computer executable instructions are used to execute the handwriting processing method according to any one of claims 1 to 20 when executed by a computer processor.

Citation Information

Patent Citations

  • System for achieving blackboard writing on any interface on intelligent interaction large screen

    CN110162266A

  • Handwriting display method and device, terminal equipment and storage medium

    CN110597444A

  • Electronic handwriting writing and erasing method, storage medium and equipment

    CN113608667A

  • Interface handwriting writing method and system, control device and storage medium

    CN114610188A

  • Display control device, display device, display system, program, and recording medium

    JP2015148845A