Quick annotation method, interactive panel, and storage medium

Abstract

Disclosed in embodiments of the present application are a quick annotation method, an interactive panel, and a storage medium. According to the quick annotation method provided in the embodiments of the present application, for an annotation function having high frequency of use in an interactive panel, in a specific annotation requirement scenario and by means of multiple specific modes, no annotation function trigger operation is required on the basis of existing displayed pictures; when a touch-sensitive display screen of the interactive panel detects touch operations that corresponding sensor data matches the usage characteristics of the annotation function, an application window capable of realizing the annotation function can directly respond to these touch operations while maintaining the existing displayed pictures, and the specific input content of a handwriting function is directly used as a trigger mode for an application supporting the handwriting function, thus simplifying the interaction process of realizing specific operations, and reducing the number of operations incapable of directly generating data.

Description

Quick annotation method, interactive tablet and storage medium Technical Field

[0001] The embodiments of the present application relate to the field of human-computer interaction technology, and in particular to a quick annotation method, an interactive tablet, and a storage medium. Background Art

[0002] With the continuous development of electronic technology, the types of electronic products that people come into contact with in daily life are becoming more and more diverse. In addition, based on the intuitiveness and convenience of human-computer interaction in interactive electronic products, the usage rate of interactive electronic products in people's work and life is becoming more and more high.

[0003] Currently, most interactive electronic products on the market (such as interactive tablets) require annotation operations to be triggered by clicking an annotation button. Furthermore, after launching the annotation app, users cannot directly select, click, or turn pages of the on-screen content. Instead, they must first actively close the annotation app or set its usage status. Overall, on interactive tablets, various specific operations on the on-screen content require triggering one or more functional controls as required to enter the corresponding functional state, making the interactive process complex.

[0004] Summary of the Invention

[0005] The present invention provides a quick annotation method, an interactive tablet and a storage medium to solve the technical problem that various specific operations on the screen display content on the interactive tablet require triggering one or more functional controls as required to enter the corresponding functional state for operation, thereby realizing a complex interactive process for specific operations.

[0006] In a first aspect, an embodiment of the present application provides a quick annotation method, which is applied to a first interactive tablet. The first interactive tablet includes a touch-sensitive display screen, and the touch-sensitive display screen is used to detect the position information and touch type of a touch object. The quick annotation method includes:

[0007] Displaying a first screen on a touch-sensitive display screen of a first interactive tablet, wherein the first interactive tablet is in a video conference with a second video conferencing application of at least one second interactive tablet on a network end via a first video conferencing application, and a second screen is displayed on the second interactive tablet;

[0008] receiving first sensing data of a touch object performing a first operation on a first screen, the first sensing data including first position information detected by the touch-sensitive display screen and a touch object type of the touch object;

[0009] When it is confirmed that the touch object type is the preset first touch object type and the first operation is confirmed to be a move operation based on the first position information, the first batch of annotation application windows of the first batch of annotation applications are superimposed and displayed on the first screen, and the first writing handwriting is added and displayed on the annotation application window based on the first position information;

[0010] Acquiring first handwriting data of the first handwriting, synchronizing the first handwriting data to a second video conferencing application of the second interactive tablet through the first video conferencing application, causing the second interactive tablet to overlay a second annotation application window of the second annotation application on the second screen based on the first handwriting data, and adding and displaying the first handwriting in the second annotation application window;

[0011] receiving, through the first video conferencing application, second handwriting data synchronized with the second video conferencing application, the second handwriting data being handwriting data generated by a writing operation performed by a touch object on the second annotation application window;

[0012] The second handwriting data is sent to the first batch annotation application program, so that the first batch annotation application program adds and displays the second handwriting in the first batch annotation application window according to the second handwriting data.

[0013] As described above, when multiple interactive tablets are participating in the same video conference, when a specific type of touch object movement operation is detected through the touch-sensitive display screen of the interactive tablet, an annotation application window is superimposed and displayed on the basis of the first screen displayed locally, and while directly adding handwriting according to the movement operation, the corresponding handwriting data is sent to other interactive tablets in the same video conference, so that the other interactive tablets also superimpose an annotation application window and add handwriting according to the handwriting data. From another perspective, when the interactive tablet first receives the handwriting data sent by the other interactive tablets, it also superimposes and displays the annotation application window and adds the handwriting. This is equivalent to when multiple interactive tablets are participating in the same video conference, when one interactive tablet starts a writing operation, the other interactive tablets directly start the annotation application window that can perform interactive annotations. Corresponding to the user's operational needs, when a user uses a touch object dedicated to writing to perform a moving operation in a video conference state, it is equivalent to the user having a writing need. In a video conference scenario, when a user has a writing need, the written content must be sent to other interactive tablets to be displayed to other participants. Moreover, this display is likely to require multi-party interaction, that is, participants using other interactive tablets may also have the need to display writing based on a synchronized writing interface. Therefore, the quick annotation method designed in this solution can simultaneously start the annotation application windows of multiple interactive tablets and enter the interactive annotation state through a single operation, simplifying the operation process and improving operational efficiency. Especially for video conferencing scenarios, it can avoid complex operations on the terminals of the conference process and ensure the continuity of the conference process. Moreover, directly triggering interactive annotations and synchronous display of different interactive tablets with handwriting data can save transmission bandwidth compared to screen sharing, and allocate more bandwidth to data transmission tasks such as sound and live video transmission, effectively reducing lag.

[0014] The first handwriting data of the first handwriting is obtained, and the first handwriting data is synchronized to the second video conferencing application of the second interactive tablet through the first video conferencing application, specifically:

[0015] Obtain the conference identification information of the current conference of the first video conferencing application, and obtain the first handwriting data of the first written handwriting, and send the first handwriting data and the conference identification information to the conference server through the first video conferencing application, so that the conference server synchronizes the first handwriting data to the second video conferencing application of the second interactive tablet according to the conference identification information, and the current conference identification information of the second video conferencing application is the same as the conference identification information of the first video conferencing application.

[0016] In the above, the conference server forwards data to the associated interactive tablet according to the conference identification information. The first interactive tablet only needs to send data once for each writing behavior, which can effectively improve data transmission efficiency and reduce local data transmission load and complexity.

[0017] The quick annotation method further includes:

[0018] receiving second sensing data of a touch object performing a second operation on the first registration application window, the second sensing data including second position information detected by the touch-sensitive display screen and a touch object type of the touch object;

[0019] Adding handwriting to the first batch of annotation application windows according to the second position information, or triggering operation controls of the first batch of annotation application windows;

[0020] After the erase control of the first batch of registered application windows is triggered, third sensing data of a third operation performed by the touch object on the first batch of registered application windows is received, the third sensing data including third position information detected by the touch-sensitive display screen and a touch object type of the touch object;

[0021] According to the third position information, corresponding writing handwriting is erased on the first batch of annotation application windows.

[0022] As described above, based on the first batch of annotation application windows that have been displayed, writing handwriting can be added or deleted according to the specific operation content. Based on the first batch of annotation application windows, the display content can be easily edited according to the needs of the video conference.

[0023] The step of erasing corresponding handwriting on the first batch of annotation application windows according to the third position information includes:

[0024] Sending handwriting information of the target deleted handwriting associated with the third position information to the second interactive tablet, so that the second interactive tablet sends the handwriting information to the second annotation application to lock the corresponding handwriting, so that the locked handwriting cannot be edited;

[0025] After erasing the corresponding handwriting on the first batch of annotation application windows according to the third position information, the method further includes:

[0026] When the third operation is confirmed to be completed, the handwriting update information generated according to the third operation is sent to the second interactive tablet, so that the second interactive tablet sends the handwriting update information to the second annotation application to unlock the written handwriting and update the corresponding written handwriting.

[0027] As described above, in the case of interactive annotations established between the first interactive tablet and the second interactive tablet, when an erasing operation occurs on the first interactive tablet, by locking the currently erased handwriting, operation conflicts caused by multiple users operating the same handwriting on different interactive tablets at the same time can be avoided.

[0028] The third position information includes position information corresponding to multiple touch points;

[0029] Correspondingly, erasing the corresponding handwriting on the first batch of annotation application windows according to the third position information includes:

[0030] When the first batch annotation application window is in the first batch annotation state, the first single point position information is confirmed according to the third position information, and the writing corresponding to the first single point position information is erased on the first batch annotation application window, and the first screen in the first batch annotation state remains unchanged.

[0031] As mentioned above, after triggering the erase control, all operation targets should be to delete the existing writing handwriting. Even if the third position information is the position information generated by multi-point operation, the first single-point position information is confirmed based on the third position information, and the multi-point operation is deleted in the form of a single-point response, so that handwriting deletion can be achieved through various operation methods.

[0032] The second position information includes position information corresponding to multiple touch points;

[0033] Accordingly, adding handwriting to the first batch of annotation application windows according to the second position information includes:

[0034] When the first batch annotation application window is in the first batch annotation state, the second single point position information is confirmed according to the second position information, and writing handwriting is added to the first batch annotation application window according to the second single point position information, and the first screen in the first batch annotation state remains unchanged.

[0035] As mentioned above, in the writing state, all operation targets should be to add writing handwriting. Even if the second position information is the position information generated by multi-point operation, the second single-point position information is confirmed based on the second position information, and the multi-point operation is performed in the form of a single-point response, so that handwriting addition can be achieved through various operation methods.

[0036] The quick annotation method further includes:

[0037] receiving fourth sensing data of a fourth operation performed by a touch object when the first batch of annotation application windows is in a first batch annotation state, the fourth sensing data including fourth position information detected by the touch-sensitive display screen and a touch object type, and the touch area of ​​the touch object reaches a preset erasure threshold, and the first screen in the first batch annotation state remains unchanged;

[0038] According to the fourth position information, corresponding writing handwriting is erased on the first batch of annotation application windows.

[0039] As described above, the first batch of registered applications can be quickly erased in any state through a specific touch method that is not used for writing or clicking operations, that is, through an operation in which the touch area reaches a certain preset size.

[0040] The method of obtaining first handwriting data of the first handwriting and synchronizing the first handwriting data to a second video conferencing application of the second interactive tablet through the first video conferencing application includes:

[0041] The screen data of the first screen is synchronized to the second interactive tablet, so that the second interactive tablet displays the first screen, and the second annotation application window covers the first screen.

[0042] As described above, when the first interactive tablet and the second interactive tablet are in the same video conference, when the first interactive tablet generates the first writing handwriting, the first writing handwriting and the first picture are directly synchronized to the first interactive tablet for display, so that the writing operation can simultaneously generate the writing handwriting, share the writing handwriting and share the first picture, thereby improving the interaction efficiency in the video conference scenario.

[0043] The first screen is the shared screen of the video conference.

[0044] As described above, superimposing the annotation application window on the shared screen enables participants using different interactive tablets to perform interactive annotations based on the same basic information without any information gap.

[0045] In a second aspect, an embodiment of the present application provides a quick annotation method, which is applied to an interactive tablet, the interactive tablet including a touch-sensitive display screen, the touch-sensitive display screen being used to detect the position information and touch type of a touch object, the quick annotation method comprising:

[0046] displaying a first interface on the touch-sensitive display screen;

[0047] receiving first sensing data of a touch object performing a first operation on a first interface, the first sensing data including first position information detected by the touch-sensitive display screen and a touch object type of the touch object;

[0048] When it is determined that the touch object type does not meet the preset first touch object type, performing a touch response to the first operation based on the first position information, and updating the first interface;

[0049] When it is confirmed that the touch object type is the preset first touch object type, and the first operation is confirmed to be a click or long press operation based on the first position information, a touch response is performed to the first operation based on the first position information, and the first interface is updated;

[0050] When it is confirmed that the touch object type is the preset first touch object type and the first operation is confirmed to be a move operation based on the first position information, a first batch of annotation application windows are added to the first interface, and writing is added to the first batch of annotation application windows based on the first position information;

[0051] receiving second sensing data of a second operation performed by a touch object on the first batch of registered application windows, the second sensing data including second position information detected by the touch-sensitive display screen and a touch object type of the touch object;

[0052] Adding handwriting on the first batch of annotation application windows according to the second position information, or triggering operation controls on the first batch of annotation application windows;

[0053] After triggering the erase control on the first batch of application windows, receiving third sensing data of a third operation performed by the touch object on the first batch of application windows, the third sensing data including third position information detected by the touch-sensitive display screen and a touch object type of the touch object;

[0054] According to the third position information, corresponding writing handwriting is erased on the first batch of annotation application windows.

[0055] As mentioned above, when the interactive tablet's touch-sensitive display detects the movement of a specific type of touch object, a new annotation application window is displayed overlaid on the first locally displayed screen, allowing writing and erasing operations within the annotation application window. In response to user operational needs, when a user uses a touch object specifically for writing to perform a movement operation, it is equivalent to the user having a writing need. The quick annotation method designed in this solution can quickly launch the interactive tablet's annotation application window and enter the annotation state with a single operation, simplifying the operation process and improving operational efficiency.

[0056] The first interface is an interface of a writing application, and the quick annotation method further includes:

[0057] receiving fourth sensing data of a fourth operation performed by the touch object on the first interface, the fourth sensing data including fourth position information detected by the touch-sensitive display screen and a touch object type of the touch object;

[0058] Perform a touch response to the fourth sensor data and update the first interface.

[0059] As mentioned above, when the interactive tablet itself has displayed the interface of the writing application, it is equivalent to the user's current operation requirement being to write or perform other operations on the first interface. The writing operation or any other operation can be directly responded to through the interface of the writing application. At this time, the display of the annotation application window is no longer used as a response to the fourth operation, which can reduce erroneous operations.

[0060] The quick annotation method further includes:

[0061] When the touch object type is confirmed to be the preset first touch object type and the first operation is confirmed to be in the edge area of ​​the first interface based on the first position information, a touch response is performed on the first operation based on the first position information to update the first interface.

[0062] As mentioned above, for user operations, writing operations are usually performed in the center area of ​​the interactive tablet, and the edge area usually cannot meet conventional writing needs. Therefore, shortcut operations can be defined or commonly used operation controls can be laid out in the edge area. When a first touch operation that meets the preset requirements is detected in the edge area of ​​the interactive tablet, quick operations can be achieved according to the defined shortcut operations or triggered operation controls.

[0063] Among them, the first interface is the projection interface received by the interactive tablet, and the quick annotation method also includes:

[0064] Updated the screen projection interface;

[0065] The handwriting of the first batch of application windows is displayed on the updated projection interface.

[0066] As mentioned above, based on the projection, the first batch of application windows are triggered by the first operation. In order to ensure the normal display of the core display content, the first batch of application windows do not affect the reception and display of the projection screen, that is, the projection screen displayed in the first interface is always updated to ensure the information presentation goals of all dimensions of the interactive tablet.

[0067] The third position information includes position information corresponding to multiple touch points;

[0068] Correspondingly, erasing the corresponding handwriting on the first batch of annotation application windows according to the third position information includes:

[0069] When the first batch annotation application window is in the first batch annotation state, the first single point position information is confirmed according to the third position information, and the writing corresponding to the first single point position information is erased on the first batch annotation application window, and the first screen in the first batch annotation state remains unchanged.

[0070] As mentioned above, after triggering the erase control, all operation targets should be to delete the existing writing handwriting. Even if the third position information is the position information generated by multi-point operation, the first single-point position information is confirmed based on the third position information, and the multi-point operation is deleted in the form of a single-point response, so that handwriting deletion can be achieved through various operation methods.

[0071] The second position information includes position information corresponding to multiple touch points;

[0072] Accordingly, adding handwriting to the first batch of annotation application windows according to the second position information includes:

[0073] When the first batch annotation application window is in the first batch annotation state, the second single point position information is confirmed according to the second position information, and writing handwriting is added to the first batch annotation application window according to the second single point position information, and the first screen in the first batch annotation state remains unchanged.

[0074] As mentioned above, in the writing state, all operation targets should be to add writing handwriting. Even if the second position information is the position information generated by multi-point operation, the second single-point position information is confirmed based on the second position information, and the multi-point operation is performed in the form of a single-point response, so that handwriting addition can be achieved through various operation methods.

[0075] After receiving the second sensing data of the second operation performed by the touch object on the first batch of registered application windows, the method further includes:

[0076] When the touch object type in the second sensing data is the touch object type corresponding to the pen end and the first operation is confirmed to be a move operation based on the second position information, the corresponding writing handwriting is erased on the first batch of annotation application windows according to the second position information.

[0077] As described above, based on the daily usage habit of writing with the pen tip and erasing with the pen tail, on the basis that the touch-sensitive display screen can recognize the type of the touch object, when the touch object type corresponding to the pen tail is recognized, the direct response is an erasing operation.

[0078] The quick annotation method further includes:

[0079] receiving fourth sensing data of a fourth operation performed by a touch object when the first batch of annotation application windows is in a first batch annotation state, the fourth sensing data including fourth position information detected by the touch-sensitive display screen and a touch object type, and the touch area of ​​the touch object reaches a preset erasure threshold, and the first screen in the first batch annotation state remains unchanged;

[0080] According to the fourth position information, corresponding writing handwriting is erased on the first batch of annotation application windows.

[0081] As described above, the first batch of registered applications can be quickly erased in any state through a specific touch method that is not used for writing or clicking operations, that is, through an operation in which the touch area reaches a certain preset size.

[0082] When adding handwriting to the first batch of annotation application windows, the display properties of the handwriting added corresponding to different touch object types are different.

[0083] As described above, different touch object types correspond to different display attributes of handwriting added, which can provide clear input comparison when multiple people are writing or when individuals have different inputs.

[0084] In a third aspect, an embodiment of the present application further provides a quick annotation method, which is applied to an interactive tablet, wherein the interactive tablet includes a touch-sensitive display and a control mainboard, the touch-sensitive display is used to detect the position information of the touch object and the medium type of the touch object, the control mainboard is installed with a driver and an operating system, and the touch-sensitive display is connected to the control mainboard. The quick annotation method includes:

[0085] displaying a first interface on the touch-sensitive display screen;

[0086] The driver receives first sensing data of a touch object performing a first operation on a first interface, the first sensing data including first position information detected by the touch-sensitive display screen and a touch object type of the touch object;

[0087] The driver confirms, based on the first position information, that the first operation is a moving operation and that the touch object type is a preset first medium type, and sends the first sensing data to the annotation application;

[0088] The annotation application program adds a first batch of annotation application windows on the first interface, and adds writing handwriting to the first batch of annotation application windows according to the first position information;

[0089] The driver receives second sensing data of the second operation performed by the touch object on the first batch of registered application windows and sends the data to the operating system, the second sensing data including second position information detected by the touch-sensitive display screen;

[0090] The operating system sends the second sensory data to the annotation application;

[0091] The annotation application adds writing handwriting on the first batch of annotation application windows according to the second position information, or triggers operation controls on the first batch of annotation application windows;

[0092] After the erase control on the first batch of application windows is triggered, the driver receives third sensing data of the third operation performed by the touch object on the first batch of application windows and sends the data to the operating system, the third sensing data including third position information detected by the touch-sensitive display screen;

[0093] The operating system sends the third sensory data to the annotation application;

[0094] The annotation application erases the corresponding writing handwriting on the first annotation application window according to the third position information.

[0095] As mentioned above, by preliminarily confirming the data status of the sensor data corresponding to the touch operation through the driver, the display of the annotation application window can be directly triggered. The user can directly pick up the pen to write, and the underlying driver directly sends data to trigger the annotation application window that responds to the writing operation and directly completes the addition of writing handwriting. There is no need for complicated switching states or pre-operations of the wake-up function, thus achieving fast writing.

[0096] The annotation application is started and runs in the background; the quick annotation method also includes:

[0097] When the annotation application confirms that the first interface is not the interface of the writing application, the annotation application establishes a data channel with the driver; when the annotation application confirms that the first interface is the interface of the writing application, the annotation application disconnects the data channel with the driver; the data channel is used to transmit the first sensor data.

[0098] As described above, setting the connection state of the data channel between the annotation application and the driver according to the type of the first interface can directly avoid unnecessary display of the annotation application window when writing is currently supported.

[0099] In a fourth aspect, an embodiment of the present application further provides an interactive tablet, including:

[0100] one or more processors;

[0101] a memory for storing one or more computer programs;

[0102] When one or more computer programs are executed by one or more processors, the interactive tablet implements any quick annotation method as described in the first to third aspects.

[0103] In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, it implements the quick annotation method of any one of the first to third aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0104] FIG1 is a flow chart of a first quick annotation method provided in an embodiment of the present application.

[0105] FIG2 is a schematic diagram of a first interface provided in an embodiment of the present application.

[0106] FIG3 is a schematic diagram of an annotation application window provided in an embodiment of the present application.

[0107] FIG4 is a schematic diagram of handwriting added based on an embodiment of the present application.

[0108] FIG5 is a schematic diagram of another handwriting added based on an embodiment of the present application.

[0109] FIG6 is a schematic diagram of performing multipoint operation;

[0110] FIG7 is a flow chart of a second quick annotation method provided in an embodiment of the present application.

[0111] FIG8 is a flow chart of a third quick annotation method provided in an embodiment of the present application.

[0112] FIG9 is a schematic diagram of the structure of an interactive tablet provided in an embodiment of the present application. DETAILED DESCRIPTION

[0113] In order to make the purpose, technical solutions and advantages of this application more clear, the specific embodiments of this application are further described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, rather than to limit the present invention.

[0114] It should be noted that, for ease of description, only the parts related to the present application, not all of the contents, are shown in the accompanying drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the various operations (or steps) as sequential processes, many of the operations therein can be implemented in parallel, concurrently, or simultaneously. In addition, the order of the various operations can be rearranged. The process can be terminated when its operations are completed, but there can also be additional steps not included in the accompanying drawings. The terms "first", "second", etc. in the specification, claims, and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0115] The quick annotation method of the present application can be applied to an interactive tablet, which can be an integrated device that uses touch technology to control the content displayed on the display screen and realize human-computer interaction operations. It integrates one or more functions such as a projector, an electronic whiteboard, a screen, a speaker, a television, and a video conferencing terminal. Of course, the interactive tablet does not include any restrictions on the surface characteristics of the display surface. For example, the surface characteristics of the interactive tablet can be flat, curved, or a combination of multiple flat surfaces.

[0116] Typically, the interactive tablet is installed with at least one operating system, wherein the operating system includes but is not limited to Android system, Linux system, Windows system and Huawei Hongmeng system, which is used to control and coordinate the interactive tablet and external devices so that the various independent hardware in the interactive tablet can work in coordination as a stable whole. The architectural layer where the operating system is located is defined as the system layer. On the basis of the system layer, the interactive tablet is installed with applications developed to meet different fields and different problems of users, and the corresponding architectural layer is the application layer. In the description of the specific embodiment of this scheme, the interactive tablet can install at least one application with a writing function. Among them, the application with a writing function can be an application that comes with the operating system, and it can also be an application downloaded from a third-party device or server. Optionally, in addition to the writing function based on touch operation, the application also has other editing functions, such as deletion function, inserting tables, inserting pictures, illustration graphics, drawing tables, drawing graphics and other functions. For example, annotation applications, whiteboard applications, etc. belong to the above-mentioned applications with writing functions.

[0117] Interactive tablets are mainly suitable for multi-person communication scenarios. In these application scenarios, there are a large number of interactions between people and between people and interactive tablets. In applications developed to support or realize these interactions, each specific interactive function usually requires a corresponding control to trigger. With the increase in applications and the continuous improvement of functions, the use of applications tends to be complex. The learning cost of proficiently using the interactive functions in various applications is getting higher and higher, and the user experience is poor.

[0118] In a video conference scenario, the two parties communicate remotely through a video conference application. During the communication process, they may directly draw text or graphics and share them with other participants in the video conference. They may also share a screen, annotate it, and share it with other participants. In the existing technical solutions, when drawing text or annotations are needed in a video conference, it is necessary to open the relevant application (such as an annotation application) through a complex path, and then click on the sharing control to realize the sharing of the drawing content. This method is complicated to operate and has a poor user experience. Sometimes, repeated attempts are required during the meeting to realize the drawing content and the sharing of the drawing content, which seriously affects the smooth progress of the video conference and provides a poor user experience.

[0119] In response to the above technical problems, the embodiments of the present application propose a quick annotation method. For the annotation function that is frequently used on interactive tablets, it can be used in a variety of specific ways to target specific annotation demand scenarios. On the basis of the existing displayed screen, there is no need to trigger the annotation function. When the touch-sensitive display screen of the interactive tablet detects a touch operation whose corresponding sensor data meets the usage characteristics of the annotation function, it directly responds to these touch operations with an application window that can implement the annotation function on the basis of maintaining the existing displayed screen. The specific input content of the handwriting function is directly used as the trigger method for the application that supports the handwriting function, which simplifies the interactive process for implementing specific operations and reduces operations that cannot directly generate data.

[0120] FIG1 is a method flow chart of a quick annotation method provided in an embodiment of the present application, wherein the quick annotation method is applied to a first interactive tablet, wherein the first interactive tablet includes a touch-sensitive display screen, and the touch-sensitive display screen is used to detect the position information of a touch object and the touch object type of the touch object. A touch-sensitive display screen is a display screen with a touch function, such as an infrared display screen, a capacitive display screen, a resistive display screen, an electromagnetic display screen, or a pressure-sensitive display screen, etc. On the touch-sensitive display screen, a user can perform writing operations or other operations by touching the touch-sensitive display screen with a finger, a writing pen, or other touch media (collectively referred to as a touch object). Accordingly, the interactive tablet detects the position information of the finger or writing pen when performing the touch operation, and responds according to the position information to realize a touch-based human-computer interaction function. In an embodiment of the present application, the sensor data that can be detected by the touch-sensitive display screen includes not only position information, but also a judgment result on the type of touch object achieved by directly detecting a touch signal or detecting a specific signal of the touch object through an auxiliary sensor. For example, different types of touch objects are distinguished according to the size of the contact point when the touch object contacts the touch-sensitive display screen, different types of touch objects are distinguished according to a recognizable physical signal (such as sound, etc.) generated when the touch object contacts the touch-sensitive display screen, and different types of touch objects are distinguished according to a wireless signal with identification capability generated when the touch object contacts the touch-sensitive display screen. The detection results corresponding to these implementation methods all belong to the sensor data detected by the touch-sensitive display screen.

[0121] As shown in FIG1 , the quick annotation method includes but is not limited to steps S110 to S160:

[0122] Step S110: Displaying a first picture on the touch-sensitive display screen of the first interactive tablet, wherein the first interactive tablet is in a video conference with a second video conferencing application of at least one second interactive tablet on the network end through the first video conferencing application, and a second picture is displayed on the second interactive tablet.

[0123] In the embodiment of the present application, the screen currently displayed by the interactive tablet through the touch-sensitive display screen is the first screen, that is, the first screen refers to the interactive screen currently displayed by the interactive tablet through the touch-sensitive display screen. It can be understood that the content presented in the interactive screen may include one or more application interfaces for receiving and / or displaying information. For example, a document editing application, whose application interface is mainly used to receive document content input by the user and display it; a video playback application, whose application interface is mainly used to display changing video screens. Similarly, for the system desktop on the interactive tablet, it can also be the interactive screen currently displayed by the touch-sensitive display screen. As shown in Figure 2, the touch-sensitive display screen of the interactive tablet 1 exemplarily displays the first screen, which is the system desktop with multiple application icons 1 displayed on the interactive tablet 1.

[0124] The specific application scenario targeted in the embodiments of this application is a video conference between an interactive tablet and other interactive tablets on the network. The video conference is established at the application level through a video conferencing application. Specifically, the video conferencing applications installed on different interactive tablets initiate access to a conference server using conference information requested by the conference initiator and join a virtual conference room provided by the conference server. The interactive tablets in the same virtual conference room are in the video conference. In the embodiments of this application, for ease of description, one interactive tablet in this application scenario is defined as a first interactive tablet, the video conferencing application installed on the first interactive tablet is defined as a first video conferencing application, and the interface displayed on the first interactive tablet is defined as a first screen. Correspondingly, the other interactive tablet is defined as a second interactive tablet, the video conferencing application installed on the second interactive tablet is defined as a second video conferencing application, and the screen displayed on the second interactive tablet is defined as a second screen. It should be understood that the corresponding names used above with reference to the first and second interactive tablets essentially refer to objects of the same type, and the differences in naming only reflect individual differences. For example, the first and second video conferencing applications may be the same application, and the difference between them may be that they are logged in using different accounts on different interactive tablets and have different permissions when used in specific applications. Based on the embodiment of the present application, operations on the first interactive tablet may affect the display content of the second interactive tablet, and similar operations on the second interactive tablet may also have an impact on the display content of the first interactive tablet. Therefore, during a video conference, any interactive tablet can be used as the first interactive tablet, and based on the embodiment of the present application, interactive annotations of all interactive tablets in the same video conference can be implemented.

[0125] Step S120: receiving first sensing data of a touch object performing a first operation on a first screen, the first sensing data including first position information detected by the touch-sensitive display screen and a touch object type of the touch object.

[0126] The first operation is an operation performed by the user using a touch object on the first interactive tablet when only the first screen is displayed on the first interactive tablet, or the first screen is displayed on top. The touch-sensitive display screen can detect corresponding sensor data for all touch operations when in normal use. In the embodiment of the present application, the sensor data corresponding to the first operation is defined as first sensor data, which corresponds to the sensor data described above and includes position information and touch object type as a whole, that is, the first sensor data includes the position information corresponding to the first operation and the touch object type of the touch object.

[0127] The detected sensor data needs to be packaged according to a pre-set data structure and then sent to the processor of the first interactive flat panel for processing. In an embodiment of the present application, the packaging method of the sensor data can be implemented on the basis of a universal standard data structure. Each touch operation performed on the touch-sensitive display screen may generate multiple touch points, and the sensor data corresponding to each touch point is generated and distributed according to the standard. For example, according to the universal standard data structure, the sensor data corresponding to each touch point is recorded through multiple bytes, and the information recorded in the sensor data includes the coordinates, width, height, pressure and direction angle of the touch point, etc. Each information occupies a corresponding byte length in the universal standard data structure for recording.

[0128] In the embodiment of the present application, the bytes corresponding to a certain information can be further subdivided. While ensuring the normal recording of the original information, a number of digits can be assigned to record the identifier corresponding to the identified touch object type (i.e., medium type), for example, 0 represents a finger, 1 represents a writing pen A, 2 represents a writing pen B, 3 represents an eraser, etc. Of course, the identifiers 0, 1, 2, and 3 here are decimal numbers, which are converted to binary numbers 00, 01, 10, and 11 when recorded in the digits.

[0129] Step S130: When it is confirmed that the touch object type is the preset first touch object type, and based on the first position information, it is confirmed that the first operation is a moving operation, the first batch of annotation application windows of the first batch of annotation applications are superimposed and displayed on the first screen, and the first writing handwriting is added and displayed on the first batch of annotation application windows based on the first position information.

[0130] The interactive design of interactive tablets, centered around handwriting input, generally adheres to common practices of physical writing. For example, pen tips used for writing are generally thinner, and pen tips of varying thicknesses produce handwriting of varying thicknesses. In an embodiment of the present application, if it is confirmed that the touch object type corresponding to the first operation is consistent with the touch object type preset for writing on the interactive tablet (i.e., the first touch object type), and the operation process of the first operation itself satisfies the general variation process of a writing operation, i.e., the first operation occurring on the first screen is a move operation (also known as a slide operation), then it can be confirmed that the user is currently writing on the first interactive tablet, and the first operation can be directly responded to as a writing operation. Specifically, to confirm whether the touch object type corresponding to the first operation is the preset first touch object type, the identifier recorded in the digit dedicated to recording the touch object type can be directly read from the sensor data encapsulated in a preset data structure, and then compared with the pre-stored identifier of the touch object type used for writing. If they are consistent, the touch object type is confirmed to be the preset first touch object type. For example, if the identifier recorded in the digit for recording the touch object type in the received sensor data is 0 as mentioned above, it is usually confirmed as the first touch object type. Because fingers are often used for writing, the identifier corresponding to the finger is usually pre-stored as the identifier of the touch object type used for writing.

[0131] For interactive tablets, after joining a video conference, they do not enter a writing state by default. In fact, in most cases, the user of the first interactive tablet previews the files and eventually opens the various files that need to be presented to the user of the second interactive tablet on the network side. This is equivalent to the first interactive tablet displaying more interactive screens in the first screen for display to the user. These interactive screens usually do not support direct handwriting input. Therefore, in the embodiment of the present application, on the basis of maintaining the display of the first screen, the first batch of annotation application windows of the first batch of annotation applications are superimposed on the first screen, and the first writing handwriting is added and displayed on the first batch of annotation application windows based on the first position information.

[0132] The first batch of note application windows is a display window of the first batch of note applications installed in the first interactive tablet, also known as the display interface of the first batch of note applications. It is understandable that, from the user's interactive experience, the first batch of note application windows is used to receive the user's writing operations, and in response to the user's writing operations, generates and displays handwriting that is substantially consistent with the movement trajectory of the writing operations. Accordingly, the first handwriting displayed in the first batch of note application windows is substantially consistent with the movement trajectory of the first operation represented by the first position information. When the first batch of note application windows adopts a transparent design, the presentation effect on the touch-sensitive display screen is mainly to display the handwriting in the first screen. From the user's visual perception, the first batch of note application windows are not as obvious as video playback application windows and the background in the border. However, the first batch of note application windows does exist in a transparent display mode. The handwriting is usually not related to the first screen in terms of the underlying data. It only presents the effect of writing in the first screen because of the layered overlay display. In addition, the naming logic of the first batch of annotation applications installed in the first interactive tablet and the second batch of annotation applications installed in the second interactive tablet in the following text, as well as the first batch of annotation application windows and the second batch of annotation application windows are the same as the naming logic of the "first video conferencing application" and "second video conferencing application", "first screen" and "second screen" in the previous text, and will not be explained further here.

[0133] The first batch of annotation application windows can be transparent, semi-transparent, or have a masking effect, or other forms. As shown in Figure 3, by directly clicking on the application icon to wake up, the first batch of annotation application windows that have not yet displayed any writing handwriting also display an annotation toolbar 11, and the annotation toolbar 11 includes annotation controls such as page turning, saving, and erasing. Specifically, the method of superimposing the first batch of annotation application windows on the first screen can be that the first batch of annotation application windows are not displayed first, so that the first batch of annotation application windows containing the annotation toolbar 11 are directly added and displayed on the first screen, or after the first batch of annotation applications are started, the first batch of annotation application windows without the annotation toolbar 11 are always displayed on top and are completely transparent, and the user cannot perceive them, so that the annotation toolbar is loaded and displayed in this step, thereby realizing the display of the first batch of annotation application windows, showing the effect of superimposing the first batch of annotation application windows. The specific display details are not limited in the embodiments of this application.

[0134] The first batch of annotation application windows serve as a layer interface that can be used to display writing handwriting. It can be understood that the first batch of annotation application windows are independent of the layer interface in the first screen, that is, the content displayed on the first batch of annotation application windows and the content displayed in the first screen have no relationship at the underlying data level.

[0135] For example, the finger in Figure 4 and the pen in Figure 5 are both first touch object types. When a first operation, as shown in Figure 4 or 5, is detected based on Figure 2, it can be confirmed that it is a move operation during the first operation. Therefore, the first batch of annotation application windows should be superimposed on Figure 2, and the handwriting of A1A2 or B2B1 should be displayed accordingly. In actual display, Figure 4 or 5 also displays the three application icons on the system desktop shown in Figure 2. To avoid clutter in Figures 4 and 5, Figures 4 and 5 show a simplified representation after omitting the three application icons.

[0136] Step S140: Obtain the first handwriting data of the first writing handwriting, and synchronize the first handwriting data to the second video conferencing application of the second interactive tablet through the first video conferencing application, so that the second interactive tablet superimposes the second annotation application window of the second annotation application on the second screen according to the first handwriting data, and adds and displays the first writing handwriting in the second annotation application window.

[0137] The first writing handwriting is the writing handwriting generated by the first interactive tablet according to the first operation superimposed on the first batch of annotation application windows, and in the first batch of annotation application windows according to the first position information corresponding to the first operation. In the video conference scenario, the user using the first interactive tablet has a writing need, and must send the writing content to other interactive tablets to show to other participants. Therefore, when it is confirmed based on the first operation that the first writing handwriting needs to be added, it is not only necessary to display the writing handwriting on the first interactive tablet, but also to control the second interactive tablet to display the same writing handwriting. Therefore, the first handwriting data of the first writing handwriting is obtained, and the first handwriting data is transmitted through the video conferencing application currently in the same video conference, that is, through the first video conferencing application installed on the first interactive tablet, the first handwriting data is synchronized to the second video conferencing application installed on the second interactive tablet, so that the second interactive tablet superimposes the second annotation application window of the second annotation application on the currently displayed second screen according to the received first handwriting data, and completes the display of the first writing handwriting in the second annotation application window according to the received first batch of annotation data, thereby realizing information synchronization of participants corresponding to different interactive tablets.

[0138] Among them, the processing process of sending the first handwriting data can first obtain the conference identification information of the current conference of the first video conferencing application (for example, a string of multiple numbers and / or letters), and obtain the first handwriting data of the first written handwriting, and send the first handwriting data and the conference identification information to the conference server through the first video conferencing application. The conference server can confirm the video conferencing application associated with the received conference identification information based on the current video conferencing data, that is, the second video conferencing application of all second interactive tablets, and then synchronize the first handwriting data to the second video conferencing application of the second interactive tablet. The current conference identification information of the second video conferencing application is the same as the conference identification information of the first video conferencing application. The conference server forwards data to the associated interactive tablet based on the conference identification information. The first interactive tablet only needs to send data once for one writing behavior, which can effectively improve data transmission efficiency and reduce the local data transmission load and complexity.

[0139] In the specific implementation process, the sending of handwriting data (first handwriting data and second handwriting data) and the display of the corresponding written handwriting may not affect the basic display state of the original display content of the first interactive tablet and the second interactive tablet, but only superimpose and display their respective annotation application windows, and add written handwriting to the annotation application window. For example, after the first interactive tablet obtains the first handwriting data and sends it to the second interactive tablet, the second interactive tablet superimposes and displays the second annotation application window on the original second screen. When the handwriting is updated and synchronized according to the respective writing operations, the original display content is always maintained and displayed in the lower layer of the respective annotation application windows. In this way, communication can be carried out based only on the content presented in the annotation application windows of the respective interactive tablets. For example, during negotiations or other business communications, each party can open pre-organized notes or outlines of ideas they want to express, and then use their own annotation application window, which displays synchronized information, as the center to express and discuss their opinions. During this process, under the guidance of established views or ideas, they can continuously add or erase handwriting in the annotation application window according to communication behavior, so as to intuitively present their own views to the other party in real time while avoiding the presentation of personal private information to the other party. Moreover, this solution, which uses the annotation application as the information synchronization and communication center, does not require the development of a specific application. Instead, the annotation data can be sent to the remote interactive tablet through the channel of the existing video conferencing application, and can be displayed simultaneously with the annotation application. The overall solution only requires simple adaptation and development of the video conferencing application, with low development costs and good compatibility.

[0140] In another optional implementation, compared to the previous implementation in which only the first handwriting data is sent to the second interactive tablet, which does not affect the display content of the second screen, the screen data of the first screen can also be synchronized to the second interactive tablet at the same time, so that the second interactive tablet synchronously displays the first screen and no longer displays the second screen. At this time, the second annotation window of the second interactive tablet covers the first screen. When the first interactive tablet and the second interactive tablet are in the same video conference, when the first interactive tablet generates the first handwriting, the first handwriting and the first screen are directly synchronized to the first interactive tablet for display, so that the writing operation can generate the handwriting, share the handwriting and share the first screen at the same time, thereby improving the interaction efficiency in the video conference scenario. In the specific implementation process, a screen sharing confirmation control can be further displayed, that is, a pop-up window can be used to remind the user whether to share the synchronized first screen. The first screen will be sent only when it is used to confirm sharing. Of course, the first screen can also be directly shared according to the pre-configuration.

[0141] For the second interactive tablet, when the content of the first screen is displayed synchronously, it can be considered that the second interactive tablet updates the display content on the second screen, and the updated content is the content of the first screen. When the sharing of the first screen ends, the second interactive tablet should restore the original display content of the second screen. The first screen can be considered to be displayed between the second screen and the second annotation application window in terms of the display hierarchy on the second interactive tablet. In this specific implementation, the specific underlying implementation method of the second interactive tablet is not limited. As long as the visual effect is that the first screen and the first handwriting are displayed synchronously on the second interactive tablet with the first interactive tablet, it is sufficient.

[0142] The specific processing method for describing handwriting data and the data transmission between devices with established network connections are basic implementations in related fields and will not be elaborated here.

[0143] Step S150: receiving second handwriting data synchronized with the second video conferencing application through the first video conferencing application, where the second handwriting data is handwriting data generated by a writing operation performed by a touch object on the second annotation application window.

[0144] Step S160: Send the second handwriting data to the first batch annotation application program, so that the first batch annotation application program adds and displays the second handwriting in the first batch annotation application window according to the second handwriting data.

[0145] In the specific implementation process, the implementation process of steps S150 and S160 is roughly equivalent to the corresponding execution process of the first interactive tablet when the second interactive tablet implements step S140. The detailed change is that after the first interactive tablet has completed the superimposed display of the annotation application window on the first interactive tablet and all second interactive tablets according to the first operation, while the display state of the annotation application window remains unchanged, the data transmission related to the annotation application window mainly includes the generation of handwriting corresponding to the writing operation detected by any interactive tablet. For the first interactive tablet, the handwriting generated by the writing operation needs to be sent to the second interactive tablet for handwriting synchronization. That is, for the second interactive tablet, as can be seen in step S140, the second interactive tablet obtains the second handwriting data of the second handwriting, synchronizes the second handwriting data to the first video conferencing application of the first interactive tablet through the second video conferencing application, so that the first interactive tablet adds and displays the second handwriting in the first batch of annotation application windows of the first batch of annotation applications according to the second handwriting data. Steps S150 and S160 are the process of the first interactive tablet receiving the second handwriting data and displaying the second handwriting.

[0146] In a video conferencing scenario, the first screen can be various types of screens, such as a shared screen of a video conference. That is, before starting the interactive annotation, the screen content displayed by each interactive tablet is the same. The annotation application window is superimposed on the shared screen, which enables participants using different interactive tablets to conduct interactive annotations based on the same basic information without information difference.

[0147] Based on the detailed implementation process of steps S110 to S160, when multiple interactive tablets join the same video conference, when a specific type of touch object movement operation is detected through the touch-sensitive display screen of the interactive tablet, an annotation application window is superimposed and displayed on the basis of the first screen displayed locally, and while directly adding writing handwriting according to the movement operation, the corresponding handwriting data is sent to other interactive tablets in the same video conference, so that the other interactive tablets also superimpose an annotation application window and add writing handwriting according to the handwriting data. From another perspective, when the interactive tablet first receives the handwriting data sent by other interactive tablets, it also superimposes and displays the annotation application window and adds writing handwriting. This is equivalent to when multiple interactive tablets join the same video conference, when one interactive tablet starts a writing operation, the other interactive tablets directly start the annotation application window that can perform interactive annotations. Corresponding to the user's operational needs, when a user uses a touch object dedicated to writing to perform a moving operation in a video conference state, it is equivalent to the user having a writing need. In a video conference scenario, when a user has a writing need, the written content must be sent to other interactive tablets to be displayed to other participants. Moreover, this display is likely to require multi-party interaction, that is, participants using other interactive tablets may also have the need to display writing based on a synchronized writing interface. Therefore, the quick annotation method designed in this solution can simultaneously start the annotation application windows of multiple interactive tablets and enter the interactive annotation state through a single operation, simplifying the operation process and improving operational efficiency. Especially for video conferencing scenarios, it can avoid complex operations on the terminals of the conference process and ensure the continuity of the conference process. Moreover, directly triggering interactive annotations and synchronous display of different interactive tablets with handwriting data can save transmission bandwidth compared to screen sharing, and allocate more bandwidth to data transmission tasks such as sound and live video transmission, effectively reducing lag.

[0148] In an optional implementation, the quick annotation method further includes: receiving second sensor data of the touch object performing a second operation in the first batch of annotation application windows, the second sensor data including second position information detected by the touch-sensitive display and the touch object type of the touch object; adding writing handwriting in the first batch of annotation application windows according to the second position information, or triggering the operation control of the first batch of annotation application windows; after triggering the erase control of the first batch of annotation application windows, receiving third sensor data of the touch object performing a third operation in the first batch of annotation application windows, the third sensor data including third position information detected by the touch-sensitive display and the touch object type of the touch object; and erasing the corresponding writing handwriting on the first batch of annotation application windows according to the third position information.

[0149] The second operation is the operation performed by the user using a touch object on the first interactive tablet after the first interactive tablet displays the first batch of annotation application windows superimposed on the first screen. The touch-sensitive display screen can detect corresponding sensor data for all touch operations when in normal use. In the embodiment of the present application, the sensor data corresponding to the second operation is defined as second sensor data, corresponding to the sensor data described above, which includes position information and touch object type as a whole, that is, the second sensor data includes position information corresponding to the second operation and the touch object type of the touch object. In the case where the first batch of annotation application windows are currently displayed on top, the second operation is mainly used to add writing handwriting to the first batch of annotation application windows, or to trigger specific operation controls to implement a specific function, such as deleting a portion of writing handwriting. Specifically, for adding writing handwriting or triggering operation controls, please refer to the general implementation method in the relevant annotation application program, which will not be elaborated here.

[0150] In an embodiment of the present application, after the erase control of the first batch of annotation application windows is triggered according to the position information of the second operation, the operation performed by the user using the touch object on the first interactive flat panel is defined as a third operation, and the third sensing data corresponding to the third operation includes the third position information detected by the touch-sensitive display screen and the touch object type of the touch object; when it is confirmed that the erase control has been triggered and the writing needs to be erased, the corresponding writing can be erased on the first batch of annotation application windows according to the third position information. The specific erasing process can refer to the implementation method of the relevant annotation application.

[0151] Based on the first batch of annotation application windows that have been displayed, writing handwriting can be added or deleted according to the specific operation content. Based on the first batch of annotation application windows, the display content can be easily edited according to the needs of the video conference.

[0152] In another optional implementation, more precise control can be performed when deleting handwriting according to the third position information, and the handwriting information of the target handwriting to be deleted associated with the third position information is sent to the second interactive tablet, so that the second interactive tablet sends the handwriting information to the second annotation application to lock the corresponding handwriting, and the locked handwriting cannot be edited; accordingly, after erasing the corresponding handwriting according to the third position information, it is confirmed that the third operation is completed, and the handwriting update information generated according to the third operation is sent to the second interactive tablet, so that the second interactive tablet sends the handwriting update information to the second annotation application to unlock the handwriting and update the corresponding handwriting. In the case of interactive annotations established by the first interactive tablet and the second interactive tablet, when the first interactive tablet performs an erasing operation, by notifying the second interactive tablet that there is currently a handwriting in the erasing and editing state, so that the second interactive tablet locks the handwriting currently being erased and edited, it is possible to avoid operation conflicts caused by multiple users operating the same handwriting on different interactive tablets at the same time.

[0153] After confirming that the current state requires writing or erasing, you can use a variety of touch operations to add or delete handwriting. For example, when the third position information includes position information corresponding to multiple touch points, when the first batch annotation application window is in the first batch annotation state, the first single-point position information is confirmed based on the third position information, and the handwriting corresponding to the first single-point position information is erased on the first batch annotation application window, and the first screen in the first batch annotation state remains unchanged. For another example, when the second position information includes position information corresponding to multiple touch points; when the first batch annotation application window is in the first batch annotation state, the second single-point position information is confirmed based on the second position information, and handwriting is added to the first batch annotation application window based on the second single-point position information, and the first screen in the first batch annotation state remains unchanged.

[0154] In the case where the user makes an error (such as deformed movements) or actively uses a multi-point operation (such as the two-point operation shown in FIG6 ), resulting in the second position information or the third position information including position information corresponding to multiple touch points, because adding and erasing writing handwriting are both operations that require high precision, it is necessary to identify one of the position information corresponding to the multiple touch points as the corresponding single-point position information (i.e., the first single-point position information and the second single-point position information). For example, only the touch point that landed the earliest can be retained as the corresponding single-point position information, and the addition or deletion of writing handwriting can be achieved based on the single-point position information. In addition, the first screen in the first batch of annotations remains unchanged, which means that the display content of the first screen cannot be switched in the first batch of annotations. Correspondingly, the display content of the first screen can be switched in the second annotation state. Limiting the specific application scenarios of adding or deleting writing handwriting through multiple touch points can avoid conflicts in interactive instructions caused by other interactive definitions of multi-point operations in the second annotation state. The subsequent limitation to the first batch of annotations when erasing through the fourth operation is also based on the reason of avoiding conflicts in interactive instructions.

[0155] After triggering the erase control, all operations should be aimed at deleting existing handwriting. Even if the third position information is generated by a multi-point operation, the first single-point position information is confirmed based on the third position information, and the multi-point operation is performed as a single-point response. This allows handwriting deletion to be achieved through various operation methods. In the writing state, all operations should be aimed at adding handwriting. Even if the second position information is generated by a multi-point operation, the second single-point position information is confirmed based on the second position information, and the multi-point operation is performed as a single-point response. This allows handwriting addition to be achieved through various operation methods.

[0156] In another optional implementation, the quick annotation method further includes: receiving fourth sensor data indicating a fourth operation performed by a touch object while the first batch annotation application window is in the first batch annotation state, the fourth sensor data including fourth position information detected by the touch-sensitive display and the touch object type, and the touch area of ​​the touch object reaches a preset erasure threshold, and the first screen in the first batch annotation state remains unchanged; and erasing the corresponding handwriting on the first batch annotation application window based on the fourth position information. The fourth sensor data may be sensor data corresponding to the touch operation that meets the aforementioned requirements received in the first batch annotation state, regardless of whether the erase control is currently triggered, and the fourth operation is the operation corresponding to such sensor data. The touch area can be the area of ​​a single touch point or the area encompassed by multiple closely spaced touch points. This allows for more nuanced handling of multi-touch operations. When processing a multi-touch operation, if the position information corresponding to the multiple touch points confirms that the touch points are relatively far apart, the position information corresponding to one of the touch points is used to add or erase handwriting accordingly. If the position information corresponding to the multiple touch points confirms that the touch points are relatively close, erasure is performed based on the area encompassed by the multiple touch points (e.g., a polygon or a fitted circle), regardless of whether an erase space is triggered. The distance is empirically determined, for example, by presetting the range covered by five fingers on a single hand. If the multi-touch operation itself is performed at a distance far exceeding the typical five-finger touch distance, it may be a conventional multi-point simultaneous writing operation, in which case handwriting can be added to the corresponding multiple points. The specific handwriting to be erased can be determined based on the fourth position information. Using a specific touch method not used for writing or clicking, namely, by using a touch area reaching a certain preset size, the first batch of registered applications can be quickly erased in any state.

[0157] Please refer to Figure 7. The embodiment of the present application also provides a quick annotation method, which is applied to an interactive tablet. The interactive tablet includes a touch-sensitive display screen, and the touch-sensitive display screen is used to detect the position information of the touch object and the touch object type of the touch object. The overall implementation process in the embodiment of the present application is roughly equivalent to the process in which the first interactive tablet in the previous application embodiment only implements quick annotations on itself when it is separated from the video conferencing scene. The description that is not fully described in the embodiment of the present application can refer to the previous embodiment, such as the detailed explanation of the interactive tablet, the detailed explanation of the sensor data, etc. The embodiment of the present application mainly explains in detail the implementation details that are different from the previous embodiment. As shown in Figure 7, the quick annotation method includes but is not limited to steps S210-step S290:

[0158] Step S210: Displaying a first interface on the touch-sensitive display screen.

[0159] In the application embodiment, the screen currently displayed by the interactive tablet through the touch-sensitive display screen is the first interface, that is, the first interface refers to the interactive interface currently displayed by the interactive tablet through the touch-sensitive display screen. It can be understood that the content presented in the interactive interface may include one or more application interfaces for receiving and / or displaying information. For example, a document editing application, whose application interface is mainly used to receive document content input by the user and display it; a video playback application, whose application interface is mainly used to display changing video images.

[0160] Step S220: receiving first sensing data of a touch object performing a first operation on a first interface, the first sensing data including first position information detected by the touch-sensitive display screen and a touch object type of the touch object.

[0161] The detected sensor data needs to be packaged according to a pre-set data structure and then sent to the processor of the first interactive flat panel for processing. In an embodiment of the present application, the packaging method of the sensor data can be implemented on the basis of a universal standard data structure. Each touch operation performed on the touch-sensitive display screen may generate multiple touch points, and the sensor data corresponding to each touch point is generated and distributed according to the standard. For example, according to the universal standard data structure, the sensor data corresponding to each touch point is recorded through multiple bytes, and the information recorded in the sensor data includes the coordinates, width, height, pressure and direction angle of the touch point, etc. Each information occupies a corresponding byte length in the universal standard data structure for recording.

[0162] In the embodiment of the present application, the bytes corresponding to a certain information can be further subdivided. While ensuring the normal recording of the original information, a number of digits can be assigned to record the identifier corresponding to the identified touch object type (i.e., medium type), for example, 0 represents a finger, 1 represents a writing pen A, 2 represents a writing pen B, 3 represents an eraser, etc. Of course, the identifiers 0, 1, 2, and 3 here are decimal numbers, which are converted to binary numbers 00, 01, 10, and 11 when recorded in the digits.

[0163] Step S230: When it is determined that the touch object type does not meet the preset first touch object type, a touch response is performed on the first operation based on the first position information, and the first interface is updated.

[0164] Step S240: When the touch object type is confirmed to be the preset first touch object type and the first operation is confirmed to be a click or long press operation based on the first position information, a touch response is performed to the first operation based on the first position information, and the first interface is updated.

[0165] In an embodiment of the present application, steps S230 and S240 enable a richer response to various situations of the first operation. If the touch object type does not meet the preset first touch object type, the interactive tablet responds according to its conventional interaction logic, such as clicking an application icon to open an application or trigger a function control within the application. In other words, the first operation is responded to by the application corresponding to the application interface displayed in the first interface or by the system. If the touch object type meets the preset first touch object type and the first operation is a click or long press operation, it indicates that the first operation is not a writing operation. In this case, the first operation is also responded to according to the click or long press operation in the conventional interaction logic, such as opening an application or selecting an interactive target.

[0166] To specifically determine whether the touch object type corresponding to the first operation is the preset first touch object type, the identifier recorded in the digit dedicated to recording the touch object type in the sensor data encapsulated in the preset data structure can be directly read, and then compared with the pre-stored identifier of the touch object type used for writing. If they match, the touch object type is determined to be the preset first touch object type. For example, if the identifier recorded in the digit dedicated to recording the touch object type in the received sensor data is 0 as described above, it is generally determined to be the first touch object type. Because fingers are often used for writing, the identifier corresponding to the finger is generally pre-stored as the identifier of the touch object type used for writing. The first sensor data being 0 indicates that the touch object type corresponding to the first operation is the first touch object type. If the identifier recorded in the digit dedicated to recording the touch object type in the received sensor data is 3 as described above, it is generally determined to be the first touch object type. Because fingers are often used for writing, the identifier corresponding to the finger is generally pre-stored as the identifier of the touch object type used for writing. The first sensor data being 0 indicates that the touch object type corresponding to the first operation is the first touch object type.

[0167] Step S250: When the touch object type is confirmed to be the preset first touch object type and the first operation is confirmed to be a move operation based on the first position information, the first batch of annotation application windows are added to the first interface, and writing is added to the first batch of annotation application windows according to the first position information.

[0168] When adding handwriting to the first batch of note application windows, different touch object types display different handwriting attributes. This allows for clear input comparison when multiple people are writing or when individual input differs.

[0169] Step S260: receiving second sensing data of a second operation performed by a touch object on the first batch of registered application windows, where the second sensing data includes second position information detected by the touch-sensitive display screen and a touch object type of the touch object.

[0170] Step S270: adding writing handwriting to the first batch of annotation application windows according to the second position information, or triggering operation controls on the first batch of annotation application windows.

[0171] Step S280: After the erase control on the first batch of application windows is triggered, third sensing data of the touch object performing a third operation on the first batch of application windows is received, the third sensing data including third position information detected by the touch-sensitive display screen and the touch object type of the touch object.

[0172] Step S290: Erasing corresponding handwriting on the first batch of annotation application windows according to the third position information.

[0173] Steps S260 to S270 are based on the second sensor data which is different from the first sensor data, and implement the addition and erasure of writing handwriting in the first batch of application windows. The first sensor data and the second sensor data are used as a whole to realize the basic operations from quickly starting writing to realizing the writing process, thereby improving the interaction efficiency and reducing the learning cost of the practical writing function. The writing process is more in line with the usage habits developed from using a physical blackboard.

[0174] As mentioned above, when the interactive tablet's touch-sensitive display detects the movement of a specific type of touch object, a new annotation application window is displayed overlaid on the first locally displayed screen, allowing writing and erasing operations within the annotation application window. In response to user operational needs, when a user uses a touch object specifically for writing to perform a movement operation, it is equivalent to the user having a writing need. The quick annotation method designed in this solution can quickly launch the interactive tablet's annotation application window and enter the annotation state with a single operation, simplifying the operation process and improving operational efficiency.

[0175] During the specific implementation process, if the first interface is the interface of a writing application, then the fourth sensor data of the touch object performing the fourth operation on the first interface is received, and the fourth sensor data includes the fourth position information detected by the touch-sensitive display screen and the touch object type of the touch object; a touch response is performed on the fourth sensor data, and the first interface is updated. The fourth operation in the embodiment of the present application is different from the fourth operation in the previous embodiment. In the embodiment of the present application, the fourth operation is an operation performed by the user on the interactive tablet using a touch object when the first interface displayed on the interactive tablet is the interface of a writing application. The touch-sensitive display screen can detect corresponding sensor data for all touch operations when in normal use. In the embodiment of the present application, the sensor data corresponding to the fourth operation is defined as fourth sensor data, corresponding to the sensor data described above, which includes position information and touch object type as a whole, that is, the fourth sensor data includes position information corresponding to the fourth operation and the touch object type of the touch object. A writing application refers to an application that supports user handwriting input and presents and / or records user input content in the form of handwriting, such as a handwriting shorthand application, a calligraphy practice application, etc. When the interactive tablet itself has already displayed the interface of the writing application, it is equivalent to the user's current operation requirement being to write or perform other operations on the first interface. The writing operation or any other operation can be directly responded to through the interface of the writing application. At this time, the display of the annotation application window is no longer used as a response to the fourth operation, which can reduce erroneous operations.

[0176] In one optional implementation, when the touch object type is confirmed to be a preset first touch object type, and the first operation is confirmed to be in an edge area of ​​the first interface based on the first position information, a touch response is performed to the first operation based on the first position information, and the first interface is updated. With respect to user operations, writing operations are typically performed in the center area of ​​the interactive tablet, and the edge areas generally cannot meet conventional writing requirements. Therefore, shortcut operations can be defined or commonly used operation controls can be arranged in the edge areas. When a first touch operation that meets the preset requirements is detected in the edge area of ​​the interactive tablet, a quick operation can be implemented based on the defined shortcut operation or the triggered operation control.

[0177] When the interactive tablet is in use, it may not display its own screen, but rather the screen projected by other electronic devices onto the interactive tablet. That is, the first interface may be the projection interface displayed after the interactive tablet receives the projection data. In the case where the first interface is the projection interface received by the interactive tablet, the projection interface can be kept updated at any time based on the projection data sent by other electronic devices; at the same time, the handwriting of the first batch of application windows is kept displayed on the updated projection interface. Based on the projection, the first batch of application windows is triggered by the first operation. To ensure the normal display of the core display content, the first batch of application windows does not affect the reception and display of the projection screen. That is, the projection screen displayed in the first interface is always kept updated, ensuring the information presentation goals of all dimensions of the interactive tablet.

[0178] In an optional implementation, the third position information includes position information corresponding to multiple touch points; accordingly, when erasing handwriting on the first batch of annotation application windows based on the third position information, the first single-point position information can be confirmed based on the third position information while the first batch of annotation application windows are in the first batch of annotation state, and the handwriting corresponding to the first single-point position information is erased on the first batch of annotation application windows, while the first screen in the first batch of annotation state remains unchanged. After triggering the erase control, all operations should target deleting existing handwriting. Even if the third position information is position information generated by a multi-point operation, the first single-point position information is confirmed based on the third position information, and the multi-point operation is deleted in a single-point response manner, thereby enabling handwriting deletion through various operation methods.

[0179] In another optional implementation, the second location information includes location information corresponding to multiple touch points; accordingly, when adding handwriting to the first batch annotation application window based on the second location information, the second single-point location information can be confirmed based on the second location information while the first batch annotation application window is in the first batch annotation state, and handwriting is added to the first batch annotation application window based on the second single-point location information, while the first screen in the first batch annotation state remains unchanged. In the writing state, all operations should target adding handwriting. Even if the second location information is location information generated by a multi-point operation, the second single-point location information is confirmed based on the second location information, and the multi-point operation is performed as a writing operation with a single-point response, thereby enabling handwriting addition through various operation methods.

[0180] Furthermore, during the specific erasing process, if the touch object type in the second sensor data corresponds to the touch object type at the end of the pen, and the first operation is confirmed to be a move operation based on the second position information, the corresponding handwriting may be erased from the first batch of annotation application windows based on the second position information. Based on the daily usage habit of writing with the pen tip and erasing with the end of the pen, and on the basis that the touch-sensitive display can recognize the touch object type, if the touch object type corresponding to the end of the pen is recognized, the direct response is an erase operation.

[0181] In another erasure implementation, fourth sensor data can be received, indicating a fourth operation performed by a touch object while the first batch of note application windows are in the first batch note state. The fourth sensor data includes fourth position information detected by the touch-sensitive display and the touch object type. Furthermore, if the touch area of ​​the touch object reaches a preset erasure threshold, the first screen in the first batch note state remains unchanged. Based on the fourth position information, the corresponding handwriting is erased from the first batch note application window. Using a specific touch method not used for writing or clicking, namely, an operation in which the touch area reaches a preset size, the first batch of note applications can be quickly erased in any state.

[0182] The embodiment of the present application also provides a quick annotation method, which is applied to an interactive tablet, wherein the interactive tablet includes a touch-sensitive display screen and a control mainboard, the touch-sensitive display screen is used to detect the position information of the touch object and the medium type of the touch object, the control mainboard is installed with a driver and an operating system, and the touch-sensitive display screen is connected to the control mainboard. The embodiment of the present application can be regarded as the underlying implementation process for realizing quick annotations. In the aforementioned embodiment, the interactive response process on the first interactive tablet and on the interactive tablet can be implemented from the dimension of underlying sensor data transmission using the embodiment of the present application. Of course, the various embodiments described in this scheme can be implemented independently on the same or different interactive tablets. For example, the quick annotation method shown in Figure 1 and the quick annotation method shown in Figure 7 can be implemented on the same interactive tablet in different usage states. The quick annotation method in the embodiment of the present application can also be used as an underlying data implementation scheme to support the implementation of the quick annotation method in the foregoing text.

[0183] In the embodiments of the present application, the implementation process of the solution is first described as a whole, and then the process of discovering problems before implementing the solution, the ideas of designing the solution and the details of the implementation solution are described in detail.

[0184] Please refer to FIG8 . As shown in FIG8 , the quick annotation method includes but is not limited to steps S300 to S390 :

[0185] Step S300: Displaying a first interface on the touch-sensitive display screen.

[0186] In the application embodiment, the screen currently displayed by the interactive tablet through the touch-sensitive display screen is the first interface, that is, the first interface refers to the interactive interface currently displayed by the interactive tablet through the touch-sensitive display screen. It can be understood that the content presented in the interactive interface may include one or more application interfaces for receiving and / or displaying information. For example, a document editing application, whose application interface is mainly used to receive document content input by the user and display it; a video playback application, whose application interface is mainly used to display changing video images.

[0187] Step S310: The driver receives first sensing data of a touch object performing a first operation on a first interface, where the first sensing data includes first position information detected by the touch-sensitive display screen and a touch object type.

[0188] The first operation is an operation performed by the user using a touch object on the first interactive tablet when only the first screen is displayed on the first interactive tablet, or the first screen is displayed on top. The touch-sensitive display screen can detect corresponding sensor data for all touch operations when in normal use. In the embodiment of the present application, the sensor data corresponding to the first operation is defined as first sensor data, which corresponds to the sensor data described above and includes position information and touch object type as a whole, that is, the first sensor data includes the position information corresponding to the first operation and the touch object type of the touch object.

[0189] The detected sensor data needs to be packaged according to a pre-set data structure and then sent to the processor of the first interactive flat panel for processing. In an embodiment of the present application, the packaging method of the sensor data can be implemented on the basis of a universal standard data structure. Each touch operation performed on the touch-sensitive display screen may generate multiple touch points, and the sensor data corresponding to each touch point is generated and distributed according to the standard. For example, according to the universal standard data structure, the sensor data corresponding to each touch point is recorded through multiple bytes, and the information recorded in the sensor data includes the coordinates, width, height, pressure and direction angle of the touch point, etc. Each information occupies a corresponding byte length in the universal standard data structure for recording.

[0190] In the embodiment of the present application, the bytes corresponding to a certain information can be further subdivided. While ensuring the normal recording of the original information, a number of digits can be assigned to record the identifier corresponding to the identified touch object type (i.e., medium type), for example, 0 represents a finger, 1 represents a writing pen A, 2 represents a writing pen B, 3 represents an eraser, etc. Of course, the identifiers 0, 1, 2, and 3 here are decimal numbers, which are converted to binary numbers 00, 01, 10, and 11 when recorded in the digits.

[0191] Step S320: The driver confirms, based on the first position information, that the first operation is a moving operation and the touch object type is a preset first medium type, and sends the first sensing data to the annotation application.

[0192] In the interactive design of the interactive tablet centered on handwriting input, the general habit of physical writing is generally followed. For example, the pen tip used for writing is generally thinner, and pen tips of different thicknesses correspond to writing handwriting of different thicknesses. In an embodiment of the present application, if it is confirmed that the touch object type corresponding to the first operation is consistent with the touch object type for writing preset by the corresponding interactive tablet (i.e., the first medium type), and the operation process of the first operation itself meets the general change process of the writing operation, that is, the first operation occurring on the first screen is a moving operation (also called a sliding operation), then it can be confirmed that there is currently a user writing behavior on the first interactive tablet, and the first operation can be directly responded to as a writing operation. When writing on an interactive tablet, the annotation application usually provides various functions required for writing. When the first operation is directly responded to as a writing operation, the first sensor data corresponding to the first operation is sent to the annotation application, and the distribution of the sensor data by the operating system is omitted. The first sensor data is directly sent to the annotation application for a quick writing response.

[0193] To specifically confirm whether the touch object type corresponding to the first operation is the preset first touch object type, the identifier recorded in the digit dedicated to recording the touch object type can be directly read from the sensor data encapsulated in the preset data structure, and then compared with the pre-stored identifier of the touch object type used for writing. If they match, the touch object type is confirmed to be the preset first touch object type. For example, if the identifier recorded in the digit dedicated to recording the touch object type in the received sensor data is 0 as described above, it is generally confirmed to be the first touch object type. Because fingers are often used for writing, the identifier corresponding to fingers is generally pre-stored as the identifier of the touch object type used for writing. The first sensor data being 0 indicates that the medium type corresponding to the first operation is the first medium type.

[0194] Step S330: the annotation application program adds a first batch of annotation application windows on the first interface, and adds writing handwriting to the first batch of annotation application windows according to the first position information.

[0195] For interactive tablets, writing is not enabled by default after powering on. In fact, in most cases, the first screen displayed by the first interactive tablet is mainly an interactive screen for user display, and these interactive screens generally do not support direct handwriting input. Therefore, in the embodiment of the present application, while maintaining the first screen display, the first batch of annotation application windows of the first batch of annotation applications are superimposed on the first screen, and the first handwriting is added and displayed on the first batch of annotation application windows based on the first position information.

[0196] The first batch of note application windows is a display window of the first batch of note applications installed in the first interactive tablet, also known as the display interface of the first batch of note applications. It is understandable that, from the user's interactive experience, the first batch of note application windows is used to receive the user's writing operations, and in response to the user's writing operations, generates and displays handwriting that is substantially consistent with the movement trajectory of the writing operations. Accordingly, the first handwriting displayed in the first batch of note application windows is substantially consistent with the movement trajectory of the first operation represented by the first position information. When the first batch of note application windows adopts a transparent design, the presentation effect on the touch-sensitive display screen is mainly to display the handwriting in the first screen. From the user's visual perception, the first batch of note application windows are not as obvious as video playback application windows and the background in the border. However, the first batch of note application windows does exist in a transparent display mode. The handwriting is usually not related to the first screen in terms of the underlying data. It only presents the effect of writing in the first screen because of the layered overlay display.

[0197] Step S340: The driver receives second sensing data of the second operation performed by the touch object on the first batch of registered application windows and sends the second sensing data to the operating system, where the second sensing data includes second position information detected by the touch-sensitive display screen.

[0198] The second operation is an operation performed by a user using a touch object on the first interactive tablet when the first batch of note application windows has already been displayed, or when the first batch of note application windows is displayed on top. The touch-sensitive display screen can detect corresponding sensor data for all touch operations when in normal use. In the embodiment of the present application, the sensor data corresponding to the second operation is defined as second sensor data. When the first interactive tablet is currently in a writing state and there is usually no quick start of a special function, all sensor data in this state (i.e., second sensor data) is directly sent to the operating system and processed in a sensor data processing flow that is as standard as possible (i.e., distribution logic with the operating system as the distribution subject) to ensure stable operation of the operating system and the first interactive tablet and reduce operational anomalies. When the first batch of note application windows are currently displayed, the relevant information of the touch points generated by the second operation is basically sufficient to add new writing handwriting. Therefore, the second sensor data can only include position information. The operating system will then distribute the second sensor data to the first batch of note applications, and the first batch of note applications can respond accordingly based on the position information. Of course, the second sensor data may also include the medium type, which can be used as a reference for confirming details such as the display properties of the handwriting based on the addition of basic handwriting. For example, the colors of handwriting added to touch objects of different medium types are different.

[0199] Step S350: The operating system sends the second sensor data to the annotation application.

[0200] For the operating system, the received sensor data can be distributed according to the display level of the application window. When the second sensor data is received, the first batch of annotation application windows are displayed on top, and the second sensor data can be sent to the annotation application accordingly.

[0201] Step S360: The annotation application adds writing handwriting on the first batch of annotation application windows according to the second position information, or triggers the operation controls on the first batch of annotation application windows.

[0202] Step S370: After the erase control on the first batch of application windows is triggered, the driver receives third sensing data of the third operation performed by the touch object on the first batch of application windows and sends it to the operating system. The third sensing data includes third position information detected by the touch-sensitive display.

[0203] Step S380: The operating system sends the third sensor data to the annotation application.

[0204] Step S390: The annotation application erases the corresponding writing on the first annotation application window according to the third position information.

[0205] Steps S360 to S390 are when all current operations are clearly targeted at the first batch of annotation application windows. The driver sends the sensor data to the operating system according to the normal processing flow, and then the operating system distributes it to the annotation application. The annotation application responds according to the location of the sensor data, such as adding writing handwriting, triggering the erase state, erasing handwriting, etc. This part of the response process can be implemented with reference to the implementation details of the relevant annotation application and will not be elaborated here. In general, by identifying the specific sensor data features of the first operation, when the first operation is a moving operation and the touch object type is the preset first medium type, the first sensor data is directly given to the first batch of annotation applications to quickly start writing. Subsequently, the sensor data is given to the operating system in the normal processing flow, and the operating system distributes the sensor data based on the original distribution strategy, which can achieve rapid entry into the writing state and stable operation after entering the writing state.

[0206] Display and writing functions are very important for interactive tablets. To improve the user experience of using interactive smart tablets, we tried to design a design that allows users to operate the displayed content when the interactive tablet is running an annotation application. However, we found the following technical problems:

[0207] First, the technical problems of the annotation operation of the existing interactive tablet are analyzed. Take the interactive tablet running the Android operating system as an example. When the Android operating system is started, its event monitoring and distribution mechanism begins to work. When the annotation application of the interactive tablet is started, the annotation application window of the annotation application is pinned to the top. In this scenario, the Android operating system monitors the input of various input devices through eventHub, including the input of the touch-sensitive display screen of the interactive tablet. When the touch object clicks or slides on the touch-sensitive display screen, the touch-sensitive display screen generates touch data (i.e., sensor data) and sends the data to the processor of the interactive tablet. The inputReader reading thread run by the processor running the Android operating system reads the touch data and dispatches the data to the application corresponding to the pinned window through the inputDispatcher dispatch thread, i.e., the annotation application. The annotation application responds according to the touch data, including but not limited to displaying the touch track.

[0208] The Windows operating system works slightly differently from the Android operating system, so the specific settings are slightly different, but the implementation principles are similar. Specifically, the Windows operating system defaults to distributing touch data to the window on which the touch is made.

[0209] Under the above mechanism, in a conference scenario, if a user uses an interactive tablet to display a presentation (such as a PPT) and needs to annotate a part of the content displayed in the presentation, the user will start the annotation application while displaying the content of the presentation. As mentioned above, when the annotation application is started, all touch data will be distributed to the annotation application by the operating system. The user cannot operate the presentation by touching the interactive tablet while the annotation application is running, for example, turning the page of the presentation. In addition, in the prior art, the user can select, click, and turn the page of the content displayed on the screen. If you still want to annotate the content displayed on the screen, you need to click the annotation button to start the annotation application, trigger the annotation operation, and write the annotation. Because in the prior art, after the annotation application window is pinned to the top, all touch data will be distributed to the annotation application by the operating system. After writing the annotation, the user needs to click the exit button to exit the annotation application before continuing to perform operations such as turning pages. That is to say, since in the existing technology, all touch data will be distributed to the annotation application by the operating system, when the user wants to control the underlying display content during the annotation function, he can only manually exit the annotation application to perform the above operations. As a result, during the annotation process, the user needs to repeatedly exit and restart the annotation application, which is a cumbersome operation.

[0210] In response to the above problems, the present application creatively proposes a new technical solution, including hardware improvements and software design, which realizes the operation of the displayed content while the interactive tablet is running the annotation application through two levels. First, in terms of hardware architecture, the embodiment of the present application adopts a high-precision touch-sensitive display screen, which can not only identify the position information of the touch object on the touch-sensitive display screen, but also identify the specific shape of the touch object, thereby distinguishing the specific type of the touch object. Secondly, the present application redesigns the touch data reception of the annotation application window in terms of software architecture or software logic, so as to meet data acquisition in different states.

[0211] Specifically, when the interactive tablet is powered on and the operating system is running, the annotation application starts running in the background, and the annotation application window is not displayed at this time. During the operation of the interactive tablet, when the touch object performs a touch operation on the touch-sensitive display screen of the interactive tablet, the operating system of the interactive tablet will receive the touch data. The annotation application will determine in real time whether there are other writing applications running. If so, it will not establish a connection with the driver layer of the operating system (corresponding to the driver), and the operating system will distribute the data in response. That is, the annotation application is powered on and runs in the background; when the annotation application confirms that the first interface is not the interface of the writing application, it establishes a data channel with the driver; when it confirms that the first interface is the interface of the writing application, it disconnects the data channel with the driver; the data channel is used to transmit the first sensor data. Setting the connection status of the data channel between the annotation application and the driver according to the type of the first interface can directly avoid the unnecessary display of the annotation application window when writing is currently supported.

[0212] If no other writing applications are running, the annotation application establishes a connection with the driver layer of the operating system and informs the driver layer of the judgment rules or conditions for the touch data that needs to be intercepted. The driver layer makes a judgment based on the received touch data. If it is determined that the touch data is generated by a pen (the corresponding touch object type is the preset first medium type), the touch data is intercepted and sent to the annotation application for response. If it is determined that the touch data is not generated by a pen, the operating system distributes the touch data in response. This enables users to write on the interactive tablet by simply picking up a pen.

[0213] In the prior art, after receiving touch data, the operating system directly dispatches the touch data to the application corresponding to the top window without intercepting it. In this embodiment, when the operating system is running, the annotation application is started and runs in the background. The annotation application is pre-configured with the relevant attributes of the touch data that needs to be responded to. After the annotation application runs, it notifies the operating system of the judgment rules or conditions for the relevant attributes of the touch data that needs to be responded to. The operating system intercepts the touch data based on the judgment rules or conditions, that is, the touch data that meets the requirements of the annotation application is sent to the annotation application without dispatching it to other applications.

[0214] Specifically, taking the Windows operating system as an example, after the Windows operating system is started, the annotation application starts running. The annotation application will determine in real time whether there are other writing applications running. If there are, it will not establish a connection with the operating system's driver layer, and the operating system will respond with data distribution. If there are no other writing applications running, the annotation application will establish a connection with the operating system's driver layer. At this time, the annotation application and the operating system's driver layer establish communication through DeviceIoControl and send the judgment rules or conditions to the operating system. When the operating system's driver layer processes touch data, it needs to intercept touch data that meets the judgment rules or conditions based on the judgment rules or conditions. If the touch data meets the judgment rules or conditions, the operating system's driver layer will send the touch data to the annotation application. At this time, the annotation application needs to superimpose the annotation application window on the current display interface of the interactive tablet, and the annotation application processes the touch data. For example, if the touch data is generated by the movement of a writing pen, the writing track corresponding to the touch data is added to the display interface of the interactive tablet.

[0215] It should be noted that if it is determined that the touch data needs to be intercepted, the driver layer notifies the annotation application by setting a semaphore. After receiving the signal, the annotation application sends a notification of receiving touch data to the driver layer through DeviceIoControl. After receiving the notification, the driver layer sends the touch data to the annotation application instead of to other applications. In other words, the driver layer intercepts the touch data and sends it to the annotation application, and no longer passes it on to the applications corresponding to other windows. After receiving the touch data, the annotation application parses and processes the received touch data and responds. In this process, the annotation application window of the annotation application will be superimposed on the current display interface of the operating system, so that the response result of the touch data will be presented on the annotation application window.

[0216] When the driver layer receives touch data, if it determines that it does not need to be intercepted, the operating system directly distributes the touch data to the application corresponding to the top window. The specific response method depends on the type of application corresponding to the lower-level window.

[0217] It should also be noted that touch data is the output information of the driver layer of the operating system after the touch data is encapsulated. Under the new hardware architecture of this embodiment, when a touch object touches the touch-sensitive display screen of the interactive tablet, the interactive tablet's operating system not only receives the touch data but also receives the identification result of the touch object type. The driver layer of the operating system also encapsulates the identification result of the touch object type when encapsulating the touch data. Specifically, the touch object type can be represented by a specific identifier or ID. The annotation application can perform different responses based on different touch object types.

[0218] In another embodiment, for different touch object types, the driver layer will attach the corresponding touch object type when sending touch data. Applications such as annotation applications can know the touch object type and further identify that different touch objects are performing touch operations.

[0219] For example, the main communication protocol structure between the annotation application and the driver layer is as follows:

[0220] The annotation application uses the above protocol to inform the driver layer of the judgment rules or conditions for the touch data that needs to be intercepted. Among them, isEnable tells the driver whether it needs to intercept touch data, and the characteristics of intercepted data have been built into the driver layer logic. Only when the value is set to true will the next step of judgment be entered, otherwise, no data interception will be performed. maxPointCacheForJudge indicates the maximum number of touch points to be cached before judgment, xDeltaThreshold indicates the touch displacement threshold in the horizontal direction, and yDeltaThreshold indicates the touch displacement threshold in the vertical direction. When the number of touch points cached in a touch event is less than or equal to maxPointCacheForJudge, it is judged in real time whether the horizontal displacement and vertical displacement represented by the touch data of these touch points exceed xDeltaThreshold and yDeltaThreshold. If any one exceeds, it means that the touch event is a moving operation, and the driver layer intercepts the data. Other situations will be considered as not meeting the conditions and no data interception will be performed.

[0221] The communication protocol above characterizes the specific touch object type that generates touch data and the touch object movement operation that satisfies the need to intercept touch data whose displacement exceeds a certain pixel. In this embodiment, the packaged touch data is the identification result of the touch object type represented by an ID.

[0222] In response to the above technical problems, this embodiment also proposes an improved method, specifically:

[0223] The driver layer can implement different touch data judgment rules or conditions for different scenarios. Specifically, after the annotation application window is displayed, the annotation application or operating system notifies the driver layer to change the current touch data judgment rules or conditions, so that the driver layer intercepts touch data based on the judgment rules or conditions of the specific touch object type.

[0224] When the annotation application window is closed or hidden, the interactive tablet will no longer display the annotation application window, and the user cannot perceive the annotation application window. Therefore, the annotation application or operating system again informs the driver layer to change the current touch data judgment rules or conditions, so that the driver layer re-intercepts the touch data according to the material type of the specific touch object and the movement operation of the touch object as the judgment rules or conditions.

[0225] Specifically, the data format of touch data is as follows:

[0226] ContactId identifies the touch object, touchType distinguishes between down, move, and up operation types. Down indicates that the touch object begins contacting the touch-sensitive display, Move indicates that the touch object moves on the touch-sensitive display, and Up indicates that the touch object leaves the touch-sensitive display. logicX indicates the horizontal position of the touch object relative to the touch-sensitive display, logicY indicates the vertical position of the touch object relative to the touch-sensitive display, logicMaxX indicates the maximum horizontal position of the touch-sensitive display, logicMaxY indicates the maximum vertical position of the touch-sensitive display, width indicates the width of the touch object, and height indicates the height of the touch object. The coordinates of the touch object's touch position on the touch-sensitive display can be calculated using logicX, logicY, logicMaxX, and logicMaxY.

[0227] It should be noted that in the embodiment of the present application, the way in which the driver layer of the operating system and the annotation application window establish communication through DeviceIoControl is only an example. Specifically, various methods can be used to establish communication based on the properties of the operating system. For example, for the Android system, the JNI method or inter-process communication method can be used to realize the communication between the driver layer of the operating system and the annotation application window.

[0228] In an embodiment of the present application, the sensor data can be packaged based on a universal standard data structure. Each touch operation performed on a touch-sensitive display may generate multiple touch points, and the sensor data corresponding to each touch point is generated and distributed according to the standard. For example, according to the universal standard data structure, the sensor data corresponding to each touch point is recorded using multiple bytes. The information recorded in the sensor data includes the coordinates, width, height, pressure sensitivity, and direction angle of the touch point, and each piece of information occupies a corresponding byte length in the universal standard data structure for recording.

[0229] In the embodiment of the present application, the bytes corresponding to a certain information can be further subdivided. While ensuring the normal recording of the original information, a number of digits can be assigned to record the identifier corresponding to the identified touch object type (i.e., medium type), for example, 0 represents a finger, 1 represents a writing pen A, 2 represents a writing pen B, 3 represents an eraser, etc. Of course, the identifiers 0, 1, 2, and 3 here are decimal numbers, which are converted to binary numbers 00, 01, 10, and 11 when recorded in the digits.

[0230] As mentioned above, by preliminarily confirming the data status of the sensor data corresponding to the touch operation through the driver, the display of the annotation application window can be directly triggered. The user can directly pick up the pen to write, and the underlying driver directly sends data to trigger the annotation application window that responds to the writing operation and directly completes the addition of writing handwriting. There is no need for complicated switching states or pre-operations of the wake-up function, thus achieving fast writing.

[0231] Figure 9 is a schematic diagram of the structure of an interactive tablet provided in an embodiment of the present application. As shown in Figure 9, the interactive tablet includes a processor 310 and a memory 320, and may also include an input device 330, an output device 340, and a communication device 350. The interactive tablet can have one or more processors 310, with Figure 9 using a single processor 310 as an example. The processor 310, memory 320, input device 330, output device 340, and communication device 350 in the interactive tablet can be connected via a bus or other means, with Figure 9 using a bus as an example.

[0232] Memory 320, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as the program instructions / modules corresponding to the quick annotation method in the embodiments of the present application. Processor 310 executes the software programs, instructions, and modules stored in memory 320 to execute various functional applications and data processing of the interactive tablet, thereby implementing the quick annotation method described above.

[0233] The memory 320 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function; the data storage area may store data generated based on the use of the interactive tablet, etc. Furthermore, the memory 320 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state memory device. In some instances, the memory 320 may further include memory remotely located relative to the processor 310, and these remote memories may be connected to the interactive tablet via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0234] The input device 330 may be used to receive input digital or character information and generate signal input related to user settings and function control of the interactive tablet. The output device 340 may include a display device such as a display screen.

[0235] The above-mentioned interactive tablet can be used to execute any quick annotation method, and has corresponding functions and beneficial effects.

[0236] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, it is used to perform relevant operations in the quick annotation method provided in any embodiment of the present application, and has corresponding functions and beneficial effects.

[0237] Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products.

[0238] Therefore, the application can adopt the form of complete hardware embodiment, complete software embodiment, or the embodiment in combination with software and hardware. Moreover, the application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code. The application is described with reference to the flow chart and / or block diagram of the method, equipment (system) and computer program product according to the embodiment of the application. It should be understood that each flow process and / or box in the flow chart and / or block diagram and the combination of the flow chart and / or box in the flow chart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processing machine or other programmable data processing device to produce a machine, so that the instruction executed by the processor of the computer or other programmable data processing device produces a device for realizing the function specified in one flow chart flow chart or multiple flow processes and / or one block or multiple blocks of the block diagram. These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device that implements the functions specified in one or more processes of the flowchart and / or one or more blocks of the block diagram. These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes of the flowchart and / or one or more blocks of the block diagram.

[0239] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory. Memory may include non-permanent storage in a computer-readable medium, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0240] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory media such as modulated data signals and carrier waves.

[0241] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of other identical elements in the process, method, commodity, or apparatus comprising the element.

[0242] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will appreciate that the present invention is not limited to the specific embodiments herein, and that various obvious changes, readjustments, and substitutions are possible for those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the scope of the present invention. The scope of the present invention is determined by the scope of the appended claims.

Claims

1. A quick annotation method, applied to a first interactive tablet, wherein: The first interactive tablet includes a touch-sensitive display screen, the touch-sensitive display screen is used to detect position information of a touch object and a touch object type of the touch object, and the quick annotation method includes: Displaying a first screen on the touch-sensitive display screen of the first interactive tablet, wherein the first interactive tablet is in a video conference with a second video conferencing application of at least one second interactive tablet on a network end via a first video conferencing application, and a second screen is displayed on the second interactive tablet; receiving first sensing data of a touch object performing a first operation on the first screen, the first sensing data including first position information detected by the touch-sensitive display screen and a touch object type of the touch object; When it is determined that the touch object type is a preset first touch object type and the first operation is determined to be a move operation based on the first position information, first batch of annotation application windows of the first batch of annotation applications are superimposed on the first screen, and first writing handwriting is added and displayed on the first batch of annotation application windows based on the first position information; Acquiring first handwriting data of the first handwriting, synchronizing the first handwriting data to the second video conferencing application of the second interactive tablet through the first video conferencing application, so that the second interactive tablet overlays a second annotation application window of the second annotation application on the second screen according to the first handwriting data, and adds and displays the first handwriting in the second annotation application window; receiving, through the first video conferencing application, second handwriting data synchronized with the second video conferencing application, where the second handwriting data is handwriting data generated by a touch object performing a writing operation on the second annotation application window; The second handwriting data is sent to the first batch annotation application program, so that the first batch annotation application program adds and displays the second handwriting in the first batch annotation application window according to the second handwriting data.

2. The quick annotation method according to claim 1, wherein: The acquiring of first handwriting data of the first handwriting and synchronizing the first handwriting data to the second video conferencing application of the second interactive tablet through the first video conferencing application specifically comprises: Obtain the conference identification information of the current conference of the first video conferencing application, and obtain the first handwriting data of the first written handwriting, and send the first handwriting data and the conference identification information to the conference server through the first video conferencing application, so that the conference server synchronizes the first handwriting data to the second video conferencing application of the second interactive tablet according to the conference identification information, and the current conference identification information of the second video conferencing application is the same as the conference identification information of the first video conferencing application.

3. The quick annotation method according to claim 1 or 2, wherein: Also includes: receiving second sensing data of a touch object performing a second operation on the first batch of registered application windows, the second sensing data including second position information detected by the touch-sensitive display screen and a touch object type of the touch object; adding handwriting to the first batch of annotation application windows according to the second position information, or triggering an operation control of the first batch of annotation application windows; receiving, after triggering an erase control of the first batch of noted application windows, third sensing data indicating a third operation performed by the touch object on the first batch of noted application windows, the third sensing data including third position information detected by the touch-sensitive display screen and a touch object type of the touch object; According to the third position information, corresponding writing handwriting is erased on the first batch of annotation application windows.

4. The quick annotation method according to claim 3, wherein: Erasing the corresponding handwriting on the first batch of annotation application windows according to the third position information includes: Sending handwriting information of the target deleted handwriting associated with the third position information to the second interactive tablet, so that the second interactive tablet sends the handwriting information to the second annotation application to lock the corresponding handwriting, so that the locked handwriting cannot be edited; After erasing the corresponding handwriting on the first batch of annotation application windows according to the third position information, the method further includes: After confirming that the third operation is completed, the handwriting update information generated according to the third operation is sent to the second interactive tablet, so that the second interactive tablet sends the handwriting update information to the second annotation application to unlock the written handwriting and update the corresponding written handwriting.

5. The quick annotation method according to claim 3, wherein: The third position information includes position information corresponding to multiple touch points; Accordingly, erasing the corresponding handwriting on the first batch of annotation application windows according to the third position information includes: When the first batch annotation application window is in the first batch annotation state, the first single point position information is confirmed according to the third position information, and the writing corresponding to the first single point position information is erased on the first batch annotation application window, and the first screen in the first batch annotation state remains unchanged.

6. The quick annotation method according to claim 3, wherein: The second position information includes position information corresponding to multiple touch points; Accordingly, adding handwriting to the first batch of annotation application windows according to the second position information includes: When the first batch annotation application window is in the first batch annotation state, the second single point position information is confirmed according to the second position information, and writing handwriting is added to the first batch annotation application window according to the second single point position information, and the first screen in the first batch annotation state remains unchanged.

7. The quick annotation method according to claim 1 or 2, wherein: Also includes: receiving fourth sensing data of a fourth operation performed by a touch object when the first batch annotation application window is in a first batch annotation state, the fourth sensing data including fourth position information detected by the touch-sensitive display screen and a touch object type of the touch object, and the touch area of ​​the touch object reaches a preset erasure threshold, and the first screen in the first batch annotation state remains unchanged; According to the fourth position information, corresponding writing handwriting is erased on the first batch of annotation application windows.

8. The quick annotation method according to claim 1 or 2, wherein: The acquiring first handwriting data of the first handwriting and synchronizing the first handwriting data to the second video conferencing application of the second interactive tablet through the first video conferencing application includes: The screen data of the first screen is synchronized to the second interactive tablet, so that the second interactive tablet displays the first screen, and the second annotation application window covers the first screen.

9. The quick annotation method according to claim 1 or 2, wherein: The first screen is a shared screen of a video conference.

10. A quick annotation method, applied to an interactive tablet, wherein: The interactive tablet includes a touch-sensitive display screen, and the touch-sensitive display screen is used to detect position information of a touch object and the touch object type of the touch object. The quick annotation method includes: Displaying a first interface on the touch-sensitive display screen; receiving first sensing data of a touch object performing a first operation on the first interface, the first sensing data including first position information detected by the touch-sensitive display screen and a touch object type of the touch object; When it is determined that the touch object type does not meet the preset first touch object type, performing a touch response to the first operation based on the first position information, and updating the first interface; When it is confirmed that the touch object type is a preset first touch object type, and the first operation is confirmed to be a click or long press operation based on the first position information, a touch response is performed to the first operation based on the first position information, and the first interface is updated; When it is confirmed that the touch object type is the preset first touch object type, and the first operation is confirmed to be a moving operation based on the first position information, in the first Adding a first batch of annotation application windows on the interface, and adding writing handwriting to the first batch of annotation application windows according to the first position information; receiving second sensing data of a touch object performing a second operation on the first batch of registered application windows, the second sensing data including second position information detected by the touch-sensitive display screen and a touch object type of the touch object; adding handwriting on the first batch of annotation application windows according to the second position information, or triggering an operation control on the first batch of annotation application windows; receiving, after triggering an erase control on the first batch of noted application windows, third sensing data indicating a third operation performed by the touch object on the first batch of noted application windows, the third sensing data including third position information detected by the touch-sensitive display screen and a touch object type of the touch object; According to the third position information, corresponding writing handwriting is erased on the first batch of annotation application windows.

11. The quick annotation method according to claim 10, wherein: The first interface is an interface of a writing application, and the quick annotation method further includes: receiving fourth sensing data of a touch object performing a fourth operation on the first interface, the fourth sensing data including fourth position information detected by the touch-sensitive display screen and a touch object type of the touch object; Perform a touch response to the fourth sensor data and update the first interface.

12. The quick annotation method according to claim 10 or 11, wherein: The quick annotation method further includes: When it is confirmed that the touch object type is a preset first touch object type and it is confirmed based on the first position information that the first operation is in an edge area of ​​the first interface, a touch response is performed on the first operation based on the first position information to update the first interface.

13. The quick annotation method according to claim 10 or 11, wherein: The first interface is a projection interface received by the interactive tablet, and the quick annotation method further includes: Updating the screen projection interface; The handwriting of the first batch of application windows is displayed on the updated projection interface.

14. The quick annotation method according to claim 10 or 11, wherein: The third position information includes position information corresponding to multiple touch points; Accordingly, erasing the corresponding handwriting on the first batch of annotation application windows according to the third position information includes: When the first batch annotation application window is in the first batch annotation state, the first single point position information is confirmed according to the third position information, and the writing corresponding to the first single point position information is erased on the first batch annotation application window, and the first screen in the first batch annotation state remains unchanged.

15. The quick annotation method according to claim 10 or 11, wherein: The second position information includes position information corresponding to multiple touch points; Accordingly, adding handwriting to the first batch of annotation application windows according to the second position information includes: When the first batch annotation application window is in the first batch annotation state, the second single point position information is confirmed according to the second position information, and writing handwriting is added to the first batch annotation application window according to the second single point position information, and the first screen in the first batch annotation state remains unchanged.

16. The quick annotation method according to claim 10 or 11, wherein: Also includes: receiving fourth sensing data of a fourth operation performed by a touch object when the first batch annotation application window is in a first batch annotation state, the fourth sensing data including fourth position information detected by the touch-sensitive display screen and a touch object type of the touch object, and the touch area of ​​the touch object reaches a preset erasure threshold, and the first screen in the first batch annotation state remains unchanged; According to the fourth position information, corresponding writing handwriting is erased on the first batch of annotation application windows.

17. The quick annotation method according to claim 10 or 11, wherein: After receiving second sensing data of a second operation performed by a touch object on the first batch of registered application windows, the method further includes: When the touch object type in the second sensing data is the touch object type corresponding to the pen end, and the first operation is confirmed to be a move operation based on the second position information, the corresponding writing handwriting is erased on the first batch annotation application window according to the second position information.

18. The quick annotation method according to claim 10 or 11, wherein: When handwriting is added to the first batch of annotation application windows, display properties of the handwriting added corresponding to different touch object types are different.

19. A quick annotation method, applied to an interactive tablet, wherein: The interactive tablet includes a touch-sensitive display screen and a control mainboard. The touch-sensitive display screen is used to detect the position information of a touch object and the medium type of the touch object. The control mainboard is installed with a driver and an operating system. The touch-sensitive display screen is connected to the control mainboard. The quick annotation method includes: Displaying a first interface on the touch-sensitive display screen; The driver receives first sensing data of a touch object performing a first operation on the first interface, the first sensing data including first position information detected by the touch-sensitive display screen and a touch object type of the touch object; The driver confirms, based on the first position information, that the first operation is a moving operation and that the touch object type is a preset first medium type, and sends the first sensing data to the annotation application; The annotation application program adds a first batch of annotation application windows on the first interface, and adds writing handwriting to the first batch of annotation application windows according to the first position information; The driver receives second sensing data of a second operation performed by a touch object on the first batch of registered application windows and sends the second sensing data to the operating system, wherein the second sensing data includes second position information detected by the touch-sensitive display screen; The operating system sends the second sensory data to the annotation application; The annotation application adds writing handwriting on the first batch of annotation application windows according to the second position information, or triggers an operation control on the first batch of annotation application windows; When an erase control on the first batch of application windows is triggered, the driver receives third sensing data of a third operation performed by the touch object on the first batch of application windows and sends the data to the operating system, the third sensing data including third position information detected by the touch-sensitive display screen; The operating system sends the third sensory data to the annotation application; The annotation application erases corresponding writing on the first annotation application window according to the third position information.

20. The quick annotation method according to claim 19, wherein: The annotation application is started and runs in the background; the quick annotation method also includes: When the annotation application confirms that the first interface is not the interface of a writing application, the annotation application establishes a data channel with the driver; when the annotation application confirms that the first interface is the interface of a writing application, the annotation application disconnects the data channel with the driver; the data channel is used to transmit the first sensor data.

21. An interactive tablet, wherein: include: one or more processors; a memory for storing one or more computer programs; When the one or more computer programs are executed by the one or more processors, the interactive tablet implements the shortcut function as described in any one of claims 1 to 20. Annotation method.

22. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the quick annotation method according to any one of claims 1 to 20 is implemented.

Images