A handwriting display method, device, interactive tablet and storage medium
By detecting the material and trajectory information of the stylus, the synchronization of distinguishing private content and shared content on the electronic whiteboard is achieved, which solves the problem of not being able to annotate private content in collaborative meetings and improves the user experience.
Patent Information
- Application Number
- CN202110435248.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-04-22
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2041-04-22
AI Technical Summary
The existing electronic whiteboard cannot realize the annotation of private content in collaborative meetings, resulting in users being unable to add private content during the meeting, affecting the meeting host's explanation and the viewing experience of other participants.
By receiving the touch sensing information input by the stylus pen on the display interface, using the touch sensing module and elastic wave sensor to detect the material and trajectory information of the stylus pen, generate writing handwriting, and according to the preset pen material mode (private mode) or Share Mode) determines whether to sync the handwriting to other collaborative whiteboards.
This enables users to write and hide handwriting content privately during meetings, avoid display conflicts with shared content, and improves user experience.
Smart Images

Figure CN114690929B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the technical field of electronic whiteboards, and in particular to a method and device for displaying handwriting, an interactive tablet, and a storage medium. Background Art
[0002] With the continuous advancement of science and technology, many electronic devices with handwriting input systems have begun to enter the market, such as smart terminals such as mobile phones, e-books and tablets with handwriting functions. In order to enrich the application of handwriting functions in smart terminals, electronic whiteboard applications have come into being. Electronic whiteboards are an application that displays input text or pictures according to the handwriting of users on the screen. With the continuous development of the Internet, cross-regional collaboration has become an indispensable part of users' daily work. In order to meet the needs of users for cross-regional collaboration, electronic whiteboards have added remote collaboration functions, that is, after running electronic whiteboards on multiple smart terminal devices and joining the same meeting, the display content on a certain electronic whiteboard will be synchronized to the other electronic whiteboards participating in the meeting, so that participants can share the display content of the electronic whiteboard.
[0003] The inventor discovered that for the solution of participating in a meeting through an electronic whiteboard in the prior art, all displayed content on the user's electronic whiteboard will be synchronized to other participants, which makes it impossible for the user to annotate private content on the electronic whiteboard during the meeting, that is, the annotations added by the user on the electronic whiteboard will be synchronized to other participants. For example, when the conference host is explaining the display content of the electronic whiteboard to the participants, the participants have doubts about a certain display content, but it is not appropriate to interrupt the conference host's explanation midway, so it is necessary to annotate the doubtful display content to facilitate the conference host to ask questions after the explanation. If annotations are added to the electronic whiteboard based on the prior art, this will not only affect the conference host's explanation based on the display content of the electronic whiteboard, but will also block other participants from viewing the display content on the electronic whiteboard. In summary, how to annotate private content has become a technical problem that needs to be solved urgently. Summary of the invention
[0004] The embodiments of the present application provide a handwriting display method, device, interactive tablet and storage medium, which solve the technical problem in the prior art that a collaborative whiteboard participating in a collaborative meeting cannot write private content, and improve the user experience.
[0005] In a first aspect, an embodiment of the present application provides a handwriting display method, which is applied to a first collaborative whiteboard participating in a collaborative conference, where the first collaborative whiteboard and at least one second collaborative whiteboard are involved in the collaborative conference, and is characterized in that it includes:
[0006] Displaying a display interface of the first collaborative whiteboard;
[0007] receiving touch sensing information corresponding to a writing operation input by a writing pen on the display interface, and extracting touch track information detected by a touch sensing module and elastic wave feature information detected by an elastic wave sensor from the touch sensing information;
[0008] Determining the material of the writing pen according to the elastic wave characteristic information, and generating a corresponding first writing trace according to the touch track information;
[0009] When confirming that a writing pen material is pre-set locally, determine whether the material of the writing pen is the same as the preset material; if the two are the same, draw the first writing handwriting to the top layer of the display hierarchy of the display interface, and do not perform a sharing operation on the writing handwriting located at the top layer; otherwise, draw the first writing handwriting at a non-top layer of the display interface, and perform a sharing operation on the writing handwriting located at the non-top layer, so as to share the first writing handwriting with the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting;
[0010] When it is confirmed that the writing pen material is not pre-set locally, the first writing handwriting is drawn to the non-top layer of the display interface, and the writing handwriting located at the non-top layer is shared to share the first writing handwriting to the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting.
[0011] In a second aspect, an embodiment of the present application provides a handwriting display device, comprising:
[0012] A display module, configured to display a display interface of the first collaborative whiteboard;
[0013] a receiving module configured to receive touch sensing information corresponding to a writing operation input by a writing pen on the display interface, and extract touch track information detected by a touch sensing module and elastic wave feature information detected by an elastic wave sensor from the touch sensing information;
[0014] A writing module, configured to determine the material of the writing pen according to the elastic wave characteristic information, and generate a corresponding first writing trace according to the touch track information;
[0015] The drawing module is configured to determine whether the material of the writing pen is the same as the preset material when confirming that the material of the writing pen is preset locally. If the two are the same, the first writing handwriting is drawn to the top layer of the display hierarchy of the display interface, and the writing handwriting located at the top layer is not shared; otherwise, the first writing handwriting is drawn at a non-top layer of the display interface, and the writing handwriting located at the non-top layer is shared, so that the first writing handwriting is shared with the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting;
[0016] The sharing module is configured to draw the first writing handwriting to the non-top layer of the display interface when it is confirmed that the writing pen material is not pre-set locally, and to share the first writing handwriting to the second collaborative whiteboard so that the second collaborative whiteboard displays the first writing handwriting.
[0017] In a third aspect, an embodiment of the present application provides an interactive tablet, including:
[0018] one or more processors;
[0019] A memory for storing one or more programs;
[0020] When the one or more programs are executed by the one or more processors, the one or more processors implement the handwriting display method as described in the first aspect.
[0021] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the handwriting display method as described in the first aspect.
[0022] The above-mentioned writing handwriting display method, device, interactive tablet and storage medium receive touch sensing information corresponding to the writing operation input by the writing pen on the display interface, extract the touch track information detected by the touch sensing module and the elastic wave characteristic information detected by the elastic wave sensor in the touch sensing information; determine the material of the writing pen according to the elastic wave characteristic information, and generate the corresponding first writing handwriting according to the touch track information; when it is confirmed that the writing pen material is pre-set locally, determine whether the material of the writing pen is the same as the preset material, and if the two are the same, draw the first writing handwriting on the display interface. The first writing handwriting is drawn on the top layer of the display hierarchy of the display interface, and the writing handwriting on the top layer is not shared; otherwise, the first writing handwriting is drawn on the non-top layer of the display interface, and the writing handwriting on the non-top layer is shared to share the first writing handwriting with the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting; when it is confirmed that the writing pen material is not pre-set locally, the first writing handwriting is drawn to the non-top layer of the display interface, and the writing handwriting on the non-top layer is shared to share the first writing handwriting with the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting. By adopting the above-mentioned technical means, based on the fact that the elastic wave characteristic information detected by the elastic wave sensor when different writing pens input writing operations is different, the material of the writing pen is determined by the elastic wave characteristic information. The user can set the writing pen material on the electronic whiteboard in advance. When the user uses a writing pen with the same preset material to write on the electronic whiteboard, the handwriting content will not be synchronized to the other electronic whiteboards in the collaborative meeting, so that the user can write private content in the meeting, and a convenient interactive method for hiding and displaying private content is provided to avoid display conflicts between private content and shared content on the electronic whiteboard, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] Figure 1 It is a flow chart of a handwriting display method provided by an embodiment of the present application;
[0024] Figure 2 is a first schematic diagram of a first collaborative whiteboard provided in an embodiment of the present application;
[0025] Figure 3 is a second schematic diagram of the first collaborative whiteboard provided in an embodiment of the present application;
[0026] Figure 4 is a third schematic diagram of the first collaborative whiteboard provided in an embodiment of the present application;
[0027] Figure 5 is a fourth schematic diagram of the first collaborative whiteboard provided in an embodiment of the present application;
[0028] Figure 6 is a flow chart of another method for displaying handwriting provided by an embodiment of the present application;
[0029] Figure 7 A fifth schematic diagram of a first collaborative whiteboard provided in an embodiment of the present application;
[0030] Figure 8 A sixth schematic diagram of the first collaborative whiteboard provided in an embodiment of the present application;
[0031] Fig. 9 A seventh schematic diagram of a first collaborative whiteboard provided in an embodiment of the present application;
[0032] Fig.10 An eighth schematic diagram of the first collaborative whiteboard provided in an embodiment of the present application;
[0033] Fig.11 A ninth schematic diagram of the first collaborative whiteboard provided in an embodiment of the present application;
[0034] Fig.12 It is a structural schematic diagram of a handwriting display device provided by an embodiment of the present application;
[0035] Fig.13 It is a structural schematic diagram of an interactive tablet provided by an embodiment of the present application. DETAILED DESCRIPTION
[0036] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only the parts related to the present application, rather than all structures, are shown in the accompanying drawings.
[0037] It should be noted that, in the present application, relational terms such as first and second are only used to distinguish one entity or operation or object from another entity or operation or object, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations or objects. For example, the "first" and "second" of the first collaborative whiteboard and the second collaborative whiteboard are used to distinguish the electronic whiteboards participating in the collaborative meeting. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to the specific circumstances. In addition, in the description of the present application, unless otherwise specified, "multiple" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.
[0038] The handwriting display method provided in the embodiment of the present application can be executed by an interactive tablet with a touch function. The interactive tablet can operate the content displayed on the display screen and realize human-computer interaction through touch technology, and it integrates one or more functions such as a projector, an electronic whiteboard, a screen, an audio system, a television, and a video conferencing terminal. In actual applications, the hardware part of the interactive tablet is composed of parts such as a display screen and an intelligent processing system, which are combined together by integral structural parts and are also supported by a dedicated software system, wherein the display screen has a touch function. In the embodiment, the display screen displays an electronic whiteboard, and the user can touch the display screen with a finger or a stylus. The intelligent processing system generates handwriting drawn on the electronic whiteboard according to the touch operation input by the user, or generates control instructions according to the touch operation input by the user to process the display content on the electronic whiteboard.
[0039] Typically, the smart interactive tablet is installed with at least one type of operating system, wherein the operating system includes but is not limited to Android system, Linux system and Windows system. The touch operation received through the display screen is processed by the operating system. Furthermore, the smart interactive tablet can install at least one application based on the operating system. In the embodiment, the electronic whiteboard application is used as an example description. For example, an electronic whiteboard application is installed in the smart interactive tablet. Among them, the application can be an application that comes with the operating system, or it can be an application downloaded from a third-party device or server. Optionally, under the electronic whiteboard function, functions such as writing, inserting tables, inserting pictures, inserting multimedia, inserting files (such as PPT, etc.), playing multimedia, inserting graphics, drawing tables, etc. can be realized. In addition, the electronic whiteboard also has a conference function. Each interactive tablet terminal can join the same conference through the electronic whiteboard, and display the conference content shared by each interactive tablet terminal in the conference on the electronic whiteboard.
[0040] Figure 1 1 is a flowchart of a handwriting display method provided by an embodiment of the present application. Figure 1 , the handwriting display method comprises:
[0041] S110: Display a display interface of a first collaborative whiteboard.
[0042] The first collaborative whiteboard and the second collaborative whiteboard are electronic whiteboard applications participating in the same collaborative conference, and the participants in the collaborative conference include the first collaborative whiteboard and at least one second collaborative whiteboard. It can be understood that the first collaborative whiteboard is the participating terminal used by the user, and the second collaborative whiteboard is the remaining participating terminals in the collaborative conference.
[0043] S120, receiving touch sensing information corresponding to the writing operation input by the writing pen on the display interface, and extracting touch track information detected by the touch sensing module and elastic wave feature information detected by the elastic wave sensor from the touch sensing information.
[0044] Exemplarily, when a user uses a writing pen to input a writing operation on the display interface of the first collaborative whiteboard, the touch sensing module and elastic wave sensor installed on the display screen detect the writing operation input by the user to generate touch sensing information, and send the touch sensing information to the processor to inform the processor to process the writing operation.
[0045] Among them, the touch sensing information includes elastic wave characteristic information, and the elastic wave characteristic information is measured by a piezoelectric elastic wave sensor installed at the screen frame or on the inner side of the screen cover. Exemplarily, when the writing pen touches the screen cover, characteristic elastic wave characteristic information will be generated, and the elastic wave characteristic information starts from the contact point and propagates around along the screen cover, or propagates to the inner side of the screen cover. The piezoelectric elastic wave sensor located at the screen frame or on the inner side of the cover converts the elastic wave characteristic information into a voltage signal, and then transmits the voltage signal to an IC chip with a temperature compensation circuit for amplification processing, and converts the amplified voltage signal into a digital voltage signal through an analog-to-digital conversion circuit, and uses the digital voltage signal as the elastic wave characteristic information. The processor analyzes and processes the elastic wave characteristic information to determine the material of the writing pen corresponding to the elastic wave characteristic information.
[0046] Further, the touch sensing information also includes touch track information, which is measured by the optical touch sensors installed on both sides of the display screen surface about the track information of the user moving the writing pen on the display screen, which specifically includes the contact area between the writing pen and the display interface, the moving speed of the writing pen on the display interface, and the contact position when the writing pen contacts the display interface. Exemplarily, the optical touch sensors are arranged on both sides of the display screen surface, and the optical touch sensors include an infrared transmitter and an infrared receiver, the infrared transmitter is used to transmit infrared light, and the infrared receiver is used to receive infrared light, and the beam grid formed by the dense infrared light in different directions is used to locate the contact position of the writing pen contacting the screen cover. M infrared transmitters are arranged on one side of the display screen in the horizontal direction, and N infrared transmitters are arranged on one side of the display screen in the vertical direction. Correspondingly, M infrared receivers are arranged on the other side of the horizontal direction, and N infrared receivers are arranged on the other side of the vertical direction. The infrared transmitter transmits infrared light at a certain frequency, and the corresponding infrared receiver receives infrared light at a certain frequency. When the writing pen touches the screen cover, the writing pen will completely or partially block one or more vertical and horizontal infrared lights, and then obtain an M*N infrared light intensity pixel map. First, find the position greater than the first light intensity threshold on the infrared light intensity pixel map. The first light intensity threshold represents a real and effective touch, rather than noise or the light intensity measured when the infrared light is half-blocked when an object is close but not completely touched. The real touch position is the contact position when the writing pen touches the screen cover. Further, find the position greater than the second light intensity threshold in the vicinity of the real touch position. The second light intensity threshold is greater than the noise value, which can represent the extension of the real touch area. The position greater than the second light intensity threshold in the vicinity of the real touch position is marked as a valid touch area. The area of the touch area is the contact area between the writing pen and the screen cover. When the writing pen moves on the screen cover, the infrared light intensity pixel map with multiple frames of time continuous records the contact position and contact area of the writing pen on the screen cover. The moving speed of the writing pen on the screen cover can be obtained through the contact position and contact area recorded in the continuous frames. When the writing pen leaves the screen cover, the writing pen's obstruction of infrared light becomes smaller. If the contact position in the previous frame of the infrared light intensity pixel map, the relative position in the current infrared light intensity pixel map, and the adjacent area do not have pixels exceeding the third light intensity threshold, then it is determined that the relationship between the writing pen and the screen cover is out of touch, and the third light intensity threshold represents the maximum light intensity when out of touch.
[0047] In addition, the touch trajectory information also includes the contact pressure when the writing pen touches the display interface. The contact pressure is the pressure of the writing pen pressing on the screen cover, and the contact pressure is measured by the pressure sensor when the writing pen touches the screen cover. Exemplarily, the pressure sensor is installed under the screen cover or at the screen frame. Due to the superposition of force, multiple pressure sensors can sense pressure information at different positions, and combined with the optical touch sensor, the pressure of each touch point can be deduced.
[0048] It should be noted that the optical touch sensor and the pressure sensor constitute a touch sensor module.
[0049] S130, determining the material of the writing pen according to the elastic wave characteristic information, and generating a corresponding first writing handwriting according to the touch trajectory information.
[0050] Exemplarily, the elastic wave feature information is used as an input signal, and the material type of the touch pen is output through the machine learning model, and the material information of the touch pen is represented by the material type of the touch pen. It can be understood that the elastic wave feature information generated when the touch pen of the same material touches the screen cover is roughly the same. The machine learning model is trained in advance with a large number of training samples to identify the touch pen material corresponding to the elastic wave feature information through the machine learning model, and the training samples include the elastic wave feature information and the corresponding touch pen material.
[0051] After obtaining the contact area between the touch pen and the display interface, the moving speed of the touch pen on the display interface, the contact position when the touch pen contacts the display interface, and the contact pressure when the writing pen touches the display interface, the corresponding writing handwriting is generated according to this information. Exemplarily, the coordinates of the touch pen touching the screen cover are determined according to the contact position, the coordinates of the track point corresponding to the writing handwriting on the display interface are determined according to the coordinates, and the rendering area of the corresponding track point on the display interface is determined according to the contact area corresponding to the contact position. According to the moving speed of the touch pen between two adjacent contact positions and the contact pressure at the two contact positions, the connection track between the track points corresponding to the two contact positions is determined. According to the track point coordinates, the track point rendering area and the connection track, the corresponding writing handwriting is generated.
[0052] S140. When confirming that a writing pen material is pre-set locally, determine whether the material of the writing pen is the same as the preset material. If the two are the same, draw the first writing handwriting to the top layer of the display hierarchy of the display interface, and do not share the writing handwriting at the top layer; otherwise, draw the first writing handwriting at a non-top layer of the display interface, and share the writing handwriting at the non-top layer to share the first writing handwriting to the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting.
[0053] The first collaborative whiteboard and the second collaborative whiteboard are electronic whiteboard applications participating in the same collaborative conference. In a traditional collaborative conference, the content data input by each participating terminal will be synchronized to the other participating terminals. Therefore, for a traditional collaborative whiteboard, users cannot enter private content on its display interface, that is, no matter what the user enters, it will be displayed in the display interface of the other collaborative whiteboards. The reason for this problem is that the traditional participating terminal cannot distinguish the material of the writing pen used to draw the handwriting, and thus cannot distinguish the handwriting drawn by different writing pen materials. The traditional participating terminal can only synchronize all the displayed content on the electronic whiteboard. As can be seen from step S110, this embodiment can identify the material of the writing pen through the elastic wave characteristic information detected by the elastic wave sensor when the writing pen inputs the writing operation, and distinguish the handwriting by the material of the writing pen. Therefore, the user can set the material of the writing pen on the first collaborative whiteboard in advance, and the handwriting input by the writing pen of the preset material will not be synchronized to other participating terminals in the meeting, thereby realizing the function that the user can enter private content in the meeting.
[0054] In this regard, the present embodiment is provided with a private mode and a shared mode. In the private mode, the content input by the user using a writing pen of a preset material is private content, and the private content will not be shared with other participating terminals in the collaborative conference. In the shared mode, the content written by the user is shared content, which will be shared with other participants in the conference. Exemplarily, if the user sets the writing pen material in the private mode in the setting interface of the first collaborative whiteboard, it means that if the user uses a writing pen of this material to draw the handwriting, it will not be synchronized to other participating terminals in the conference, that is, the user can write private content on the first collaborative whiteboard, so it is confirmed that the current first collaborative whiteboard is in private mode. If the user does not set the writing pen material in the private mode in the setting interface of the first collaborative whiteboard, it means that no matter what material the user uses to draw the handwriting, it will be synchronized to other participating terminals in the conference, that is, the user cannot write private content on the first collaborative whiteboard, so it is confirmed that the current first collaborative whiteboard is in shared mode.
[0055] Furthermore, after confirming that the first collaborative whiteboard is in private mode, the handwriting input by the user using the same material as the writing pen set in the private mode of the first collaborative whiteboard is private content. Therefore, in order to determine whether the handwriting currently input is private content, it is necessary to determine whether the material of the writing pen used to input the writing operation is the same as the material set in the private mode. If the two are the same, it indicates that the first handwriting currently input is private content. If the two are different, it indicates that the handwriting currently input is shared content.
[0056] Furthermore, if the handwriting currently input is private content, the first handwriting is drawn to the top layer of the display hierarchy of the display interface of the first collaborative whiteboard to prevent the private content from being blocked by the shared content on the first collaborative whiteboard. The display hierarchy is the hierarchy of the content displayed on the display interface. Assuming that the highest level of the displayed content on the current display interface is the fifth layer, the handwriting is drawn on the sixth layer. Among them, the handwriting on the top layer will not be shared, that is, the handwriting on the top layer will not be shared with the second collaborative whiteboard, then the second collaborative whiteboard will not receive the handwriting data of the first handwriting, and the second collaborative whiteboard will not display the first handwriting, that is, the first handwriting will only be displayed on the first collaborative whiteboard.
[0057] If the first handwriting currently being drawn is shared content, the first handwriting will be drawn on the non-top layer of the display interface, and the handwriting located on the non-top layer will be shared with the second collaborative whiteboard so that the second collaborative whiteboard displays the first handwriting, that is, the first handwriting will be displayed on the first collaborative whiteboard and the second collaborative whiteboard at the same time.
[0058] S150. When it is confirmed that the writing pen material is not pre-set locally, the first writing handwriting is drawn to the non-top layer of the display interface, and the writing handwriting located at the non-top layer is shared to share the first writing handwriting to the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting.
[0059] For example, when the first collaborative whiteboard is in sharing mode, the user has not set the writing pen material in private mode in the setting interface of the first collaborative whiteboard. This means that no matter what material of writing pen the user uses, the writing handwriting will be synchronized to other participating terminals in the meeting. That is, the writing handwriting drawn by the user in sharing mode belongs to shared content, so the currently input first writing handwriting needs to be shared with other participating terminals in the meeting.
[0060] The technical solution provided by the embodiment is described exemplarily below:
[0061] The user opens the first collaborative whiteboard, joins the collaborative meeting, receives the shared content sent by the second collaborative whiteboard corresponding to the speaker in the meeting, and displays the shared content on the display interface of the first collaborative whiteboard. Assume that the current speaker is explaining the annual sales and influencing factors of a certain product in the display interface. At this time, the user has doubts about one of the influencing factors mentioned by the speaker, so he wants to make an annotation on the influencing factor that is only visible to himself, so that he can ask the speaker after the meeting. In this regard, the user can open the setting interface of the first collaborative whiteboard to check whether the first collaborative whiteboard is in private mode or shared mode. Figure 2 is a first schematic diagram of a first collaborative whiteboard provided in an embodiment of the present application. Figure 2The setting interface 11 of the first collaborative whiteboard includes a private mode setting directory 12, and the private mode setting directory 12 includes a switch control 13. The switch control 13 controls the switching between the private mode and the sharing mode. When the switch control moves to the right, the private mode is turned off, that is, the sharing mode is turned on. Figure 3 is a second schematic diagram of the first collaborative whiteboard provided in an embodiment of the present application. Figure 3 , the switch control 13 moves to the left, the private mode is turned on, and a selection window 14 is expanded in the private mode setting directory. The first collaborative whiteboard is pre-set with writing pens of material No. 1 to material No. 5. The user can select any one of them as the writing pen material set in the private mode through the selection window 14. Further, refer to Figure 3 , the user opens the private mode in the setting interface 11, and selects material No. 1 as the writing pen material set in the private mode.
[0062] The first collaborative whiteboard is equipped with writing pens No. 1 to No. 5, which correspond to materials No. 1 to No. 5 respectively. In order to annotate private content visible only to oneself on the display interface of the first collaborative whiteboard, the user selects a writing pen No. 1 to write the annotation content on the first collaborative whiteboard. At this time, the processor receives the touch sensing information, obtains the touch trajectory information and the elastic wave feature information from the touch sensing information, generates the corresponding first writing handwriting according to the touch trajectory information, and inputs the elastic wave feature information into the pre-trained machine learning model to obtain the material No. 1 corresponding to the writing pen No. 1. Further, it is queried whether the current private mode is turned on. If the current private mode is turned on, the writing pen material set in the current private mode is then queried. The material result obtained by the machine learning model is compared with the writing pen material set in the private mode to determine whether the two are the same. At this time, the material result obtained by the machine learning model is material No. 1, and the writing pen material set in the private mode is also material No. 1, that is, it is determined that the two are the same material, so that the annotation content currently input by the user using the writing pen No. 1 is determined to be private content visible only to oneself, and there is no need to share the annotation content to the other participating terminals in the meeting.
[0063] Figure 4 is a third schematic diagram of the first collaborative whiteboard provided in an embodiment of the present application. Figure 4 The display interface 15 of the first collaborative whiteboard displays the annual sales line chart of a certain product and the corresponding three influencing factors, namely the first influencing factor, the second influencing factor and the third influencing factor. The user has some questions about the third influencing factor and writes annotations in the display interface 15 using a No. 1 writing pen. Figure 5 4 is a fourth schematic diagram of the first collaborative whiteboard provided in the embodiment of the present application. Figure 5, the user uses the No. 1 writing pen to annotate the question mark 16 behind the third influencing factor of the display interface 15. The processor generates the first handwriting of the question mark 16 according to the touch track information, and determines that the question mark 16 is private content according to the elastic wave feature information. Draw the question mark 16 to the top layer of the display hierarchy in the display interface 15. For example, the first influencing factor is the highest level display content of the display interface 15, which belongs to the fourth layer, so the question mark 16 is moved to the fifth layer. It is understandable that the first handwriting of the question mark 16 is not shared with the second collaborative whiteboard. At this time, the display interface of the second collaborative whiteboard is the same as that of the second collaborative whiteboard. Figure 4 The other participants still maintain the original display content and are not affected by the private content added by the user.
[0064] Furthermore, if the user currently wants to share the written content with the other participants in the meeting, move the switch control to the right to turn off the private mode. At this time, no matter which writing pen is used, the content written will be shared with the other participants in the meeting. Alternatively, a writing pen other than the No. 1 writing pen is selected for writing. Since the material of other writing pens is different from the No. 1 material set in the private mode, the processor will treat the content written by the writing pen other than the No. 1 writing pen as the shared content, and share the shared content with the other participants.
[0065] Figure 6 1 is a flowchart of another handwriting display method provided by an embodiment of the present application. This embodiment is specific based on the above embodiment. Figure 6 The handwriting display method provided in this embodiment includes:
[0066] S210: Receive a conference code input in the conference login window of the display interface, and join the corresponding collaborative conference according to the conference code.
[0067] For example, Figure 7 is a fifth schematic diagram of the first collaborative whiteboard provided in an embodiment of the present application. Figure 7 , open the conference interface 17 of the first collaborative whiteboard, enter the conference code in the conference login window 18, and click the join control 19 to enter the corresponding collaborative conference. After joining the collaborative conference, receive the shared content sent by the conference speaker, which includes the annual sales line chart of a certain product and the corresponding three influencing factors, and display the shared content on the display interface 15 to obtain Figure 4 A third schematic diagram of the first collaborative whiteboard.
[0068] S220, receiving second handwriting data sent by the second collaborative whiteboard, displaying corresponding second handwriting on the display interface according to the second handwriting data, and drawing the second handwriting to a non-top layer of the display interface.
[0069] For example, assuming that the second collaborative whiteboard inputs the second handwriting on its display interface, the second collaborative whiteboard determines that the second handwriting is shared content, and transmits the second handwriting data of the second handwriting to the first collaborative whiteboard. The first collaborative whiteboard draws the second handwriting on the non-top layer of its display interface according to the second handwriting data. For example, Figure 8 It is the sixth schematic diagram of the first collaborative whiteboard provided in the embodiment of the present application. The speaker annotates the second handwriting on the annual sales line chart of the second collaborative whiteboard, and the second collaborative whiteboard shares the second handwriting data to the first collaborative whiteboard. The first collaborative whiteboard receives the second handwriting data and displays the second handwriting 20 corresponding to the second handwriting data in the display interface 15. It can be understood that the handwriting located at the non-top layer needs to be shared, that is, the handwriting at the non-top layer is all shared content, then the handwriting shared by the second collaborative whiteboard also belongs to the shared content, so the shared content is drawn at the non-top layer.
[0070] S230, receiving erasure data sent by the second collaborative whiteboard, and erasing the corresponding writing handwriting on the non-top layer of the display interface according to the erasure data.
[0071] For example, Fig. 9 This is the seventh schematic diagram of the first collaborative whiteboard provided in the embodiment of the present application. After the lecturer finishes explaining the annual sales line chart, he erases the second handwriting on the second collaborative whiteboard. The second collaborative whiteboard extracts the touch track information corresponding to the input erasure operation and generates a corresponding erase area. The second collaborative whiteboard shares the erase data corresponding to the erase area with the first collaborative whiteboard. The first collaborative whiteboard receives the erase data and erases the second handwriting 20 on the non-top layer according to the erase data. Fig. 9 Display interface 15 in. It can be understood that the erased data shared by the second collaborative whiteboard is also shared content, and the private content is only visible to the user and can only be modified by the user, so the erased data shared by the second collaborative whiteboard will not affect the normal display of the private content, that is, the erased data will only erase the non-top-level shared content.
[0072] S240, receiving touch sensing information corresponding to the writing operation input by the writing pen on the display interface, and extracting touch track information detected by the touch sensing module and elastic wave feature information detected by the elastic wave sensor from the touch sensing information.
[0073] S250: Determine the material of the writing pen according to the elastic wave characteristic information, and generate a corresponding first writing handwriting according to the touch track information.
[0074] S260. When confirming that a writing pen material is pre-set locally, determine whether the material of the writing pen is the same as the preset material. If the two are the same, draw the first writing handwriting to the top layer of the display hierarchy of the display interface, and do not share the writing handwriting at the top layer; otherwise, draw the first writing handwriting at a non-top layer of the display interface, and share the writing handwriting at the non-top layer to share the first writing handwriting to the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting.
[0075] Exemplarily, the specific implementation of steps S240-S260 may refer to steps S110-S130.
[0076] S270: Receive a first touch operation on a hiding control of a first handwriting, and hide the first handwriting displayed on the display interface.
[0077] For example, the first handwriting as private content may conflict with the existing display content on the first collaborative whiteboard, that is, the first handwriting blocks the display content, making the display content unclear. In this regard, this embodiment sets the handwriting as hidden content, and hides and unfolds the handwriting through a hidden control.
[0078] For example, Fig.10 8 is an eighth schematic diagram of the first collaborative whiteboard provided in the embodiment of the present application. Fig.10 The question mark 16 is the private content annotated by the user on the display interface, which is used to indicate that the user has doubts about the third influencing factor. A hidden control 21 is set below the question mark 16. At this time, the question mark 16 is in a display state. When the user clicks the hidden control 21, the question mark 16 is retracted and enters a hidden state.
[0079] S280: Receive a second touch operation on the display control of the first handwriting, and restore the display of the first handwriting on the display interface.
[0080] For example, Fig.11 This is the ninth schematic diagram of the first collaborative whiteboard provided in the embodiment of the present application. Fig.10 The hidden control 20 in the question mark 16 is collapsed, and we get Fig.11 . Click Fig.11 Display control 22 in the question mark 16 is expanded to obtain Fig.10 , question mark 16 enters display mode from hidden mode.
[0081] S290. When it is confirmed that the writing pen material is not pre-set locally, the first writing handwriting is drawn to the non-top layer of the display interface, and the writing handwriting located at the non-top layer is shared to share the first writing handwriting to the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting.
[0082] Exemplarily, the specific details of this step may refer to S140.
[0083] The above-mentioned writing handwriting display method receives touch sensing information corresponding to the writing operation input by the writing pen on the display interface, extracts the touch track information detected by the touch sensing module and the elastic wave characteristic information detected by the elastic wave sensor in the touch sensing information; determines the material of the writing pen according to the elastic wave characteristic information, and generates the corresponding first writing handwriting according to the touch track information; when it is confirmed that the writing pen material is pre-set locally, determines whether the material of the writing pen is the same as the preset material, if the two are the same, draws the first writing handwriting to the top layer of the display hierarchy of the display interface, and the writing handwriting at the top layer is not shared; otherwise, draws the first writing handwriting on the non-top layer of the display interface, and shares the writing handwriting at the non-top layer, so that the first writing handwriting is shared to the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting; when it is confirmed that the writing pen material is not pre-set locally, draws the first writing handwriting to the non-top layer of the display interface, and shares the writing handwriting at the non-top layer, so that the first writing handwriting is shared to the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting. By adopting the above-mentioned technical means, based on the fact that the elastic wave characteristic information detected by the elastic wave sensor when different writing pens input writing operations is different, the material of the writing pen is determined by the elastic wave characteristic information. The user can set the writing pen material on the electronic whiteboard in advance. When the user uses a writing pen with the same preset material to write on the electronic whiteboard, the handwriting content will not be synchronized to the other electronic whiteboards in the collaborative meeting, so that the user can write private content in the meeting, and a convenient interactive method for hiding and displaying private content is provided to avoid display conflicts between private content and shared content on the electronic whiteboard, thereby improving the user experience.
[0084] Fig.12 Schematic diagram of a handwriting display device provided by an embodiment of the present application. Fig.12 The handwriting display device includes: a display module 301, a receiving module 302, a writing module 303, a drawing module 304 and a sharing module 305.
[0085] The display module 301 is configured to display a display interface of the first collaborative whiteboard;
[0086] The receiving module 302 is configured to receive touch sensing information corresponding to the writing operation input by the writing pen on the display interface, and extract touch track information detected by the touch sensing module and elastic wave feature information detected by the elastic wave sensor from the touch sensing information;
[0087] The writing module 303 is configured to determine the material of the writing pen according to the elastic wave characteristic information, and generate the corresponding first writing handwriting according to the touch track information;
[0088] The drawing module 304 is configured to determine whether the material of the writing pen is the same as the preset material when confirming that the material of the writing pen is preset locally. If the two are the same, the first writing handwriting is drawn to the top layer of the display hierarchy of the display interface, and the writing handwriting at the top layer is not shared; otherwise, the first writing handwriting is drawn at a non-top layer of the display interface, and the writing handwriting at the non-top layer is shared, so that the first writing handwriting is shared with the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting;
[0089] The sharing module 305 is configured to draw the first writing handwriting to the non-top layer of the display interface when it is confirmed that the writing pen material is not pre-set locally, and to share the first writing handwriting to the second collaborative whiteboard so that the second collaborative whiteboard displays the first writing handwriting.
[0090] On the basis of the above embodiment, the touch trajectory information includes the contact area, movement speed and / or contact pressure when the writing pen touches the first collaborative whiteboard.
[0091] On the basis of the above-mentioned embodiment, the touch track information is measured by the optical touch sensors installed on both sides of the display screen surface, and the touch track information includes the touch area, touch position and movement speed of the writing pen.
[0092] On the basis of the above embodiment, the display module includes: a hiding unit configured to receive a first touch operation of a hiding control of a first handwriting, and hide the first handwriting displayed on the display interface.
[0093] On the basis of the above embodiment, the display module further includes: a display unit configured to receive a second touch operation on the display control of the first handwriting, and restore the display of the first handwriting on the display interface.
[0094] On the basis of the above embodiment, the handwriting handwriting display device further includes: a conference joining module configured to receive a conference code input in a conference login window of the display interface, and join the corresponding collaborative conference according to the conference code.
[0095] Based on the above embodiment, the handwriting display device also includes: a shared handwriting module, which is configured to receive second handwriting data sent by the second collaborative whiteboard, display the corresponding second handwriting on the display interface according to the second handwriting data, and draw the second handwriting to the top layer.
[0096] On the basis of the above embodiment, the writing handwriting display device further includes: a shared erasing module, which is configured to receive erasing data sent by the second collaborative whiteboard, and erase the corresponding writing handwriting on the non-top layer according to the erasing data.
[0097] The above-mentioned writing handwriting display device receives touch sensing information corresponding to the writing operation input by the writing pen on the display interface, extracts the touch track information detected by the touch sensing module and the elastic wave characteristic information detected by the elastic wave sensor in the touch sensing information; determines the material of the writing pen according to the elastic wave characteristic information, and generates the corresponding first writing handwriting according to the touch track information; when it is confirmed that the writing pen material is pre-set locally, it is determined whether the material of the writing pen is the same as the preset material. If the two are the same, the first writing handwriting is drawn to the top layer of the display hierarchy of the display interface, and the writing handwriting at the top layer is not shared; otherwise, the first writing handwriting is drawn on the non-top layer of the display interface, and the writing handwriting at the non-top layer is shared, so that the first writing handwriting is shared to the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting; when it is confirmed that the writing pen material is not pre-set locally, the first writing handwriting is drawn to the non-top layer of the display interface, and the writing handwriting at the non-top layer is shared, so that the first writing handwriting is shared to the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting. By adopting the above-mentioned technical means, based on the fact that the elastic wave characteristic information detected by the elastic wave sensor when different writing pens input writing operations is different, the material of the writing pen is determined by the elastic wave characteristic information. The user can set the writing pen material on the electronic whiteboard in advance. When the user uses a writing pen with the same preset material to write on the electronic whiteboard, the handwriting content will not be synchronized to the other electronic whiteboards in the collaborative meeting, so that the user can write private content in the meeting, and a convenient interactive method for hiding and displaying private content is provided to avoid display conflicts between private content and shared content on the electronic whiteboard, thereby improving the user experience.
[0098] It is worth noting that in the above-mentioned embodiment of the handwriting display device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application.
[0099] The handwriting display device provided in the embodiment of the present application is included in an interactive tablet and can be used to execute the handwriting display method provided in any of the above embodiments, and has corresponding functions and beneficial effects.
[0100] Fig.13 Schematic diagram of an interactive tablet provided by an embodiment of the present application. Fig.13 As shown, the interactive tablet includes a processor 40, a memory 41, an input device 42, an output device 43 and a display screen 44; the number of processors 40 in the interactive tablet can be one or more. Fig.13In the example, a processor 40 is used; the number of display screens 44 in the interactive tablet can be one or more, Fig.13 A display screen 44 is taken as an example; the processor 40, the memory 41, the input device 42, the output device 43 and the display screen 44 in the interactive tablet can be connected by a bus or other means. Fig.13 The example of connecting through bus is taken in the following.
[0101] The memory 41 is a computer-readable storage medium that can be used to store software programs, computer executable programs and modules, such as program instructions / modules corresponding to the handwriting display method in the embodiment of the present application (for example, the display module 301, the receiving module 302, the writing module 303, the drawing module 304 and the sharing module 305 in the handwriting display device). The processor 40 executes various functional applications and data processing of the interactive tablet by running the software programs, instructions and modules stored in the memory 41, that is, realizing the above-mentioned handwriting display method.
[0102] The memory 41 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required for a function; the data storage area may store data created according to the use of the interactive tablet, etc. In addition, the memory 41 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 41 may further include a memory remotely arranged relative to the processor 40, and these remote memories may be connected to the interactive tablet via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0103] The input device 42 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the interactive tablet. The output device 43 may include an audio output device such as a speaker. The display screen 44 is a display screen with a touch function, which can be a capacitive screen, an electromagnetic screen or an infrared screen. Optionally, when the display screen 44 is an infrared screen, it includes an optical touch sensor, which is arranged around the display screen 44, and can also be used to receive infrared signals and send the infrared signals to the processor 40 or other devices. The display screen 44 also includes a piezoelectric elastic wave sensor, which is used to measure the touch signal of the writing pen. The display screen 44 can display private content and shared content on the electronic whiteboard according to the instructions of the processor.
[0104] The above-mentioned interactive tablet includes a handwriting display device, which can be used to execute any handwriting display method and has corresponding functions and beneficial effects.
[0105] An embodiment of the present application provides a computer-readable storage medium, which, when executed by a processor, is used to execute the handwriting display method provided in the above embodiment.
[0106] Of course, the computer-readable storage medium provided in the embodiment of the present application, whose computer executable instructions are not limited to the method operations described above, can also execute related operations in the handwriting display method provided in any embodiment of the present application.
[0107] Through the above description of the implementation method, the technicians in the relevant field can clearly understand that the present application can be implemented with the help of software and necessary general hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application can be essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of each embodiment of the present application.
[0108] Note that the above are only preferred embodiments of the present application and the technical principles used. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.
Claims
1. A handwriting display method, the method is applied to a first collaborative whiteboard participating in a collaborative meeting, the collaborative meeting includes the first collaborative whiteboard and at least one second collaborative whiteboard, characterized in that: include: Displaying a display interface of the first collaborative whiteboard; receiving touch sensing information corresponding to a writing operation input by a writing pen on the display interface, and extracting touch track information detected by a touch sensing module and elastic wave feature information detected by an elastic wave sensor from the touch sensing information; Determining the material of the writing pen according to the elastic wave characteristic information, and generating a corresponding first writing trace according to the touch track information; When confirming that a writing pen material is pre-set locally, determine whether the material of the writing pen is the same as the preset material; if the two are the same, draw the first writing handwriting to the top layer of the display hierarchy of the display interface, and do not perform a sharing operation on the writing handwriting located at the top layer; otherwise, draw the first writing handwriting at a non-top layer of the display interface, and perform a sharing operation on the writing handwriting located at the non-top layer, so as to share the first writing handwriting with the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting; When it is confirmed that the writing pen material is not pre-set locally, the first writing handwriting is drawn to the non-top layer of the display interface, and the writing handwriting located at the non-top layer is shared to share the first writing handwriting to the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting.
2. The method according to claim 1, characterized in that The touch trajectory information includes a contact area, a moving speed and / or a contact pressure when the writing pen touches the first collaborative whiteboard.
3. The method according to claim 1, characterized in that After drawing the first handwriting to the topmost layer of the display hierarchy of the display interface, the method further includes: A first touch operation of hiding a control of the first handwriting is received, and the first handwriting displayed on the display interface is hidden.
4. The method according to claim 3, characterized in that After hiding the first handwriting displayed on the display interface, the method further includes: A second touch operation on the display control of the first handwriting is received, and the display of the first handwriting on the display interface is restored.
5. The method according to claim 1, characterized in that Before receiving the touch sensing information corresponding to the writing operation input by the writing pen on the display interface, the method further includes: A conference code input in a conference login window of a display interface is received, and a corresponding collaborative conference is joined according to the conference code.
6. The method according to claim 5, characterized in that After joining the corresponding collaborative conference according to the conference code, the method further includes: Receive the second handwriting data sent by the second collaborative whiteboard, display the corresponding second handwriting on the display interface according to the second handwriting data, and draw the second handwriting to the non-top layer.
7. The method according to claim 5, characterized in that After joining the corresponding collaborative conference according to the conference code, the method further includes: Receive the erasure data sent by the second collaborative whiteboard, and erase the corresponding writing on the non-top layer according to the erasure data.
8. A handwriting display device, characterized in that: include: A display module, configured to display a display interface of the first collaborative whiteboard; a receiving module configured to receive touch sensing information corresponding to a writing operation input by a writing pen on the display interface, and extract touch track information detected by a touch sensing module and elastic wave feature information detected by an elastic wave sensor from the touch sensing information; A writing module, configured to determine the material of the writing pen according to the elastic wave characteristic information, and generate a corresponding first writing trace according to the touch track information; The drawing module is configured to determine whether the material of the writing pen is the same as the preset material when confirming that the material of the writing pen is preset locally. If the two are the same, the first writing handwriting is drawn to the top layer of the display hierarchy of the display interface, and the writing handwriting located at the top layer is not shared; otherwise, the first writing handwriting is drawn at a non-top layer of the display interface, and the writing handwriting located at the non-top layer is shared, so that the first writing handwriting is shared with the second collaborative whiteboard, so that the second collaborative whiteboard displays the first writing handwriting; The sharing module is configured to draw the first writing handwriting to the non-top layer of the display interface when it is confirmed that the writing pen material is not pre-set locally, and to share the first writing handwriting to the second collaborative whiteboard so that the second collaborative whiteboard displays the first writing handwriting.
9. An interactive tablet, characterized in that: include: one or more processors; A memory for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the handwriting display method as described in any one of claims 1-7.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the handwriting display method as described in any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
White board content display method and device, white board equipment and server
CN110597472A
Techniques to manage a whiteboard for multimedia conference events
US20090309956A1
