A remote drawing board implementation method, system, device and storage medium

Abstract

The present application discloses a method, system, device and storage medium for implementing a remote drawing board, the method comprising: a server creates a drawing room, verifies and allows a legitimate client to draw in the room; the server receives the drawing trajectory data captured by each client and sent by each client in real time, calculates the similarity of the drawing trajectory data of the client received at the current moment and the previous moment and compares it with the preset similarity, and selects to generate a first client to continue drawing instruction broadcast to the second client according to the comparison result, so that the second client completes the trajectory synchronization according to the drawing trajectory data received at the previous moment and completed the size conversion, or broadcasts the drawing trajectory data received by the first client at the current moment to the second client, so that the second client completes the trajectory synchronization after the size conversion of the drawing trajectory data received at the current moment. The present application can further improve the accuracy and timeliness of the remote synchronization display of drawing trajectory data.

Description

Technical Field

[0001] The present application relates to the technical field of real-time presentation of drawing trajectories, and in particular to a method, system, device and storage medium for implementing a remote drawing board. Background Art

[0002] Current online conference systems or teaching systems mainly focus on audio and video transmission and screen sharing technologies. Although static documents or pictures can be displayed through screen sharing, it is impossible to achieve the function of multiple people drawing in near real time on a physical whiteboard at the same time, resulting in limited interactivity and expression during online communication.

[0003] The existing technology uses screenshots or video recording to share the drawing process. These methods have many disadvantages, such as: the inability to transmit the drawing trajectory in real time, or the complexity of real-time transmission of the drawing trajectory, or the limitation of the number of users for real-time transmission, lack of real-time performance, poor interactivity, inconvenient operation, and the inability to provide a smooth and natural drawing communication experience. In order to further improve the user's drawing communication experience, the existing technology also provides a synchronous display method for the user's drawing image trajectory, but most of the synchronous display methods still lack the accuracy and timeliness of the remote synchronous display of the drawing trajectory data. Summary of the invention

[0004] In order to further improve the accuracy and timeliness of remote synchronous display of drawing trajectory data, the present application provides a method, system, device and storage medium for implementing a remote drawing board.

[0005] In a first aspect, the present application provides a method for implementing a remote drawing board, including:

[0006] The server receives the request command of creating a drawing room sent by the client and creates the drawing room, receives the request command of joining the drawing room sent by multiple clients, verifies and allows the legal clients to enter the drawing room, and sends the drawing trajectory data in the current drawing board of any client in the drawing room to the client that enters the drawing room for the first time;

[0007] The server receives in real time the drawing trajectory data captured by each client within a preset number threshold, calculates the similarity between the drawing trajectory data received from each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment, and compares them with the preset similarity;

[0008] If the similarity compared for the first client is less than the preset similarity, a first client continuing drawing instruction is directly generated and broadcasted to the second client, so that the second client continues to draw the track on the first client layer set on the second client's own drawing board according to the drawing track data of the first client received at the last moment and completed the size conversion;

[0009] If the similarity compared for the first client is not less than the preset similarity, the drawing trajectory data received from the first client at the current moment is directly broadcast to the second client, so that the second client will perform size conversion on the drawing trajectory data received from the first client at the current moment, and continue to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client at the current moment after the size conversion; the first client is any client in the drawing room; the second client is each client in the drawing room except the first client.

[0010] By adopting the above scheme, the server receives the drawing trajectory data captured and sent by the client in real time and broadcasts it in real time, so that each client receives the broadcasted trajectory data and draws the trajectory locally, realizing real-time synchronization of the trajectory; during the entire real-time broadcast process, the drawing trajectory data obtained at the current moment is compared with the drawing trajectory data obtained at the previous moment, and the historical drawing trajectory that completes the size conversion is conditionally selected according to the comparison result, so as to ensure the accuracy of drawing trajectory synchronization while improving the efficiency of trajectory synchronization display; in order to further optimize the data transmission efficiency and real-time performance, the client adopts a real-time sending and segmented transmission mechanism, and sets a threshold to control the transmission, so that the server receives byte-level data transmission in real time.

[0011] Preferably, it also includes:

[0012] When receiving a drawing room creation request instruction sent by a client, the server determines the application scenario type of the drawing room requested to be created; queries a preset similarity database for the determined application scenario type and the preset similarity corresponding to the determined application scenario type; and compares the queried preset similarity with the calculated similarity.

[0013] By adopting the above scheme, taking into account the differences in abnormal drawing trajectory data in different application scenarios, such as: the painting teaching scenario needs to set a larger similarity to capture more detailed changes, while the office meeting scenario needs to set a smaller similarity to reduce unnecessary data transmission. According to the characteristics of different application scenarios, the preset similarity value of trajectory data comparison is dynamically adjusted to ensure the accuracy of trajectory synchronization.

[0014] Preferably, after the server receives the drawing trajectory data captured by each client itself and sent by each client in real time, and before comparing the similarity between the drawing trajectory data received by each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment, the server further includes: identifying and completing abnormal data on the drawing trajectory data captured by each client itself and received in real time, specifically including:

[0015] The server inputs the drawing trajectory data captured by each client itself and received in real time into the abnormal trajectory recognition model of the corresponding application scenario type, and obtains the judgment of whether the drawing trajectory data captured by each client itself is abnormal or not; among them, the abnormal trajectory recognition model of different application scenario types uses a neural network model, which is trained and generated by the abnormal historical drawing trajectory data marked under the corresponding scenario type; the server refers to the corresponding client historical drawing trajectory data for matching and completion for the drawing trajectory data captured by each client itself that is judged to be abnormal.

[0016] By adopting the above solution, considering that data transmission between the server and the client may cause transmission failure and data loss due to network or other factors, abnormal data identification and completion are performed on the received drawing trajectory data to ensure the accuracy of drawing trajectory data transmission.

[0017] Preferably, it also includes:

[0018] When the server is delayed in receiving the drawing trajectory data captured by each client itself in real time, the server obtains the drawing trajectory data captured by each client itself to be received at the next moment based on the drawing trajectory data captured by each client itself sent by each client in the past, combined with the deep learning network algorithm, and transforms the size of the drawing trajectory data captured by each client itself to be received at the next moment;

[0019] After the similarity between the drawing trajectory data received from each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment is calculated and compared with the preset similarity, and the comparison result is that the similarity compared for the first client is not less than the preset similarity, the similarity between the drawing trajectory data received from each client at the current moment and the drawing trajectory data captured by each client itself received at the predicted next moment is calculated and compared with the preset similarity;

[0020] If the similarity compared for the first client is less than the preset similarity, the drawing trajectory data captured by the first client itself and received at the next predicted moment of completing the size conversion is directly broadcast to the second client, so that the second client directly draws the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data captured by the first client itself and received at the next predicted moment of completing the size conversion;

[0021] If the similarity compared for the first client is not less than the preset similarity, the drawing trajectory data received from the first client at the current moment will be directly broadcast to the second client, so that the second client will convert the size of the drawing trajectory data received from the first client at the current moment, and continue to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client at the current moment after the size conversion.

[0022] By adopting the above scheme and utilizing the prediction algorithm, the user's drawing trajectory is predicted during the drawing trajectory data transmission delay and the size conversion of the drawing trajectory data is performed in advance. The predicted drawing trajectory data is compared with the actually received drawing trajectory data for similarity, and the predicted drawing trajectory data that has completed the size conversion is conditionally selected for broadcasting based on the similarity result, thereby ensuring the accuracy of trajectory synchronization and improving the efficiency of trajectory synchronization display.

[0023] Preferably, it also includes:

[0024] The server receives a trajectory synchronization mode selection instruction and designated client information sent by an authorized client; the server determines whether the specifically selected trajectory synchronization mode is a full-client trajectory synchronization mode or a partial-client trajectory synchronization mode according to the trajectory synchronization mode selection instruction received from the authorized client, and if it is a partial-client trajectory synchronization mode, the second client is adjusted accordingly, and the original second client is adjusted to the designated client.

[0025] By adopting the above solution, considering the diverse functional requirements of users for remote drawing boards, partial client synchronization can be carried out according to the mode selected by the client with permission settings to achieve the effect of designated teaching or designated discussion in a meeting.

[0026] Preferably, it also includes:

[0027] The server receives the designated client information and the designated client drawing trajectory synchronization area sent by the authorized client; when the server receives the drawing trajectory data captured by each client itself and is within a preset quantity threshold in real time, the server removes the data that does not belong to the designated client drawing trajectory synchronization area from the drawing trajectory data captured by the designated client itself.

[0028] By adopting the above solution, taking into account the diverse functional requirements of users for the remote drawing board, the drawing trajectory synchronization area is set according to some clients selected by the clients with permission settings, so as to achieve the effect of collaborative teaching or conference discussion while avoiding mutual interference.

[0029] Preferably, the method further comprises: the server preprocesses the drawing trajectory data received in real time and sent by each client, and the preprocessing comprises: drawing trajectory data filtering and drawing trajectory data compression.

[0030] By adopting the above solution, considering that the data transmission between the server and the client may fail due to network or other factors and be repeated, the received drawing trajectory data is filtered for duplicate data and some complex data such as quantity units are screened and compressed to ensure the accuracy of trajectory data transmission.

[0031] In a second aspect, the present application provides a remote drawing board implementation system, including:

[0032] The drawing trajectory initial acquisition module is used to receive the drawing room creation request instruction sent by the client and create the drawing room, receive the drawing room joining request instructions sent by multiple clients and verify and allow the legitimate client to enter the drawing room, and send the drawing trajectory data in the current drawing board of any client in the drawing room to the client entering the drawing room for the first time;

[0033] A drawing trajectory similarity comparison module is used to receive drawing trajectory data captured by each client in real time and within a preset quantity threshold, calculate the similarity between the drawing trajectory data received from each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment, and compare them with the preset similarity;

[0034] A drawing trajectory synchronization module is used to directly generate a first client continue drawing instruction and broadcast it to the second client if the similarity compared with the first client is less than a preset similarity, so that the second client continues to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client received at the previous moment and completed the size conversion; if the similarity compared with the first client is not less than the preset similarity, the drawing trajectory data received from the first client at the current moment is directly broadcast to the second client, so that the second client will perform size conversion on the drawing trajectory data of the first client at the current moment received, and continue to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client at the current moment after the size conversion is completed; the first client is any client in the drawing room; the second client is each client in the drawing room except the first client.

[0035] By adopting the above solution, a real-time trajectory capture and transmission mechanism is adopted, combined with data processing and broadcasting on the server side, and trajectory rendering technology on the client side, real-time synchronous presentation of drawing trajectories of multiple users at the same time is achieved, ensuring accuracy and improving efficiency.

[0036] In a third aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the method as described above.

[0037] In a fourth aspect, the present application provides a computer device, comprising a memory, a processor, and a program stored and executable on the memory, wherein the program implements the steps of the above method when executed by the processor.

[0038] In summary, this application has the following beneficial effects:

[0039] 1. The client adopts real-time delivery, segmented transmission, and setting thresholds to control transmission, so that the server receives byte-level data transmission in real time, optimizing data transmission efficiency and real-time performance; the server receives the drawing trajectory data captured and sent by the client in real time and broadcasts it in real time, so that each client receives the broadcasted trajectory data and combines distributed data synchronization processing technology with trajectory rendering technology to complete local trajectory drawing, realize real-time synchronization of drawing trajectories on the client drawing board, and improve user interactive experience; during the entire real-time broadcast process, the trajectory data obtained at the current moment is compared with the trajectory data obtained at the previous moment, and conditional selection is made according to the comparison result to complete the historical trajectory drawing of size conversion, so as to ensure the accuracy of trajectory synchronization while improving the efficiency of trajectory synchronization display;

[0040] 2. According to the characteristics of different application scenarios, dynamically adjust the similarity value of trajectory data comparison to ensure the accuracy of trajectory synchronization;

[0041] 3. When there is a transmission delay in the drawing trajectory data, the prediction algorithm is used to predict the user's drawing trajectory and the size conversion of the drawing trajectory data is performed first. The predicted drawing trajectory data is compared with the actually received drawing trajectory data for similarity. According to the similarity result, the predicted drawing trajectory data that has completed the size conversion is conditionally selected for broadcasting, so as to ensure the accuracy of drawing trajectory synchronization while improving the efficiency of drawing trajectory synchronization display. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 is a flow chart of a method for implementing a remote drawing board in a specific embodiment;

[0043] Figure 2 It is a structural diagram of the implementation system of the remote drawing board described in the specific embodiment. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0045] like Figure 1 As shown, the embodiment of the present application discloses a method for implementing a remote drawing board, and the specific steps are as follows:

[0046] S1. The server creates a drawing room and sends drawing trajectory data to the client that enters the drawing room for the first time.

[0047] Specifically, the user logs in to the client and uses the client to send a request to create a drawing room to the server;

[0048] The server creates a drawing room upon receiving the drawing room creation request instruction sent by the client, and sends the number and verification code of the created drawing room to the client requesting to create the drawing room; wherein the number and verification code of the drawing room are uniquely matched settings;

[0049] The user selects a drawing room to enter according to the needs, and uses the client to send a drawing room joining request instruction including the drawing room number and verification code to the server;

[0050] The server receives a plurality of drawing room joining request instructions sent by clients, verifies and allows a legitimate client to draw a room, wherein the legitimate client is a client whose drawing room number in the drawing room joining request instruction matches the verification code;

[0051] The drawing track data in the current drawing board of any client in the drawing room is sent to the client entering the drawing room for the first time; wherein, the drawing track data in the current drawing board may be blank, that is, no drawing track begins to appear in the drawing board of any client in the current drawing room.

[0052] S2. Each client in the drawing room captures the drawing trajectory data in its own drawing board and sends it to the server.

[0053] Specifically, when the user performs a drawing operation on the client, each drawing operation is transmitted based on the event drive of the operation type. The client obtains drawing trajectory data by capturing various operation type (such as drawing, erasing and layer operation, etc.) events; the drawing trajectory data includes: drawing position data, drawing rate data, drawing attribute data (such as brush type, color, line width) and drawing pressure data, etc.

[0054] In order to ensure the efficiency and real-time performance of data transmission sent to the server, each client adopts real-time delivery and segmented transmission mechanism, limits the data quantity threshold for each segment transmission, and uses Protobuf protocol for Byte-level data transmission; among which, the data quantity threshold for each segment transmission is a preset quantity threshold.

[0055] Taking into account the situation where the first transmission fails to obtain a server response due to various reasons (such as: connection in the middle, insufficient storage space, etc.), the system will automatically try to retransmit until a server response is received to stop transmission or the preset number of transmissions for each segment of data (such as: four times) is reached, thereby improving the accuracy of data transmission.

[0056] S3. The server receives the drawing trajectory data captured by each client and sent by each client in real time, and processes and broadcasts the data.

[0057] Specifically, the server receives in real time the drawing trajectory data captured by each client and within a preset quantity threshold, performs preprocessing, and stores the preprocessed drawing trajectory data of each client in a corresponding manner; wherein the preprocessing includes: drawing trajectory data filtering, drawing trajectory data compression, etc., such as: filtering duplicate data and erroneous data in the drawing trajectory data, deleting data units in the drawing trajectory data, thereby completing drawing trajectory data compression, and improving the efficiency of synchronous display of drawing trajectory data.

[0058] The server performs data processing on the drawing trajectory data captured by each client after preprocessing. The specific processing process includes: calculating the similarity between the drawing trajectory data received from each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment, such as: calculating the similarity between the drawing trajectory data of client 1 at the current moment and the drawing trajectory data of client 1 at the previous moment; comparing the calculated similarity of the client with the preset similarity.

[0059] Obtain the comparison result of the calculated similarity and the preset similarity, and select the corresponding broadcast client for broadcasting according to the comparison result; the specific comparison process is as follows:

[0060] If there is a similarity compared with the first client that is less than the preset similarity, it indicates that the drawing operation of the current user is almost the same as the drawing operation of the previous period, such as: drawing lines in the horizontal direction at a uniform speed, directly generating a first client to continue drawing instruction and broadcasting it to the second client; wherein, the first client is any client of the clients in the drawing room, and the second client is each client in the drawing room except the first client; when the second client receives the first client to continue drawing instruction, it will query the drawing trajectory data of the first client that completed the size conversion at the last moment and stored in its own database; wherein, due to the different screen sizes of different clients, in order to ensure the consistency of the presentation effect, each client will perform size conversion on the drawing trajectory data received from other clients according to the screen size ratio of each client; the second client continues to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client that completed the size conversion received at the last moment; wherein, the drawing boards of each client are hierarchically controlled to control the drawing trajectory data of each client to complete the trajectory rendering and drawing on the corresponding layer, so as to achieve drawing trajectory synchronization and meet user interaction needs.

[0061] If the similarity compared with the first client is not less than the preset similarity, it indicates that the current user's drawing operation has changed compared to the drawing operation in the previous period, and the drawing trajectory data received from the first client at the current moment is directly broadcast to the second client; when the second client receives the drawing trajectory data of the first client at the current moment, it converts the size of the drawing trajectory data received from the first client at the current moment, and continues to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client at the current moment after the size conversion, thereby realizing drawing trajectory synchronization and meeting user interaction needs.

[0062] In a specific embodiment, considering that data transmission between the server and the client may be erroneous or lost due to network or other factors, the accuracy of trajectory data transmission is ensured by identifying and completing abnormal data; the method includes:

[0063] After the server receives the drawing trajectory data captured by each client and sent by each client in real time, and before comparing the similarity between the drawing trajectory data received by each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment, the server also includes: identifying and completing abnormal data on the drawing trajectory data captured by each client in real time, specifically including:

[0064] The server inputs the drawing trajectory data captured by each client itself and received in real time into the abnormal trajectory recognition model of the corresponding application scenario type, and obtains whether the drawing trajectory data captured by each client itself is abnormal and the specific abnormal drawing trajectory data.

[0065] Among them, the abnormal trajectory recognition models of different application scenario types all adopt neural network models, which are trained and generated by the abnormal historical drawing trajectory data marked under the corresponding application scenario type; among them, the historical drawing trajectory data collected under the specific application scenario containing abnormal data (such as: position data interruption without change in speed and direction, etc.) is obtained and marked to generate training data; the input of different abnormal trajectory recognition models is the drawing trajectory data, and the output is whether the drawing trajectory data is abnormal and the abnormal drawing trajectory data.

[0066] The server matches and completes the abnormal drawing trajectory data captured by each client that is judged to have obtained an abnormality, and refers to the corresponding client's historical drawing trajectory data. The specific matching and completion include:

[0067] It queries the historical trajectory data in the period of time adjacent to the current one to see whether the similarity with the current trajectory data is greater than the preset similarity of the corresponding application scenario. If so, the data is matched and completed according to the historical trajectory data. If not, the data is completed by interpolation method according to the trajectory data of the previous and next moments.

[0068] In a specific embodiment, when data transmission is delayed, in order to ensure the timeliness of synchronous display of trajectory data as much as possible, the method further includes:

[0069] When there is a delay in the real-time reception of the drawing trajectory data captured by each client itself, that is, the server fails to receive the drawing trajectory data captured by each client itself sent by the client within the interval sampling time; according to the drawing trajectory data captured by each client itself sent by each client historically received, combined with the deep learning network algorithm, the drawing trajectory data captured by each client itself received at the next moment is predicted, and the size of the drawing trajectory data captured by each client itself received at the next moment is transformed; wherein, a neural network model for drawing trajectory data prediction is constructed, and the model is trained and generated through the drawing trajectory data captured by each client itself sent by each client historically received.

[0070] After the similarity between the drawing trajectory data received from each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment is calculated and compared with the preset similarity, and the comparison result is that the similarity compared for the first client is not less than the preset similarity, the similarity between the drawing trajectory data received from each client at the current moment and the drawing trajectory data captured by each client itself received at the predicted next moment is calculated and compared with the preset similarity, and the client is selected for broadcasting according to the comparison result. The specific process includes:

[0071] If the similarity compared for the first client is less than the preset similarity, the drawing trajectory data captured by the first client itself and received at the next predicted moment when the size conversion is completed will be directly broadcast to the second client; the second client draws the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data captured by the first client itself and received at the next predicted moment when the size conversion is completed, thereby realizing drawing trajectory synchronization, meeting user interaction needs, and improving the efficiency of synchronous display of drawing trajectories.

[0072] If the similarity compared with the first client is not less than the preset similarity, the drawing trajectory data received from the first client at the current moment will be directly broadcast to the second client, so that the second client will convert the size of the drawing trajectory data received from the first client at the current moment, and continue to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client at the current moment after the size conversion, thereby realizing drawing trajectory synchronization and meeting user interaction needs.

[0073] In a specific embodiment, considering that different application scenarios have different requirements for synchronization accuracy of user-drawn trajectories, the preset similarity can be dynamically adjusted according to the application scenario type. The method further includes:

[0074] When receiving the drawing room creation request instruction sent by the client, the server determines the application scenario type of the drawing room requested to be created; the application scenario types include teaching application scenarios, conference application scenarios, remote guidance application scenarios, etc.; wherein the user selects a specific type of application scenario according to needs and generates a drawing room creation request instruction accordingly.

[0075] The server queries the preset similarity corresponding to the determined application scenario type from the preset similarity database according to the determined application scenario type; the preset similarity database stores the preset similarities corresponding to different application scenario types, such as: the preset similarity corresponding to the teaching application scenario is the first preset similarity, the preset similarity corresponding to the conference application scenario is the second preset similarity, and the preset similarity of the remote guidance application scenario is the third preset similarity.

[0076] The preset similarity found is compared with the calculated similarity.

[0077] In a specific embodiment, in order to meet the diverse needs of users for synchronous display of drawing trajectories, the method further includes:

[0078] The server receives the trajectory synchronization mode selection instruction and the designated client information sent by the authorized client; wherein the authorized client is specifically: a client authorized by the server by sending the drawing room management authority request instruction to the server.

[0079] The server determines the specific selected trajectory synchronization mode as the full-client trajectory synchronization mode or the partial-client trajectory synchronization mode according to the trajectory synchronization mode selection instruction received from the authorized client. If it is the partial-client trajectory synchronization mode, the second client is adjusted accordingly, and the original second client is adjusted to the designated client according to the designated client information, thereby realizing the broadcasting of the drawing trajectory data to some clients, thereby meeting the user's need to interact with only some students or employees in certain teaching and office scenarios.

[0080] In addition, in order to meet the needs of some users to collaborate without disturbing each other, the method further includes:

[0081] The server receives the designated client information and the designated client drawing trajectory synchronization area sent by the authorized client; wherein the designated client drawing trajectory synchronization area is the drawing board area of ​​the corresponding client (such as: the nth area of ​​the drawing board area of ​​client 1 divided evenly from left to right) or the designated area in the background image uploaded by the designated client and broadcast by the server to all clients.

[0082] When receiving the drawing trajectory data captured by each client itself and sent by each client in real time, the server removes the data that does not belong to the drawing trajectory synchronization area of ​​the specified client from the drawing trajectory data captured by the specified client itself.

[0083] like Figure 2 As shown, the embodiment of the present application provides a remote drawing board implementation system, which specifically includes:

[0084] The drawing trajectory initial acquisition module 101 is used to receive a drawing room creation request instruction sent by a client and create a drawing room, receive a drawing room entry request instruction sent by multiple clients and verify and allow legitimate clients to enter the drawing room, and send the drawing trajectory data in the current drawing board of any client in the drawing room to the client that enters the drawing room for the first time;

[0085] The drawing trajectory similarity comparison module 102 is used to receive the drawing trajectory data captured by each client and within a preset quantity threshold in real time, calculate the similarity between the drawing trajectory data received from each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment, and compare them with the preset similarity;

[0086] The drawing trajectory synchronization module 103 is used to directly generate a first client continuing drawing instruction and broadcast it to the second client if the similarity compared with the first client is less than the preset similarity, so that the second client continues to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client received at the previous moment and completed the size conversion; if the similarity compared with the first client is not less than the preset similarity, the drawing trajectory data received from the first client at the current moment is directly broadcast to the second client, so that the second client will perform size conversion on the drawing trajectory data of the first client at the current moment received, and continue to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client at the current moment after the size conversion is completed; the first client is any client in the drawing room; the second client is each client in the drawing room except the first client.

[0087] In a specific embodiment, the drawing trajectory similarity comparison module 102 is further used to determine the application scenario type of the drawing room requested to be created when receiving a drawing room creation request instruction sent by the client; query the preset similarity corresponding to the determined application scenario type from the preset similarity database according to the determined application scenario type; and complete the comparison with the calculated similarity according to the queried preset similarity.

[0088] In a specific embodiment, the drawing trajectory similarity comparison module 102 is further used to, after receiving the drawing trajectory data captured by each client itself and within a preset quantity threshold sent by each client in real time, and before comparing the similarity of the drawing trajectory data received from each client at the current moment with the drawing trajectory data corresponding to the same client received at the previous moment, identify and complete abnormal data on the drawing trajectory data captured by each client itself received in real time, specifically including: inputting the drawing trajectory data captured by each client itself received in real time into the abnormal trajectory recognition model of the corresponding application scenario type, respectively, to obtain a judgment on whether the drawing trajectory data captured by each client itself is abnormal; wherein the abnormal trajectory recognition model of different application scenario types uses a neural network model, which is respectively trained and generated by the abnormal historical drawing trajectory data marked under the corresponding scenario type; for the drawing trajectory data captured by each client itself that is judged to be abnormal, matching and completing are respectively performed with reference to the corresponding client historical drawing trajectory data.

[0089] In a specific embodiment, the drawing trajectory similarity comparison module 102 is further used to, when a delay occurs in the real-time reception of the drawing trajectory data captured by each client itself, obtain the drawing trajectory data captured by each client itself received at the next moment based on the drawing trajectory data captured by each client itself sent by each client historically received, in combination with the deep learning network algorithm prediction, and transform the size of the drawing trajectory data captured by each client itself received at the next moment predicted; after completing the calculation of the similarity between the drawing trajectory data received by each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment and comparing them with the preset similarity, and the comparison result is that there is a similarity for the first client that is not less than the preset similarity, continue to calculate the similarity between the drawing trajectory data received by each client at the current moment and the drawing trajectory data captured by each client itself received at the next moment predicted, and compare them with the preset similarity;

[0090] The drawing trajectory synchronization module 103 is also used for directly broadcasting the drawing trajectory data captured by the first client itself and received at the next predicted moment after the size conversion is completed to the second client if the similarity compared with the first client is less than the preset similarity, so that the second client directly draws the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data captured by the first client itself and received at the next predicted moment after the size conversion is completed; if the similarity compared with the first client is not less than the preset similarity, directly broadcasting the drawing trajectory data received from the first client at the current moment to the second client, so that the second client performs size conversion on the drawing trajectory data received from the first client at the current moment, and continues to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client at the current moment after the size conversion is completed.

[0091] In a specific embodiment, the drawing trajectory synchronization module 103 is further used to receive a trajectory synchronization mode selection instruction and designated client information sent by an authorized client; according to the received trajectory synchronization mode selection instruction sent by the authorized client, determine whether the specifically selected trajectory synchronization mode is a full-client trajectory synchronization mode or a partial-client trajectory synchronization mode; if it is a partial-client trajectory synchronization mode, the second client is adjusted accordingly, and the original second client is adjusted to the designated client.

[0092] In a specific embodiment, the drawing trajectory similarity comparison module 102 is further used to receive designated client information and designated client drawing trajectory synchronization area sent by authorized clients; when receiving drawing trajectory data captured by each client itself and within a preset quantity threshold in real time, the drawing trajectory data captured by the designated client itself that does not belong to the designated client drawing trajectory synchronization area is eliminated.

[0093] The embodiment of the present application also discloses a computer-readable storage medium.

[0094] Specifically, the computer-readable storage medium stores a computer program that can be loaded by a processor and executes a method for implementing the remote drawing board as described above. The computer-readable storage medium includes, for example, various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0095] The embodiment of the present application also discloses a computer device.

[0096] Specifically, the computer device includes a memory and a processor, and the memory stores a computer program that can be loaded by the processor and execute the above-mentioned remote drawing board implementation method.

[0097] The above are all preferred embodiments of the present application, and are not intended to limit the protection scope of the present application. Any feature disclosed in this specification (including the abstract and drawings), unless otherwise stated, can be replaced by other equivalent or alternative features with similar purposes. That is, unless otherwise stated, each feature is only an example of a series of equivalent or similar features.

Claims

1. A method for implementing a remote drawing board, characterized in that: include: The server receives a request command from a client to create a drawing room and creates a drawing room, receives a request command from multiple clients to join a drawing room, verifies and allows legitimate clients to enter the drawing room, and sends the drawing trajectory data in the current drawing board of any client in the drawing room to the client that enters the drawing room for the first time; The server receives in real time the drawing trajectory data captured by each client within a preset quantity threshold, calculates the similarity between the drawing trajectory data received from each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment, and compares them with the preset similarity; If the similarity compared with the first client is less than the preset similarity, a first client continuing drawing instruction is directly generated and broadcasted to the second client, so that the second client continues to draw the track on the first client layer set on the second client's own drawing board according to the drawing track data of the first client received at the last moment and completed the size conversion; If the similarity compared with the first client is not less than the preset similarity, the drawing trajectory data received from the first client at the current moment is directly broadcast to the second client, so that the second client performs size conversion on the drawing trajectory data received from the first client at the current moment, and continues to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client at the current moment after the size conversion is completed; The first client is any client of the clients in the drawing room; The second client is each client in the drawing room except the first client; and further includes: When receiving a drawing room creation request instruction sent by a client, the server determines the application scenario type of the drawing room requested to be created; according to the determined application scenario type, queries a preset similarity database corresponding to the determined application scenario type; and compares the similarity calculated with the queried preset similarity; after the server receives the drawing trajectory data captured by each client itself and sent by each client in real time, before comparing the similarity of the drawing trajectory data received by each client at the current moment with the drawing trajectory data corresponding to the same client received at the previous moment, the server also includes: identifying and completing abnormal data on the drawing trajectory data captured by each client itself and received in real time, specifically including: The server inputs the drawing trajectory data captured by each client itself and received in real time into the abnormal trajectory recognition model of the corresponding application scenario type, and obtains the judgment of whether the drawing trajectory data captured by each client itself is abnormal or not; among them, the abnormal trajectory recognition model of different application scenario types uses a neural network model, which is trained and generated by the abnormal historical drawing trajectory data marked under the corresponding scenario type; the server refers to the corresponding client historical drawing trajectory data for matching and completion for the drawing trajectory data captured by each client itself that is judged to be abnormal.

2. The method for implementing a remote drawing board according to claim 1, characterized in that: Also includes: When there is a delay in receiving the drawing trajectory data captured by each client itself in real time, the drawing trajectory data captured by each client itself received at the next moment is obtained by combining the deep learning network algorithm to predict the drawing trajectory data captured by each client itself received at the next moment, and the size of the drawing trajectory data captured by each client itself received at the next moment is transformed; After the drawing trajectory data received from each client at the current moment is calculated and the drawing trajectory data corresponding to the same client received at the previous moment are compared with the preset similarity, and the comparison result shows that the similarity compared for the first client is not less than the preset similarity, the drawing trajectory data received from each client at the current moment and the drawing trajectory data captured by each client itself received at the next predicted moment are continued to be calculated and compared with the preset similarity; If the similarity compared for the first client is less than the preset similarity, the drawing trajectory data captured by the first client itself and received at the next predicted moment of completing the size conversion is directly broadcast to the second client, so that the second client directly draws the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data captured by the first client itself and received at the next predicted moment of completing the size conversion; If the similarity compared for the first client is not less than the preset similarity, the drawing trajectory data received from the first client at the current moment will be directly broadcast to the second client, so that the second client will convert the size of the drawing trajectory data received from the first client at the current moment, and continue to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client at the current moment after the size conversion.

3. The method for implementing a remote drawing board according to claim 1, characterized in that: Also includes: The server receives the trajectory synchronization mode selection instruction and the specified client information sent by the authorized client; The server determines the specific selected trajectory synchronization mode as the full-client trajectory synchronization mode or the partial-client trajectory synchronization mode according to the trajectory synchronization mode selection instruction received from the authorized client. If it is the partial-client trajectory synchronization mode, the second client is adjusted accordingly, and the original second client is adjusted to the designated client.

4. The method for implementing a remote drawing board according to claim 1, characterized in that: Also includes: The server receives the designated client information sent by the authorized client and draws the trajectory synchronization area with the designated client; When receiving the drawing trajectory data captured by each client and within a preset quantity threshold in real time, the server removes the data that does not belong to the drawing trajectory synchronization area of ​​the specified client from the drawing trajectory data captured by the specified client.

5. The method for implementing a remote drawing board according to claim 1, characterized in that: Also includes: The server performs preprocessing on the drawing trajectory data sent by each client in real time, wherein the preprocessing includes: drawing trajectory data filtering and drawing trajectory data compression.

6. A remote drawing board implementation system, characterized in that: include: The drawing trajectory initial acquisition module is used to receive a drawing room creation request instruction sent by a client and create a drawing room, receive a drawing room entry request instruction sent by multiple clients and verify and allow legitimate clients to enter the drawing room, and send the drawing trajectory data in the current drawing board of any client in the drawing room to the client that enters the drawing room for the first time; The drawing trajectory similarity comparison module is used to receive the drawing trajectory data captured by each client itself and within a preset quantity threshold in real time, calculate the similarity between the drawing trajectory data received by each client at the current moment and the drawing trajectory data corresponding to the same client received at the previous moment, and compare them with the preset similarity; it is also used to determine the application scenario type of the drawing room requested to be created when receiving the drawing room creation request instruction sent by the client; query the preset similarity corresponding to the determined application scenario type from the preset similarity database according to the determined application scenario type; complete the comparison with the calculated similarity according to the queried preset similarity; it is also used to complete the comparison with the calculated similarity after comparing the current drawing trajectory data captured by each client itself and within the preset quantity threshold in real time. Before determining the similarity between the drawing trajectory data received at each client at a moment and the drawing trajectory data corresponding to the same client received at the previous moment, the drawing trajectory data captured by each client itself received in real time is identified and supplemented with abnormal data, specifically including: inputting the drawing trajectory data captured by each client itself received in real time into the abnormal trajectory identification model of the corresponding application scenario type, and obtaining a judgment on whether the drawing trajectory data captured by each client itself is abnormal; wherein the abnormal trajectory identification model of different application scenario types uses a neural network model, which is respectively generated by training the historical drawing trajectory data marked with abnormalities under the corresponding scenario type; for the drawing trajectory data captured by each client itself that is judged to be abnormal, matching and supplementing are performed with reference to the historical drawing trajectory data of the corresponding client; A drawing trajectory synchronization module is used to directly generate a first client continue drawing instruction and broadcast it to the second client if the similarity compared with the first client is less than a preset similarity, so that the second client continues to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client received at the previous moment and completed the size conversion; if the similarity compared with the first client is not less than the preset similarity, the drawing trajectory data received from the first client at the current moment is directly broadcast to the second client, so that the second client will perform size conversion on the drawing trajectory data of the first client at the current moment received, and continue to draw the trajectory on the first client layer set on the second client's own drawing board according to the drawing trajectory data of the first client at the current moment after the size conversion is completed; the first client is any client in the drawing room; the second client is each client in the drawing room except the first client.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored computer program, wherein when the computer program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 5.

8. A computer device, characterized in that: The computer device comprises a memory, a processor and a program stored and executable on the memory, and the program implements the steps of the method according to any one of claims 1 to 5 when executed by the processor.

Images