Cloud drawing collaborative annotation method for multi-terminal mobile equipment

Abstract

The invention discloses a multi-terminal mobile device-oriented cloud drawing collaborative annotation method, and relates to the technical field related to data processing, and the method comprises the following steps: connecting a cloud server, and determining a plurality of terminal mobile devices which initiate annotation requests to a first CAD drawing; performing data synchronization fluency inspection on the cloud server and the plurality of terminal mobile devices; performing drawing annotation behavior detection on the corresponding terminal mobile equipment by adopting a full-speed synchronization mechanism; and performing drawing annotation behavior detection and incremental data packet compression on the corresponding terminal mobile equipment by adopting a batch synchronization mechanism. The technical problem of low drawing collaboration efficiency and accuracy caused by inconsistency and instability of real-time data synchronization when a plurality of users operate drawings on different devices in the face of different network environments in existing cloud drawing collaboration annotation is solved, real-time sharing and collaborative editing of drawing information are realized, and the drawing collaboration efficiency and accuracy are improved. The technical effect of improving the accuracy and efficiency of collaborative annotation of the drawings is achieved.

Description

Technical Field

[0001] The present application relates to the technical field related to data processing, and in particular to a cloud-based collaborative drawing annotation method for multiple mobile devices. Background Art

[0002] With the rapid development of information technology, especially the breakthrough in mobile computing and cloud computing, the application of drawing collaboration and annotation in engineering design, architectural planning, mechanical manufacturing and other fields is becoming more and more widespread. The traditional drawing collaboration method is limited by the inconvenience of geography, equipment and information synchronization, and it is difficult to meet the modern efficient and real-time collaboration needs. In complex projects such as engineering design, drawings usually contain a lot of detailed information and precise dimensions. Collaborative annotation of these drawings is a key link to ensure the smooth progress of the project. When the traditional drawing collaboration method is actually applied, team members may use devices with different performance and be in different network environments. That is, it is difficult to synchronize and share drawing information between different team members in real time, resulting in delays or data loss in the synchronization data of drawing collaboration annotation, which affects the smooth progress of drawing collaboration and makes it difficult to ensure the security of data during transmission and storage.

[0003] At present, in the cloud-based collaborative drawing annotation related technologies, there are technical problems such as inconsistency and instability in real-time data synchronization when multiple users operate drawings on different devices in different network environments, which leads to low efficiency and accuracy of drawing collaboration. Summary of the invention

[0004] This application provides a cloud-based drawing collaborative annotation method for multiple mobile devices, thereby solving the technical problems existing in the existing cloud-based drawing collaborative annotation, such as inconsistency and instability in real-time data synchronization when multiple users operate drawings on different devices in different network environments, which in turn leads to low efficiency and accuracy of drawing collaboration. This application realizes real-time sharing and collaborative editing of drawing information, achieving the technical effect of improving the accuracy and efficiency of drawing collaborative annotation.

[0005] The present application provides a cloud-based collaborative drawing annotation method for multiple mobile devices, including: connecting to a cloud server, determining multiple terminal mobile devices that initiate annotation requests to a first CAD drawing, wherein the multiple terminal mobile devices correspond to multiple collaborative users; performing data synchronization fluency inspection on the cloud server and the multiple terminal mobile devices, generating a first collaborative user set whose synchronization fluency index is greater than or equal to a preset fluency and a second collaborative user set whose synchronization fluency index is less than the preset fluency; for users in the first collaborative user set, using a full-speed synchronization mechanism to perform drawing annotation behavior detection on the corresponding terminal mobile devices, generating multiple drawing annotation increments and sending them to the cloud server for drawing update; for users in the second collaborative user set, using a batch synchronization mechanism to perform drawing annotation behavior detection and incremental data packet compression on the corresponding terminal mobile devices, generating multiple incremental compression packages and sending them to the cloud server for drawing update.

[0006] In a possible implementation, the full-speed synchronization mechanism is used to detect drawing annotation behavior on the corresponding terminal mobile device, generate multiple drawing annotation increments and send them to the cloud server for drawing update, and also perform the following processing: extract the first user and the corresponding first terminal mobile device from the first collaborative user set; when the first terminal mobile device detects that the first user annotates the first CAD drawing, the full-speed synchronization mechanism is used to generate the first drawing annotation increment in real time and send it to the cloud server; the cloud server synchronizes and updates the drawings of multiple terminal mobile devices according to the first drawing annotation increment.

[0007] In a possible implementation, when the first terminal mobile device detects that the first user is annotating the first CAD drawing, a full-speed synchronization mechanism is used to generate a first drawing annotation increment in real time, and the following processing is also performed: the drawing status displayed by the first terminal mobile device is detected by an incremental detection module to generate a first reference state; the operation of the first collaborative user is monitored in real time by the incremental detection module to generate first operation monitoring data; the first operation monitoring data is compared with the first reference state to identify the difference data of the operation and generate the first drawing annotation increment.

[0008] In a possible implementation, for users in the second collaborative user set, a batch synchronization mechanism is used to perform drawing annotation behavior detection and incremental data packet compression on the corresponding terminal mobile device, generate multiple incremental compression packages and send them to the cloud server for drawing update, and also perform the following processing: extract the second user and the corresponding second terminal mobile device from the second collaborative user set; when the second terminal mobile device detects that the second user annotates the first CAD drawing, a batch synchronization mechanism is used to generate a second drawing annotation increment and send it to the cloud server, wherein the batch synchronization mechanism includes batch operation pause time constraints and batch data volume constraints; the cloud server performs synchronous drawing updates on multiple terminal mobile devices according to the second drawing annotation increment.

[0009] In a possible implementation, a batch synchronization mechanism is used to generate a second drawing annotation increment and send it to the cloud server, and the following processing is also performed: the operation pause time and the annotation incremental data volume of the second user's annotation operation on the first CAD drawing are detected by the second terminal mobile device; when the operation pause time meets the batch operation pause time constraint or the annotation incremental data volume meets the batch data volume constraint, the annotation incremental data is compared and obtained, and a predetermined compression algorithm is used to compress the data to generate the second drawing annotation increment.

[0010] In a possible implementation, after each drawing is updated, the following processing is also performed: the drawing version before the update is automatically recorded by the cloud server and stored in a historical database corresponding to the first CAD drawing.

[0011] In a possible implementation, the cloud-based drawing collaborative annotation method for multiple mobile devices also performs the following processing: after each drawing update, obtain the latest drawing version; obtain multiple annotations located in the same drawing area in the latest drawing version; perform similarity clustering on the multiple annotations to generate multiple cluster annotation sets; and perform folded display based on the multiple cluster annotation sets.

[0012] In a possible implementation, the cloud server and the multiple terminal mobile devices are tested for data synchronization fluency, and the following processing is also performed: a synchronization test instruction is sent to the multiple terminal mobile devices by the cloud server, and the data packets generated by the multiple terminal mobile devices are obtained according to the synchronization test instruction, and then sent to the cloud server and synchronized to multiple terminal devices. The test results, wherein any synchronization test result includes data transmission delay, data transmission rate and synchronization consistency index; the data transmission delay, data transmission rate and synchronization consistency index are normalized and positively weighted, and the data synchronization fluency corresponding to the multiple terminal mobile devices is generated.

[0013] The cloud-based collaborative drawing annotation method for multiple mobile devices proposed in this application is intended to connect to the cloud server, determine multiple terminal mobile devices that initiate annotation requests to the first CAD drawing; perform data synchronization fluency tests between the cloud server and multiple terminal mobile devices; use a full-speed synchronization mechanism to detect drawing annotation behavior on the corresponding terminal mobile devices; use a batch synchronization mechanism to detect drawing annotation behavior and compress incremental data packets on the corresponding terminal mobile devices. This solves the technical problem of inconsistency and instability in real-time data synchronization when multiple users operate drawings on different devices in different network environments, which leads to low efficiency and accuracy of drawing collaboration. It realizes real-time sharing and collaborative editing of drawing information, and achieves the technical effect of improving the accuracy and efficiency of collaborative drawing annotation. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solution of the embodiment of the present invention, the accompanying drawings of the embodiment of the present invention will be briefly introduced below. A flow chart is used in the present application to illustrate the operations performed by the system according to the embodiment of the present application. It should be understood that the preceding or following operations are not necessarily performed accurately in order. On the contrary, various steps can be processed in reverse order or simultaneously as needed. At the same time, other operations can also be added to these processes, or one or more operations can be removed from these processes.

[0015] Figure 1 A flowchart of a cloud-based collaborative annotation method for multiple mobile devices provided in an embodiment of the present application; Figure 2 A schematic diagram of a process for generating a first drawing annotation increment in a cloud-based drawing collaborative annotation method for multiple mobile devices provided in an embodiment of the present application. DETAILED DESCRIPTION

[0016] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below.

[0017] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of this application.

[0018] In the following description, reference is made to "some embodiments", which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict, and the terms "first\second" involved are merely to distinguish similar objects and do not represent a specific ordering of objects. The terms "including" and "having" and any variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or modules that are not clearly listed or inherent to these processes, methods, products, or devices. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by technicians in the technical field of this application. The terms used herein are for the purpose of describing the embodiments of the present application only.

[0019] The present application embodiment provides a cloud-based collaborative annotation method for multiple mobile devices, such as Figure 1 As shown, the method includes: Step S100, connecting to a cloud server, and determining a plurality of terminal mobile devices that initiate annotation requests to a first CAD drawing, wherein the plurality of terminal mobile devices correspond to a plurality of collaborative users.

[0020] Preferably, before conducting drawing collaboration, all terminal mobile devices participating in the collaboration establish a connection with the cloud server through the Internet, wherein the cloud server is the core of the entire collaboration system and is responsible for storing, managing and synchronizing CAD drawing data. This connection is usually implemented based on network protocols such as TCP / IP to ensure that data can be efficiently and accurately transmitted between the cloud server and the terminal mobile devices. Specifically, when a collaborative user needs to annotate a CAD drawing, he initiates an annotation request to the cloud server through his terminal mobile device (such as a smart phone, tablet computer, etc.). After receiving the request, the cloud server will identify the source of the request, that is, determine to initiate an annotation request to the first CAD drawing. Terminal mobile devices for annotation requests. During the drawing collaboration process, there may be multiple collaborative users participating at the same time. They each use their own terminal mobile devices to interact with the cloud server. These terminal mobile devices are identified as different clients on the cloud server. Each client corresponds to a collaborative user. The cloud server manages these clients to achieve simultaneous support and collaborative control of multiple collaborative users. That is, each collaborative user can view, edit and annotate CAD drawings through his or her terminal mobile device. The cloud server will track each user's operations in real time and synchronize these operations to other users' terminal mobile devices to ensure that all users can see the latest drawing status and annotation information.

[0021] Step S200, performing data synchronization fluency test on the cloud server and the plurality of terminal mobile devices, generating a first collaborative user set whose synchronization fluency index is greater than or equal to a preset fluency and a second collaborative user set whose synchronization fluency index is less than the preset fluency.

[0022] Preferably, a data synchronization fluency test is performed on the cloud server and multiple terminal mobile devices, wherein data synchronization fluency refers to the efficiency and stability of data transmission between the cloud server and the terminal mobile devices. During the collaboration process, the fluency of data synchronization is crucial to ensure the real-time updating of drawing information and the smooth progress of collaboration. Specifically, performance indicators such as response time, throughput, and packet loss rate are used to evaluate the fluency of data synchronization, thereby reflecting the speed, stability, and reliability of data transmission, that is, real-time monitoring of data transmission between the cloud server and the terminal mobile devices, including indicators such as response time and throughput. Based on the real-time monitored data, the fluency of data synchronization is evaluated and compared with the preset fluency indicators. The preset fluency refers to a fluency standard value pre-set according to actual application scenarios, user needs, etc., which is used to evaluate the fluency of data synchronization between the cloud server and the terminal mobile devices. Then, based on the evaluation results, the users are divided into a first collaborative user set and a second collaborative user set, and then the corresponding synchronization mechanism is selected for data synchronization.

[0023] Preferably, users are divided into different sets according to the data synchronization fluency index between the cloud server and the terminal mobile device. Specifically, the user set whose synchronization fluency index is greater than or equal to the preset fluency is taken as the first collaborative user set. The data transmission between the terminal mobile devices of these users and the cloud server is efficient and stable, and can meet the needs of real-time collaboration. For the users in the first collaborative user set, a full-speed synchronization mechanism is adopted to detect their drawing annotation behavior on the terminal mobile device in real time, and generate drawing annotation increments, which are then immediately sent to the cloud server for drawing update; the user set whose synchronization fluency index is less than the preset fluency is taken as the second collaborative user set. The data transmission between the terminal mobile devices of these users and the cloud server may have problems such as delay and packet loss, and cannot meet the needs of real-time collaboration. For the users in the second collaborative user set, a batch synchronization mechanism is adopted. After detecting the drawing annotation behavior, the incremental data packet is compressed and then sent to the cloud server. Although a certain degree of real-time performance is sacrificed, it can reduce the occupation of network resources by data transmission, improve the efficiency and stability of data synchronization, and thus ensure the efficient and stable operation of cloud-based drawing collaborative annotation.

[0024] Step S200 further includes step S210, sending a synchronization test instruction to the multiple terminal mobile devices through the cloud server, obtaining multiple synchronization test results of the data packets generated by the multiple terminal mobile devices according to the synchronization test instruction, sending them to the cloud server, and then synchronizing them to other terminal devices, wherein any synchronization test result includes data transmission delay, data transmission rate and synchronization consistency index; step S220, normalizing and positively weighting the data transmission delay, data transmission rate and synchronization consistency index to generate data synchronization fluency corresponding to the multiple terminal mobile devices respectively.

[0025] Preferably, the cloud server sends a synchronization test instruction to multiple terminal mobile devices, triggering the terminal mobile devices to perform synchronization operations and collect relevant data on data synchronization performance. Specifically, after receiving the synchronization test instruction, each terminal mobile device will generate a data packet containing test data and send it to the cloud server. After receiving the data packet, the cloud server will synchronize it to other terminal mobile devices participating in the test. During the synchronization process, multiple synchronization test results are recorded and collected, including data transmission delay, data transmission rate and synchronization consistency index, wherein the synchronization consistency index indicates that after the cloud server and all terminal devices are synchronized, the drawings and annotations The displayed content should be completely consistent, without data loss or version errors; these indicators are normalized, that is, converted to the same scale, the smaller the data transmission delay is, the better, and other indicators (such as data transmission rate) are as large as possible. The indicators are positive, that is, the values ​​of all indicators are as large as possible or as small as possible, such as by taking the reciprocal or subtracting the minimum value and dividing by the difference between the maximum and minimum values. Finally, according to the importance of each indicator in evaluating the fluency of data synchronization, weights are assigned for weighted processing. Finally, the data synchronization fluency of each terminal mobile device is calculated based on these processed indicator values, reflecting the overall performance of the terminal mobile device in data synchronization.

[0026] Step S300: for the users in the first collaborative user set, a full-speed synchronization mechanism is used to detect the drawing annotation behavior on the corresponding terminal mobile device, and multiple drawing annotation increments are generated and sent to the cloud server for drawing update.

[0027] Preferably, in the cloud-based drawing collaborative annotation method for multi-terminal mobile devices, for users in the first collaborative user set, a full-speed synchronization mechanism is used to detect drawing annotation behavior on the corresponding terminal mobile device, generate multiple drawing annotation increments and send them to the cloud server for drawing update. Specifically, the full-speed synchronization mechanism is an efficient data transmission method that utilizes the full bandwidth and performance of the network to ensure that data can be transmitted from the terminal mobile device to the cloud server in the shortest time. The full-speed synchronization mechanism is suitable for scenarios with good network conditions and high device performance, and can meet collaboration needs with high real-time requirements. In the first collaborative user set, the corresponding collaborative application will be installed on the user's terminal mobile device. When the user annotates on the drawing, the application will capture the user's operating behavior in real time and convert it into drawing annotations. Increments usually include key information such as annotation content, location, and timestamp. The collaborative application will convert the captured drawing annotation behavior into specific drawing annotation increments, that is, these incremental data will be packaged into a specific format to facilitate efficient processing and parsing in the subsequent data transmission process. After generating the drawing annotation increment, the collaborative application will immediately send these incremental data to the cloud server. With the support of the full-speed synchronization mechanism, the data can be transmitted in a very short time, ensuring that the cloud server can receive the latest drawing annotation information in real time; after receiving the drawing annotation increment, the cloud server will immediately process this data, specifically, parse the key information in the incremental data, and then update the drawings stored on the server based on this information, ensuring that all collaborative users can access the latest drawing version.

[0028] Step S300 further includes step S310, extracting the first user and the corresponding first terminal mobile device from the first collaborative user set; step S320, when the first terminal mobile device detects that the first user annotates the first CAD drawing, a full-speed synchronization mechanism is used to generate a first drawing annotation increment in real time and send it to the cloud server; step S330, the cloud server synchronously updates the drawings of multiple terminal mobile devices according to the first drawing annotation increment.

[0029] Preferably, the first collaborative user set usually includes users with good network conditions and high device performance. A user is randomly extracted from these users and is called the first user. The first user corresponds to a specific terminal mobile device, namely the first terminal mobile device. When the first user annotates a CAD drawing (namely the first CAD drawing) through the first terminal mobile device, the collaborative application on the terminal will capture these operations in real time, which may include adding text, lines, graphics and other elements to the drawing, or modifying and deleting existing elements. If the first terminal mobile device detects the annotation operation of the first user, the collaborative application will immediately adopt the full-speed synchronization mechanism. Specifically, the full-speed synchronization mechanism uses the full speed of the network to synchronize the data. The bandwidth and performance of the whole system are used to ensure that data can be transmitted from the terminal mobile device to the cloud server in real time. The collaborative application will generate the first drawing annotation increment in real time. The incremental data contains detailed information about all annotation operations made by the first user on the drawing, such as the content, location, timestamp, etc. of the annotation, and then send it to the cloud server. The cloud server will synchronize the drawings of multiple terminal mobile devices based on the first drawing annotation increment to ensure that all collaborative users (including the first collaborative user set and users in other collaborative user sets) can access the latest drawing version. For example, by sending the updated content of the drawing to all terminal mobile devices, users can see the latest version and annotation content no matter when and where they access the drawing.

[0030] like Figure 2 As shown, step S320 further includes step S321, detecting the drawing status displayed on the first terminal mobile device through the incremental detection module to generate a first reference state; step S322, monitoring the operation of the first collaborative user in real time through the incremental detection module to generate first operation monitoring data; step S323, comparing the first operation monitoring data with the first reference state, identifying the difference data of the operation, and generating the first drawing annotation increment.

[0031] Preferably, the incremental detection module is a software component responsible for monitoring user operations and generating incremental data of drawings so as to achieve real-time updating and synchronization of drawings. Specifically, the incremental detection module is used to monitor the state changes of drawings and the operation behaviors of users in real time, and can identify every tiny change on the drawings and convert it into a processable data format. The incremental detection module first detects the drawing state currently displayed on the first terminal mobile device, which includes all elements, attributes and the relationship between them of the drawings, which can be regarded as a complete drawing snapshot as the first reference state; then the incremental detection module monitors the operation of the first collaborative user in real time, such as the first user starts to operate on the drawing ( Such as adding comments, modifying lines, deleting elements, etc.), capturing every operation action of the user, including key information such as the type, location, and timestamp of the operation, and generating the first operation monitoring data, which contains all the captured operation information, that is, a detailed record of all modifications and changes made by the user to the drawing; finally, the first operation monitoring data is compared with the first reference state, and each element and attribute on the drawing is checked item by item to identify the difference data between the two, that is, to identify all drawing changes caused by user operations and record these changes, and convert them into a specific data format, called the first drawing annotation increment, which contains all information related to the drawing changes, such as the type, location, and content of the changes.

[0032] Step S400, for the users in the second collaborative user set, a batch synchronization mechanism is used to perform drawing annotation behavior detection and incremental data packet compression on the corresponding terminal mobile device, generate multiple incremental compression packages and send them to the cloud server for drawing update.

[0033] Preferably, in the cloud-based collaborative drawing annotation method, for users in the second collaborative user set, a batch synchronization mechanism is used to perform drawing annotation behavior detection and incremental data packet compression on the corresponding terminal mobile device, generate multiple incremental compression packages and send them to the cloud server for drawing update. Specifically, the batch synchronization mechanism is a data transmission method for scenarios with poor network conditions or limited device performance. Unlike the full-speed synchronization mechanism, it does not transmit data in real time, but accumulates data over a period of time to form batch data packets, which are then transmitted to the cloud server at one time to reduce the number of data transmissions, reduce network burden, and improve data transmission efficiency. In the second collaborative user set, a collaborative application will also be installed on the user's terminal mobile device. When the user annotates on the drawing, the application will capture the user's operating behavior in real time. However, unlike the first collaborative user set, these behavior data will not be transmitted to the cloud server immediately, but will be stored locally first, waiting for subsequent batch processing. After accumulating a certain amount of drawing annotation behavior data, the collaborative application will package these data into incremental data packets, and then compress them to form incremental compressed packets to improve data transmission efficiency. ,The compression algorithm can be selected according to the actual situation to minimize the size of the data packet while ensuring data integrity. As users continue to annotate on the drawings, the collaborative application will continuously generate new incremental data packets and compress them to form multiple incremental compressed packages. Each package contains the user's drawing annotation behavior data over a period of time. After accumulating a sufficient number of incremental compressed packages, the collaborative application will send these packages to the cloud server at one time. During the transmission process, the network's idle time or off-peak time will be used for transmission to reduce the occupation of network resources. After receiving the incremental compressed package, the cloud server will decompress and process it, and then update the drawings stored on the server according to the information in the incremental data packet. Among them, the update refers to the synchronization of the cloud update to all terminals. Each time the drawing is updated, each user defaults to annotate on a different layer, and there will be no problem of annotation coverage in the same area. After the update is completed, the cloud server will ensure that all collaborative users (including users in the first collaborative user set and the second collaborative user set) can access the latest drawing version, which can improve the efficiency and reliability of data transmission while ensuring data integrity and consistency.

[0034] Step S400 further includes step S410, extracting the second user and the corresponding second terminal mobile device from the second collaborative user set; step S420, when the second terminal mobile device detects that the second user annotates the first CAD drawing, a batch synchronization mechanism is used to generate a second drawing annotation increment and send it to the cloud server, wherein the batch synchronization mechanism includes a batch operation pause time constraint and a batch data volume constraint; step S430, the cloud server synchronizes and updates the drawings of multiple terminal mobile devices according to the second drawing annotation increment.

[0035] Preferably, one of the multiple users who participate in editing and annotating drawings in the second collaborative user set is randomly selected as the second user. When the second user starts to participate in the drawing collaboration, the second user corresponds to a terminal mobile device associated with it, such as a smart phone, tablet computer, etc., that is, a second terminal mobile device, which is used to receive drawings, display drawing contents, and allow users to perform annotations and other editing operations on them. The second user can view the first CAD drawing on the second terminal mobile device and annotate it. These annotations may include text descriptions, labels, marks, etc., which are used to supplement the drawing information or provide additional instructions. When the second terminal mobile device detects that the second user annotates the first CAD drawing, a batch synchronization mechanism is used to generate a second drawing annotation increment. Specifically, the batch synchronization mechanism includes a batch operation pause time constraint and a batch data volume constraint. When the second user performs a series of continuous annotation operations in a short period of time, these operations will not be immediately synchronized to the cloud server one by one. The server will wait for a period of time (i.e., pause time) to see if there are more annotation operations. If there are no new annotation operations within the pause time, all previous annotation operations will be synchronized as a batch data packet. In addition to the pause time, whether to perform batch synchronization is also determined based on the data volume of the annotation operation. That is, if the data volume of a single annotation operation is small, but the number is large, these operations are also merged into a batch data packet for synchronization to reduce the number and overhead of data transmission. Based on these two constraints, the second drawing annotation increment is generated and sent to the cloud server. After receiving the batch data packet sent by the second terminal mobile device, the cloud server parses it, including extracting the drawing annotation increment in the data packet, i.e., all the annotation operations made by the second user on the drawing, and then synchronizing and updating the drawings stored thereon, and also synchronizing these annotation increments to all terminal mobile devices participating in the collaboration, ensuring that all collaborative users can obtain the latest status of the drawings in real time.

[0036] Preferably, step S420 further includes step S421, detecting, through the second terminal mobile device, the operation pause time and the annotation incremental data volume of the second user's annotation operation on the first CAD drawing; step S422, when the operation pause time meets the batch operation pause time constraint or the annotation incremental data volume meets the batch data volume constraint, comparing and obtaining the annotation incremental data and using a predetermined compression algorithm to perform data compression to generate the second drawing annotation increment.

[0037] Preferably, the operation pause time and the amount of annotation incremental data of the second user performing an annotation operation on the first CAD drawing are detected through the second terminal mobile device. Specifically, if the user does not perform any annotation operation for a period of time, this period of time is regarded as the operation pause time, which may reflect that the user is thinking, resting or waiting for other information. The amount of annotation incremental data describes the changes made by the user to the drawing. As the user operation proceeds, these incremental data will gradually accumulate, and the total amount of these data will be monitored to determine when to perform batch synchronization; the batch operation pause time constraint is a preset batch operation pause time threshold, and the batch data volume constraint is a preset batch data volume threshold. When the detected operation pause time exceeds the batch operation pause time When the threshold is reached or the amount of incremental annotation data reaches or exceeds the threshold of batch data volume, it is considered that the user has completed the annotation operation at the current stage or has accumulated enough data and is ready for batch synchronization. Then the current drawing state is compared with the drawing state at the last synchronization, so as to obtain the data of all annotation operations performed by the user during this period, that is, the incremental annotation data. Then, a predetermined compression algorithm is used to compress the acquired incremental annotation data to improve the efficiency of data transmission, such as significantly reducing the size of the data, thereby reducing the transmission time and bandwidth occupancy. The compressed incremental annotation data is encapsulated into a data packet, called the second drawing annotation increment, which is used to update the drawing on the cloud server and synchronize it to other terminal mobile devices. By detecting the operation pause time and the amount of incremental annotation data, efficient drawing synchronization and collaboration are achieved, which not only improves the user's collaboration efficiency, but also reduces the cost of data transmission.

[0038] Step S430 further includes step S431, after each drawing update, the drawing version before the update is automatically recorded by the cloud server and stored in the historical database corresponding to the first CAD drawing.

[0039] Preferably, after each drawing is updated, the cloud server will automatically execute operations to record and store the drawing version before the update in the corresponding historical database. Specifically, when a drawing is updated, it means that a user has modified, annotated or otherwise edited the drawing, which may be initiated by the user through the CAD software on a terminal mobile device (such as a mobile phone, tablet or computer) and uploaded to the cloud server for synchronization. If the cloud server detects that a drawing has been updated, it triggers the corresponding recording mechanism. Before the update operation occurs, the latest version of the current drawing is obtained and the obtained drawing version before the update is encapsulated, and a historical version record is generated, such as the version number of the drawing, update time, updater information and specific content of the drawing. Finally, the storage location corresponding to the first CAD drawing is found in the historical database according to the identification information of the drawing, and the generated historical version record is stored in the specified location.

[0040] Step S430 further includes step S432, obtaining the latest drawing version after each drawing update; step S433, obtaining multiple annotations located in the same drawing area in the latest drawing version; step S434, similarity clustering the multiple annotations to generate multiple cluster annotation sets; step S434, folding and displaying based on the multiple cluster annotation sets.

[0041] Preferably, after a drawing is updated, the latest drawing version is first obtained, that is, the latest drawing file is retrieved from a cloud server or local storage, which includes all modifications and annotations made by the user. Then, multiple annotations located in the same area on the drawing are identified and extracted. These annotations may be added by different users at different time points, but they all point to the same position or area on the drawing. The location information (such as coordinates) of the annotations is compared to determine whether they belong to the same area. Then, these annotations are clustered by similarity, aiming to classify annotations with similar properties or contents into one category for more effective display and processing. For example, clustering is performed based on the text content, color, size, shape or other visual features of the annotations. After similarity clustering, multiple clustered annotations are obtained. Set, each cluster annotation set contains a group of annotations with high similarity in the same area on the drawing; finally, the generated cluster annotation sets are folded and displayed. Specifically, on the display interface of the drawing, for each cluster annotation set, only one representative annotation (such as the earliest annotation, the latest annotation, or an annotation of a specific attribute) is displayed, and other annotations in the cluster annotation set are hidden or folded. Users can view these hidden annotations by clicking or expanding them, reducing visual interference on the drawing, allowing users to locate and understand key information on the drawing more quickly, while allowing users to view or hide detailed information of annotations as needed, thereby providing a more flexible and personalized viewing experience, and thus providing users with a more efficient and intuitive drawing viewing experience.

[0042] The above specific implementation manner does not constitute a limitation to the protection scope of the present application. It should be understood by those skilled in the art that various modifications, combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application should be included in the protection scope of the present application. In some cases, the actions or steps recorded in the present application can be performed in an order different from that in the embodiment and can still achieve the desired results. In addition, the process depicted in the accompanying drawings does not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

Claims

1. A cloud-based collaborative drawing annotation method for multiple mobile devices, characterized in that: include: Connecting to a cloud server, determining a plurality of terminal mobile devices that initiate annotation requests to the first CAD drawing, wherein the plurality of terminal mobile devices correspond to a plurality of collaborative users; Performing a data synchronization fluency test on the cloud server and the plurality of terminal mobile devices, generating a first collaborative user set whose synchronization fluency index is greater than or equal to a preset fluency and a second collaborative user set whose synchronization fluency index is less than the preset fluency; For the users in the first collaborative user set, a full-speed synchronization mechanism is used to detect drawing annotation behavior on the corresponding terminal mobile device, and multiple drawing annotation increments are generated and sent to the cloud server for drawing update; For the users in the second collaborative user set, a batch synchronization mechanism is used to perform drawing annotation behavior detection and incremental data packet compression on the corresponding terminal mobile device, generate multiple incremental compression packages and send them to the cloud server for drawing update.

2. The cloud-based collaborative annotation method for multi-terminal mobile devices as claimed in claim 1, characterized in that: A full-speed synchronization mechanism is used to detect drawing annotation behavior on the corresponding terminal mobile device, generate multiple drawing annotation increments and send them to the cloud server for drawing update, including: Extracting a first user and a corresponding first terminal mobile device from the first collaborative user set; When the first terminal mobile device detects that the first user performs an annotation operation on the first CAD drawing, a full-speed synchronization mechanism is used to generate an annotation increment of the first drawing in real time and send it to the cloud server; The cloud server synchronously updates drawings of multiple terminal mobile devices according to the first drawing annotation increment.

3. The cloud-based collaborative annotation method for multi-terminal mobile devices as claimed in claim 2, characterized in that: When the first terminal mobile device detects that the first user performs an annotation operation on the first CAD drawing, a full-speed synchronization mechanism is used to generate a first drawing annotation increment in real time, including: Detecting the state of the drawing displayed by the first terminal mobile device through an incremental detection module to generate a first reference state; Monitor the operation of the first collaborative user in real time through an incremental detection module to generate first operation monitoring data; The first operation monitoring data is compared with the first reference state, difference data of operation is identified, and the first drawing annotation increment is generated.

4. The cloud-based collaborative annotation method for multi-terminal mobile devices as claimed in claim 3, characterized in that: For the users in the second collaborative user set, a batch synchronization mechanism is used to perform drawing annotation behavior detection and incremental data packet compression on the corresponding terminal mobile device, generate multiple incremental compression packages and send them to the cloud server for drawing update, including: Extracting a second user and a corresponding second terminal mobile device from the second collaborative user set; When the second terminal mobile device detects that the second user performs an annotation operation on the first CAD drawing, a batch synchronization mechanism is used to generate a second drawing annotation increment and send it to the cloud server, wherein the batch synchronization mechanism includes a batch operation pause time constraint and a batch data volume constraint; The cloud server synchronously updates the drawings of multiple terminal mobile devices according to the second drawing annotation increment.

5. The cloud-based collaborative annotation method for multi-terminal mobile devices as claimed in claim 4, characterized in that: The second drawing annotation increment is generated by adopting a batch synchronization mechanism and sent to the cloud server, including: Detecting, by the second terminal mobile device, the pause time and the amount of annotation incremental data of the annotation operation performed by the second user on the first CAD drawing; When the operation pause time satisfies the batch operation pause time constraint or the annotation incremental data volume satisfies the batch data volume constraint, the annotation incremental data is obtained by comparison and a predetermined compression algorithm is used to perform data compression to generate the second drawing annotation increment.

6. The cloud-based collaborative annotation method for multiple mobile devices as claimed in claim 1, characterized in that: After each drawing is updated, the cloud server automatically records the drawing version before the update and stores it in the historical database corresponding to the first CAD drawing.

7. The cloud-based collaborative annotation method for multiple mobile devices as claimed in claim 1, characterized in that: include: After each drawing update, obtain the latest drawing version; Acquire multiple annotations located in the same drawing area in the latest drawing version; Performing similarity clustering on the multiple annotations to generate multiple cluster annotation sets; The folding display is performed based on the multiple cluster annotation sets.

8. The cloud-based collaborative annotation method for multiple mobile devices as claimed in claim 1, characterized in that: Performing a data synchronization fluency test on the cloud server and the plurality of terminal mobile devices includes: Sending synchronization test instructions to the multiple terminal mobile devices through the cloud server, obtaining multiple synchronization test results of data packets generated by the multiple terminal mobile devices according to the synchronization test instructions, sending them to the cloud server and then synchronizing them to other terminal devices, wherein any synchronization test result includes data transmission delay, data transmission rate and synchronization consistency index; The data transmission delay, data transmission rate and synchronization consistency index are normalized and index-positive, and then weighted to generate data synchronization fluency corresponding to the multiple terminal mobile devices respectively.

Images