Power business process monitoring method and device based on multi-terminal interconnection

Abstract

The invention provides an electric power business process monitoring method and device based on multi-terminal interconnection, and relates to the multi-terminal interconnection technology, and the method comprises the steps: extracting element coordinates in an electric power document based on an interaction request of each business terminal, dynamically updating the element coordinates according to a window rolling offset, binding an anchoring graph layer to the element coordinates, and carrying out the dynamic updating of the element coordinates according to the window rolling offset. The method comprises the following steps: intercepting a sub-layer fragment containing annotation data in an anchoring layer, automatically updating annotation coordinates of the sub-layer fragment along with movement of element coordinates, obtaining a time difference between document annotation and interactive operation, and adjusting the sub-layer fragment according to interactive parameters and the time difference to enable the feature offset of the sub-layer fragment and a target element to meet a preset error threshold value, the identity information and the annotation timestamps of all the service terminals are associated with the process nodes, cooperative monitoring data are generated and stored in the database, and real-time cooperative interaction of the power data among the multiple service terminals can be achieved.

Description

Technical Field

[0001] The present invention relates to multi - terminal interconnection technology, and particularly to a method and device for monitoring power service processes based on multi - terminal interconnection. Background Art

[0002] In power service meetings, the collaborative interaction of power data is an important link. In the prior art, when carrying out collaborative interaction of power data, it is often impossible to achieve the collaborative interaction of power data among multiple service terminals. Usually, the person initiating the meeting stores the power data in the form of a file on a shared server, and the participants download the file to their respective corresponding service terminals for viewing, editing, annotation and other interaction operations. After completing the operations, the participants need to manually upload the file back to the shared platform again. Only by downloading the updated file again can other people obtain the latest power data. However, this collaborative interaction method has many drawbacks. On the one hand, the repeated download and upload operations are not only time - consuming and laborious, but also prone to human errors, resulting in data version confusion. For example, if multiple participants modify and upload the file simultaneously, it is very likely that some modified contents will be overwritten, making it impossible for subsequent file - downloading personnel to obtain complete information. On the other hand, due to the lack of real - time synchronization, there is an obvious delay in information update, seriously affecting the timeliness of collaborative interaction and making it difficult to meet the requirements of rapid decision - making and efficient communication in power service meetings.

[0003] Therefore, how to achieve real - time collaborative interaction of power data among multiple service terminals has become an urgent problem to be solved. Summary of the Invention

[0004] The present invention provides a method and device for monitoring power service processes based on multi - terminal interconnection, which can achieve real - time collaborative interaction of power data among multiple service terminals.

[0005] In the first aspect of the present invention, a method for monitoring power service processes based on multi - terminal interconnection is provided, including: Extracting the element coordinates in a power document based on the interaction requests of each service terminal, and dynamically updating the element coordinates according to the viewport scroll offset; Binding an anchor layer to the element coordinates, intercepting a sub - layer segment containing annotation data in the anchor layer, and automatically updating the annotation coordinates of the sub - layer segment as the element coordinates move; Obtaining the time difference between document annotation and interaction operations, and adjusting the sub - layer segment according to the interaction parameters and the time difference so that its characteristic offset from the target element meets a preset error threshold; Associating the identity information and annotation timestamps of each service terminal with process nodes, and generating collaborative monitoring data for storage in a database.

[0006] Optionally, in a possible implementation of the first aspect, extracting the element coordinates in the power document based on the interaction requests of each business terminal, and dynamically updating the element coordinates according to the window scroll offset, including: Traverse the document elements in the power document, determine the center point of the power document as the coordinate origin, and obtain the element coordinates of each document element; Generate a unique identifier for each document element based on the document page number and the initial element coordinates, and associate each document element with its corresponding unique identifier; Obtain the window scroll offset in real time to obtain the horizontal scroll offset and the vertical scroll offset; Update the horizontal coordinate value in the element coordinates according to the horizontal scroll offset, and update the vertical coordinate value in the element coordinates according to the vertical scroll offset.

[0007] Optionally, in a possible implementation of the first aspect, binding the anchor layer to the element coordinates, intercepting the sub-layer segment containing the annotation data in the anchor layer, and automatically updating the annotation coordinates of the sub-layer segment as the element coordinates move, including: Bind the anchor layer to the element coordinates of the corresponding document element, and obtain the annotation data drawn by the business terminal for this document element; Obtain the visible area of the annotation data containing associated attributes and / or the visible area of the annotation data containing a single attribute; Intercept the visible area to obtain the sub-layer segment, and bind the sub-layer segment and the element coordinates of the corresponding document element; Automatically update the annotation coordinates of the sub-layer segment according to the window scroll offset corresponding to the element coordinates.

[0008] Optionally, in a possible implementation of the first aspect, obtaining the visible area of the annotation data containing associated attributes and / or the visible area of the annotation data containing a single attribute, including: Determine that multiple annotation data corresponding to the same document element are associated attributes, generate a rectangular outer frame for all document elements containing associated attributes, and determine the area within the rectangular outer frame as the visible area; and / or, Determine that a single annotation data corresponding to the same document element is a single attribute, and extract the outer contour of the annotation data; Enlarge and adjust the outer contour according to a preset magnification ratio to obtain an offset contour, align the center points of the offset contour and the outer contour, and determine the area within the offset contour as the visible area.

[0009] Optionally, in a possible implementation of the first aspect, during the process of automatically updating the annotation coordinates of the sub-layer segment as the element coordinates move, it further includes: Statistically calculate the pixel quantity difference of the document element at adjacent moments during the movement; When the difference in the number of pixels is greater than or equal to the area threshold, obtain a scaling ratio based on the ratio of the number of pixels of the document element at the later moment to the number of pixels at the previous moment; Obtain an adjusted area based on the product of the number of pixels of the sub-layer segment and the scaling ratio, and update the area of the sub-layer segment to the adjusted area.

[0010] Optionally, in a possible implementation of the first aspect, obtain the time difference between the document annotation and the interaction operation, and adjust the sub-layer segment according to the interaction parameter and the time difference so that the feature offset from the target element meets a preset error threshold, including: Determine the rendering moment of the document annotation and the first trigger moment of the scrolling operation, and obtain a first time difference by subtracting the first trigger moment from the rendering moment; Determine the position offset between the sub-layer segment and the target element according to the scrolling rate and the first time difference. When the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, adjust the current annotation coordinates of the sub-layer segment according to the position offset; or, Determine the second trigger moment of the scaling operation, and obtain a second time difference by subtracting the second trigger moment from the rendering moment; Determine the scaling offset between the sub-layer segment and the target element according to the second time difference. When the scaling offset is greater than or equal to the preset error threshold corresponding to the scaling operation, perform area adjustment on the sub-layer segment based on the scaling offset; Wherein, the interaction operation includes a scrolling operation and a scaling operation, the interaction parameter includes a scrolling rate and a scaling ratio, and the feature offset includes a position offset and a scaling offset.

[0011] Optionally, in a possible implementation of the first aspect, when the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, adjust the current annotation coordinates of the sub-layer segment according to the position offset, including: When the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, determine the direction opposite to the scrolling direction as the calibration direction, and determine the arithmetic property corresponding to the calibration direction, where the arithmetic property includes an increasing property and a decreasing property; Obtain the coordinate value corresponding to the calibration direction, and add or subtract the position offset from the coordinate value according to the arithmetic property to obtain the annotation coordinates corresponding to the adjusted sub-layer segment.

[0012] Optionally, in a possible implementation of the first aspect, determine the scaling offset between the sub-layer segment and the target element according to the second time difference. When the scaling offset is greater than or equal to the preset error threshold corresponding to the scaling operation, perform area adjustment on the sub-layer segment based on the scaling offset, including: Determine the scaling offset between the sub-layer segment and the target element based on the ratio of the number of pixels of the target element at the end moment and the initial moment of the second time difference; When the scaling offset is greater than or equal to the preset error threshold corresponding to the scaling operation, obtain the scaling area according to the product of the scaling offset and the number of pixels of the sub-layer segment, and update the area of the sub-layer segment to the scaling area.

[0013] Optionally, in a possible implementation manner of the first aspect, after adjusting the current annotation coordinates of the sub-layer segment according to the position offset, it further includes: Generate a calibration axis including nodes corresponding to each first time difference, and the distance between adjacent nodes in the calibration axis is obtained by the product of its corresponding time interval difference and the unit length; Obtain the unit increment according to the ratio of the offset difference between adjacent nodes and the distance, and take the node with a smaller value as the reference, and sequentially determine multiple prediction nodes at intervals of the unit length; Taking the position offset corresponding to the node with a smaller value as the reference, sequentially add the unit increment to obtain the prediction offset corresponding to each prediction node; When there is a time difference corresponding to a prediction node that is equal to the time difference between the next document annotation and the scrolling operation, use the prediction offset corresponding to the prediction node as the position offset for the next annotation coordinate adjustment.

[0014] In the second aspect of the present invention, there is provided a power service process monitoring device based on multi-terminal interconnection, including: An extraction module, configured to extract the element coordinates in the power document based on the interaction requests of each service terminal, and dynamically update the element coordinates according to the viewport scrolling offset; An update module, configured to bind the anchored layer to the element coordinates, intercept the sub-layer segment containing the annotation data in the anchored layer, and automatically update the annotation coordinates of the sub-layer segment as the element coordinates move; An adjustment module, configured to obtain the time difference between the document annotation and the interaction operation, and adjust the sub-layer segment according to the interaction parameters and the time difference, so that its characteristic offset from the target element meets the preset error threshold; A generation module, configured to associate the identity information and annotation timestamps of each service terminal with the process nodes, and generate collaborative monitoring data and store it in the database.

[0015] The beneficial effects of the present invention are as follows: 1. This solution can implement the multi-terminal interaction function of the power document during the meeting, support multiple service terminals to perform annotation operations on the same document simultaneously, realize the efficient management of the power service, and bind the annotation information to the corresponding service terminal. Through the binding mechanism, the operation monitoring data of each service terminal during the meeting can be generated, which is convenient for subsequent quick backtracking and review.

[0016] 2. During the interaction process, the present invention can, according to different interactive operations of different business terminals on the document in the window, such as scrolling and zooming operations, etc., perform real-time dynamic scrolling or zooming adjustment on the annotation data, ensuring that the annotation information always remains consistent with the document content and avoiding problems such as annotation misalignment or loss caused by document changes.

[0017] 3. During the process of multiple people annotating simultaneously, the present invention can bind the anchor layer to the element coordinates corresponding to the document elements, thereby solving the problem in the traditional solution that it cannot adapt to document scrolling and zooming, resulting in annotation misalignment with the target content. After binding the anchor layer to the element coordinates corresponding to the document elements, a sub-layer fragment containing annotation data can be intercepted from the anchor layer, and detailed information related to the annotation data can be accurately obtained, which can reduce unnecessary data processing volume and improve processing efficiency. When the position of the document element changes, the annotation coordinates of the sub-layer fragment can be automatically updated to ensure that the annotation is always closely associated with the corresponding document element.

[0018] 4. During the process of multi-terminal interaction, due to factors such as the processing speed and network latency between multiple terminals, there may be a time difference between document annotation and interactive operations. The present invention can obtain the time difference between document annotation and interactive operations, and update the corresponding annotation coordinates of the sub-layer fragment according to the interactive parameters and time difference when the business terminal performs interactive operations on the power document, so as to ensure that the characteristic offset between the annotation data and the target element meets the preset error threshold and achieve accurate correspondence between the annotation and the document content.

[0019] 5. After updating the current annotation coordinates of the sub-layer fragment, the present invention can generate a calibration axis, calculate the unit increment, determine the prediction node and its prediction offset, so that when a situation with the same time difference as the prediction node occurs subsequently, the corresponding prediction offset can be quickly obtained for annotation coordinate adjustment, reducing repeated calculations, improving the efficiency and accuracy of annotation calibration, and thus being able to more efficiently and accurately handle the subsequent possible time difference problem between document annotation and scrolling operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 is a schematic flowchart of a power service process monitoring method based on multi-terminal interconnection provided by an embodiment of the present invention; Figure 2 is a schematic diagram of a calibration direction provided by an embodiment of the present invention; Figure 3 is a schematic diagram of a calibration axis provided by an embodiment of the present invention; Figure 4 is a schematic structural diagram of a power service process monitoring device based on multi-terminal interconnection provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0021] To make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are only a part rather than all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0022] The technical solutions of the present invention will be described in detail below with specific embodiments. These specific embodiments may be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0023] See Figure 1 , which is a schematic diagram of a method for monitoring power service processes based on multi-terminal interconnection provided by an embodiment of the present invention. Figure 1 The execution subject of the method shown may be a software and / or hardware device. The execution subjects of the present application may include, but are not limited to, at least one of the following: user equipment, network equipment, etc. Among them, the user equipment may include, but is not limited to, a computer, a smart phone, a personal digital assistant (Personal Digital Assistant, abbreviated as: PDA), and the above-mentioned electronic devices, etc. The network equipment may include, but is not limited to, a single network server, a server group composed of multiple network servers, or a cloud composed of a large number of computers or network servers based on cloud computing. Among them, cloud computing is a type of distributed computing, which is composed of a group of loosely coupled computers to form a super virtual computer. This embodiment does not make any restrictions. It includes steps S1 to S4, which are specifically as follows: S1, extract the element coordinates in the power document based on the interaction requests of each service terminal, and dynamically update the element coordinates according to the window scroll offset.

[0024] Among them, the service terminal refers to the terminal used by the staff of the power department, for example, it can be an office computer. The interaction request refers to the request of the staff of the service terminal to annotate, slide, zoom, etc. the meeting document during the meeting process. The power document refers to the document related to the power service. The element coordinates refer to the position coordinates of various elements in the power document, such as text blocks, icons, formulas, etc. on the document page. The window scroll offset refers to the distance that the document content displayed in the window moves when the staff scrolls the power document page.

[0025] This solution can realize the multi-terminal interaction function of power documents during the meeting process, support multiple user terminals to perform annotation operations on the same document simultaneously, achieve efficient management of power operations, and bind the annotation information to the corresponding users. Through the binding mechanism, operation monitoring data of each user during the meeting process can be generated, which is convenient for subsequent quick backtracking and review. Moreover, during the interaction process, this solution can perform real-time dynamic scrolling or zoom adjustment on the annotation data according to different users' different interaction operations on the document in the window, such as scrolling and zooming operations. For example, when a certain text or paragraph in the document is moved, the annotation associated with this content will also move automatically, always keeping in sync with the document, ensuring that the annotation information always matches the document content and avoiding problems such as annotation misalignment or loss caused by document changes.

[0026] Specifically, during the meeting process, when the staff of the power department participating in the meeting wants to perform corresponding operations on the meeting document, such as annotating the document content, scrolling the document content up and down, or zooming the document, they can send corresponding interaction requests through their corresponding business terminals, such as computers. According to the interaction requests sent by each business terminal, through image recognition and text parsing technologies, for different types of document elements, such as text blocks, structured text paragraphs, complex charts, and professional formulas, accurate recognition and positioning can be carried out to obtain their corresponding element coordinates. However, in practical applications, due to the rich content of power documents, the staff may need to scroll the page to view different parts of the content during browsing. When the staff uses the mouse wheel to move the document page up and down or left and right in the window, the document content displayed in the window will also change accordingly, and the distance of the change is the window scroll offset. The change situation of the window scroll offset can be monitored in real time to dynamically update the extracted element coordinates. For example, when the document slides down, the originally extracted element coordinates can be corrected according to the window scroll offset to ensure that the positions of these document elements can still be accurately tracked in the new window state.

[0027] In some embodiments, the specific implementation manner of step S1 may be: S11, traverse the document elements in the power document, determine the center point of the power document as the coordinate origin, and obtain the element coordinates of each document element.

[0028] Specifically, the power document can be traversed to identify all document elements, including text blocks, charts, formulas, and other document elements. To uniformly measure the positions of each document element, the center point of the power document can be determined as the coordinate origin, a coordinate system can be constructed, and the position of each document element in the coordinate system with the center point of the power document as the coordinate origin can be determined to obtain the coordinates corresponding to each document element, that is, the element coordinates. Among them, the document element refers to the basic constituent elements in the power document, including text blocks, text paragraphs, charts, and other elements.

[0029] S12. Generate a unique identifier for each document element based on the document page number and the initial element coordinates, and associate each document element with its corresponding unique identifier.

[0030] Specifically, to accurately distinguish and manage each document element in the power document, the unique identifier corresponding to the document element can be generated by combining the document page number and the initial element coordinates corresponding to the document element. The document page number is an important reference factor because elements on different pages are different elements even if their coordinates are the same. Combining the initial coordinates can further ensure the uniqueness of the identifier. For example, a text block located on page 3 with coordinates (x 1 , y 1 ) can have a unique identifier of "P3-(x 1 , y 1 )". Such an identifier can clearly indicate the page and approximate position where the document element is located. Bind and associate the generated unique identifier with the corresponding document element. This association is like attaching a unique label to each element, facilitating subsequent searching, referencing, and operating on the elements in the system. Whether it is making annotations, moving document elements, or viewing document element information, the specific document element can be quickly located through the unique identifier.

[0031] Among them, the unique identifier refers to the identifier used to uniquely distinguish and identify each document element in the power document.

[0032] S13. Obtain the window scroll offset in real time to get the horizontal scroll offset and the vertical scroll offset.

[0033] In practical applications, when users browse the power document, they usually scroll the window to view different parts of the content. The scrolling of the window will cause the relative positions of the document elements in the window to change. Therefore, it is necessary to obtain the scroll offset in real time.

[0034] Specifically, users may use the mouse wheel, touchpad gestures, or other scrolling operation methods to scroll the window, and can continuously monitor the real-time window scrolling situation. Since window scrolling may be horizontal, that is, left and right scrolling, or vertical, that is, up and down scrolling, the horizontal scrolling offset and the vertical scrolling offset can be obtained respectively. For example, when the user scrolls the mouse wheel to the left, the document content will move to the right, and the horizontal moving distance can be recorded as the horizontal scrolling offset. When the user scrolls the mouse wheel up, the document content will move down, and the vertical moving distance can be recorded as the vertical scrolling offset.

[0035] Among them, the horizontal scrolling offset refers to the distance that the document content moves relative to the window in the horizontal direction, and the vertical scrolling offset refers to the distance that the document content moves relative to the window in the vertical direction.

[0036] S14, update the horizontal coordinate value in the element coordinates according to the horizontal scrolling offset, and update the vertical coordinate value in the element coordinates according to the vertical scrolling offset.

[0037] In practical applications, window scrolling will change the relative position of document elements in the window. To ensure that the positions of document elements can always be accurately recorded, the element coordinates can be updated according to the scrolling offset.

[0038] Specifically, after obtaining the horizontal offset, the horizontal coordinate value in the corresponding coordinate element of the document element can be updated according to the horizontal offset. If it is a right scroll, but the document element will move to the left. Generally, in a two-dimensional coordinate system, the direction of the x-axis is generally from left to right, and the direction of the y-axis is generally from bottom to top. Therefore, by subtracting the horizontal offset from the horizontal coordinate value, the updated horizontal coordinate value is obtained. If it is a left scroll, but the document element will move to the right. Therefore, by adding the horizontal offset to the horizontal coordinate value, the updated horizontal coordinate value is obtained. After obtaining the vertical offset, the vertical coordinate value in the corresponding coordinate element of the document element can be updated according to the vertical offset. If it is an up scroll, but the document element will move down. Therefore, by subtracting the vertical offset from the vertical coordinate value, the updated vertical coordinate value is obtained. If it is a down scroll, but the document element will move up. Therefore, by adding the vertical offset to the vertical coordinate value, the updated horizontal coordinate value is obtained.

[0039] Among them, the horizontal coordinate value refers to the coordinate value of the document element in the horizontal direction, such as the x-axis coordinate value, and the vertical coordinate value refers to the coordinate value of the document element in the vertical direction, such as the y-axis coordinate value.

[0040] Through the above implementation methods, it can be ensured that the coordinates of document elements can be adjusted in time, ensuring the accuracy of element positions in different window states.

[0041] S2. Bind the anchor layer to the element coordinates, intercept the sub-layer segment containing the annotation data in the anchor layer, and automatically update the annotation coordinates of the sub-layer segment as the element coordinates move.

[0042] Among them, the anchor layer is usually a graphical interface element, which can be used to provide a visual reference framework on the document element so that users can add annotations on it, such as underlining and color marking. Annotation data refers to the data generated by users' operations such as color marking and underlining on the text elements in the document. The sub-layer segment refers to the segment containing the annotation data, and the annotation coordinates refer to the coordinate position of the sub-layer segment corresponding to the annotation data in the document.

[0043] In traditional power document processing and annotation solutions, screen absolute coordinates such as pixel positions are often used to locate annotations and document elements. However, this method has obvious drawbacks. When the document is scrolled, zoomed, or page switching operations such as PPT page turning occur, since the absolute coordinates do not automatically adjust with the relative position change of the document content, it will cause the annotation to be misaligned with the original corresponding target content. For example, in the PPT scenario, when turning from page 8 to other pages, the annotation on page 8 before will still stay at the original position determined by the absolute coordinates and cannot move with the document content, seriously affecting the accuracy and practicality of the annotation information.

[0044] This solution can solve the problem in the traditional solution that annotations are misaligned with the target content due to the inability to adapt to document scrolling and zooming by binding the anchor layer to the element coordinates corresponding to the document element. Specifically, the anchor layer can be bound to the element coordinates corresponding to the document element, and the anchor layer can follow the element coordinates in real time, so as to realize that the annotation data can correspond to the document element in real time. Although the anchor layer is closely bound to the document element, the specification of the anchor layer usually corresponds to the specification of the viewport, so it may contain a lot of information irrelevant to the annotation data corresponding to the document element. In order to improve the processing efficiency and reduce the unnecessary data processing volume, the sub-layer segment containing the annotation data can be further intercepted from the anchor layer. When operations such as scrolling and zooming occur to the document, the position of the document element will change accordingly. In order to ensure that the annotation always corresponds to the document element, the change of the element coordinates can be monitored in real time, and the annotation coordinates of the sub-layer segment can be automatically updated according to these changes.

[0045] In actual operation, there will also be cases where the element coordinates are not within the current viewport. For example, when the attendee scrolls the document to other pages, the elements and their annotations on the previous page will go beyond the current viewport range. At this time, in order to save memory resources, when it is detected that the element coordinates are not within the viewport, the sub-layers of the corresponding page can be automatically unloaded and kept in a bound relationship with the elements. In this way, when it is necessary to return to this page later, the sub-layer fragments can be quickly located based on the element coordinates, and the sub-layer fragments can be dynamically loaded, while automatically aligning the current page layout. Whether it is zooming or scrolling operations, it can ensure that the annotations are perfectly adapted to the target content.

[0046] For example, during a meeting, when attendee A performs a marking operation on page 8 of the PPT and selects the anchored layer mode, clicks on the picture of the transformer radiator and draws a red line for defect marking. The key of the anchored layer mode is that it binds the annotation information to the relative position of the document element, rather than relying on the absolute screen coordinates. In this way, the annotation can closely follow the associated document element. No matter how the document is operated, as long as the element position changes, the annotation will be adjusted synchronously. When attendee B scrolls the PPT to page 12, it can be automatically detected that the element coordinates of page 8 are no longer within the current viewport. At this time, in order to optimize memory usage, the sub-layers of page 8 can be automatically unloaded. This is because when the content of page 8 cannot be seen in the current viewport, continuing to retain the sub-layers of this page will occupy unnecessary memory resources. Through the unloading operation, the memory can be released to support other operations that require more resources. When the meeting process flips back to page 8, the annotations made on this page before can be quickly located based on the previously bound element coordinates. At the same time, the previously unloaded sub-layer fragments are dynamically loaded, and the annotations are redisplayed in the correct positions, ensuring the accurate correspondence between the annotations and the target content, greatly improving the stability and reliability of document annotations in complex operation scenarios.

[0047] Based on the above embodiments, the specific implementation manner of step S2 can be: S21, Bind the anchored layer to the element coordinates of the corresponding document element, and obtain the annotation data drawn by the business terminal on this document element.

[0048] Specifically, the retrieved anchored layer can be bound to the element coordinates of the document element being annotated. And when the staff uses the business terminal to perform an annotation operation on the document element, the business terminal can record the corresponding annotation data, including the content of the annotation such as the line marking, the style of the annotation such as the color, the line thickness, etc., and the relative position of the annotation in the document, etc.

[0049] S22, Obtain the visible area of the annotation data containing associated attributes and / or the visible area of the annotation data containing single attributes.

[0050] Among them, the associated attribute refers to the annotation attribute with a certain internal connection or common feature, the visible area refers to the partial area in the user window that can display the annotation data, and the single attribute refers to the attribute of the document element corresponding to only a single annotation.

[0051] During the actual annotation process, multiple annotations may be drawn on the same document element, or only one annotation may be drawn. In order to process and display the annotation information more efficiently, when intercepting the visible area, different interception methods can be used according to different attributes.

[0052] Specifically, the visible area of the annotation data with different attributes can be determined first. The annotation data corresponding to the document element can be analyzed to determine whether it belongs to the associated attribute or the single attribute. For the annotation data with the associated attribute, the positions and ranges of all relevant annotations can be comprehensively considered to generate a maximum visible area that can contain these annotation data. The visible area can ensure that all associated annotations can be completely displayed in the window for convenient viewing. For the annotation data with the single attribute, the independent visible area can be determined according to the specific position and size of the annotation. This area only needs to just accommodate the single annotation to avoid including too much irrelevant information.

[0053] In some embodiments, step S22 includes S221 to S223, which are specifically as follows: S221, determine that multiple annotation data corresponding to the same document element are associated attributes, generate a rectangular outer frame for all document elements with the associated attributes, and determine the area within the rectangular outer frame as the visible area.

[0054] Specifically, the annotation data corresponding to the same document element can be analyzed. In an electrical document, a document element may have multiple pieces of annotation data, and these annotations may be for different aspects of content. When there are multiple such pieces of annotation data, the multiple annotation data corresponding to the same document element can be determined to have associated attributes, and a rectangular outer frame corresponding to all document elements with the associated attributes can be generated. When generating the rectangular outer frame, the leftmost, rightmost, topmost, and bottommost boundary points of the document element in the two-dimensional coordinate system can be obtained, and then a rectangular outer frame that can just contain all relevant document elements can be drawn based on these boundary points. This rectangular outer frame can cover all document elements with the associated attributes and their annotation data, and the area within the rectangular outer frame is determined as the visible area.

[0055] S222, and / or, determine that a single annotation data corresponding to the same document element is a single attribute, and extract the outer contour of the annotation data.

[0056] When there is only one annotation data corresponding to the same document element, the annotation data can be recognized as having a single attribute. For the annotation data with a single attribute, its outer contour can be extracted. For example, for an annotation marked with a red circle, the key points on the circumference of the circle can be found, so as to extract the circular outer contour of the annotation data.

[0057] S223, expand and adjust the outer contour according to a preset magnification ratio to obtain an offset contour, align the center points of the offset contour and the outer contour, and determine the area within the offset contour as the visible area.

[0058] Specifically, the outer contour can be expanded and adjusted according to a preset magnification ratio. The preset magnification ratio is a fixed value determined according to actual requirements and system design. For example, 1.2 times. By magnifying the outer contour according to the preset magnification ratio, a larger contour, that is, the offset contour, can be obtained. After obtaining the offset contour, the center points of the offset contour and the outer contour can be aligned. In this way, it can be ensured that the expanded offset contour expands evenly around the original outer contour without offset or misalignment. The area within the offset contour is determined as the visible area.

[0059] S23, intercept the visible area to obtain a sub-layer segment, and bind the sub-layer segment and the element coordinates of the corresponding document element.

[0060] Specifically, considering that the anchored layer may be large, in order to reduce the data processing volume, a sub-layer segment containing the visible area of the annotation data can be intercepted from the anchored layer. By intercepting the sub-layer segment and only processing the part related to the annotation data, the processing efficiency can be improved. The intercepted sub-layer segment is bound to the element coordinates of the corresponding document element. In this way, a close connection is established between the sub-layer segment and the document element. When the document element moves, the sub-layer segment will also move accordingly. Among them, the sub-layer segment refers to.

[0061] S24, automatically update the annotation coordinates of the sub-layer segment according to the viewport scroll offset corresponding to the element coordinates.

[0062] According to the obtained viewport scroll offset, the annotation coordinates of the sub-layer segment can be automatically updated. If the viewport scrolls horizontally, the horizontal coordinates of the annotation data can be adjusted accordingly according to the horizontal scroll offset. If the viewport scrolls vertically, the vertical coordinates of the annotation data can be adjusted according to the vertical scroll offset. For example, when the viewport scrolls down a certain distance, the vertical coordinates of the annotations in the sub-layer segment will increase accordingly to ensure that the relative position of the annotations and the document elements in the viewport remains unchanged, and the annotations move synchronously with the movement of the document elements. Through this automatic update mechanism, it can be ensured that the annotation data always accurately corresponds to the corresponding document elements during the document scrolling process, avoiding the situation of annotation misalignment or loss.

[0063] Through the above embodiments, it can be ensured that the annotation data always accurately corresponds to the corresponding document elements during the document scrolling process, avoiding the situation of annotation misalignment or loss.

[0064] In some embodiments, during the process of automatically updating the annotation coordinates of the sub-layer segment along with the movement of the element coordinates, it further includes: A1. Statistically calculate the difference in the number of pixels of the document element at adjacent moments during the movement.

[0065] During the operation of the document, in addition to window scrolling, the document elements may also be scaled. To ensure that the annotations can maintain a good correspondence with the scaled document elements, during the process of automatically updating the annotation coordinates of the sub-layer segment along with the movement of the element coordinates, the area of the sub-layer segment where the annotation is located can be adjusted accordingly.

[0066] Specifically, during the movement of the document element, the number of pixels occupied by the document element can be statistically calculated at two adjacent moments respectively, and the difference in the number of pixels of the document element at these two moments is calculated to obtain the pixel number difference. The pixel number difference can reflect the change in the number of pixels of the document element during this period, which may be caused by a scaling operation. Among them, the pixel number difference refers to the difference in the number of pixels corresponding to the document element between adjacent moments.

[0067] A2. When the pixel number difference is greater than or equal to the area threshold, obtain the scaling ratio according to the ratio of the number of pixels of the document element at the latter moment to the number of pixels at the former moment.

[0068] Specifically, an area threshold can be preset in advance. This threshold is used to determine whether the change in the number of pixels of the document element has reached the level that requires scaling adjustment. When the calculated pixel number difference is greater than or equal to the area threshold, it indicates that the document element has undergone a relatively obvious scaling. According to the ratio of the number of pixels of the document element at the latter moment to the number of pixels at the former moment, the scaling ratio can be obtained. If the scaling ratio is greater than 1, it means that the document element has been enlarged. If the scaling ratio is less than 1, it means that the document element has been reduced. If the scaling ratio is equal to 1, it means that the document element has not been scaled. Among them, the area threshold refers to the maximum value that can be used to determine whether the change in the number of pixels of the document element is significant enough to require scaling adjustment, and the scaling ratio refers to the ratio obtained by comparing the number of pixels of the document element at the latter moment with the number of pixels at the former moment.

[0069] A3. Obtain the adjusted area according to the product of the number of pixels of the sub-layer segment and the scaling ratio, and update the area of the sub-layer segment to the adjusted area.

[0070] Specifically, the sub-layer segment is the area containing the annotation data. The number of pixels occupied by the sub-layer segment can be obtained, and this number of pixels can reflect the current size of the sub-layer segment. Since the document element has been scaled, to ensure that the ratio between the annotation and the document element remains unchanged, the sub-layer segment also needs to be adjusted according to the same scaling ratio. By multiplying the scaling ratio by the number of pixels of the sub-layer segment, the adjusted area can be obtained. The size of the sub-layer segment is re-adjusted according to the new adjusted area to make it match the scaled document element.

[0071] Through the above implementation, it can be ensured that the annotation data matches the scaled document element.

[0072] S3. Obtain the time difference between the document annotation and the interaction operation, and adjust the sub-layer segment according to the interaction parameter and the time difference so that the characteristic offset between the sub-layer segment and the target element meets the preset error threshold.

[0073] Among them, the document annotation refers to the annotation data drawn in the power document. The interaction operations include scrolling operations and zooming operations on the power document. The time difference refers to the time interval from the start of an interaction operation such as scrolling or zooming the power document to the actual rendering and display of the document annotation in the power document. The interaction parameters include the scrolling rate and the zooming ratio. The target element refers to the document element corresponding to the sub-layer segment. The characteristic offset refers to the deviation between the annotation position and the actual position of the target element. The preset error threshold refers to the maximum deviation allowed between the annotation position and the target element position. If the characteristic offset exceeds this threshold, the sub-layer segment needs to be adjusted to ensure the precise correspondence between the annotation and the document content.

[0074] In the multi-terminal interaction scenario of a power business meeting, there may be multiple business terminals performing corresponding interaction operations on the power document. For example, there may be a main business terminal and a slave business terminal. When the main business terminal performs a scrolling operation or a zooming operation on the document, the slave business terminal may draw annotations simultaneously. Due to factors such as the processing speed and network latency between multiple terminals, there may be a time difference between the document annotation and the interaction operation. This time difference may cause the annotation to be misaligned with the target element, and the annotation ultimately deviates from the user's intention. For example, when making a mark during the scrolling process, the layer may not follow the scrolling in time, resulting in a misaligned mark. When making a mark during the zooming process, the layer is not adjusted in time, resulting in the mark not corresponding to the target element. To solve this problem, it is necessary to obtain the time difference between the document annotation and the interaction operation, and adjust the sub-layer segment according to the interaction parameter and the time difference to ensure that the characteristic offset between the annotation and the target element meets the preset error threshold, and achieve the precise correspondence between the annotation and the document content.

[0075] Based on the above embodiments, the specific implementation manner of step S3 can be: S31. Determine the rendering time of the document annotation and the first trigger time of the scrolling operation, and obtain the first time difference by subtracting the first trigger time from the rendering time.

[0076] Specifically, when the business terminal completes the annotation drawing of the document element, it can accurately record the time when the annotation data is actually rendered and displayed in the power document, that is, the rendering time. This time marks the actual appearance of the annotation in front of the user and is an important basis for subsequent calculation of the time difference. When another business terminal initiates a scrolling operation on the power document, it can immediately capture and record the instant when the operation starts, that is, the first trigger time. Subtract the first trigger time of the scrolling operation from the rendering time of the document annotation, and the obtained difference is the first time difference. This time difference reflects the time interval from the start of the scrolling operation to the completion of the annotation rendering and is a key factor for subsequent judgment of whether the annotation position needs to be adjusted. For example, if the annotation rendering time is 10:15:30 and the first trigger time of the scrolling operation is 10:15:25, then the first time difference is 5 seconds.

[0077] Among them, the rendering time refers to the time when the annotation data is actually displayed in the power document, the first trigger time refers to the time when the scrolling operation on the power document starts, and the first time difference refers to the time interval from the start of the scrolling operation to the completion of the annotation rendering.

[0078] S32. Determine the position offset of the sub-layer segment and the target element according to the scrolling speed and the first time difference. When the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, adjust the current annotation coordinates of the sub-layer segment according to the position offset.

[0079] Specifically, the scrolling speed during the scrolling operation of the business terminal can be monitored in real time. The scrolling speed represents the distance that the document scrolls per unit time, for example, scrolling 80 pixels per second. Combining the first time difference, multiplying the first time difference by the scrolling speed can obtain the position offset of the sub-layer segment and the target element. The preset error threshold corresponding to the preset scrolling operation can be obtained. This threshold is the maximum position deviation allowed between the annotation and the target element. Compare the calculated position offset with the preset error threshold. If the position offset is greater than or equal to the preset error threshold, it means that the position deviation between the annotation and the target element exceeds the acceptable range. At this time, the current annotation coordinates of the sub-layer segment need to be adjusted according to the position offset. For example, when the business terminal scrolls the document downward and the position offset is 400 pixels and the preset error threshold is 300 pixels, then the vertical coordinate of the annotation in the sub-layer segment can be increased by 400 pixels to realign the annotation with the target element.

[0080] Among them, the position offset refers to the moving distance of the sub-layer segment relative to its original position in the viewport due to the scrolling operation.

[0081] In some embodiments, "when the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, adjusting the current annotation coordinates of the sub-layer segment according to the position offset" in step S32 includes the following steps: S321, when the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, determine the direction opposite to the scrolling direction as the calibration direction, and determine the arithmetic property corresponding to the calibration direction, where the arithmetic property includes an increasing property and a decreasing property.

[0082] Specifically, when the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, a calibration operation is required. First, the direction opposite to the scrolling direction can be determined as the calibration direction. Since the scrolling operation causes a position deviation between the target element and the annotation data, in order to eliminate this deviation, an adjustment needs to be made in the opposite direction. Refer to Figure 2 , which is a schematic diagram of a calibration direction provided by an embodiment of the present invention. For example Figure 2 as shown in the left figure of, if the scrolling direction of the power document is downward scrolling, visually, the target element in the power document will move upward relatively. When the annotation data corresponding to the target element is an underline, the position of the annotation data deviates downward relative to the target element. In order to realign the annotation data with the target element, the calibration direction for calibrating the corresponding annotation data can be the upward direction, as Figure 2 shown in the right figure of. If the scrolling direction of the power document is rightward scrolling, the target element in the power document will move leftward, and the position of the annotation deviates rightward relative to the target element. Then, the calibration direction for calibrating the corresponding annotation can be the leftward direction.

[0083] Generally, in a two-dimensional coordinate system, the direction of the x-axis is generally from left to right, and the direction of the y-axis is generally from bottom to top. In practical applications, moving upward means moving in the positive direction of the y-axis, that is, increasing the vertical coordinate value of the annotation. Therefore, when the calibration direction is upward, the corresponding arithmetic property is the increasing property. Moving downward is moving in the negative direction of the y-axis, and the vertical coordinate value of the annotation needs to be decreased. Therefore, when the calibration direction is downward, the corresponding arithmetic property is the decreasing property. Moving leftward is moving in the negative direction of the x-axis, and the horizontal coordinate value of the annotation needs to be decreased. Therefore, when the calibration direction is leftward, the corresponding arithmetic property is the decreasing property. Moving rightward is moving in the positive direction of the x-axis, and the horizontal coordinate value of the annotation needs to be increased. Therefore, when the calibration direction is rightward, the corresponding arithmetic property is the increasing property.

[0084] Among them, the calibration direction refers to the direction when calibrating the annotation data corresponding to the document element, the operation attribute refers to the corresponding attribute when calculating the position coordinates of the annotation according to the calibration direction, the increase attribute refers to the corresponding attribute when increasing the coordinate value, and the decrease attribute refers to the corresponding attribute when decreasing the coordinate value.

[0085] S322. Obtain the coordinate value corresponding to the calibration direction, and add or subtract the position offset from this coordinate value according to the operation attribute to obtain the annotation coordinate corresponding to the adjusted sub-layer segment.

[0086] Specifically, the coordinate value corresponding to the calibration direction can be obtained. If the calibration direction is upward or downward, the vertical coordinate value of the annotation is obtained. If the calibration direction is leftward or rightward, the horizontal coordinate value of the annotation is obtained. Perform corresponding operations on this coordinate value according to the determined operation attribute. If the operation attribute is the increase attribute, add the position offset to the coordinate value. If the operation attribute is the decrease attribute, subtract the position offset from the coordinate value. After such an operation, the result obtained is the annotation coordinate corresponding to the adjusted sub-layer segment.

[0087] After adjusting the current annotation coordinate of the sub-layer segment according to the position offset, it further includes: B1. Generate a calibration axis including nodes corresponding to each first time difference, and the distance between adjacent nodes in this calibration axis is obtained by the product of its corresponding time interval difference and the unit length.

[0088] In the multi-terminal interaction scenario of the power business meeting, after adjusting the current annotation coordinate of the sub-layer segment according to the position offset, in order to more efficiently and accurately handle the subsequent possible time difference problems between document annotation and scrolling operations, a prediction mechanism can be constructed. This solution can generate a calibration axis, calculate the unit increment, determine the prediction node and its prediction offset, so that when the subsequent situation with a time difference equal to that of the prediction node occurs, the corresponding prediction offset can be quickly obtained for annotation coordinate adjustment, reducing repeated calculations and improving the efficiency and accuracy of annotation calibration.

[0089] Specifically, during the process of adjusting the annotation coordinates, the first time differences between each document annotation and scrolling operation have been recorded. These first time differences can reflect the time intervals between the two in different situations and are the basic data for constructing the calibration axis. Each first time difference is corresponding to a node on the calibration axis. The calibration axis is a number axis used to intuitively display the relationship between the time difference and the offset. The position of each node on the axis is determined by its corresponding first time difference. For two adjacent nodes on the calibration axis, the distance between them is determined by the product of the time interval difference corresponding to them and the unit length. The unit length is a preset fixed value used to unify the distance measurement on the calibration axis. In this way, the distribution of nodes on the calibration axis can accurately reflect the relative relationship between different first time differences. Among them, the calibration axis refers to a number axis used to intuitively display the relationship between the time difference and the offset, and the time interval difference refers to the difference between the first time differences corresponding to adjacent nodes on the calibration axis.

[0090] B2. Obtain the unit increment according to the ratio of the offset difference and the distance between adjacent nodes. Taking the node with a smaller value as the reference, determine multiple prediction nodes at intervals of the unit length in sequence.

[0091] Specifically, for two adjacent nodes on the calibration axis, the corresponding position offsets can be obtained. By calculating the difference between the position offsets corresponding to the adjacent nodes, the offset difference can be obtained. By calculating the ratio of the offset difference to the distance between the adjacent nodes, the unit increment can be obtained. Select the node with a smaller first time difference value on the calibration axis as the reference node. This reference node is the starting point for determining the subsequent prediction nodes. Starting from the reference node, determine multiple prediction nodes at intervals of the unit length along the calibration axis. See Figure 3 , which is a schematic diagram of a calibration axis provided by an embodiment of the present invention. As shown in Figure 3 , the position offset corresponding to node 1 and the position offset corresponding to node 2 can be obtained. By calculating the difference between the position offsets corresponding to the two nodes, the offset difference can be obtained, and the distance between node 1 and node 2 can be obtained. According to the ratio of the offset difference to the distance, the unit increment can be obtained. When the first time difference value corresponding to node 1 is smaller, node 1 can be used as the reference. At intervals of the unit length, prediction node 1 can be determined. Then, taking prediction node 1 as the reference and at intervals of the unit length, prediction node 2 can be determined, and so on. Multiple prediction nodes can be determined. These prediction nodes are the positions predicted based on the unit length and the unit increment on the basis of the existing data and are used to estimate the position offset corresponding to the time difference that may occur in the future.

[0092] B3. Taking the position offset corresponding to the node with a smaller value as the reference, sequentially add the unit increment to obtain the predicted offsets corresponding to each prediction node.

[0093] Specifically, the position offset corresponding to the node with a smaller first time difference value can be used as the reference offset. For example, Figure 3 as shown in, for prediction node 1, adding the unit increment to the position offset corresponding to node 1 can obtain the prediction offset corresponding to prediction node 1. For prediction node 2, adding the unit increment to the prediction offset corresponding to prediction node 2 can obtain the prediction offset corresponding to prediction node 2. Among them, the prediction offset refers to the position offset corresponding to each prediction node predicted according to the unit increment.

[0094] B4. When the time difference corresponding to a prediction node is equal to the time difference between the next document annotation and the scrolling operation, the prediction offset corresponding to the prediction node is used as the position offset for the next annotation coordinate adjustment.

[0095] During the subsequent document annotation and scrolling operations, the time difference between the two can be monitored in real time. At the same time, the monitored time difference is compared one by one with the time differences corresponding to each prediction node on the calibration axis. If it is found that the time difference corresponding to a certain prediction node is equal to the currently monitored time difference, it means that the previously predicted result can be utilized. At this time, the prediction offset corresponding to this prediction node is used as the position offset for the next annotation coordinate adjustment. In this way, without re - performing complex calculations, the pre - predicted offset is directly used for annotation coordinate adjustment, greatly improving the efficiency and response speed of annotation calibration, and ensuring that the annotation can be aligned with the target element in a timely and accurate manner.

[0096] S33, or, determine the second trigger moment of the zoom operation, and obtain the second time difference by subtracting the second trigger moment from the rendering moment.

[0097] Specifically, if there is a zoom operation on the power document by the business terminal, the moment when the zoom operation starts, that is, the second trigger moment, can be recorded. Subtracting the second trigger moment of the zoom operation from the rendering moment of the document annotation, the obtained difference is the second time difference. This time difference can reflect the time interval from the start of the zoom operation to the completion of annotation rendering, which is crucial for subsequent analysis of the impact of zooming on the position and size of the annotation. For example, if the annotation rendering moment is 10:20:40 and the second trigger moment of the zoom operation is 10:20:35, then the second time difference is 5 seconds. Among them, the second trigger moment refers to the starting time point when the business terminal user performs a zoom operation on the power document, and the second time difference refers to the time interval from the second trigger moment of the zoom operation to the document annotation rendering completion moment.

[0098] S34, determine the zoom offset of the sub - layer segment and the target element according to the second time difference. When the zoom offset is greater than or equal to the preset error threshold corresponding to the zoom operation, adjust the area of the sub - layer segment based on the zoom offset.

[0099] Among them, the interaction operations include a scrolling operation and a zooming operation, the interaction parameters include a scrolling rate and a zoom ratio, and the feature offset includes a position offset and a zoom offset.

[0100] Specifically, according to the second time difference, the zoom offset corresponding to the sub-layer segment and the target element can be determined. After obtaining the zoom offset, the preset error threshold corresponding to the preset zoom operation can be retrieved. This threshold is the maximum zoom deviation allowed between the annotation and the target element. Compare the calculated zoom offset with the preset error threshold. If the zoom offset is greater than or equal to the preset error threshold, it indicates that the zoom deviation between the annotation and the target element exceeds the acceptable range. At this time, the area of the sub-layer segment needs to be adjusted according to the zoom offset. For example, if the zoom offset indicates that the target element is enlarged by 1.61 times and the preset error threshold is 1.5 times, then multiply the area of the sub-layer segment by 1.61 times to ensure that the proportional relationship between the annotation and the target element after zooming remains consistent. Among them, the zoom offset refers to the change amount of the sub-layer segment and the target element relative to the original ratio after the zoom operation.

[0101] In some embodiments, the specific implementation manner of step S34 may be: S341, Determine the zoom offset of the sub-layer segment and the target element based on the ratio of the number of pixels of the target element at the end moment and the initial moment of the second time difference.

[0102] Specifically, the number of pixels occupied by the target element at the initial moment and the end moment of the second time difference can be recorded respectively. The initial moment is the instant when the zoom operation starts to be triggered, and the end moment is the moment when the document annotation rendering is completed. By calculating the ratio of the number of pixels of the target element at the end moment and the initial moment, the zoom offset of the sub-layer segment and the target element can be obtained. If the zoom offset is greater than 1, it can indicate that the target element is enlarged. If the zoom offset is less than 1, it can indicate that the target element is reduced.

[0103] Among them, the end moment refers to the moment when the document annotation rendering is completed, and the initial moment refers to the moment when the zoom operation starts to be triggered.

[0104] S342, When the zoom offset is greater than or equal to the preset error threshold corresponding to the zoom operation, obtain the zoom area according to the product of the zoom offset and the number of pixels of the sub-layer segment, and update the area of the sub-layer segment to the zoom area.

[0105] Specifically, compare the calculated scaling offset with the preset error threshold corresponding to the preset scaling operation. If the scaling offset is greater than or equal to the preset error threshold corresponding to the scaling operation, it indicates that the scaling deviation between the annotation and the target element exceeds the acceptable range, and the area of the sub-layer segment needs to be adjusted. The number of pixels corresponding to the sub-layer segment can be obtained, and by multiplying the scaling offset by the number of pixels corresponding to the sub-layer segment, the corresponding scaling area can be obtained. Update the area of the sub-layer segment to the scaling area, so as to ensure that the proportional relationship between the annotation and the target element after scaling remains consistent and ensure the accuracy of the annotation information. Among them, the scaling area refers to the area adjusted for the sub-layer segment according to the scaling offset.

[0106] Through the above implementation manner, it can be ensured that the feature offset between the annotation and the target element meets the preset error threshold, and the accurate correspondence between the annotation and the document content is realized.

[0107] S4. Associate the identity information and annotation timestamp of each business terminal with the process node, and generate collaborative monitoring data to be stored in the database.

[0108] Among them, the identity information refers to the information of the power department staff participating in the meeting. The annotation timestamp accurately records the specific time when the participant annotates the document in the power document processing process. The process node refers to the key stage in the power document processing process, such as the start of the meeting, different topic discussion sessions, and the passing of the final resolution, etc. The collaborative monitoring data refers to the data recording the process of the power department staff participating in the meeting annotating the power document, including information on personnel identity, annotation content, annotation time, and the relationship with the meeting process and other important aspects.

[0109] In practical applications, each business terminal corresponds to a power department staff member participating in the meeting. Its identity information can be the employee number, name, department, etc. The annotation timestamp accurately records the specific time of the annotation. By associating this information with each node in the power document processing process, collaborative monitoring data including personnel identity, annotation content, annotation time, and the relationship with the meeting process can be generated, and the collaborative monitoring data can be stored in the database. When reviewing the meeting process later, simply by performing a query operation and inputting key information such as the personnel name or the meeting process node, it is possible to quickly locate the operations and annotations of a certain person on the document at a specific stage of the meeting, which is convenient for reviewing the meeting content and decision-making process, and provides strong data support for the optimization of the power business process and problem troubleshooting.

[0110] See Figure 4 , which is a schematic structural diagram of a power business process monitoring device based on multi-terminal interconnection provided by an embodiment of the present invention. The data processing system of the power business process monitoring device based on multi-terminal interconnection includes: An extraction module, configured to extract the element coordinates in the power document based on the interaction requests of each business terminal, and dynamically update the element coordinates according to the window scroll offset; An update module, configured to bind the anchor layer to the element coordinates, intercept the sub-layer segment containing the annotation data in the anchor layer, and automatically update the annotation coordinates of the sub-layer segment as the element coordinates move; An adjustment module, configured to obtain the time difference between the document annotation and the interaction operation, and adjust the sub-layer segment according to the interaction parameter and the time difference, so that the characteristic offset from the target element meets the preset error threshold; A generation module, configured to associate the identity information and annotation timestamps of each business terminal with the process nodes, and generate collaborative monitoring data for storage in the database.

[0111] Figure 4 The device in the illustrated embodiment can correspondingly be used to execute Figure 1 the steps in the illustrated method embodiment, and its implementation principle and technical effects are similar, which will not be elaborated here.

[0112] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for monitoring electric power business processes based on multi-terminal interconnection, characterized in that: include: Extract element coordinates in the power document based on the interactive requests of each business terminal, and dynamically update the element coordinates according to the window scroll offset; Bind the anchor layer to the element coordinates, intercept the sub-layer fragment containing the annotation data in the anchor layer, and automatically update the annotation coordinates of the sub-layer fragment as the element coordinates move; Obtain the time difference between document annotation and interactive operation, and adjust the sub-layer fragment according to the interactive parameter and the time difference so that the feature offset between the sub-layer fragment and the target element meets the preset error threshold; The identity information and annotation timestamp of each business terminal are associated with the process node to generate collaborative monitoring data and store it in the database.

2. The method according to claim 1, characterized in that: Extract element coordinates in the power document based on the interactive requests of each business terminal, and dynamically update the element coordinates according to the window scroll offset, including: Traverse the document elements in the power document, determine the center point of the power document as the coordinate origin, and obtain the element coordinates of each document element; Generate a unique identifier for each document element according to the document page number and the initial element coordinates, and associate each document element with its corresponding unique identifier; Get the window scroll offset in real time to get the horizontal scroll offset and the vertical scroll offset; The horizontal coordinate value in the element coordinates is updated according to the horizontal scroll offset, and the vertical coordinate value in the element coordinates is updated according to the vertical scroll offset.

3. The method according to claim 1, characterized in that Bind the anchor layer to the element coordinates, intercept the sub-layer fragment containing the annotation data in the anchor layer, and automatically update the annotation coordinates of the sub-layer fragment as the element coordinates move, including: Bind the anchor layer to the element coordinates of the corresponding document element, and obtain the annotation data drawn by the business terminal on the document element; Obtaining a visible area of ​​annotation data containing associated attributes and / or a visible area of ​​annotation data containing a single attribute; Cut the visible area to get the sublayer fragment, and bind the sublayer fragment to the element coordinates of the corresponding document element; Automatically update the annotation coordinates of the sublayer fragment according to the viewport scroll offset corresponding to the element coordinates.

4. The method according to claim 3, characterized in that: Gets the visible area of ​​annotation data containing associated attributes and / or the visible area of ​​annotation data containing a single attribute, including: Determine that multiple annotation data corresponding to the same document element are associated attributes, generate a rectangular frame of all document elements containing the associated attributes, and determine the area within the rectangular frame as a visible area; and / or, Determine that the single annotation data corresponding to the same document element is a single attribute, and extract the outer contour of the annotation data; The outer contour is enlarged and adjusted according to a preset magnification ratio to obtain an offset contour, the center points of the offset contour and the outer contour are aligned, and the area within the offset contour is determined to be a visible area.

5. The method according to claim 3, characterized in that: In the process of automatically updating the annotation coordinates of the sublayer fragment as the element coordinates move, it also includes: Count the difference in the number of pixels of document elements at adjacent moments during the movement process; When the pixel number difference is greater than or equal to the area threshold, the zoom ratio is obtained according to the ratio of the pixel number of the document element at the next moment to the pixel number of the previous moment; The adjusted area is obtained according to the product of the number of pixels of the sub-layer fragment and the scaling ratio, and the area of ​​the sub-layer fragment is updated to the adjusted area.

6. The method according to claim 1, characterized in that Obtain the time difference between document annotation and interactive operation, and adjust the sublayer fragment according to the interactive parameters and the time difference so that the feature offset between it and the target element meets the preset error threshold, including: Determine the rendering time of the document annotation and the first triggering time of the scrolling operation, and obtain a first time difference by subtracting the first triggering time from the rendering time; Determine the position offset between the sub-layer segment and the target element according to the scrolling rate and the first time difference, and when the position offset is greater than or equal to a preset error threshold corresponding to the scrolling operation, adjust the current annotation coordinates of the sub-layer segment according to the position offset; or, Determine a second triggering time of the zoom operation, and obtain a second time difference by subtracting the second triggering time from the rendering time; Determine a scaling offset between the sub-layer segment and the target element according to the second time difference, and when the scaling offset is greater than or equal to a preset error threshold corresponding to the scaling operation, adjust the area of ​​the sub-layer segment based on the scaling offset; The interactive operation includes a scrolling operation and a zooming operation, the interactive parameters include a scrolling rate and a zooming ratio, and the feature offset includes a position offset and a zooming offset.

7. The method according to claim 6, characterized in that When the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, the current annotation coordinates of the sub-layer fragment are adjusted according to the position offset, including: When the position offset is greater than or equal to a preset error threshold corresponding to the scrolling operation, determining a direction opposite to the scrolling direction as a calibration direction, and determining an operation attribute corresponding to the calibration direction, the operation attribute including an increase attribute and a decrease attribute; Get the coordinate value corresponding to the calibration direction, and add or subtract the position offset from the coordinate value according to the operation attribute to obtain the annotation coordinates corresponding to the adjusted sub-layer fragment.

8. The method according to claim 6, characterized in that Determining a scaling offset between the sub-layer segment and the target element according to the second time difference, and when the scaling offset is greater than or equal to a preset error threshold corresponding to the scaling operation, adjusting the area of ​​the sub-layer segment based on the scaling offset, including: Determine a scaling offset between the sublayer fragment and the target element based on a ratio of the number of pixels of the target element at the end time and the initial time of the second time difference; When the scaling offset is greater than or equal to a preset error threshold corresponding to the scaling operation, the scaling area is obtained according to the product of the scaling offset and the number of pixels of the sub-layer fragment, and the area of ​​the sub-layer fragment is updated to the scaling area.

9. The method according to claim 6, characterized in that After adjusting the current annotation coordinates of the sublayer fragment according to the position offset, it also includes: Generate a calibration axis including nodes corresponding to each first time difference, wherein the distance between adjacent nodes in the calibration axis is obtained by multiplying the corresponding time interval difference and the unit length; The unit increment is obtained according to the ratio of the offset difference and the distance of the adjacent nodes, and multiple prediction nodes are determined in sequence with the node with the smallest value as the benchmark and the unit length interval; Taking the position offset corresponding to the node with a small value as the benchmark, add the unit increment in sequence to obtain the predicted offset corresponding to each predicted node; When there is a time difference corresponding to a predicted node that is equal to the time difference between the next document annotation and scrolling operation, the predicted offset corresponding to the predicted node is used as the position offset for the next annotation coordinate adjustment.

10. A power business process monitoring device based on multi-terminal interconnection, characterized in that: include: An extraction module, used to extract element coordinates in the power document based on the interactive request of each business terminal, and dynamically update the element coordinates according to the window scroll offset; An update module is used to bind the anchor layer to the element coordinates, intercept the sub-layer fragment containing the annotation data in the anchor layer, and automatically update the annotation coordinates of the sub-layer fragment as the element coordinates move; An adjustment module is used to obtain the time difference between the document annotation and the interactive operation, and adjust the sub-layer fragment according to the interactive parameter and the time difference so that the feature offset between the sub-layer fragment and the target element meets the preset error threshold; The generation module is used to associate the identity information and annotation timestamp of each business terminal with the process node, and generate collaborative monitoring data to be stored in the database.

Images