Power business process monitoring method and device based on multi-terminal interconnection

Abstract

The present invention provides a method and device for monitoring power service processes based on multi-terminal interconnection, relating to multi-terminal interconnection technology. The method includes: extracting the element coordinates in a power document based on the interaction requests of each service terminal, dynamically updating the element coordinates according to the viewport scrolling offset, binding an anchored layer to the element coordinates, intercepting a sub-layer segment containing annotation data in the anchored layer, and automatically updating the annotation coordinates of the sub-layer segment as the element coordinates move. Obtaining the time difference between the document annotation and the interaction operation, adjusting the sub-layer segment according to the interaction parameters and the time difference so that the characteristic offset from the target element meets a preset error threshold, associating the identity information and annotation timestamps of each service terminal with the process nodes, and generating collaborative monitoring data to be stored in a database, thereby enabling real-time collaborative interaction of power data among multiple service terminals.

Description

Technical Field

[0001] The present invention relates to multi - terminal interconnection technology, and particularly to a power service process monitoring method and device based on multi - terminal interconnection. Background Art

[0002] In a power service meeting, the collaborative interaction of power data is an important link. In the prior art, when carrying out collaborative interaction on power data, it is often impossible to achieve collaborative interaction of power data among multiple service terminals. Usually, the person initiating the meeting stores the power data in the form of a file on a shared server, and the participants download the file to their respective corresponding service terminals for viewing, editing, or annotating and other interaction operations. After completing the operations, the participants need to manually upload the file back to the shared platform again. Only by downloading the updated file again can other people obtain the latest power data. However, this collaborative interaction method has many drawbacks. On the one hand, the repeated download and upload operations are not only time - consuming and laborious, but also prone to human errors, resulting in data version chaos. For example, if multiple participants modify and upload the file simultaneously, it is very likely that some modified contents will be overwritten, making it impossible for subsequent file - downloading personnel to obtain complete information. On the other hand, due to the lack of real - time synchronization, there is an obvious delay in information update, seriously affecting the timeliness of collaborative interaction and making it difficult to meet the requirements of quick decision - making and efficient communication in power service meetings.

[0003] Therefore, how to achieve real - time collaborative interaction of power data among multiple service terminals has become an urgent problem to be solved. Summary of the Invention

[0004] The present invention provides a power service process monitoring method and device based on multi - terminal interconnection, which can achieve real - time collaborative interaction of power data among multiple service terminals.

[0005] In the first aspect of the present invention, a power service process monitoring method based on multi - terminal interconnection is provided, including:

[0006] Extracting the element coordinates in a power document based on the interaction requests of each service terminal, and dynamically updating the element coordinates according to the viewport scroll offset;

[0007] Binding an anchor layer to the element coordinates, intercepting a sub - layer segment containing annotation data in the anchor layer, and automatically updating the annotation coordinates of the sub - layer segment as the element coordinates move;

[0008] Obtaining the time difference between document annotation and interaction operations, and adjusting the sub - layer segment according to the interaction parameters and the time difference so that the characteristic offset from the target element meets a preset error threshold;

[0009] Associate the identity information and annotation timestamps of each business terminal with the process nodes, generate collaborative monitoring data, and store it in the database.

[0010] Optionally, in a possible implementation manner of the first aspect, extract the element coordinates in the power document based on the interaction requests of each business terminal, and dynamically update the element coordinates according to the window scroll offset, including:

[0011] Traverse the document elements in the power document, determine the center point of the power document as the coordinate origin, and obtain the element coordinates of each document element;

[0012] Generate a unique identifier for each document element based on the document page number and the initial element coordinates, and associate each document element with its corresponding unique identifier;

[0013] Obtain the window scroll offset in real time to get the horizontal scroll offset and the vertical scroll offset;

[0014] Update the horizontal coordinate value in the element coordinates according to the horizontal scroll offset, and update the vertical coordinate value in the element coordinates according to the vertical scroll offset.

[0015] Optionally, in a possible implementation manner of the first aspect, bind the anchor layer to the element coordinates, intercept the sub-layer segment containing the annotation data in the anchor layer, and automatically update the annotation coordinates of the sub-layer segment as the element coordinates move, including:

[0016] Bind the anchor layer to the element coordinates of the corresponding document element, and obtain the annotation data drawn by the business terminal on this document element;

[0017] Obtain the visible area of the annotation data containing associated attributes and / or the visible area of the annotation data containing a single attribute;

[0018] Intercept the visible area to obtain the sub-layer segment, and bind the sub-layer segment and the element coordinates of the corresponding document element;

[0019] Automatically update the annotation coordinates of the sub-layer segment according to the window scroll offset corresponding to the element coordinates.

[0020] Optionally, in a possible implementation manner of the first aspect, obtain the visible area of the annotation data containing associated attributes and / or the visible area of the annotation data containing a single attribute, including:

[0021] Determine that multiple annotation data corresponding to the same document element are associated attributes, generate a rectangular outer frame for all document elements containing associated attributes, and determine the area within the rectangular outer frame as the visible area; and / or,

[0022] Determine that a single annotation data corresponding to the same document element is a single attribute, and extract the outer contour of the annotation data;

[0023] The outer contour is enlarged and adjusted according to a preset magnification ratio to obtain an offset contour, and the center points of the offset contour and the outer contour are aligned, and the area within the offset contour is determined as the visible area.

[0024] Optionally, in a possible implementation manner of the first aspect, in the process of automatically updating the annotation coordinates of the sub-layer segment as the element coordinates move, it further includes:

[0025] Statistical difference in the number of pixels of the document element at adjacent moments during the movement;

[0026] When the difference in the number of pixels is greater than or equal to the area threshold, a scaling ratio is obtained according to the ratio of the number of pixels of the document element at the latter moment to the number of pixels at the previous moment;

[0027] The adjusted area is obtained by multiplying the number of pixels of the sub-layer segment by the scaling ratio, and the area of the sub-layer segment is updated to the adjusted area.

[0028] Optionally, in a possible implementation manner of the first aspect, obtaining the time difference between the document annotation and the interaction operation, and adjusting the sub-layer segment according to the interaction parameter and the time difference so that the characteristic offset amount from the target element meets a preset error threshold, includes:

[0029] Determine the rendering moment of the document annotation and the first trigger moment of the scrolling operation, and obtain the first time difference by subtracting the first trigger moment from the rendering moment;

[0030] Determine the position offset amount between the sub-layer segment and the target element according to the scrolling rate and the first time difference. When the position offset amount is greater than or equal to the preset error threshold corresponding to the scrolling operation, adjust the current annotation coordinates of the sub-layer segment according to the position offset amount; or,

[0031] Determine the second trigger moment of the zoom operation, and obtain the second time difference by subtracting the second trigger moment from the rendering moment;

[0032] Determine the zoom offset amount between the sub-layer segment and the target element according to the second time difference. When the zoom offset amount is greater than or equal to the preset error threshold corresponding to the zoom operation, adjust the area of the sub-layer segment based on the zoom offset amount;

[0033] Wherein, the interaction operation includes a scrolling operation and a zoom operation, the interaction parameter includes a scrolling rate and a zoom ratio, and the characteristic offset amount includes a position offset amount and a zoom offset amount.

[0034] Optionally, in a possible implementation manner of the first aspect, when the position offset amount is greater than or equal to the preset error threshold corresponding to the scrolling operation, adjusting the current annotation coordinates of the sub-layer segment according to the position offset amount includes:

[0035] When the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, determine the direction opposite to the scrolling direction as the calibration direction, and determine the arithmetic property corresponding to the calibration direction, where the arithmetic property includes an increase property and a decrease property;

[0036] Obtain the coordinate value corresponding to the calibration direction, and add or subtract the position offset from the coordinate value according to the arithmetic property to obtain the annotation coordinate corresponding to the adjusted sub-layer segment.

[0037] Optionally, in a possible implementation manner of the first aspect, determine the scaling offset between the sub-layer segment and the target element according to the second time difference. When the scaling offset is greater than or equal to the preset error threshold corresponding to the scaling operation, perform area adjustment on the sub-layer segment based on the scaling offset, including:

[0038] Determine the scaling offset between the sub-layer segment and the target element based on the ratio of the number of pixels of the target element at the end moment and the initial moment of the second time difference;

[0039] When the scaling offset is greater than or equal to the preset error threshold corresponding to the scaling operation, obtain the scaling area by multiplying the scaling offset by the number of pixels of the sub-layer segment, and update the area of the sub-layer segment to the scaling area.

[0040] Optionally, in a possible implementation manner of the first aspect, after adjusting the current annotation coordinate of the sub-layer segment according to the position offset, it further includes:

[0041] Generate a calibration axis including nodes corresponding to each first time difference, where the distance between adjacent nodes in the calibration axis is obtained by multiplying the corresponding time interval difference by the unit length;

[0042] Obtain the unit increment according to the ratio of the offset difference between adjacent nodes to the distance, and sequentially determine multiple prediction nodes at intervals of the unit length with the node with a smaller value as the reference;

[0043] Taking the position offset corresponding to the node with a smaller value as the reference, sequentially add the unit increment to obtain the prediction offset corresponding to each prediction node;

[0044] When there is a time difference corresponding to a prediction node that is equal to the time difference between the next document annotation and the scrolling operation, use the prediction offset corresponding to the prediction node as the position offset for the next annotation coordinate adjustment.

[0045] In the second aspect of the present invention, a power service process monitoring device based on multi-terminal interconnection is provided, including:

[0046] An extraction module, configured to extract the element coordinates in the power document based on the interaction requests of each service terminal, and dynamically update the element coordinates according to the viewport scrolling offset;

[0047] An update module, configured to bind an anchored layer to an element coordinate, intercept a sub-layer segment containing annotation data in the anchored layer, and automatically update the annotation coordinates of the sub-layer segment as the element coordinate moves;

[0048] An adjustment module, configured to obtain the time difference between document annotation and interaction operations, and adjust the sub-layer segment according to the interaction parameters and the time difference, so that the characteristic offset from the target element meets a preset error threshold;

[0049] A generation module, configured to associate the identity information and annotation timestamps of each business terminal with process nodes, and generate collaborative monitoring data for storage in a database.

[0050] The beneficial effects of the present invention are as follows:

[0051] 1. This solution can implement the multi-terminal interaction function for power documents during a meeting, support multiple business terminals to perform annotation operations on the same document simultaneously, achieve efficient management of power services, and bind the annotation information to the corresponding business terminals. Through the binding mechanism, operation monitoring data of each business terminal during the meeting can be generated, which is convenient for subsequent quick backtracking and review.

[0052] 2. During the interaction process, the present invention can perform real-time dynamic scrolling or zooming adjustment on the annotation data according to different interaction operations of different business terminals on the document within the viewport, such as scrolling and zooming operations, etc., to ensure that the annotation information always remains consistent with the document content, and avoid problems such as annotation misalignment or loss caused by document changes.

[0053] 3. During the process of multiple people annotating simultaneously, the present invention can bind the anchored layer to the element coordinate corresponding to the document element, thereby solving the problem in the traditional solution that it cannot adapt to document scrolling and zooming, resulting in misalignment between the annotation and the target content. After binding the anchored layer to the element coordinate corresponding to the document element, a sub-layer segment containing annotation data can be intercepted from the anchored layer, and detailed information related to the annotation data can be accurately obtained, which can reduce unnecessary data processing volume and improve processing efficiency. When the position of the document element changes, the annotation coordinates of the sub-layer segment can be automatically updated to ensure that the annotation is always closely associated with the corresponding document element.

[0054] 4. During the multi-terminal interaction process, due to factors such as the processing speed and network latency between multiple terminals, there may be a time difference between document annotation and interaction operations. The present invention can obtain the time difference between document annotation and interaction operations, and update the corresponding annotation coordinates of the sub-layer segment according to the interaction parameters and the time difference when the business terminal performs interaction operations on the power document, so as to ensure that the characteristic offset of the annotation data from the target element meets the preset error threshold, and achieve accurate correspondence between the annotation and the document content.

[0055] 5. After updating the current annotation coordinates of the sub-layer segment, the present invention can generate a calibration axis, calculate the unit increment, determine the prediction nodes and their prediction offsets, so that when a situation with the same time difference as the prediction nodes occurs subsequently, the corresponding prediction offsets can be quickly obtained for adjusting the annotation coordinates, reducing repeated calculations, improving the efficiency and accuracy of annotation calibration, and thus more efficiently and accurately coping with the problem of time difference between subsequent possible document annotation and scrolling operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Figure 1 is a schematic flow chart of a power service process monitoring method based on multi-terminal interconnection provided by an embodiment of the present invention;

[0057] Figure 2 is a schematic diagram of a calibration direction provided by an embodiment of the present invention;

[0058] Figure 3 is a schematic diagram of a calibration axis provided by an embodiment of the present invention;

[0059] Figure 4 is a schematic structural diagram of a power service process monitoring device based on multi-terminal interconnection provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0060] To make the objectives, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0061] The technical solutions of the present invention will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0062] See Figure 1 , which is a schematic diagram of a power service process monitoring method based on multi-terminal interconnection provided by an embodiment of the present invention, Figure 1The execution entity of the method shown can be a software and / or hardware device. The execution entity of this application can include but is not limited to at least one of the following: user equipment, network equipment, etc. Among them, the user equipment can include but is not limited to computers, smart phones, personal digital assistants (Personal Digital Assistant, abbreviated as: PDA) and the electronic devices mentioned above, etc. The network equipment can include but is not limited to a single network server, a server group composed of multiple network servers, or a cloud composed of a large number of computers or network servers based on cloud computing. Among them, cloud computing is a type of distributed computing, which consists of a super virtual computer composed of a group of loosely coupled computers. This embodiment does not make any restrictions on this. It includes steps S1 to S4, specifically as follows:

[0063] S1, extract the element coordinates in the power document based on the interaction requests of each business terminal, and dynamically update the element coordinates according to the window scroll offset.

[0064] Among them, the business terminal refers to the terminal used by the staff of the power department. For example, it can be an office computer. The interaction request refers to the request of the staff of the business terminal to perform operations such as annotation, sliding, and zooming on the meeting document during the meeting. The power document refers to the document related to the power business. The element coordinates refer to the position coordinates of various elements in the power document, such as text blocks, icons, formulas, etc. on the document page. The window scroll offset refers to the distance that the document content displayed in the window moves when the staff scrolls the power document page.

[0065] This solution can realize the multi-terminal interaction function of the power document during the meeting, support multiple user terminals to perform annotation operations on the same document at the same time, realize the efficient management of the power business, and bind the annotation information to the corresponding user. Through the binding mechanism, the operation monitoring data of each user during the meeting can be generated, which is convenient for subsequent quick backtracking and review. And during the interaction process, this solution can perform real-time dynamic scrolling or zooming adjustment on the annotation data according to different interaction operations of different users on the document in the window, such as scrolling and zooming operations. For example, when a certain text or paragraph in the document is moved, the annotation associated with this content will also move automatically, always keeping in sync with the document, ensuring that the annotation information always remains consistent with the document content, and avoiding problems such as annotation misalignment or loss caused by document changes.

[0066] Specifically, during the meeting, when the staff of the power department participating in the meeting wants to perform corresponding operations on the meeting documents, such as adding comments to the document content, scrolling the document content up and down, zooming in or out on the document, etc., they can send corresponding interaction requests through their corresponding business terminals, such as computers. According to the interaction requests sent by each business terminal, through image recognition and text parsing technologies, for different types of document elements, such as text blocks, structured text paragraphs, complex charts, and professional formulas, accurate recognition and positioning can be carried out to obtain their corresponding element coordinates. However, in practical applications, due to the rich content of power documents, when the staff browses the documents, they may need to scroll the page to view different parts of the content. When the staff uses the mouse wheel to move the document page up and down or left and right in the viewport, the document content displayed in the viewport will also change accordingly, and the distance of the change is the viewport scroll offset. The change situation of the viewport scroll offset can be monitored in real time, and the extracted element coordinates can be dynamically updated. For example, when the document slides down, the originally extracted element coordinates can be corrected according to the viewport scroll offset to ensure that the positions of these document elements can still be accurately tracked in the new viewport state.

[0067] In some embodiments, the specific implementation manner of step S1 may be:

[0068] S11, traverse the document elements in the power document, determine the center point of the power document as the coordinate origin, and obtain the element coordinates of each document element.

[0069] Specifically, the power document can be traversed to identify all document elements, including text blocks, charts, formulas, and other document elements. In order to uniformly measure the positions of each document element, the center point of the power document can be determined as the coordinate origin, a coordinate system can be constructed, and the position of each document element in the coordinate system with the center point of the power document as the coordinate origin can be determined, and the corresponding coordinates of each document element, that is, the element coordinates, can be obtained. Among them, the document element refers to the basic constituent element in the power document, including elements such as text blocks, text paragraphs, and charts.

[0070] S12, generate a unique identifier for each document element according to the number of document pages and the initial element coordinates, and associate each document element with its corresponding unique identifier.

[0071] Specifically, in order to accurately distinguish and manage each document element in the power document, a unique identifier corresponding to the document element can be generated by combining the document page number and the initial element coordinates corresponding to the document element. The document page number is an important reference factor because elements on different pages are different elements even if their coordinates are the same. Combining the initial coordinates can further ensure the uniqueness of the identifier. For example, a text block located on page 3 with coordinates (x1, y1) can have a unique identifier of "P3-(x1,y1)". Such an identifier can clearly indicate the page and approximate location where the document element is located. Bind and associate the generated unique identifier with the corresponding document element. This association is like attaching a unique label to each element, facilitating subsequent searching, referencing, and operating on the elements in the system. Whether it is making annotations, moving document elements, or viewing document element information, the specific document element can be quickly located through the unique identifier.

[0072] Among them, the unique identifier refers to the identifier used to uniquely distinguish and identify each document element in the power document.

[0073] S13, Obtain the window scroll offset in real time to get the horizontal scroll offset and the vertical scroll offset.

[0074] In practical applications, when users browse power documents, they usually scroll the window to view different parts of the content. The scrolling of the window causes the relative positions of document elements in the window to change. Therefore, it is necessary to obtain the scroll offset in real time.

[0075] Specifically, users may use the mouse wheel, touchpad gestures, or other scrolling operation methods to scroll the window. The scrolling situation of the window can be continuously monitored in real time. Since the window scrolling may be horizontal, that is, left and right scrolling, or vertical, that is, up and down scrolling, the horizontal scroll offset and the vertical scroll offset can be obtained respectively. For example, when the user scrolls the mouse wheel to the left, the document content will move to the right, and the horizontal movement distance can be recorded as the horizontal scroll offset. When the user scrolls the mouse wheel up, the document content will move down, and the vertical movement distance can be recorded as the vertical scroll offset.

[0076] Among them, the horizontal scroll offset refers to the distance that the document content moves horizontally relative to the window, and the vertical scroll offset refers to the distance that the document content moves vertically relative to the window.

[0077] S14, Update the horizontal coordinate value in the element coordinates according to the horizontal scroll offset, and update the vertical coordinate value in the element coordinates according to the vertical scroll offset.

[0078] In practical applications, window scrolling changes the relative positions of document elements in the window. To ensure that the positions of document elements can always be accurately recorded, the element coordinates can be updated according to the scroll offset.

[0079] Specifically, after obtaining the horizontal offset, the horizontal coordinate value in the corresponding coordinate element of the document element can be updated according to the horizontal offset. If it is a rightward scroll, the document element will move leftward. Generally, in a two-dimensional coordinate system, the x-axis direction is usually from left to right, and the y-axis direction is usually from bottom to top. Therefore, by subtracting the horizontal offset from the horizontal coordinate value, the updated horizontal coordinate value is obtained. If it is a leftward scroll, the document element will move rightward. Therefore, by adding the horizontal offset to the horizontal coordinate value, the updated horizontal coordinate value is obtained. After obtaining the vertical offset, the vertical coordinate value in the corresponding coordinate element of the document element can be updated according to the vertical offset. If it is an upward scroll, the document element will move downward. Therefore, by subtracting the vertical offset from the vertical coordinate value, the updated vertical coordinate value is obtained. If it is a downward scroll, the document element will move upward. Therefore, by adding the vertical offset to the vertical coordinate value, the updated horizontal coordinate value is obtained.

[0080] Among them, the horizontal coordinate value refers to the coordinate value of the document element in the horizontal direction, such as the x-axis coordinate value, and the vertical coordinate value refers to the coordinate value of the document element in the vertical direction, such as the y-axis coordinate value.

[0081] Through the above implementation methods, it can be ensured that the coordinates of document elements can be adjusted in a timely manner, ensuring the accuracy of element positions in different window states.

[0082] S2. Bind the anchor layer to the element coordinates, intercept the sub-layer segment containing the annotation data in the anchor layer, and automatically update the annotation coordinates of the sub-layer segment as the element coordinates move.

[0083] Among them, the anchor layer is usually a graphical interface element that can be used to provide a visual reference framework on the document element so that users can add annotations on it, such as underlining annotations, color annotations, etc. Annotation data refers to the data generated by users' operations such as color annotation and underlining annotation on the text elements in the document. The sub-layer segment refers to the segment containing the annotation data, and the annotation coordinates refer to the coordinate position of the sub-layer segment corresponding to the annotation data in the document.

[0084] In traditional power document processing and annotation solutions, screen absolute coordinates such as pixel positions are often used to locate annotations and document elements. However, this approach has obvious drawbacks. When the document undergoes operations such as scrolling, zooming, or page switching like PPT page turning, since the absolute coordinates do not automatically adjust with the relative position changes of the document content, it will cause the annotations to be misaligned with the original corresponding target content. For example, in the PPT scenario, when turning from page 8 to other pages, the annotations on page 8 will still remain at the original position determined by the absolute coordinates and cannot move with the document content, seriously affecting the accuracy and practicality of the annotation information.

[0085] This solution can solve the problem in the traditional solution where annotations are misaligned with the target content due to the inability to adapt to document scrolling and zooming by binding the anchor layer to the element coordinates corresponding to the document elements. Specifically, the anchor layer can be bound to the element coordinates corresponding to the document elements. The anchor layer can follow the element coordinates in real time, so that the annotation data can correspond to the document elements in real time. Although the anchor layer is closely bound to the document elements, the specifications of the anchor layer usually correspond to the specifications of the viewport, so it may contain a large amount of information unrelated to the annotation data corresponding to the document elements. To improve processing efficiency and reduce unnecessary data processing volume, a sub-layer segment containing annotation data can be further intercepted from the anchor layer. When operations such as scrolling and zooming occur to the document, the positions of the document elements will change accordingly. To ensure that the annotations always correspond to the document elements, the changes in the element coordinates can be monitored in real time, and the annotation coordinates of the sub-layer segment can be automatically updated according to these changes.

[0086] In actual operation, there will also be situations where the element coordinates are not within the current viewport. For example, when the participant scrolls the document to other pages, the elements and their annotations on the previous page will exceed the current viewport range. At this time, to save memory resources, when it is detected that the element coordinates are not within the viewport, the layer of the corresponding page can be automatically unloaded and kept in a bound relationship with the elements. In this way, when it is necessary to return to this page later, the sub-layer segment can be quickly located based on the element coordinates, and the sub-layer segment can be dynamically loaded, while automatically aligning the current page layout. Whether it is zooming display or scrolling operation, it can ensure that the annotations are perfectly adapted to the target content.

[0087] For example, during a meeting, when attendee A performs a marking operation on page 8 of the PPT, selects the anchored layer mode, clicks on the picture of the transformer radiator and draws a red line for defect marking. The key to the anchored layer mode is that it binds the annotation information to the relative position of the document element, rather than relying on the absolute screen coordinates. In this way, the annotation can closely follow the document element it is associated with. No matter how the document is operated, as long as the element position changes, the annotation will be adjusted synchronously. When attendee B scrolls the PPT to page 12, it can be automatically detected that the element coordinates of page 8 are no longer within the current view window. At this time, to optimize memory usage, the sub - layer of page 8 can be automatically unloaded. This is because when the content of page 8 is not visible in the current view window, continuing to retain the sub - layer of this page will occupy unnecessary memory resources. Through the unloading operation, memory can be released to support other operations that require more resources. When the meeting process flips back to page 8, it can quickly locate the annotations made on this page based on the previously bound element coordinates. At the same time, dynamically load the previously unloaded sub - layer fragments and present the annotations at the correct positions again, ensuring the accurate correspondence between the annotations and the target content, greatly improving the stability and reliability of document annotations in complex operation scenarios.

[0088] Based on the above - mentioned embodiments, the specific implementation manner of step S2 can be:

[0089] S21, Bind the anchored layer to the element coordinates of the corresponding document element, and obtain the annotation data drawn by the business terminal on this document element.

[0090] Specifically, the retrieved anchored layer can be bound to the element coordinates of the document element being annotated. And when the staff uses the business terminal to perform an annotation operation on the document element, the business terminal can record the corresponding annotation data, including the content of the annotation such as line - drawing marks, the style of the annotation such as color, line thickness, etc., and the relative position of the annotation in the document, etc.

[0091] S22, Obtain the visible area of the annotation data containing associated attributes and / or the visible area of the annotation data containing single attributes.

[0092] Among them, the associated attribute refers to the annotation attribute with some internal connection or common feature, the visible area refers to the partial area in the user's view window that can display the annotation data, and the single attribute refers to the attribute of the document element corresponding to only a single annotation.

[0093] In the actual annotation process, multiple annotations may be drawn on the same document element, or only one annotation may be drawn. To process and display the annotation information more efficiently, when intercepting the visible area, different interception methods can be used according to different attributes.

[0094] Specifically, the visible area of annotation data with different attributes can be determined first. The annotation data corresponding to document elements can be analyzed to determine whether it belongs to associated attributes or single attributes. For annotation data with associated attributes, the positions and ranges of all relevant annotations can be comprehensively considered to generate a maximum visible area that can contain these annotation data. The visible area can ensure that all associated annotations can be completely displayed in the viewport for convenient viewing. For annotation data with single attributes, its independent visible area can be determined according to the specific position and size of the annotation. This area only needs to just accommodate the single annotation, avoiding including too much irrelevant information.

[0095] In some embodiments, step S22 includes S221 to S223, which are specifically as follows:

[0096] S221, determine that multiple annotation data corresponding to the same document element are of associated attributes, generate a rectangular outer frame for all document elements with associated attributes, and determine the area within the rectangular outer frame as the visible area.

[0097] Specifically, the annotation data corresponding to the same document element can be analyzed. In a power document, a document element may have multiple annotation data, and these annotations may be for different aspects of content. When there are multiple such annotation data, the multiple annotation data corresponding to the same document element can be determined to have associated attributes, and a rectangular outer frame corresponding to all document elements with associated attributes can be generated. When generating the rectangular outer frame, the leftmost, rightmost, topmost, and bottommost boundary points of the document element in the two-dimensional coordinate system can be obtained, and then a rectangular outer frame that can just contain all relevant document elements can be drawn based on these boundary points. This rectangular outer frame can cover all document elements with associated attributes and their annotation data, and the area within the rectangular outer frame is determined as the visible area.

[0098] S222, and / or, determine that a single annotation data corresponding to the same document element is of single attribute, and extract the outer contour of the annotation data.

[0099] When the same document element only corresponds to one annotation data, the annotation data can be determined to have single attributes. For annotation data with single attributes, its outer contour can be extracted. For example, for an annotation marked with a red circle, the key points on the circumference of the circle can be found to extract the circular outer contour of the annotation data.

[0100] S223, expand and adjust the outer contour according to a preset magnification ratio to obtain an offset contour, align the center points of the offset contour and the outer contour, and determine the area within the offset contour as the visible area.

[0101] Specifically, the outer contour can be enlarged and adjusted according to a preset magnification ratio. The preset magnification ratio is a fixed value determined according to actual requirements and system design, such as 1.2 times. By enlarging the outer contour according to the preset magnification ratio, a larger contour, that is, an offset contour, can be obtained. After obtaining the offset contour, the center points of the offset contour and the outer contour can be aligned, which can ensure that the enlarged offset contour is evenly enlarged around the original outer contour without offset or dislocation. The area within the offset contour is determined as the visible area.

[0102] S23, intercept the visible area to obtain a sub-layer segment, and bind the element coordinates of the sub-layer segment and the corresponding document element.

[0103] Specifically, considering that the anchored layer may be large, in order to reduce the amount of data processing, a sub-layer segment containing the visible area of the annotation data can be intercepted from the anchored layer. By intercepting the sub-layer segment and only processing the part related to the annotation data, the processing efficiency can be improved. The obtained sub-layer segment is bound to the element coordinates of the corresponding document element. In this way, a close connection is established between the sub-layer segment and the document element. When the document element moves, the sub-layer segment will also move accordingly. Among them, the sub-layer segment refers to.

[0104] S24, automatically update the annotation coordinates of the sub-layer segment according to the window scroll offset corresponding to the element coordinates.

[0105] According to the obtained window scroll offset, the annotation coordinates of the sub-layer segment can be automatically updated. If the window scrolls horizontally, the horizontal coordinates of the annotation data can be adjusted accordingly according to the horizontal scroll offset. If the window scrolls vertically, the vertical coordinates of the annotation data can be adjusted according to the vertical scroll offset. For example, when the window scrolls down a certain distance, the vertical coordinates of the annotations in the sub-layer segment will increase accordingly to ensure that the relative positions of the annotations and the document elements in the window remain unchanged, realizing the synchronous movement of the annotations with the movement of the document elements. Through this automatic update mechanism, it can be ensured that the annotation data always accurately corresponds to the corresponding document elements during the document scrolling process, avoiding the situation of annotation dislocation or loss.

[0106] Through the above implementation manners, it can be ensured that the annotation data always accurately corresponds to the corresponding document elements during the document scrolling process, avoiding the situation of annotation dislocation or loss.

[0107] In some embodiments, during the process of automatically updating the annotation coordinates of the sub-layer segment along with the movement of the element coordinates, it further includes:

[0108] A1, statistically calculate the difference in the number of pixels of the document element at adjacent moments during the movement.

[0109] During the operation of the document, in addition to window scrolling, the document elements may also be scaled. To ensure that the annotations can maintain a good correspondence with the scaled document elements, during the process of automatically updating the annotation coordinates of the sub-layer segment along with the movement of the element coordinates, the area of the sub-layer segment where the annotation is located can be adjusted accordingly.

[0110] Specifically, during the movement of the document element, the number of pixels occupied by the document element can be counted at two adjacent moments respectively, and the difference between the number of pixels of the document element at these two moments can be calculated to obtain the pixel number difference. The pixel number difference can reflect the change in the number of pixels of the document element during this period, which may be caused by the scaling operation. Among them, the pixel number difference refers to the difference between the number of pixels corresponding to the document element between adjacent moments.

[0111] A2. When the pixel number difference is greater than or equal to the area threshold, the scaling ratio is obtained according to the ratio of the number of pixels of the document element at the latter moment to the number of pixels at the former moment.

[0112] Specifically, an area threshold can be preset in advance. This threshold is used to judge whether the change in the number of pixels of the document element has reached the level that requires scaling adjustment. When the calculated pixel number difference is greater than or equal to the area threshold, it indicates that the document element has undergone a relatively obvious scaling. According to the ratio of the number of pixels of the document element at the latter moment to the number of pixels at the former moment, the scaling ratio can be obtained. If the scaling ratio is greater than 1, it means that the document element has been enlarged. If the scaling ratio is less than 1, it means that the document element has been reduced. If the scaling ratio is equal to 1, it means that the document element has not been scaled. Among them, the area threshold is the maximum value that can be used to judge whether the change in the number of pixels of the document element is significant enough to require scaling adjustment, and the scaling ratio is the ratio obtained by comparing the number of pixels of the document element at the latter moment with the number of pixels at the former moment.

[0113] A3. The adjusted area is obtained by multiplying the number of pixels of the sub-layer segment by the scaling ratio, and the area of the sub-layer segment is updated to the adjusted area.

[0114] Specifically, the sub-layer segment is the area containing the annotation data. The number of pixels currently occupied by the sub-layer segment can be obtained. This number of pixels can reflect the current size of the sub-layer segment. Since the document element has been scaled, to ensure that the proportional relationship between the annotation and the document element remains unchanged, the sub-layer segment also needs to be adjusted according to the same scaling ratio. By multiplying the scaling ratio by the number of pixels of the sub-layer segment, the adjusted area can be obtained. The size of the sub-layer segment is re-adjusted according to the new adjusted area to make it match the scaled document element.

[0115] Through the above embodiments, it is possible to ensure that the annotation data matches the scaled document elements.

[0116] S3. Obtain the time difference between the document annotation and the interaction operation, and adjust the sub-layer segment according to the interaction parameter and the time difference, so that the feature offset from the target element meets the preset error threshold.

[0117] Among them, the document annotation refers to the annotation data drawn in the power document. The interaction operations include scrolling operations and zooming operations on the power document. The time difference refers to the time interval from the start of an interaction operation such as scrolling or zooming the power document to the actual rendering and display of the document annotation in the power document. The interaction parameters include the scrolling rate and the zoom ratio. The target element refers to the document element corresponding to the sub-layer segment. The feature offset refers to the deviation between the annotation position and the actual position of the target element. The preset error threshold refers to the maximum deviation allowed between the annotation position and the target element position. If the feature offset exceeds this threshold, it is necessary to adjust the sub-layer segment to ensure the precise correspondence between the annotation and the document content.

[0118] In the multi-terminal interaction scenario of a power business meeting, there may be multiple business terminals performing corresponding interaction operations on the power document. For example, there may be a main business terminal and a slave business terminal. When the main business terminal performs a scrolling operation or a zooming operation on the document, the slave business terminal may draw annotations simultaneously. Due to factors such as the processing speed and network latency between multiple terminals, there may be a time difference between the document annotation and the interaction operation. This time difference may cause the annotation to be misaligned with the target element, and the annotation may finally deviate from the user's intention. For example, when making a mark during scrolling, the layer may not follow the scrolling in time, resulting in a misaligned mark. When making a mark during zooming, the layer may not be adjusted in size in time, resulting in the mark not corresponding to the target element. To solve this problem, it is necessary to obtain the time difference between the document annotation and the interaction operation, and adjust the sub-layer segment according to the interaction parameter and the time difference to ensure that the feature offset from the target element meets the preset error threshold and achieve the precise correspondence between the annotation and the document content.

[0119] Based on the above embodiments, the specific implementation manner of step S3 can be:

[0120] S31. Determine the rendering moment of the document annotation and the first trigger moment of the scrolling operation, and obtain the first time difference by subtracting the first trigger moment from the rendering moment.

[0121] Specifically, when the business terminal finishes drawing the annotation on the document element, it can accurately record the moment when the annotation data is actually rendered and displayed in the power document, that is, the rendering moment. This moment marks that the annotation truly appears in front of the user and is an important basis for calculating the subsequent time difference. When other business terminals initiate a scrolling operation on the power document, it can immediately capture and record the instant when the operation starts, that is, the first trigger moment. Subtracting the first trigger moment of the scrolling operation from the rendering moment of the document annotation, the obtained difference is the first time difference. This time difference reflects the time interval from the start of the scrolling operation to the completion of the annotation rendering and is a key factor for subsequent judgment on whether to adjust the annotation position. For example, if the annotation rendering moment is 10:15:30 and the first trigger moment of the scrolling operation is 10:15:25, then the first time difference is 5 seconds.

[0122] Among them, the rendering moment refers to the moment when the annotation data is actually displayed in the power document, the first trigger moment refers to the moment when the scrolling operation on the power document starts, and the first time difference refers to the time interval from the start of the scrolling operation to the completion of the annotation rendering.

[0123] S32. Determine the position offset of the sub-layer segment and the target element according to the scrolling rate and the first time difference. When the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, adjust the current annotation coordinates of the sub-layer segment according to the position offset.

[0124] Specifically, the scrolling rate during the scrolling operation of the business terminal can be monitored in real time. The scrolling rate represents the distance that the document scrolls per unit time. For example, it scrolls 80 pixels per second. Combining the first time difference, by multiplying the first time difference by the scrolling rate, the position offset of the sub-layer segment and the target element can be obtained. The preset error threshold corresponding to the preset scrolling operation can be obtained. This threshold is the maximum position deviation allowed between the annotation and the target element. Compare the calculated position offset with the preset error threshold. If the position offset is greater than or equal to the preset error threshold, it means that the position deviation between the annotation and the target element exceeds the acceptable range. At this time, the current annotation coordinates of the sub-layer segment need to be adjusted according to the position offset. For example, when the business terminal scrolls the document downward and the position offset is 400 pixels and the preset error threshold is 300 pixels, then the vertical coordinate of the annotation in the sub-layer segment can be increased by 400 pixels to realign the annotation with the target element.

[0125] Among them, the position offset refers to the moving distance of the sub-layer segment relative to its original position in the viewport due to the scrolling operation.

[0126] In some embodiments, the step of "when the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, adjusting the current annotation coordinates of the sub-layer segment according to the position offset" in step S32 includes the following steps:

[0127] S321. When the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, determine the direction opposite to the scrolling direction as the calibration direction, and determine the operation attribute corresponding to the calibration direction, where the operation attribute includes an increase attribute and a decrease attribute.

[0128] Specifically, when the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, a calibration operation is required. First, the direction opposite to the scrolling direction can be determined as the calibration direction. Since the scrolling operation causes a position deviation between the target element and the annotation data, to eliminate this deviation, an adjustment needs to be made in the opposite direction. Refer to Figure 2 , which is a schematic diagram of a calibration direction provided by an embodiment of the present invention. For example Figure 2 as shown in the left figure of Figure 2 . If the scrolling direction of the power document is downward scrolling, visually, the target element in the power document will move upward relatively. When the annotation data corresponding to the target element is an underline, the position of the annotation data deviates downward relative to the target element. To realign the annotation data with the target element, the calibration direction for calibrating the corresponding annotation data can be the upward direction, as shown in the right figure of

[0129] . If the scrolling direction of the power document is rightward scrolling, the target element in the power document will move leftward, and the annotation deviates rightward relative to the target element. Then, the calibration direction for calibrating the corresponding annotation can be the leftward direction. Generally, in a two-dimensional coordinate system, the direction of the x-axis is generally from left to right, and the direction of the y-axis is generally from bottom to top. In practical applications, moving upward means moving in the positive direction of the y-axis, that is, increasing the longitudinal coordinate value of the annotation. Therefore, when the calibration direction is upward, the corresponding operation attribute is the increase attribute. Moving downward is moving in the negative direction of the y-axis, and the longitudinal coordinate value of the annotation needs to be decreased. Therefore, when the calibration direction is downward, the corresponding operation attribute is the decrease attribute. Moving leftward is moving in the negative direction of the x-axis, and the horizontal coordinate value of the annotation needs to be decreased. So, when the calibration direction is leftward, the corresponding operation attribute is the decrease attribute. Moving rightward is moving in the positive direction of the x-axis, and the horizontal coordinate value of the annotation needs to be increased. Therefore, when the calibration direction is rightward, the corresponding operation attribute is the increase attribute.

[0130] Among them, the calibration direction refers to the direction when calibrating the annotation data corresponding to the document element, the operation attribute refers to the attribute corresponding to calculating the position coordinates of the annotation according to the calibration direction, the increase attribute refers to the attribute corresponding to increasing the coordinate value, and the decrease attribute refers to the attribute corresponding to decreasing the coordinate value.

[0131] S322. Obtain the coordinate value corresponding to the calibration direction, and add or subtract the position offset from this coordinate value according to the operation attribute to obtain the annotation coordinates corresponding to the adjusted sub-layer segment.

[0132] Specifically, the coordinate value corresponding to the calibration direction can be obtained. If the calibration direction is upward or downward, the vertical coordinate value of the annotation is obtained. If the calibration direction is leftward or rightward, the horizontal coordinate value of the annotation is obtained. Perform corresponding operations on this coordinate value according to the determined operation attribute. If the operation attribute is the increase attribute, add the position offset to the coordinate value. If the operation attribute is the decrease attribute, subtract the position offset from the coordinate value. After such operations, the result obtained is the annotation coordinates corresponding to the adjusted sub-layer segment.

[0133] After adjusting the current annotation coordinates of the sub-layer segment according to the position offset, it further includes:

[0134] B1. Generate a calibration axis including nodes corresponding to each first time difference. The distance between adjacent nodes in this calibration axis is obtained by multiplying the corresponding time interval difference by the unit length.

[0135] In the multi-terminal interaction scenario of a power business meeting, after adjusting the current annotation coordinates of the sub-layer segment according to the position offset, in order to more efficiently and accurately handle the possible time difference problems of document annotation and scrolling operations in the future, a prediction mechanism can be constructed. This solution can generate a calibration axis, calculate the unit increment, determine the prediction nodes and their prediction offsets, so that when the time difference equal to that of the prediction nodes appears in the future, the corresponding prediction offset can be quickly obtained for adjusting the annotation coordinates, reducing repeated calculations and improving the efficiency and accuracy of annotation calibration.

[0136] Specifically, during the process of adjusting the annotation coordinates, the first time differences between each document annotation and scrolling operation have been recorded. These first time differences can reflect the time intervals between the two in different situations and are the basic data for constructing the calibration axis. Each first time difference is corresponded to a node on the calibration axis. The calibration axis is a number axis used to intuitively display the relationship between the time difference and the offset. The position of each node on the axis is determined by its corresponding first time difference. For two adjacent nodes on the calibration axis, the distance between them is determined by the product of the time interval difference corresponding to them and the unit length. The unit length is a preset fixed value used to unify the distance measurement on the calibration axis. In this way, the distribution of nodes on the calibration axis can accurately reflect the relative relationship between different first time differences. Among them, the calibration axis refers to a number axis used to intuitively display the relationship between the time difference and the offset, and the time interval difference refers to the difference between the first time differences corresponding to adjacent nodes on the calibration axis.

[0137] B2. Obtain the unit increment according to the ratio of the offset difference and the distance between adjacent nodes. Taking the node with a smaller value as the reference, determine multiple prediction nodes at intervals of the unit length in sequence.

[0138] Specifically, for two adjacent nodes on the calibration axis, the corresponding position offsets can be obtained. By calculating the difference between the position offsets corresponding to the adjacent nodes, the offset difference can be obtained. By calculating the ratio of the offset difference to the distance between the adjacent nodes, the unit increment can be obtained. Select the node with a smaller first time difference value on the calibration axis as the reference node. This reference node is the starting point for determining the prediction nodes subsequently. Starting from the reference node, multiple prediction nodes are determined at intervals of the unit length along the calibration axis. Refer to Figure 3 , which is a schematic diagram of a calibration axis provided by an embodiment of the present invention. As shown in Figure 3 , the position offset corresponding to node 1 and the position offset corresponding to node 2 can be obtained. By calculating the difference between the position offsets corresponding to the two nodes, the offset difference can be obtained, and the distance between node 1 and node 2 can be obtained. According to the ratio between the offset difference and the distance, the unit increment can be obtained. When the first time difference value corresponding to node 1 is smaller, node 1 can be used as the reference. At intervals of the unit length, prediction node 1 can be determined. Then, taking prediction node 1 as the reference and at intervals of the unit length, prediction node 2 can be determined, and so on. Multiple prediction nodes can be determined. These prediction nodes are the positions predicted based on the unit length and the unit increment on the basis of the existing data and are used to estimate the position offset corresponding to the time difference that may occur in the future.

[0139] B3. Taking the position offset corresponding to the node with a smaller value as the reference, sequentially add the unit increment to obtain the predicted offsets corresponding to each prediction node.

[0140] Specifically, the position offset corresponding to the node with a small first time difference value can be used as the reference offset. For example, Figure 3 as shown in [figure], for prediction node 1, adding the unit increment to the position offset corresponding to node 1 can obtain the prediction offset corresponding to prediction node 1. For prediction node 2, adding the unit increment to the prediction offset corresponding to prediction node 2 can obtain the prediction offset corresponding to prediction node 2. Among them, the prediction offset refers to the position offset corresponding to each prediction node predicted according to the unit increment.

[0141] B4. When the time difference corresponding to the prediction node is equal to the time difference between the next document annotation and the scrolling operation, the prediction offset corresponding to the prediction node is used as the position offset for the next annotation coordinate adjustment.

[0142] During the subsequent document annotation and scrolling operations, the time difference between the two can be monitored in real time. At the same time, the monitored time difference is compared one by one with the time differences corresponding to each prediction node on the calibration axis. If it is found that the time difference corresponding to a certain prediction node is equal to the currently monitored time difference, it means that the previously predicted result can be utilized. At this time, the prediction offset corresponding to the prediction node is used as the position offset for the next annotation coordinate adjustment. In this way, without re - performing complex calculations, the pre - predicted offset is directly used for annotation coordinate adjustment, greatly improving the efficiency and response speed of annotation calibration, and ensuring that the annotation can be aligned with the target element in a timely and accurate manner.

[0143] S33, or, determine the second trigger moment of the zoom operation, and obtain the second time difference by subtracting the second trigger moment from the rendering moment.

[0144] Specifically, if there is a zoom operation on the power document by the business terminal, the moment when the zoom operation starts, that is, the second trigger moment, can be recorded. Subtracting the second trigger moment of the zoom operation from the rendering moment of the document annotation, the obtained difference is the second time difference. This time difference can reflect the time interval from the start of the zoom operation to the completion of annotation rendering, which is crucial for subsequent analysis of the impact of zoom on the position and size of the annotation. For example, if the annotation rendering moment is 10:20:40 and the second trigger moment of the zoom operation is 10:20:35, then the second time difference is 5 seconds. Among them, the second trigger moment refers to the starting time point when the business terminal user performs the zoom operation on the power document, and the second time difference refers to the time interval from the second trigger moment of the zoom operation to the completion moment of document annotation rendering.

[0145] S34, determine the zoom offset of the sub - layer segment and the target element according to the second time difference. When the zoom offset is greater than or equal to the preset error threshold corresponding to the zoom operation, adjust the area of the sub - layer segment based on the zoom offset.

[0146] Among them, the interaction operations include a scrolling operation and a zooming operation, the interaction parameters include a scrolling rate and a zoom ratio, and the feature offset includes a position offset and a zoom offset.

[0147] Specifically, according to the second time difference, the zoom offset corresponding to the sub-layer segment and the target element can be determined. After obtaining the zoom offset, the preset error threshold corresponding to the preset zoom operation can be retrieved. This threshold is the maximum zoom deviation allowed between the annotation and the target element. The calculated zoom offset is compared with the preset error threshold. If the zoom offset is greater than or equal to the preset error threshold, it indicates that the zoom deviation between the annotation and the target element exceeds the acceptable range. At this time, the area of the sub-layer segment needs to be adjusted according to the zoom offset. For example, if the zoom offset indicates that the target element is enlarged by 1.61 times and the preset error threshold is 1.5 times, then the area of the sub-layer segment is multiplied by 1.61 times to ensure that the proportional relationship between the annotation and the target element after zooming remains consistent. Among them, the zoom offset refers to the change amount of the sub-layer segment and the target element relative to the original ratio after the zoom operation.

[0148] In some embodiments, the specific implementation manner of step S34 may be:

[0149] S341, Determine the zoom offset of the sub-layer segment and the target element based on the ratio of the number of pixels of the target element at the end moment and the initial moment of the second time difference.

[0150] Specifically, the number of pixels occupied by the target element at the initial moment and the end moment of the second time difference can be recorded respectively. The initial moment is the instant when the zoom operation starts to be triggered, and the end moment is the moment when the document annotation rendering is completed. By calculating the ratio of the number of pixels of the target element at the end moment and the initial moment, the zoom offset of the sub-layer segment and the target element can be obtained. If the zoom offset is greater than 1, it can indicate that the target element is enlarged. If the zoom offset is less than 1, it can indicate that the target element is reduced.

[0151] Among them, the end moment refers to the moment when the document annotation rendering is completed, and the initial moment refers to the moment when the zoom operation starts to be triggered.

[0152] S342, When the zoom offset is greater than or equal to the preset error threshold corresponding to the zoom operation, obtain the zoom area according to the product of the zoom offset and the number of pixels of the sub-layer segment, and update the area of the sub-layer segment to the zoom area.

[0153] Specifically, compare the calculated scaling offset with the preset error threshold corresponding to the preset scaling operation. If the scaling offset is greater than or equal to the preset error threshold corresponding to the scaling operation, it indicates that the scaling deviation between the annotation and the target element exceeds the acceptable range, and the area of the sub-layer segment needs to be adjusted. The number of pixels corresponding to the sub-layer segment can be obtained, and by multiplying the scaling offset by the number of pixels corresponding to the sub-layer segment, the corresponding scaling area can be obtained. Update the area of the sub-layer segment to the scaling area, so as to ensure that the proportional relationship between the annotation and the target element after scaling remains consistent and ensure the accuracy of the annotation information. Among them, the scaling area refers to the area obtained by adjusting the sub-layer segment according to the scaling offset.

[0154] Through the above implementation manner, it can be ensured that the feature offset between the annotation and the target element meets the preset error threshold, and the accurate correspondence between the annotation and the document content is realized.

[0155] S4. Associate the identity information and annotation timestamp of each business terminal with the process node, and generate collaborative monitoring data for storage in the database.

[0156] Among them, the identity information refers to the information of the power department staff participating in the meeting. The annotation timestamp accurately records the specific time when the participant annotates the document in the power document processing process. The process node refers to the key stage in the power document processing process, such as the start of the meeting, different topic discussion sessions, and the passing of the final resolution, etc. The collaborative monitoring data refers to the data recording the process of the power department staff participating in the meeting annotating the power document, including information on personnel identity, annotation content, annotation time, and the relationship with the meeting process and other important aspects.

[0157] In practical applications, each business terminal corresponds to a power department staff member participating in the meeting. Their identity information can be employee ID, name, department, etc. The annotation timestamp accurately records the specific time of the annotation. By associating this information with each node in the power document processing process, collaborative monitoring data including personnel identity, annotation content, annotation time, and the relationship with the meeting process can be generated, and the collaborative monitoring data can be stored in the database. When tracing back the meeting process later, only by performing a simple query operation and inputting key information such as the person's name or the meeting process node, it is possible to quickly locate the operations and annotations of a certain person on the document at a specific stage of the meeting, which is convenient for reviewing the meeting content and decision-making process, and provides strong data support for the optimization of the power business process and problem troubleshooting.

[0158] See Figure 4 , which is a schematic structural diagram of a power business process monitoring device based on multi-terminal interconnection provided by an embodiment of the present invention. The data processing system of the power business process monitoring device based on multi-terminal interconnection includes:

[0159] An extraction module, configured to extract the element coordinates in the power document based on the interaction requests of each business terminal, and dynamically update the element coordinates according to the window scroll offset;

[0160] An update module, configured to bind the anchored layer to the element coordinates, intercept the sub-layer segment containing the annotation data in the anchored layer, and automatically update the annotation coordinates of the sub-layer segment as the element coordinates move;

[0161] An adjustment module, configured to obtain the time difference between the document annotation and the interaction operation, and adjust the sub-layer segment according to the interaction parameters and the time difference, so that the characteristic offset from the target element meets the preset error threshold;

[0162] A generation module, configured to associate the identity information and annotation timestamps of each business terminal with the process nodes, and generate collaborative monitoring data for storage in the database.

[0163] Figure 4 The device of the illustrated embodiment can correspondingly be used to execute Figure 1 the steps in the illustrated method embodiment, and its implementation principle and technical effects are similar, and will not be elaborated here.

[0164] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A power service process monitoring method based on multi-terminal interconnection, characterized in that Including: Extracting the element coordinates in the power document based on the interaction requests of each business terminal, and dynamically updating the element coordinates according to the window scroll offset; Binding the anchor layer to the element coordinates, intercepting the sub-layer segment containing the annotation data in the anchor layer, and automatically updating the annotation coordinates of the sub-layer segment as the element coordinates move, including: Binding the anchor layer to the element coordinates of the corresponding document element, and obtaining the annotation data drawn by the business terminal on the document element; Obtaining the visible area of the annotation data containing associated attributes and / or the visible area of the annotation data containing a single attribute; Intercepting the visible area to obtain a sub-layer segment, and binding the sub-layer segment and the element coordinates of the corresponding document element; Automatically updating the annotation coordinates of the sub-layer segment according to the window scroll offset corresponding to the element coordinates; Obtaining the time difference between the document annotation and the interaction operation, and adjusting the sub-layer segment according to the interaction parameter and the time difference so that the characteristic offset from the target element meets the preset error threshold; Associating the identity information and annotation timestamps of each business terminal with the process node, and generating collaborative monitoring data for storage in the database.

2. The method according to claim 1, wherein Extracting the element coordinates in the power document based on the interaction requests of each business terminal, and dynamically updating the element coordinates according to the window scroll offset, including: Traversing the document elements in the power document, determining the center point of the power document as the coordinate origin, and obtaining the element coordinates of each document element; Generating a unique identifier for each document element according to the number of document pages and the initial element coordinates, and associating each document element with its corresponding unique identifier; Obtaining the window scroll offset in real time to obtain the horizontal scroll offset and the vertical scroll offset; Updating the horizontal coordinate value in the element coordinates according to the horizontal scroll offset, and updating the vertical coordinate value in the element coordinates according to the vertical scroll offset.

3. The method according to claim 1, wherein Obtaining the visible area of the annotation data containing associated attributes and / or the visible area of the annotation data containing a single attribute, including: Determining multiple annotation data corresponding to the same document element as associated attributes, generating a rectangular outer frame for all document elements containing the associated attributes, and determining the area within the rectangular outer frame as the visible area; and / or, Determining a single annotation data corresponding to the same document element as a single attribute, and extracting the outer contour of the annotation data; Performing an expansion adjustment on the outer contour according to a preset magnification ratio to obtain an offset contour, aligning the center points of the offset contour and the outer contour, and determining the area within the offset contour as the visible area.

4. The method according to claim 1, wherein During the process of automatically updating the annotation coordinates of the sub-layer segment as the element coordinates move, it further includes: Counting the difference in the number of pixels of the document element at adjacent moments during the movement; When the difference in the number of pixels is greater than or equal to the area threshold, obtaining a scaling ratio according to the ratio of the number of pixels of the document element at the later moment to the number of pixels at the previous moment; Obtaining an adjusted area according to the product of the number of pixels of the sub-layer segment and the scaling ratio, and updating the area of the sub-layer segment to the adjusted area.

5. The method according to claim 1, wherein Obtain the time difference between document annotation and interaction operations, and adjust the sub-layer segment according to the interaction parameters and the time difference so that its characteristic offset from the target element meets the preset error threshold, including: Determine the rendering moment of the document annotation and the first trigger moment of the scrolling operation, and obtain the first time difference by subtracting the first trigger moment from the rendering moment; Determine the position offset between the sub-layer segment and the target element according to the scrolling rate and the first time difference. When the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, adjust the current annotation coordinates of the sub-layer segment according to the position offset; or, Determine the second trigger moment of the zoom operation, and obtain the second time difference by subtracting the second trigger moment from the rendering moment; Determine the zoom offset between the sub-layer segment and the target element according to the second time difference. When the zoom offset is greater than or equal to the preset error threshold corresponding to the zoom operation, adjust the area of the sub-layer segment based on the zoom offset; Wherein, the interaction operations include scrolling operations and zoom operations, the interaction parameters include scrolling rate and zoom ratio, and the characteristic offsets include position offset and zoom offset.

6. The method according to claim 5, wherein When the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, adjusting the current annotation coordinates of the sub-layer segment according to the position offset includes: When the position offset is greater than or equal to the preset error threshold corresponding to the scrolling operation, determine the direction opposite to the scrolling direction as the calibration direction, and determine the arithmetic property corresponding to the calibration direction, and the arithmetic property includes an increase property and a decrease property; Obtain the coordinate value corresponding to the calibration direction, and add or subtract the position offset from the coordinate value according to the arithmetic property to obtain the annotation coordinates corresponding to the adjusted sub-layer segment.

7. The method according to claim 5, wherein Determine the zoom offset between the sub-layer segment and the target element according to the second time difference. When the zoom offset is greater than or equal to the preset error threshold corresponding to the zoom operation, adjusting the area of the sub-layer segment based on the zoom offset includes: Based on the ratio of the number of pixels of the target element at the end moment and the initial moment of the second time difference, determine the zoom offset between the sub-layer segment and the target element; When the zoom offset is greater than or equal to the preset error threshold corresponding to the zoom operation, obtain the zoom area by multiplying the zoom offset by the number of pixels of the sub-layer segment, and update the area of the sub-layer segment to the zoom area.

8. The method according to claim 5, wherein After adjusting the current annotation coordinates of the sub-layer segment according to the position offset, it further includes: Generate a calibration axis including nodes corresponding to each first time difference, and the distance between adjacent nodes in the calibration axis is obtained by multiplying the corresponding time interval difference and the unit length; Obtain the unit increment according to the ratio of the offset difference between adjacent nodes and the distance, and take the node with a smaller value as the reference, and sequentially determine multiple prediction nodes at intervals of the unit length; Based on the position offset corresponding to the node with a smaller value, sequentially add the unit increment to obtain the prediction offsets corresponding to each prediction node; When the time difference corresponding to the prediction node is equal to the time difference of the next document annotation and scrolling operation, the prediction offset corresponding to the prediction node is used as the position offset for the next annotation coordinate adjustment.

9. A power service process monitoring device based on multi-terminal interconnection, characterized in that, Including: An extraction module, configured to extract the element coordinates in the power document based on the interaction requests of each business terminal, and dynamically update the element coordinates according to the viewport scrolling offset; An update module, configured to bind the anchored layer to the element coordinates, intercept the sub-layer segment containing the annotation data in the anchored layer, and automatically update the annotation coordinates of the sub-layer segment as the element coordinates move, including: Binding the anchored layer to the element coordinates of the corresponding document element, and obtaining the annotation data drawn by the business terminal on the document element; Obtaining the visible area of the annotation data including associated attributes and / or the visible area of the annotation data including single attributes; Intercepting the visible area to obtain a sub-layer segment, and binding the sub-layer segment and the element coordinates of the corresponding document element; Automatically updating the annotation coordinates of the sub-layer segment according to the viewport scrolling offset corresponding to the element coordinates; An adjustment module, configured to obtain the time difference between the document annotation and the interaction operation, and adjust the sub-layer segment according to the interaction parameters and the time difference, so that the characteristic offset from the target element meets a preset error threshold; A generation module, configured to associate the identity information and annotation timestamps of each business terminal with the process node, and generate collaborative monitoring data for storage in the database.

Images