A cross-device collaborative processing method and terminal
By generating synchronization parameters in the data indicator system, the display content across devices is synchronized, solving the problem of low information transmission efficiency in multi-person collaborative operations and achieving precise positioning and efficient collaborative operations.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-19
- Publication Date
- 2026-03-13
AI Technical Summary
Existing data indicator systems rely on external communication tools when multiple people are working together, resulting in low information transmission efficiency and delayed operation synchronization, which cannot meet the needs of real-time team discussion and decision-making.
By responding to user collaborative operations on the first terminal, the coordinates and identifiers of the target indicator module are determined, synchronization parameters are generated, and sent to the second terminal to achieve cross-device display content synchronization, establishing an internal collaboration channel and replacing screenshots and text descriptions.
It significantly improves the accuracy and efficiency of information transmission, achieves precise operation synchronization and adaptive display across devices, and overcomes the problem of operation synchronization lag caused by reliance on external tools.
Smart Images

Figure CN121349395B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, and in particular to a cross-device collaborative processing method and terminal. Background Technology
[0002] The data metrics system is mainly used to collect, process, and visualize key business data, and assists users in monitoring, analysis, and decision-making through interactive areas.
[0003] Existing data metrics systems primarily serve individual analysis and decision-making, and are unsuitable for multi-person collaborative scenarios. When a team needs to conduct real-time discussions, approvals, or task assignments around the same set of data metrics, the system cannot provide a collaborative channel. Participants must rely on external instant messaging tools, repeatedly taking screenshots and combining them with text descriptions of operation locations to communicate. This results in low information transmission efficiency and significant synchronization lag, making it difficult to ensure that all members are focused on the same data details in real time, severely impacting the team's analysis efficiency and decision-making accuracy. Summary of the Invention
[0004] This application provides a cross-device collaborative processing method and terminal to solve the problem in the prior art that data indicator systems rely on external communication tools when multiple people are collaborating, resulting in low information transmission efficiency and delayed operation synchronization.
[0005] In a first aspect, this application provides a cross-device collaborative processing method applied to a first terminal, the method comprising:
[0006] After responding to a collaborative operation triggered by a user on the first display area of the first terminal, the display content of at least one indicator module is displayed in the first display area;
[0007] Based on the coordinates of the displayed content of the at least one indicator module in the first coordinate system, the first target indicator module corresponding to the collaborative operation is determined.
[0008] Synchronization parameters are generated based on at least one of the first position coordinates, the current coordinates of the first display area, and the first module identifier, wherein the first position coordinates are the coordinates of the display content of the first target indicator module in the first coordinate system, the current coordinates of the first display area are the current coordinates of the first display area in the first coordinate system, and the first module identifier is the identifier of the first target indicator module.
[0009] The synchronization parameters are sent to the second terminal so that the second terminal displays the content corresponding to the collaborative operation on the second display area. The first terminal and the second terminal are located in the same collaborative processing group, which is generated by the first terminal in response to a collaborative creation operation triggered by the user.
[0010] In one possible implementation, the collaborative operation is a scrolling operation;
[0011] The step of determining the first target indicator module corresponding to the collaborative operation based on the coordinates of the displayed content of the at least one indicator module in the first coordinate system includes:
[0012] For each of the at least one indicator module, based on the second position coordinates of the displayed content of the indicator module in the first coordinate system and the current coordinates of the first display area, the display ratio of the displayed content of the indicator module in the first display area is calculated.
[0013] Among the calculated display ratios, the indicator modules whose display ratios are greater than or equal to a preset threshold are selected as the first target indicator modules.
[0014] In one possible implementation, the second position coordinates include the second upper left corner coordinates of the display content of the indicator module in the first coordinate system, and the second lower left corner coordinates of the display content of the indicator module in the first coordinate system. The current coordinates of the first display area include the first current upper left corner coordinates of the first display area in the first coordinate system, and the first current lower left corner coordinates of the first display area in the first coordinate system.
[0015] The step of calculating the display ratio of the indicator module's content in the first display area based on the second position coordinates of the indicator module's content in the first coordinate system and the current coordinates of the first display area includes:
[0016] The maximum value between the ordinate of the second top-left corner coordinate information and the ordinate of the first current top-left corner coordinate information is taken as the first target ordinate value, and the minimum value between the ordinate of the second bottom-left corner coordinate information and the ordinate of the first current bottom-left corner coordinate information is taken as the second target ordinate value.
[0017] Calculate the first difference between the ordinate value of the first target and the ordinate value of the second target;
[0018] The first quotient of the first difference and the first quotient of the display height of the display content of the indicator module is used as the display ratio.
[0019] In one possible implementation, the first position coordinates include the first upper left corner coordinates of the display content of the first target indicator module in the first coordinate system, and the first lower left corner coordinates of the display content of the first target indicator module in the first coordinate system.
[0020] The generation of synchronization parameters based on at least one of the first position coordinates, the current coordinates of the first display area, and the first module identifier includes:
[0021] Calculate the difference between the ordinate value of the first upper left corner coordinate information and half the height of the first display area, and use the second difference as the first reference offset;
[0022] Calculate the third difference between the first top offset and the first reference offset, wherein the first top offset is the displacement in the first coordinate system before and after the scrolling operation is performed;
[0023] Calculate the second quotient of the third difference and the display content height corresponding to the display content of the first target indicator module, and use the second quotient as the normalized position parameter of the first target indicator module;
[0024] The first module identifier of the first target indicator module and the normalized position parameter of the first target indicator module are used as the synchronization parameters.
[0025] In one possible implementation, the collaborative operation is a drawing operation, and determining the first target indicator module corresponding to the collaborative operation based on the coordinates of the displayed content of the at least one indicator module in a first coordinate system includes:
[0026] Determine the coordinate information of at least one operation point corresponding to the drawing operation;
[0027] The determined operation point coordinate information is matched with the coordinates of the display content of the at least one indicator module in the first coordinate system;
[0028] The indicator module that is successfully matched is taken as the first target indicator module.
[0029] In one possible implementation, generating synchronization parameters based on at least one of a first position coordinate, the current coordinates of a first display area, and a first module identifier includes:
[0030] For each operation point, based on the first position coordinates of the first target indicator module corresponding to the operation point and the operation point coordinate information of the operation point, normalized drawing data of the operation point is generated, wherein the normalized drawing data represents the normalized position of the drawing operation in the display content of the first target indicator module.
[0031] The first module identifier and normalized plotting data of each group of first target indicator modules are used as the synchronization parameters, wherein the first module identifier and normalized plotting data of each group of first target indicator modules correspond to an operation point.
[0032] In one possible implementation, the first position coordinates include the coordinates of the first upper-left corner of the display content of the first target indicator module in the first coordinate system. The step of generating normalized drawing data for the operation point based on the first position coordinates of the first target indicator module corresponding to the operation point and the operation point coordinates of the operation point includes:
[0033] Calculate the difference in horizontal coordinates and the difference in vertical coordinates between the coordinates of the operation point and the coordinates of the first upper left corner;
[0034] Calculate the third quotient of the difference in the horizontal coordinates and the display width of the display content of the first target indicator module, and use the third quotient as the horizontal normalization ratio of the operation point; and calculate the fourth quotient of the difference in the vertical coordinates and the display height of the display content of the first target indicator module, and use the fourth quotient as the vertical normalization ratio of the operation point.
[0035] The horizontal normalization ratio and the vertical normalization ratio are used as the normalized plotting data.
[0036] Secondly, this application provides a cross-device collaborative processing method applied to a second terminal, the method comprising:
[0037] After receiving the synchronization parameters sent by the first terminal, a second target indicator module corresponding to the synchronization parameters is determined based on the synchronization parameters;
[0038] Based on at least one of the synchronization parameters, the third position coordinates, and the current coordinates of the second display area, a display control command is generated, wherein the third position coordinates are the coordinates of the display content of the second target indicator module in the second coordinate system, and the current coordinates of the second display area are the current coordinates of the second display area in the second coordinate system;
[0039] Based on the display control command, after adjusting the display content in the second display area, display content corresponding to the collaborative operation on the first terminal is displayed in the second display area.
[0040] Thirdly, this application provides a terminal, including:
[0041] The first display module is used to display the display content of at least one indicator module in the first display area after responding to a collaborative operation triggered by the user on the first display area of the first terminal.
[0042] The first processing module is configured to determine the first target indicator module corresponding to the collaborative operation based on the coordinates of the displayed content of the at least one indicator module in the first coordinate system; and to generate synchronization parameters based on at least one of the first position coordinates, the current coordinates of the first display area, and the first module identifier, wherein the first position coordinates are the coordinates of the displayed content of the first target indicator module in the first coordinate system, the current coordinates of the first display area are the current coordinates of the first display area in the first coordinate system, and the first module identifier is the identifier of the first target indicator module.
[0043] The sending module is used to send the synchronization parameters to the second terminal so that the second terminal displays the display content corresponding to the collaborative operation on the second display area. The first terminal and the second terminal are located in the same collaborative processing group, which is generated by the first terminal in response to a collaborative creation operation triggered by the user.
[0044] Fourthly, this application provides a terminal, including:
[0045] The receiving module is used to receive the synchronization parameters sent by the first terminal and then determine the second target index module corresponding to the synchronization parameters based on the synchronization parameters.
[0046] The second processing module is used to generate a display control command based on at least one of the synchronization parameter, the third position coordinate, and the current coordinate of the second display area, wherein the third position coordinate is the coordinate of the display content of the second target index module in the second coordinate system, and the current coordinate of the second display area is the current coordinate of the second display area in the second coordinate system;
[0047] The second display module is used to adjust the display content in the second display area based on the display control command, and then display the display content corresponding to the collaborative operation on the first terminal in the second display area.
[0048] Fifthly, this application provides a terminal, including:
[0049] Memory, used to store computer programs;
[0050] A processor, when executing a computer program stored in the memory, implements the method as described in any one of the first aspects, or performs the method as described in any one of the second aspects.
[0051] The beneficial effects of this application are as follows:
[0052] This application provides a cross-device collaborative processing method and terminal. First, in response to a collaborative operation triggered by a user on a first display area of a first terminal, the method displays the content of at least one indicator module in the first display area. Then, based on the coordinates of the display content of the at least one indicator module in a first coordinate system, the method determines the first target indicator module corresponding to the collaborative operation. Next, based on at least one of the coordinates of the display content of the first target indicator module in the first coordinate system (i.e., the first position coordinates), the current coordinates of the first display area in the first coordinate system (i.e., the current coordinates of the first display area), and the identifier of the first target indicator module (i.e., the first module identifier), the method generates synchronization parameters. Finally, the method sends the synchronization parameters to a second terminal so that the second terminal displays the content corresponding to the collaborative operation on the second display area. The first terminal and the second terminal are located in the same collaborative processing group, which is generated by the first terminal in response to a collaborative creation operation triggered by a user. In the above method, an internal "collaboration channel" is established between the first terminal and the second terminal, which overcomes the operation synchronization lag caused by reliance on external tools. Secondly, by transmitting structured synchronization parameters consisting of module coordinates, display area coordinates and module identifiers, the existing screen screenshots and text descriptions are replaced, enabling the second terminal to accurately locate and restore the operation scene of the first terminal, which significantly improves the accuracy and efficiency of information transmission. Attached Figure Description
[0053] Figure 1 A flowchart illustrating a cross-device collaborative processing method provided in an embodiment of this application;
[0054] Figure 2 A flowchart illustrating another cross-device collaborative processing method provided in this application embodiment;
[0055] Figure 3 A schematic diagram of a first display area provided in an embodiment of this application;
[0056] Figure 4 This is a schematic diagram of a second display area provided in an embodiment of this application;
[0057] Figure 5 A schematic diagram of a process for generating synchronization parameters provided in an embodiment of this application;
[0058] Figure 6 A flowchart illustrating the generation of display control instructions is provided for an embodiment of this application;
[0059] Figure 7 A schematic diagram of another first display area provided in an embodiment of this application;
[0060] Figure 8 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application;
[0061] Figure 9 This is a schematic diagram of the structure of another terminal provided in an embodiment of this application;
[0062] Figure 10 This is a schematic diagram of another terminal structure provided in an embodiment of this application. Detailed Implementation
[0063] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application. Unless otherwise specified, the embodiments and features in the embodiments of this application can be arbitrarily combined with each other. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than that shown here.
[0064] The terms "first" and "second" in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the term "comprising" and any variations thereof are intended to cover non-exclusive protection. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or devices. The term "multiple" in this application can mean at least two, for example, two, three, or more, and the embodiments of this application do not impose limitations.
[0065] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of this application, including various details to aid understanding. These embodiments should be considered merely exemplary. Therefore, those skilled in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope of this application. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description. It should be noted that in the embodiments of this application, certain existing industry solutions such as software, components, and models may be mentioned. These should be considered exemplary, intended only to illustrate the feasibility of implementing the technical solutions of this application, and do not imply that the applicant has already used or necessarily used such solutions.
[0066] The acquisition, transmission, storage, and use of data in this application all comply with the requirements of relevant national laws and regulations.
[0067] Before introducing the cross-device collaborative processing method provided in the embodiments of this application, the technical background of the embodiments of this application will be described in detail below for ease of understanding.
[0068] In today's data-driven business decision-making environment, data metrics systems have become core tools for enterprise operations, monitoring, and strategic planning. These systems typically provide analysts, managers, and business personnel with critical business insights through rich visualizations, dashboards, and reports.
[0069] However, existing data indicator system design paradigms are mainly optimized around scenarios of individual users and independent operations. Their core functions focus on individuals' exploration, filtering, and interpretation of data, lacking efficient and in-depth group collaboration capabilities.
[0070] When multiple team members or cross-departmental collaborators need to collectively discuss, reach consensus, or assign tasks around the same set of core data metrics, they often rely on external, independent communication tools (such as instant messaging software or email). During this process, the initiator must manually capture screenshots of the system area and describe the location of the metrics, data status, and points of concern in text, leading to information delays. Secondly, while general screen sharing allows for synchronous operation, its pixel-level transmission cannot adapt to multi-device displays and cannot focus on core metric modules.
[0071] To address the aforementioned issues, this application provides a cross-device collaborative processing method and terminal. For ease of understanding, the cross-device collaborative processing method and terminal provided in this application will be described in detail below with reference to the accompanying drawings.
[0072] like Figure 1 The diagram shown is a flowchart illustrating a cross-device collaborative processing method provided in an embodiment of this application. This method is applied to a first terminal, and is detailed below:
[0073] S101: After responding to a collaborative operation triggered by a user on the first display area of the first terminal, display the display content of at least one indicator module in the first display area;
[0074] S102: Based on the coordinates of the display content of the at least one indicator module in the first coordinate system, determine the first target indicator module corresponding to the collaborative operation;
[0075] S103: Generate synchronization parameters based on at least one of the first position coordinates, the current coordinates of the first display area, and the first module identifier, wherein the first position coordinates are the coordinates of the display content of the first target indicator module in the first coordinate system, the current coordinates of the first display area are the current coordinates of the first display area in the first coordinate system, and the first module identifier is the identifier of the first target indicator module.
[0076] S104: Send the synchronization parameters to the second terminal so that the second terminal displays the display content corresponding to the collaborative operation on the second display area, wherein the first terminal and the second terminal are located in the same collaborative processing group, and the collaborative processing group is generated by the first terminal in response to the collaborative creation operation triggered by the user.
[0077] The cross-device collaborative processing method for a first terminal provided in this application firstly responds to a collaborative operation triggered by a user on a first display area of the first terminal, then displays the display content of at least one indicator module in the first display area. Next, based on the coordinates of the display content of the at least one indicator module in a first coordinate system, a first target indicator module corresponding to the collaborative operation is determined. Then, based on at least one of the coordinates of the display content of the first target indicator module in the first coordinate system (i.e., the first position coordinates), the current coordinates of the first display area in the first coordinate system (i.e., the current coordinates of the first display area), and the identifier of the first target indicator module (i.e., the first module identifier), synchronization parameters are generated. Finally, the synchronization parameters are sent to a second terminal so that the second terminal displays the display content corresponding to the collaborative operation on a second display area. The first terminal and the second terminal are located in the same collaborative processing group, which is generated by the first terminal in response to a collaborative creation operation triggered by a user. In the above method, an internal "collaboration channel" is established between the first terminal and the second terminal, which overcomes the operation synchronization lag caused by reliance on external tools. Secondly, by transmitting structured synchronization parameters consisting of module coordinates, display area coordinates and module identifiers, the existing screen screenshots and text descriptions are replaced, enabling the second terminal to accurately locate and restore the operation scene of the first terminal, which significantly improves the accuracy and efficiency of information transmission.
[0078] In one implementation, such as Figure 2 The diagram shown is a flowchart illustrating another cross-device collaborative processing method provided in this application embodiment. This method is applied to a second terminal, and is detailed below:
[0079] S201: After receiving the synchronization parameters sent by the first terminal, determine the second target indicator module corresponding to the synchronization parameters based on the synchronization parameters;
[0080] S202: Based on at least one of the synchronization parameters, the third position coordinates, and the current coordinates of the second display area, generate a display control command, wherein the third position coordinates are the coordinates of the display content of the second target index module in the second coordinate system, and the current coordinates of the second display area are the current coordinates of the second display area in the second coordinate system;
[0081] S203: Based on the display control command, after adjusting the display content in the second display area, display the display content corresponding to the collaborative operation on the first terminal in the second display area.
[0082] The cross-device collaborative processing method for a second terminal provided in this application first receives synchronization parameters sent by a first terminal, then determines a second target indicator module corresponding to the synchronization parameters. Next, based on at least one of the synchronization parameters, the third position coordinates of the display content of the second target indicator module in the second coordinate system, and the current coordinates of the second display area in the second coordinate system, a display control command is generated. Based on the display control command, the display content in the second display area is adjusted, and then the display content corresponding to the collaborative operation on the first terminal is displayed in the second display area. This method, by receiving and parsing synchronization parameters from the first terminal, enables the second terminal to recreate the operating perspective and interactive content of the first terminal based on its own screen attributes and coordinate system. This achieves precise operation synchronization and adaptive display across devices, while ensuring lightweight and low-latency command transmission. It significantly improves the real-time performance and consistency of operation synchronization between multiple terminals, overcoming the problems of low information transmission efficiency and delayed operation synchronization caused by reliance on external tools.
[0083] In one embodiment, a collaborative processing group is constructed to trigger a cross-device collaborative processing method. By establishing collaborative units with clear permissions and data scope, the foundation is laid for subsequent collaborative activities such as synchronization operations and task assignment between the group master terminal and member terminals.
[0084] Specifically, the collaborative processing group is created by a user with initiation authority (referred to as the "group owner") on their terminal (i.e., the first terminal, which represents the group owner's terminal in this application) through a data indicator system. The group owner initiates the creation command and configures the basic attributes of the collaborative processing group, including setting the group name and associating it with a specific range of data indicators (e.g., "monthly revenue indicator for the e-commerce industry").
[0085] After the collaborative processing group is created, the group owner invites other users to join as members via a generated invitation link or QR code. Invited members confirm their joining on their respective terminals (i.e., the second terminal, representing the member's terminal in this application). The second terminal is then automatically bound to the collaborative processing group and its associated specific indicator range. This process eliminates the need for members to manually navigate or switch within the data indicator system, achieving a seamless experience of immediate association upon entry. This significantly lowers the operational threshold for joining collaborative scenarios and ensures that all participating terminals can quickly enter a unified collaborative context.
[0086] Once the collaborative processing group is successfully created, it marks the start of a cross-device collaborative session between the group owner's first terminal and the second terminals of each member. Subsequently, the group owner's operations within the associated indicator range on the first terminal will be collected, and synchronization parameters will be generated and sent to and synchronized with each second terminal that has joined the group, based on the cross-device collaborative processing method of this application. This achieves seamless triggering and execution from group creation to real-time collaboration.
[0087] It should be noted that during cross-device collaborative processing, the group owner (i.e., the user of the first terminal) has full management authority over the collaborative processing group. For example, the group owner can remove specific members or disband the entire collaborative processing group at any time through the management interface provided by the system. After the group is disbanded, all real-time operation synchronization and task assignment functions associated with that group will immediately terminate. At the same time, all historical operation records and task data generated during the existence of the collaborative processing group will continue to be fully stored in the data indicator system database for subsequent auditing, tracing, and analysis.
[0088] In the embodiments of this application, such as Figure 3 The diagram shown is a schematic representation of a first display area provided in an embodiment of this application. Figure 3 Part (A) is a schematic diagram of the initial first display area of the first terminal. The first coordinate system is established based on the initial first display area of the first terminal. The origin of the first coordinate system is the upper left corner of the initial first display area of the first terminal. The positive x-axis of the first coordinate system is horizontal to the right, and the positive y-axis of the first coordinate system is vertical to the down.
[0089] refer to Figure 3 In part (A), the initial first display area displays indicator module 1 and indicator module 2. The coordinates of the displayed content of indicator module 1 in the first coordinate system include the initial upper left corner coordinates (0, 100) and the initial lower left corner coordinates (0, 400); the coordinates of the displayed content of indicator module 2 in the first coordinate system include the initial upper left corner coordinates (0, 450) and the initial lower left corner coordinates (0, 800); at the same time, the initial upper left corner coordinates of the initial first display area in the first coordinate system are (0, 0), the initial lower left corner coordinates of the initial first display area in the first coordinate system are (0, 800), and the height of the first display area (along the y-axis direction) is 800.
[0090] The second coordinate system is established based on the initial second display area of the second terminal, such as... Figure 4 The diagram shown is a schematic representation of a second display area provided in an embodiment of this application. Figure 4Part (A) is a schematic diagram of the initial second display area of the first terminal. The origin of the second coordinate system is the upper left corner of the initial second display area of the second terminal. The positive x-axis of the second coordinate system is horizontal to the right, and the positive y-axis of the second coordinate system is vertical to the down.
[0091] refer to Figure 4 In part (A), the initial second display area displays indicator module A and indicator module B. The coordinates of the display content of indicator module A in the second coordinate system include the initial upper left corner coordinate information (0, 80) and the initial lower left corner coordinate information (0, 320). The display height (along the y-axis direction) of the display content of indicator module A is 240, and the display width (along the x-axis direction) of the display content of indicator module A is 480.
[0092] The coordinates of the displayed content of indicator module B in the second coordinate system include the initial upper left corner coordinate information (0, 360) and the initial lower left corner coordinate information (0, 640). The display height (along the y-axis direction) of the displayed content of indicator module B is 280, and the display width (along the x-axis direction) of the displayed content of indicator module B is 480.
[0093] Meanwhile, the initial upper left corner coordinates of the initial second display area in the second coordinate system are (0, 0), the initial lower left corner coordinates of the initial second display area in the second coordinate system are (0, 500), and the height of the second display area (along the y-axis) is 500.
[0094] In one embodiment, when the collaborative operation triggered by the user on the first display area of the first terminal is a scrolling operation, in response to the user's scrolling operation, the display content of at least one indicator module is displayed in the first display area, and the first target indicator module corresponding to the scrolling operation is determined by the following method:
[0095] First, for each indicator module in at least one indicator module, based on the second position coordinates of the displayed content of the indicator module in the first coordinate system and the current coordinates of the first display area, the display ratio of the displayed content of the indicator module in the first display area is calculated. The second position coordinates include the second upper left corner coordinate information and the second lower left corner coordinate information of the displayed content of the indicator module in the first coordinate system. The current coordinates of the first display area include the first current upper left corner coordinate information and the first current lower left corner coordinate information of the first display area in the first coordinate system.
[0096] Specifically, the maximum value between the ordinate of the second top-left corner coordinate information and the ordinate of the first current top-left corner coordinate information is taken as the first target ordinate value, and the minimum value between the ordinate of the second bottom-left corner coordinate information and the ordinate of the first current bottom-left corner coordinate information is taken as the second target ordinate value.
[0097] Calculate the first difference between the ordinate values of the first target and the ordinate values of the second target;
[0098] The first quotient of the first difference and the display height of the display content of the indicator module is used as the display ratio of the indicator module, wherein the display ratio represents the percentage of the visible part of the indicator module in the first display area to the display height of the indicator module itself.
[0099] Finally, among the calculated display ratios, the indicator modules whose display ratios are greater than or equal to a preset threshold are selected as the first target indicator modules.
[0100] For example, such as Figure 3 As shown, Figure 3 Part (A) in the diagram is the initial first display area. Figure 3 Part (B) is the first display area after a user scrolls through the system, where the scrolling operation involves moving 300 units along the positive y-axis of the first coordinate system. Specifically, the displacement (i.e., the first top offset) in the first coordinate system is 300 units before and after the scrolling operation. Figure 3 In part (B), the first display area displays indicator module 1, indicator module 2 and indicator module 3. The current coordinates of the first display area include the first current upper left corner coordinate information (0, 300) and the first current lower left corner coordinate information (0, 1100) of the first display area in the first coordinate system.
[0101] For indicator module 1, the second position coordinates of the display content of indicator module 1 in the first coordinate system include the second upper left corner coordinate information (0, 100) and the second lower left corner coordinate information (0, 400) of the display content of indicator module 1 in the first coordinate system. The display height of the display content of indicator module 1 is 300 and the display width of the display content of indicator module 1 is 600.
[0102] Compare the ordinate value of the second top-left corner coordinate information (0, 100) with the ordinate value of the first current top-left corner coordinate information (0, 300), and select the maximum value as the first target ordinate value, that is, the first target ordinate value of indicator module 1 is 300; at the same time, compare the ordinate value of the second bottom-left corner coordinate information (0, 400) with the ordinate value of the first current bottom-left corner coordinate information (0, 1100), and select the minimum value as the second target ordinate value, that is, the second target ordinate value of indicator module 1 is 400;
[0103] Calculate the first difference between the ordinate values of the first target and the second target, i.e., 400-300=100;
[0104] Calculate the first quotient between the first difference and the display height of the content displayed in indicator module 1, i.e., 100 / 300=1 / 3, and use the first quotient as the display ratio of indicator module 1.
[0105] For indicator module 2, the second position coordinates of the display content of indicator module 2 in the first coordinate system include the second upper left corner coordinate information (0, 450) and the second lower left corner coordinate information (0, 800) of the display content of indicator module 2 in the first coordinate system. The display height of the display content of indicator module 2 is 350 and the display width of the display content of indicator module 2 is 600.
[0106] Compare the ordinate value of the second top-left corner coordinate information (0, 450) with the ordinate value of the first current top-left corner coordinate information (0, 300), and select the maximum value as the first target ordinate value, that is, the first target ordinate value of indicator module 2 is 450; at the same time, compare the ordinate value of the second bottom-left corner coordinate information (0, 800) with the ordinate value of the first current bottom-left corner coordinate information (0, 1100), and select the minimum value as the second target ordinate value, that is, the second target ordinate value of indicator module 2 is 800;
[0107] Calculate the first difference between the ordinate values of the first target and the second target, i.e., 800-450=350;
[0108] Calculate the first quotient between the first difference and the display height of the content displayed in indicator module 2, i.e., 350 / 350=1, and use the first quotient as the display ratio of indicator module 2.
[0109] For indicator module 3, the second position coordinates of the display content of indicator module 3 in the first coordinate system include the second upper left corner coordinate information (0, 850) and the second lower left corner coordinate information (0, 1250) of the display content of indicator module 3 in the first coordinate system. The display height of the display content of indicator module 3 is 400 and the display width of the display content of indicator module 3 is 600.
[0110] Compare the ordinate value of the second top-left corner coordinate information (0, 850) with the ordinate value of the first current top-left corner coordinate information (0, 300), and select the maximum value as the first target ordinate value, that is, the first target ordinate value of indicator module 3 is 850; at the same time, compare the ordinate value of the second bottom-left corner coordinate information (0, 1250) with the ordinate value of the first current bottom-left corner coordinate information (0, 1100), and select the minimum value as the second target ordinate value, that is, the second target ordinate value of indicator module 3 is 1100;
[0111] Calculate the first difference between the ordinate values of the first target and the second target, i.e., 1100-850=250;
[0112] Calculate the first quotient between the first difference and the display height of the content displayed in indicator module 3, i.e., 250 / 400=5 / 8, and use the first quotient as the display ratio of indicator module 3.
[0113] Among the calculated display ratios, the indicator modules whose display ratios are greater than or equal to a preset threshold are selected as the first target indicator modules.
[0114] If the preset threshold is 0.9, among the display ratios of indicator module 1, indicator module 2, and indicator module 3, the indicator module with a display ratio greater than or equal to the preset threshold will be used as the first target indicator module, that is, indicator module 2 is the first target indicator module.
[0115] In this embodiment of the application, after determining the first target indicator module corresponding to the scrolling operation by the above method, a synchronization parameter is generated based on at least one of the coordinates of the display content of the first target indicator module in the first coordinate system (i.e., the first position coordinates), the current coordinates of the first display area in the first coordinate system (i.e., the current coordinates of the first display area), and the identifier of the first target indicator module (i.e., the first module identifier).
[0116] Specifically, the first position coordinates include the first upper left corner coordinate information and the first lower left corner coordinate information of the display content of the first target indicator module in the first coordinate system, and the display height of the display content of the first target indicator module is the difference between the vertical coordinate value of the first lower left corner coordinate information and the vertical coordinate value of the first upper left corner coordinate information.
[0117] One of the core steps in generating synchronization parameters is calculating normalized position parameters, which are used to accurately recreate the viewing angle of the first terminal on the second terminal. For example... Figure 5 The diagram shown is a flowchart illustrating the generation of synchronization parameters according to an embodiment of this application. The specific process is as follows:
[0118] S501: Calculate the second difference between the vertical coordinate value of the first upper left corner coordinate information and half the height of the first display area, and use the second difference as the first reference offset;
[0119] The first reference offset represents the theoretical position to which the first display area should scroll when the first target indicator module is vertically centered within the first display area. If the first display area is scrolled to this offset, the vertical center of the first target indicator module will be aligned with the vertical center of the first display area.
[0120] S502: Calculate the third difference between the first top offset and the first reference offset;
[0121] The third difference represents the displacement difference between the current actual scroll position of the first display area and the baseline state of "centering the first target index module";
[0122] If the third difference is positive (i.e., the first top offset is greater than the first reference offset), it means that the current first display area is lower than the position corresponding to the reference state.
[0123] If the third difference is negative (i.e., the first top offset is less than the first reference offset), it means that the current first display area is positioned higher than the reference state.
[0124] If the third difference is zero (i.e., the first top offset equals the first reference offset), it means that the current first display area is at the position corresponding to the reference state.
[0125] S503: Calculate the second quotient of the third difference and the display content height corresponding to the display content of the first target indicator module, and use the second quotient as the normalized position parameter of the first target indicator module;
[0126] Specifically, the formula for calculating the normalized position parameters is as follows:
[0127] norm_scroll_ratio=[scroll_y-(y1-screen_h / 2)] / h Formula 1
[0128] Where norm_scroll_ratio is the normalized position parameter, scroll_y is the first top offset, y1 is the ordinate value of the first top left corner coordinate information, screen_h is the height of the first display area, y1-screen_h / 2 is the first reference offset, and h is the height of the display content corresponding to the display content of the first target indicator module.
[0129] The normalized position parameter represents the displacement difference between the current actual scroll position of the first display area and the reference state of "centering the first target indicator module", and is the proportion of the display height of the first target indicator module itself.
[0130] S504: Use the first module identifier of the first target indicator module and the normalized position parameter of the first target indicator module as synchronization parameters.
[0131] For example, refer to Figure 3 In part (B), taking the first target indicator module (i.e. indicator module 2) determined in the above example as an example, the first upper left corner coordinate information of the first target indicator module is the second upper left corner coordinate information of indicator module 2, i.e. (0, 450), the display content height corresponding to the display content of the first target indicator module is the display content height of indicator module 2, which is 350, the first display area height is 800, and the first top offset is 300.
[0132] Calculate the second difference between the ordinate value of the first upper left corner coordinate information and the height of half of the first display area, and use the second difference as the first reference offset, i.e., 450-400=50;
[0133] Calculate the third difference between the first top offset and the first reference offset, i.e., 300-50=250;
[0134] Calculate the second quotient between the third difference and the height of the display content corresponding to the display content of the first target indicator module, and use the second quotient as the normalized position parameter of the first target indicator module, i.e. 250 / 350=0.714;
[0135] The module identifier of indicator module 2 (i.e., the first module identifier of the first target indicator module) and the normalized position parameter of the first target indicator module (i.e., 0.714) are used as synchronization parameters.
[0136] In this embodiment, synchronization parameters are generated and sent to the second terminal using the normalized position parameters of the first target module instead of the first position coordinates of the first target module. This enables the second terminal to accurately calculate the local scroll position required to restore the same visual focus under different screen sizes and resolutions, thereby achieving precise cross-device view synchronization.
[0137] In one embodiment, after the second terminal receives the synchronization parameters sent by the first terminal, it parses the synchronization parameters and determines that the synchronization parameters include the first module identifier of the first target indicator module and the normalized position parameter of the first target indicator module.
[0138] Based on the correspondence between the first module identifier and the second module identifier, determine the second module identifier corresponding to the first module identifier;
[0139] The indicator module corresponding to the second module identifier is used as the second target indicator module.
[0140] For example, as Figure 3 The first display area shown and as Figure 4 As shown in the second display area, the correspondence between the first module identifier and the second module identifier is as follows: the first module identifier is the module identifier of indicator module 1, and the corresponding second module identifier is the module identifier of indicator module A; the first module identifier is the module identifier of indicator module 2, and the corresponding second module identifier is the module identifier of indicator module B; the first module identifier is the module identifier of indicator module 3, and the corresponding second module identifier is the module identifier of indicator module C.
[0141] Accordingly, if the first module in the synchronization parameters received by the second terminal is identified as "the module identifier of indicator module 2", then the corresponding second module can be identified as "the module identifier of indicator module B", and the indicator module identified as "the module identifier of indicator module B" in the second terminal can be identified as the second target indicator module.
[0142] In this embodiment of the application, the third position coordinate of the display content of the second target indicator module in the second coordinate system includes the third upper left corner coordinate information of the second target indicator module in the second coordinate system. Based on at least one of the synchronization parameter, the third position coordinate of the second target indicator module, and the current coordinate of the second display area in the second coordinate system, a display control command is generated.
[0143] Specifically, such as Figure 6 The diagram shown is a flowchart illustrating the generation of display control instructions according to an embodiment of this application. The specific process is as follows:
[0144] S601: Calculate the fourth difference between the vertical coordinate value of the third upper left corner coordinate information and the height of half of the second display area, and use the fourth difference as the second reference offset;
[0145] The second reference offset characterizes the theoretical position to which the second display area should scroll when the second target index module is vertically centered within the second display area.
[0146] S602: Calculate the first product of the normalized position parameter and the display height of the display content of the second target index module, and use the first product as the adjustment offset;
[0147] The adjustment offset represents the additional scrolling adjustment that needs to be made based on the second reference offset in order for the second display area to display the content corresponding to the collaborative operation on the first terminal.
[0148] S603: Calculate the first sum of the second reference offset and the adjustment offset, and use the first sum as the second top offset;
[0149] S604: Generate display control instructions based on the second top offset.
[0150] Specifically, the formula for calculating the second top offset is as follows:
[0151] scroll_y'=norm_scroll_ratio×h'+(y1'-screen_h' / 2) Formula 2
[0152] Where scroll_y' is the second top offset, norm_scroll_ratio is the normalized position parameter, h' is the display height of the content displayed in the second target indicator module, norm_scroll_ratio×h' is the adjustment offset, y1' is the ordinate value of the third top left corner coordinate information, screen_h' is the height of the second display area, and y1'-screen_h' / 2 is the second reference offset.
[0153] For example, the second display area currently displayed on the second terminal is Figure 4 As shown in part (A), the second target indicator module is indicator module B. Therefore, the third upper left corner coordinate information of the second target indicator module is (0, 360), the display height of the display content of the second target indicator module is 280, the height of the second display area is 500, and the normalized position parameter is 0.714.
[0154] Calculate the fourth difference between the vertical coordinate value of the third upper left corner coordinate information and the height of half of the second display area. Use the fourth difference as the second reference offset, i.e., 360-250=110.
[0155] Calculate the first product of the normalized position parameter and the display height of the display content of the second target index module, and use the first product as the adjustment offset, i.e. 0.714×250=178.5;
[0156] The first sum of the second reference offset and the adjustment offset is calculated, and this first sum is used as the second top offset, i.e., 110 + 178.5 = 288.5. Finally, based on the second top offset, a display control command is generated to make the second display area display the content corresponding to the collaborative operation on the first terminal.
[0157] In another embodiment, to ensure the stability of view synchronization and the integrity of the displayed content, after calculating the first sum of the second reference offset and the adjustment offset, and using the first sum as the second top offset, it is determined whether the second top offset is within the preset scroll range, wherein the lower limit of the preset scroll range is zero, and the upper limit of the preset scroll range is the maximum scrollable offset of the second display area.
[0158] If the second top offset is less than the lower limit, the second top offset is modified to zero to prevent blank or meaningless negative offset at the top of the screen due to excessive upward scrolling.
[0159] If the second top offset is greater than the maximum scrollable offset, the second top offset is modified to the maximum scrollable offset to prevent the bottom of the screen from exceeding the actual content range due to excessive downward scrolling, and to ensure that the bottom of the second display area is aligned with the bottom of the content or remains within the effective content area.
[0160] The above embodiments, by introducing this boundary protection mechanism, ensure that the generated display control commands are always valid, thereby guaranteeing the stability and reliability of the cross-device view synchronization process and avoiding display abnormalities or errors caused by coordinate out-of-bounds errors.
[0161] In this embodiment, after the second terminal generates a display control command based on the second top offset, it will perform an actual adjustment to the second display area. The current coordinates of the second display area include the second current upper left corner coordinates and the second current lower left corner coordinates of the second display area in the second coordinate system.
[0162] The specific process of adjusting the second display area based on the second top offset is as follows:
[0163] Calculate the sum of the ordinate value of the second current top-left corner coordinate information and the second top offset value, and use this sum as the ordinate value in the target's top-left corner coordinate information.
[0164] Calculate the third sum of the ordinate value of the second current lower left corner coordinate information and the second top offset, and use the third sum as the ordinate value in the target lower left corner coordinate information;
[0165] Based on the ordinate values of the top-left corner and bottom-left corner coordinates of the target, the target display area on the second terminal is determined.
[0166] For example, the second display area currently displayed on the second terminal is Figure 4 As shown in part (A), the second current upper left corner coordinate information of the second display area in the second coordinate system is (0, 0), the second current lower left corner coordinate information of the second display area in the second coordinate system is (0, 500), and the calculated second top offset is 288.5;
[0167] Calculate the sum of the ordinate value of the second current top-left corner coordinate information and the second top offset, and use the second sum as the ordinate value in the target top-left corner coordinate information, i.e., 0 + 288.5 = 288.5;
[0168] Calculate the third sum of the ordinate value of the second current lower left corner coordinate information and the second top offset, and use the third sum as the ordinate value in the target lower left corner coordinate information, i.e., 500 + 288.5 = 788.5;
[0169] Therefore, as Figure 4 The second display area shown in part (B) should be adjusted to the target display area in the vertical coordinate range [258.5, 788.5], so as to restore the view content corresponding to the first terminal on the second terminal and achieve accurate visual synchronization.
[0170] The collaborative processing method for a second terminal provided in this application firstly calculates the target display area using normalized position parameters and its own screen parameters, rather than using the position coordinate information of an indicator module. This completely solves the adaptation problems of layout disorder, incomplete content display, or proportional misalignment caused by differences in screen size and resolution, ensuring that a reasonably laid out and focused view can be reproduced on any terminal. Secondly, through lightweight synchronization parameter transmission and localized rendering, the data transmission burden and latency of traditional screen sharing technologies are avoided, enabling the operating perspective of the first terminal to be quickly and accurately reproduced on the second terminal. This effectively overcomes the problems of information synchronization lag and context breakage caused by relying on external tools and manual screenshots.
[0171] In another embodiment, when the collaborative operation is a drawing operation, the first target index module corresponding to the collaborative operation is first determined by the following method:
[0172] Determine the coordinate information of at least one operation point corresponding to the drawing operation, wherein the coordinate information of the operation point describes the specific position of the drawing trajectory (such as the starting point, passing points and the ending point of the line) in the first coordinate system; match the determined coordinate information of the operation point with the coordinates of the display content of at least one indicator module in the first coordinate system; if the coordinate information of an operation point is located in the display area corresponding to the display content of an indicator module, then the operation point is considered to match the indicator module, and the successfully matched indicator module is taken as the first target indicator module.
[0173] Secondly, after determining the first target indicator module corresponding to each operation point, for each collected operation point, based on the first position coordinates of the first target indicator module corresponding to the operation point and the operation point coordinate information of the operation point, normalized drawing data of the operation point is generated. The first position coordinates include the first upper left corner coordinate information of the display content of the first target indicator module in the first coordinate system, and the normalized drawing data represents the normalized position of the drawing operation in the display content of the first target indicator module.
[0174] Specifically, calculate the difference between the horizontal coordinate of the operation point coordinate information and the horizontal coordinate of the first upper left corner coordinate information, and calculate the difference between the vertical coordinate of the operation point coordinate information and the vertical coordinate of the first upper left corner coordinate information.
[0175] Calculate the third quotient of the difference in horizontal coordinates and the display width of the display content of the first target indicator module, and use the third quotient as the horizontal normalization ratio of the operation point; and calculate the fourth quotient of the difference in vertical coordinates and the display height of the display content of the first target indicator module, and use the fourth quotient as the vertical normalization ratio of the operation point.
[0176] The horizontal and vertical normalization ratios of each operation point are grouped together, and the horizontal and vertical normalization ratios corresponding to all operation points are used as normalized plotting data.
[0177] Finally, the first module identifier and normalized plotting data of each group of first target indicator modules are used as synchronization parameters, where each group of first target indicator modules corresponds to an operation point.
[0178] For example, with reference Figure 3 Based on the first visible area shown in section (A), the drawing operation includes three operation points: the start point, the turning point, and the end point, as shown in section (A). Figure 7 As shown in part (A) of this application, it is a schematic diagram of another first display area provided in the embodiment of this application, wherein the operation point coordinate information of the starting point is (300, 500), the operation point coordinate information of the turning point is (450, 400), and the operation point coordinate information of the ending point is (500, 300).
[0179] For the starting point, the first target indicator module corresponding to the starting point is determined to be indicator module 2, the first upper left corner coordinate information of the first target indicator module is (0, 450), and the display height of the display content of the first target indicator module is 350, and the display width of the display content of the first target indicator module is 600.
[0180] First, calculate the horizontal and vertical coordinate differences between the operation point coordinates and the coordinates of the first upper left corner of the first target indicator module.
[0181] Specifically, the starting point's coordinates are (300, 500), and the first top-left corner of the first target indicator module is (0, 450). Calculate the horizontal coordinate difference between the horizontal coordinate of the starting point and the horizontal coordinate of the first top-left corner, i.e., 300 - 0 = 300; calculate the vertical coordinate difference between the vertical coordinate of the starting point and the vertical coordinate of the first top-left corner, i.e., 500 - 450 = 50.
[0182] Secondly, calculate the third quotient of the difference in horizontal coordinates and the display width of the display content of the first target indicator module, and use the third quotient as the horizontal normalization ratio of the operation point, i.e., 300 / 600=0.5; calculate the fourth quotient of the difference in vertical coordinates and the display height of the display content of the first target indicator module, and use the fourth quotient as the vertical normalization ratio of the operation point, i.e., 50 / 350=0.143.
[0183] Therefore, the horizontal normalization ratio corresponding to the starting point is 0.5, and the vertical normalization ratio is 0.143.
[0184] For the turning point, the first target indicator module corresponding to the turning point is determined to be indicator module 1, the first upper left corner coordinate information of the first target indicator module is (0, 100), and the display height of the display content of the first target indicator module is 300, and the display width of the display content of the first target indicator module is 600.
[0185] First, calculate the horizontal and vertical coordinate differences between the operation point coordinates and the coordinates of the first upper left corner of the first target indicator module.
[0186] Specifically, the operation point coordinates of the turning point are (450, 400), and the coordinates of the first upper left corner of the first target indicator module are (0, 100). Calculate the horizontal coordinate difference between the horizontal coordinate of the operation point and the horizontal coordinate of the first upper left corner, i.e., 450-0=450; calculate the vertical coordinate difference between the vertical coordinate of the operation point and the vertical coordinate of the first upper left corner, i.e., 400-100=300.
[0187] Secondly, calculate the third quotient of the difference in horizontal coordinates and the display width of the display content of the first target indicator module, and use the third quotient as the horizontal normalization ratio of the operation point, i.e., 450 / 600=0.75; calculate the fourth quotient of the difference in vertical coordinates and the display height of the display content of the first target indicator module, and use the fourth quotient as the vertical normalization ratio of the operation point, i.e., 300 / 300=1.
[0188] Therefore, the horizontal normalization ratio corresponding to the inflection point is 0.75, and the vertical normalization ratio is 1.
[0189] For the endpoint, the first target indicator module corresponding to the endpoint is determined to be indicator module 1, the first upper left corner coordinate information of the first target indicator module is (0, 100), and the display height of the display content of the first target indicator module is 300, and the display width of the display content of the first target indicator module is 600.
[0190] First, calculate the horizontal and vertical coordinate differences between the operation point coordinates and the coordinates of the first upper left corner of the first target indicator module.
[0191] Specifically, the coordinates of the endpoint operation point are (500, 300), and the coordinates of the first upper left corner of the first target indicator module are (0, 100). Calculate the difference between the horizontal coordinates of the operation point and the horizontal coordinates of the first upper left corner, i.e., 500 - 0 = 500; calculate the difference between the vertical coordinates of the operation point and the vertical coordinates of the first upper left corner, i.e., 300 - 100 = 200.
[0192] Secondly, calculate the third quotient of the difference in horizontal coordinates and the display width of the display content of the first target indicator module, and use the third quotient as the horizontal normalization ratio of the operation point, i.e., 500 / 600=0.833; calculate the fourth quotient of the difference in vertical coordinates and the display height of the display content of the first target indicator module, and use the fourth quotient as the vertical normalization ratio of the operation point, i.e., 200 / 300=0.667.
[0193] Therefore, the horizontal normalization ratio corresponding to the endpoint is 0.833, and the vertical normalization ratio is 0.667.
[0194] Finally, the first module identifier (i.e., indicator module 2) and normalized plotted data (horizontal normalization ratio 0.5, vertical normalization ratio 0.143) of the first target indicator module corresponding to the starting point, the first module identifier (i.e., indicator module 1) and normalized plotted data (horizontal normalization ratio 0.75, vertical normalization ratio 1) of the first target indicator module corresponding to the turning point, and the first module identifier (i.e., indicator module 1) and normalized plotted data (i.e., horizontal normalization ratio 0.833, vertical normalization ratio 0.667) of the first target indicator module corresponding to the ending point are sent to the second terminal as synchronization parameters.
[0195] In the above method, by sending the relative proportion of the generated operation point to the upper left corner of its first target indicator module to the second terminal, regardless of the screen size, resolution or actual rendering size of the module of the second terminal, the normalized proportion is reverse-calculated into accurate local coordinates for drawing, thereby ensuring that the shape, direction and relative position of the annotation lines are consistent across all devices, and achieving accurate visual reproduction across devices.
[0196] In another embodiment, after receiving the synchronization parameters, the second terminal parses the synchronization parameters. If it is determined that the synchronization parameters include the first module identifier of the first target indicator module and the normalized drawing data, the second target indicator module is determined using the following method:
[0197] First, the synchronization parameters are determined to include at least one set of first module identifiers and normalized drawing data. Then, for each set of first module identifiers, based on the correspondence between the first module identifier and the second module identifier, the indicator module corresponding to the second module identifier corresponding to the first module identifier is determined as the second target indicator module.
[0198] In this embodiment of the application, after determining the second target indicator module, a display control instruction is generated based on at least one of the synchronization parameter, the third position coordinate, and the current coordinate of the second display area. The normalized drawing data in the synchronization parameter includes the horizontal normalization ratio and the vertical normalization ratio. The third position coordinate includes the third upper left corner coordinate information of the display content of the second target indicator module in the second coordinate system and the third lower left corner coordinate information of the display content of the second target indicator module in the second coordinate system.
[0199] Specifically, for each group of first module identifiers and normalized drawing data, calculate the second product of the horizontal normalization ratio and the display width of the display content of the second target indicator module corresponding to the first module identifier, and use the second product as the horizontal restoration offset; and calculate the third product of the vertical normalization ratio and the display height of the display content of the second target indicator module, and use the third product as the vertical restoration offset.
[0200] Calculate the fourth sum of the horizontal coordinate value of the third upper left corner coordinate information and the horizontal restoration offset, and calculate the fifth sum of the vertical coordinate value of the third lower left corner coordinate information and the vertical restoration offset;
[0201] Use the fourth sum as the x-axis and the fifth sum as the y-axis to generate the restored coordinates.
[0202] Based on all the generated restored coordinates, a display control instruction is generated. This instruction controls the rendering engine of the second terminal to connect all the restored coordinates on the second target indicator module according to the specified order, color, and line attributes, thereby accurately restoring the drawing trajectory that is completely consistent with that of the first terminal.
[0203] For example, as shown in the example above, the synchronization parameters include the first module identifier (i.e., indicator module 2) and normalized plotted data (horizontal normalization ratio 0.5, vertical normalization ratio 0.143) of the first target indicator module corresponding to the starting point, the first module identifier (i.e., indicator module 1) and normalized plotted data (horizontal normalization ratio 0.75, vertical normalization ratio 1) of the first target indicator module corresponding to the ending point, and the first module identifier (i.e., indicator module 1) and normalized plotted data (i.e., horizontal normalization ratio 0.833, vertical normalization ratio 0.667) of the first target indicator module corresponding to the ending point.
[0204] Regarding the starting point, Figure 4In the second display area shown in part (A), after determining that the second target indicator module corresponding to the first module identifier (i.e. indicator module 2) is indicator module B, the third upper left corner coordinate information of the second target indicator module is (0, 360), the display height of the display content of the second target indicator module is 280, and the display width of the display content of the second target indicator module is 480.
[0205] Calculate the second product of the horizontal normalization ratio and the display width of the display content of the second target index module corresponding to the first module identifier, and use the second product as the horizontal restoration offset, i.e. 0.5×480=240;
[0206] Calculate the third product of the vertical normalization ratio and the display height of the display content of the second target index module, and use the third product as the vertical restoration offset, i.e., 0.143×280=40.04;
[0207] Calculate the sum of the x-coordinate value of the third top-left corner coordinate information and the fourth value of the horizontal restoration offset, i.e., 0 + 240 = 240;
[0208] Calculate the sum of the ordinate value of the third top-left corner coordinate information and the fifth vertical offset value, i.e., 360 + 40.04 = 400.04;
[0209] Finally, using the fourth sum as the x-axis value and the fifth sum as the y-axis value, the restored coordinates corresponding to the starting point are (240, 400.04).
[0210] Regarding turning points, refer to Figure 4 In the second display area shown, after determining that the second target indicator module corresponding to the first module identifier (i.e. indicator module 1) is indicator module A, the third upper left corner coordinate information of the second target indicator module is (0, 80), the display height of the display content of the second target indicator module is 240, and the display width of the display content of the second target indicator module is 480.
[0211] Calculate the second product of the horizontal normalization ratio and the display width of the display content of the second target index module corresponding to the first module identifier, and use the second product as the horizontal restoration offset, i.e. 0.75×480=360;
[0212] Calculate the third product of the vertical normalization ratio and the display height of the display content of the second target index module, and use the third product as the vertical restoration offset, i.e., 1×240=240.
[0213] Calculate the sum of the x-coordinate value of the third top-left corner coordinate information and the fourth value of the horizontal restoration offset, i.e., 0 + 360 = 360;
[0214] Calculate the sum of the ordinate value of the third top-left corner coordinate information and the fifth vertical offset value, i.e., 80 + 240 = 320;
[0215] Finally, using the fourth sum as the x-axis value and the fifth sum as the y-axis value, the restored coordinates corresponding to the turning point are (360, 320).
[0216] For the destination, refer to Figure 4 In the second display area shown, after determining that the second target indicator module corresponding to the first module identifier (i.e. indicator module 1) is indicator module A, the third upper left corner coordinate information of the second target indicator module is (0, 80), the display height of the display content of the second target indicator module is 240, and the display width of the display content of the second target indicator module is 480.
[0217] Calculate the second product of the horizontal normalization ratio and the display width of the display content of the second target index module corresponding to the first module identifier, and use the second product as the horizontal restoration offset, i.e. 0.833×480=399.84;
[0218] Calculate the third product of the vertical normalization ratio and the display height of the display content of the second target index module, and use the third product as the vertical restoration offset, i.e. 0.667×240=160.08;
[0219] Calculate the sum of the x-coordinate value of the third top-left corner coordinate information and the fourth value of the horizontal restoration offset, i.e., 0 + 399.84 = 399.84;
[0220] Calculate the sum of the ordinate value of the third top-left corner coordinate information and the fifth vertical offset value, i.e., 80 + 160.08 = 240.08;
[0221] Finally, using the fourth sum as the x-axis value and the fifth sum as the y-axis value, the restored coordinates corresponding to the endpoint are generated as (399.84, 240.08).
[0222] Based on the restored coordinates of the starting point (240, 400.04), the restored coordinates of the turning point (360, 320), and the restored coordinates of the ending point (399.84, 240.08), display control instructions are generated to connect all the restored coordinates in a specified order (i.e., starting point - turning point - ending point), thereby accurately recreating a drawing trajectory that is completely consistent with the first terminal. Figure 7 The second display area is shown in section (B) of the diagram.
[0223] In another embodiment, when the collaborative operation is a click operation (such as page navigation, data expansion, etc.), the system responds to a click operation triggered by the user in the first display area of the first terminal and obtains the first target object of the click operation in the first display area (such as the control element of the clicked button).
[0224] Based on the coordinates of the first object in the first coordinate system and the coordinates of the display content of at least one indicator module in the first coordinate system, after determining the first target indicator module corresponding to the click operation, the first module identifier of the first target indicator module and the first object identifier of the first target object (such as btn_submit, tab_detail) are used as synchronization parameters so that the second terminal displays the display content corresponding to the click operation on the second display area.
[0225] After the second terminal receives the synchronization parameters, it parses the synchronization parameters and determines that the synchronization parameters include the first module identifier of the first target indicator module and the first object identifier of the first target object. Based on the correspondence between the first module identifier and the second module identifier, it determines the second module identifier corresponding to the first module identifier and uses the indicator module corresponding to the second module identifier as the second target indicator module.
[0226] And based on the correspondence between the first object identifier and the second object identifier, the second object identifier corresponding to the first object identifier is determined, and the second object corresponding to the second object identifier is used as the second target object, wherein the second target object is an interface control on the second terminal that has the same function as the first target terminal;
[0227] Based on the second target indicator module and the second target object, a display control instruction is generated so that the second display area displays the content corresponding to the click operation on the first terminal.
[0228] In another embodiment, when the collaborative operation is a task assignment operation, in response to the task assignment operation triggered by the user in the first display area of the first terminal, the first target indicator module and task information corresponding to the task assignment operation are determined based on the coordinates of the display content of at least one indicator module in the first coordinate system, wherein the task information includes task content and a specified execution terminal identifier.
[0229] The first module identifier and task information of the first target indicator module are sent to the second terminal as synchronization parameters, so that the second terminal displays the content corresponding to the task issuance operation on the second display area.
[0230] After the second terminal receives the synchronization parameters, it parses the synchronization parameters and determines that the synchronization parameters include the first module identifier of the first target indicator module and the task information. Then, it judges whether the terminal identifier of the second terminal matches the execution terminal identifier specified in the task information.
[0231] If a match is found, based on the correspondence between the first module identifier and the second module identifier, the second module identifier corresponding to the first module identifier is determined, and the indicator module corresponding to the second module identifier is taken as the second target indicator module.
[0232] Based on the task information in the synchronization parameters, a display control command is generated so that the second display area displays the task information corresponding to the task operation.
[0233] It should be noted that task status includes four categories: Pending Receive, Processing, Completed, and Rejected. Users on the second terminal can manage task status changes on their own terminals, such as updating the status from "Pending Receive" to "Processing," and updating it to "Completed" or "Rejected" upon completion. Feedback, including text, images, or attachments, can be submitted during or after status updates. Any changes to task status and submitted feedback will be synchronized in real time to all online terminals within the collaborative processing group, updating the group's task records and ensuring all members have a unified and timely understanding of task progress.
[0234] In this embodiment of the application, the group owner can grant the permission to "assist in issuing tasks" to specific members through the group management function, and can set the validity period of the permission (e.g., 24 hours, 7 days), wherein the built-in timer monitors and manages the validity period of the authorization in real time;
[0235] During the validity period, authorized members can initiate task assignments within the scope of indicators associated with the collaborative processing group. The tasks they assign are distinguished from those assigned by the group owner in the system records by using different identifiers.
[0236] When the authorization expires or the group owner manually revokes the permission in advance, the "Assist in issuing tasks" function entry will be automatically hidden from the member, preventing them from initiating new tasks.
[0237] Changes in permission status do not affect the normal processing flow of assigned tasks; all created tasks continue to flow independently.
[0238] In one embodiment, before sending synchronization parameters to the second terminal, the method further includes:
[0239] Detect the network connection status of the second terminal;
[0240] If the network connection is online, the synchronization parameters will be sent to the second terminal.
[0241] If the network connection is offline, the synchronization parameters will be cached until the network connection of the second terminal is online.
[0242] In this embodiment, to ensure the effectiveness of offline data management and resource utilization, structured storage and lifecycle management are implemented for cached data. Specifically, cached data is jointly classified and stored according to "collaborative processing group identifier" and "member identifier," with priority given to ensuring the integrity of the latest operation status and unreceived tasks. Secondly, a configurable storage duration (e.g., 1-30 days, default 7 days) is provided for cached data. Expired data will be automatically migrated from the cache to a persistent archive for long-term retention (e.g., archived data is retained for 90 days). Expired archived data is cleaned up according to system policies. Members can retrieve archived data through dedicated entry points such as "historical collaboration records," thereby achieving seamless synchronization of operations in offline mode and full-link traceability of the collaboration process.
[0243] Based on the same inventive concept, this application also provides a terminal. The implementation principle of the terminal is similar to that of the cross-device collaborative processing method applied to the first terminal. The specific implementation of the terminal can be found in the aforementioned cross-device collaborative processing method embodiment applied to the first terminal. Repeated details will not be repeated.
[0244] like Figure 8 The diagram shown is a structural schematic of a terminal provided in an embodiment of this application, including:
[0245] The first display module 801 is used to display the display content of at least one indicator module in the first display area after responding to a collaborative operation triggered by the user on the first display area of the first terminal.
[0246] The first processing module 802 is configured to determine the first target indicator module corresponding to the collaborative operation based on the coordinates of the display content of the at least one indicator module in the first coordinate system; and to generate synchronization parameters based on at least one of the first position coordinates, the current coordinates of the first display area, and the first module identifier, wherein the first position coordinates are the coordinates of the display content of the first target indicator module in the first coordinate system, the current coordinates of the first display area are the current coordinates of the first display area in the first coordinate system, and the first module identifier is the identifier of the first target indicator module.
[0247] The sending module 803 is used to send the synchronization parameters to the second terminal so that the second terminal displays the display content corresponding to the collaborative operation on the second display area. The first terminal and the second terminal are located in the same collaborative processing group, which is generated by the first terminal in response to a collaborative creation operation triggered by the user.
[0248] In one embodiment, the collaborative operation is a scrolling browsing operation, and the first processing module 802 is specifically used for:
[0249] For each of the at least one indicator module, based on the second position coordinates of the displayed content of the indicator module in the first coordinate system and the current coordinates of the first display area, the display ratio of the displayed content of the indicator module in the first display area is calculated.
[0250] Among the calculated display ratios, the indicator modules whose display ratios are greater than or equal to a preset threshold are selected as the first target indicator modules.
[0251] In one embodiment, the second position coordinates include the second upper left corner coordinates of the display content of the indicator module in the first coordinate system, and the second lower left corner coordinates of the display content of the indicator module in the first coordinate system. The current coordinates of the first display area include the first current upper left corner coordinates of the first display area in the first coordinate system, and the first current lower left corner coordinates of the first display area in the first coordinate system.
[0252] The first processing module 802 is specifically used for:
[0253] The maximum value between the ordinate of the second top-left corner coordinate information and the ordinate of the first current top-left corner coordinate information is taken as the first target ordinate value, and the minimum value between the ordinate of the bottom-left corner coordinate information and the ordinate of the first current bottom-left corner coordinate information is taken as the second target ordinate value.
[0254] Calculate the first difference between the ordinate value of the first target and the ordinate value of the second target;
[0255] The first quotient of the first difference and the first quotient of the display height of the display content of the indicator module is used as the display ratio.
[0256] In one embodiment, the first position coordinates include the first upper left corner coordinate information of the display content of the first target indicator module in the first coordinate system, and the first lower left corner coordinate information of the display content of the first target indicator module in the first coordinate system.
[0257] The first processing module 802 is specifically used for:
[0258] Calculate the difference between the ordinate value of the first upper left corner coordinate information and half the height of the first display area, and use the second difference as the first reference offset;
[0259] Calculate the third difference between the first top offset and the first reference offset, wherein the first top offset is the displacement in the first coordinate system before and after the scrolling operation is performed;
[0260] Calculate the second quotient of the third difference and the display content height corresponding to the display content of the first target indicator module, and use the second quotient as the normalized position parameter of the first target indicator module;
[0261] The first module identifier of the first target indicator module and the normalized position parameter of the first target indicator module are used as the synchronization parameters.
[0262] In one embodiment, the collaborative operation is a drawing operation, and the first processing module 802 is specifically used for:
[0263] Determine the coordinate information of at least one operation point corresponding to the drawing operation;
[0264] The determined operation point coordinate information is matched with the coordinates of the display content of the at least one indicator module in the first coordinate system;
[0265] The indicator module that is successfully matched is taken as the first target indicator module.
[0266] In one embodiment, the first processing module 802 is specifically used for:
[0267] For each operation point, based on the first position coordinates of the first target indicator module corresponding to the operation point and the operation point coordinate information of the operation point, normalized drawing data of the operation point is generated, wherein the normalized drawing data represents the normalized position of the drawing operation in the display content of the first target indicator module.
[0268] The first module identifier and normalized plotting data of each group of first target indicator modules are used as the synchronization parameters, wherein the first module identifier and normalized plotting data of each group of first target indicator modules correspond to an operation point.
[0269] In one embodiment, the first position coordinates include the coordinates of the first upper left corner of the display content of the first target indicator module in the first coordinate system, and the first processing module 802 is specifically used for:
[0270] Calculate the difference in horizontal coordinates and the difference in vertical coordinates between the coordinates of the operation point and the coordinates of the first upper left corner;
[0271] Calculate the third quotient of the difference in the horizontal coordinates and the display width of the display content of the first target indicator module, and use the third quotient as the horizontal normalization ratio of the operation point; and calculate the fourth quotient of the difference in the vertical coordinates and the display height of the display content of the first target indicator module, and use the fourth quotient as the vertical normalization ratio of the operation point.
[0272] The horizontal normalization ratio and the vertical normalization ratio are used as the normalized plotting data.
[0273] Based on the same inventive concept, this application also provides a terminal. The implementation principle of the terminal is similar to that of the cross-device collaborative processing method applied to the second terminal. The specific implementation of the terminal can be found in the aforementioned cross-device collaborative processing method embodiment applied to the second terminal. Repeated details will not be repeated.
[0274] like Figure 9 The diagram shown is a structural schematic of another terminal provided in an embodiment of this application, including:
[0275] The receiving module 901 is used to receive the synchronization parameters sent by the first terminal and then determine the second target index module corresponding to the synchronization parameters based on the synchronization parameters.
[0276] The second processing module 902 is used to generate a display control command based on at least one of the synchronization parameter, the third position coordinate, and the current coordinate of the second display area, wherein the third position coordinate is the coordinate of the display content of the second target index module in the second coordinate system, and the current coordinate of the second display area is the current coordinate of the second display area in the second coordinate system;
[0277] The second display module 903 is used to adjust the display content in the second display area based on the display control command, and then display the display content corresponding to the collaborative operation on the first terminal in the second display area.
[0278] In one embodiment, the receiving module 901 is specifically used for:
[0279] The synchronization parameters include a first module identifier and a normalized position parameter.
[0280] Based on the correspondence between the first module identifier and the second module identifier, determine the second module identifier corresponding to the first module identifier;
[0281] The indicator module corresponding to the second module identifier is used as the second target indicator module.
[0282] In one embodiment, the third position coordinates include the third upper left corner coordinates of the display content of the second target indicator module in the second coordinate system;
[0283] The second processing module 902 is specifically used for:
[0284] Calculate the fourth difference between the ordinate value of the third upper left corner coordinate information and the height of half of the second display area, and use the fourth difference as the second reference offset;
[0285] Calculate the first product of the normalized position parameter and the display height of the display content of the second target index module, and use the first product as the adjustment offset;
[0286] Calculate the first sum of the second reference offset and the adjustment offset, and use the first sum as the second top offset;
[0287] The display control command is generated based on the second top offset.
[0288] In one embodiment, the current coordinates of the second display area include the second current upper left corner coordinates of the second display area in the second coordinate system, and the second current lower left corner coordinates of the second display area in the second coordinate system;
[0289] The second display module 903 is specifically used for:
[0290] Calculate the sum of the ordinate value of the second current top-left corner coordinate information and the second top offset, and use the second sum as the ordinate value in the target top-left corner coordinate information.
[0291] Calculate the third sum of the ordinate value of the second current lower left corner coordinate information and the second top offset, and use the third sum as the ordinate value in the target lower left corner coordinate information;
[0292] Based on the ordinate value of the upper left corner coordinate information and the ordinate value of the lower left corner coordinate information of the target, the target display area on the second terminal is determined.
[0293] In one embodiment, after calculating a first sum of the second reference offset and the adjusted offset, and using the first sum as the second top offset, the second processing module 902 is further configured to:
[0294] Determine whether the second top offset is within a preset scroll range, wherein the lower limit of the preset scroll range is zero, and the upper limit of the preset scroll range is the maximum scrollable offset of the second display area;
[0295] If the second top offset is less than the lower limit, then the second top offset is modified to zero;
[0296] If the second top offset is greater than the maximum scrollable offset, then the second top offset is modified to the maximum scrollable offset.
[0297] In one embodiment, when it is determined that the synchronization parameters include the first module identifier of the first target index module and the normalized drawing data, the receiving module 901 is specifically used for:
[0298] The synchronization parameters include at least one set of first module identifiers and normalized drawing data;
[0299] For each group's first module identifier, based on the correspondence between the first module identifier and the second module identifier, the indicator module corresponding to the second module identifier corresponding to the first module identifier is determined as the second target indicator module.
[0300] In one embodiment, the normalized drawing data includes a horizontal normalization ratio and a vertical normalization ratio, and the third position coordinate includes the third upper left corner coordinate information of the display content of the second target indicator module in the second coordinate system;
[0301] The second processing module 902 is specifically used for:
[0302] For each group of first module identifiers and normalized drawing data, calculate the second product of the horizontal normalization ratio and the display width of the display content of the second target indicator module corresponding to the first module identifier, and use the second product as the horizontal restoration offset; calculate the third product of the vertical normalization ratio and the display height of the display content of the second target indicator module, and use the third product as the vertical restoration offset; calculate the fourth sum of the horizontal coordinate value of the third upper left corner coordinate information and the horizontal restoration offset, and calculate the fifth sum of the vertical coordinate value of the third upper left corner coordinate information and the vertical restoration offset; use the fourth sum as the horizontal coordinate value and the fifth sum as the vertical coordinate value to generate the restored coordinates;
[0303] The display control command is generated based on the generated restored coordinates.
[0304] Based on the same inventive concept, this application also provides a terminal. The implementation principle of this electronic product is similar to that of the cross-device collaborative processing method. The specific implementation of this electronic product can be found in the aforementioned cross-device collaborative processing method embodiments, and the repeated parts will not be described again.
[0305] like Figure 10 The diagram shown is a structural schematic of another terminal provided in an embodiment of this application, including:
[0306] Memory 1001 is used to store computer programs;
[0307] Processor 1002 is configured to call program instructions stored in the memory and execute the following steps according to the obtained program instructions:
[0308] After responding to a collaborative operation triggered by a user on the first display area of the first terminal, the display content of at least one indicator module is displayed in the first display area;
[0309] Based on the coordinates of the displayed content of the at least one indicator module in the first coordinate system, the first target indicator module corresponding to the collaborative operation is determined.
[0310] Synchronization parameters are generated based on at least one of the first position coordinates, the current coordinates of the first display area, and the first module identifier, wherein the first position coordinates are the coordinates of the display content of the first target indicator module in the first coordinate system, the current coordinates of the first display area are the current coordinates of the first display area in the first coordinate system, and the first module identifier is the identifier of the first target indicator module.
[0311] The synchronization parameters are sent to the second terminal so that the second terminal displays the content corresponding to the collaborative operation on the second display area. The first terminal and the second terminal are located in the same collaborative processing group, which is generated by the first terminal in response to a collaborative creation operation triggered by the user.
[0312] Alternatively, the program instructions stored in the memory can be invoked, and the following steps can be executed according to the obtained program instructions:
[0313] After receiving the synchronization parameters sent by the first terminal, a second target indicator module corresponding to the synchronization parameters is determined based on the synchronization parameters;
[0314] Based on at least one of the synchronization parameters, the third position coordinates, and the current coordinates of the second display area, a display control command is generated, wherein the third position coordinates are the coordinates of the display content of the second target indicator module in the second coordinate system, and the current coordinates of the second display area are the current coordinates of the second display area in the second coordinate system;
[0315] Based on the display control command, after adjusting the display content in the second display area, display content corresponding to the collaborative operation on the first terminal is displayed in the second display area.
[0316] Based on the same inventive concept, this application also provides a computer-readable storage medium. The implementation principle of the computer-readable storage medium is similar to that of the cross-device collaborative processing method applied to the first terminal. The specific implementation of the computer-readable storage medium can be found in the aforementioned embodiment of the cross-device collaborative processing method applied to the first terminal. Repeated details will not be repeated.
[0317] Based on the same inventive concept, this application also provides another computer-readable storage medium. The implementation principle of this computer-readable storage medium is similar to that of the cross-device collaborative processing method applied to the second terminal. The specific implementation of this computer-readable storage medium can be found in the aforementioned embodiment of the cross-device collaborative processing method applied to the second terminal. Repeated details will not be repeated.
[0318] Based on the same inventive concept, this application also provides a computer program product. The implementation principle of the computer program product is similar to that of the cross-device collaborative processing method applied to the first terminal. The specific implementation of the computer program product can be found in the aforementioned embodiment of the cross-device collaborative processing method applied to the first terminal. Repeated details will not be repeated.
[0319] Based on the same inventive concept, this application also provides another computer program product. The implementation principle of this computer program product is similar to that of the cross-device collaborative processing method applied to the second terminal. The specific implementation of this computer program product can be found in the aforementioned embodiment of the cross-device collaborative processing method applied to the second terminal. Repeated details will not be repeated.
[0320] The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a computer, cause the computer to perform the cross-device collaborative processing method as described in any of the preceding claims.
[0321] The computer program product includes: computer program code, which, when run on a computer, causes the computer to execute any of the cross-device collaborative processing methods described above.
[0322] This application provides a cross-device collaborative processing method and terminal. First, in response to a collaborative operation triggered by a user on a first display area of a first terminal, the method displays the content of at least one indicator module in the first display area. Then, based on the coordinates of the display content of the at least one indicator module in a first coordinate system, the method determines the first target indicator module corresponding to the collaborative operation. Next, based on at least one of the coordinates of the display content of the first target indicator module in the first coordinate system (i.e., the first position coordinates), the current coordinates of the first display area in the first coordinate system (i.e., the current coordinates of the first display area), and the identifier of the first target indicator module (i.e., the first module identifier), the method generates synchronization parameters. Finally, the method sends the synchronization parameters to a second terminal so that the second terminal displays the content corresponding to the collaborative operation on the second display area. The first terminal and the second terminal are located in the same collaborative processing group, which is generated by the first terminal in response to a collaborative creation operation triggered by a user. In the above method, an internal "collaboration channel" is established between the first terminal and the second terminal, which overcomes the operation synchronization lag caused by reliance on external tools. Secondly, by transmitting structured synchronization parameters consisting of module coordinates, display area coordinates and module identifiers, the existing screen screenshots and text descriptions are replaced, enabling the second terminal to accurately locate and restore the operation scene of the first terminal, which significantly improves the accuracy and efficiency of information transmission.
[0323] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0324] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0325] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0326] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0327] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.
Claims
1. A cross-device collaborative processing method, characterized by, The method applied to a first terminal comprises: displaying display content of at least one index module on a first display area of the first terminal in response to a collaborative operation triggered by a user on the first display area; determining a first target index module corresponding to the collaborative operation based on coordinates of the display content of the at least one index module in a first coordinate system; generating a synchronization parameter based on at least one of a first position coordinate, a current coordinate of the first display area and a first module identifier, wherein the first position coordinate is a coordinate of the display content of the first target index module in the first coordinate system, the current coordinate of the first display area is a current coordinate of the first display area in the first coordinate system, and the first module identifier is an identifier of the first target index module; sending the synchronization parameter to a second terminal to enable the second terminal to display display content corresponding to the collaborative operation on a second display area, wherein the first terminal and the second terminal are located in a same collaborative processing group, and the collaborative processing group is generated by the first terminal in response to a collaborative creation operation triggered by a user; in a case where the collaborative operation is a scroll browsing operation, the synchronization parameter is determined by the following steps: the first position coordinate comprises first top-left corner coordinate information of the display content of the first target index module in the first coordinate system and first top-right corner coordinate information of the display content of the first target index module in the first coordinate system; calculating a second difference value of a vertical coordinate value of the first top-left corner coordinate information and one-half of a first display area height, and taking the second difference value as a first reference offset; calculating a third difference value of a first top offset and the first reference offset, wherein the first top offset is a displacement in the first coordinate system before and after the scroll browsing operation is performed; calculating a second quotient value of the third difference value and a display content height corresponding to the display content of the first target index module, and taking the second quotient value as a normalized position parameter of the first target index module; taking the first module identifier of the first target index module and the normalized position parameter of the first target index module as the synchronization parameter.
2. The method of claim 1, wherein, in a case where the collaborative operation is a scroll browsing operation; the determination of the first target index module corresponding to the collaborative operation based on the coordinates of the display content of the at least one index module in the first coordinate system comprises: for each index module in the at least one index module, calculating a display ratio of the display content of the index module in the first display area based on a second position coordinate of the display content of the index module in the first coordinate system and the current coordinate of the first display area; taking an index module with a display ratio greater than or equal to a preset threshold in the calculated display ratios as the first target index module.
3. The method of claim 2, wherein, The second position coordinates of the display content of the index module in the first coordinate system include second top-left corner coordinate information and second bottom-left corner coordinate information, and the first display region current coordinates include first current top-left corner coordinate information and first current bottom-left corner coordinate information; The calculation of the display proportion of the display content of the index module in the first display region based on the second position coordinates of the display content of the index module in the first coordinate system and the first display region current coordinates includes: The maximum of the vertical coordinate value of the second top-left corner coordinate information and the vertical coordinate value of the first current top-left corner coordinate information is taken as a first target vertical coordinate value, and the minimum of the vertical coordinate value of the second bottom-left corner coordinate information and the vertical coordinate value of the first current bottom-left corner coordinate information is taken as a second target vertical coordinate value; A first difference value of the first target vertical coordinate value and the second target vertical coordinate value is calculated; The first difference value and a first quotient value of the display height of the display content of the index module are taken as the display proportion.
4. The method of claim 1, wherein, In the case that the collaborative operation is a drawing operation, the determination of the first target index module corresponding to the collaborative operation based on the coordinates of the display content of the at least one index module in the first coordinate system includes: Operation point coordinate information of at least one operation point corresponding to the drawing operation is determined; The determined operation point coordinate information is matched with the coordinates of the display content of the at least one index module in the first coordinate system; The index module with which the matching is successful is taken as the first target index module.
5. The method of claim 4, wherein, The generation of the synchronization parameter based on at least one of the first position coordinates, the first display region current coordinates and the first module identifiers includes: For each operation point, the normalized drawing data of the operation point is generated based on the first position coordinates of the first target index module corresponding to the operation point and the operation point coordinate information of the operation point, wherein the normalized drawing data represents the normalized position of the drawing operation in the display content of the first target index module; The first module identifiers and the normalized drawing data of each group of first target index modules are taken as the synchronization parameter, wherein the first module identifiers and the normalized drawing data of each group of first target index modules correspond to one operation point.
6. The method of claim 5, wherein, The first position coordinates of the first target index module in the first coordinate system include first top-left corner coordinate information, and the generation of the normalized drawing data of the operation point based on the first position coordinates of the first target index module corresponding to the operation point and the operation point coordinate information of the operation point includes: The horizontal coordinate difference value and the vertical coordinate difference value of the operation point coordinate information of the operation point and the first top-left corner coordinate information are calculated respectively; calculating a third quotient value of the horizontal coordinate difference value and a display width of the display content of the first target indicator module, taking the third quotient value as a horizontal normalized ratio of the operation point, and calculating a fourth quotient value of the vertical coordinate difference value and a display height of the display content of the first target indicator module, taking the fourth quotient value as a vertical normalized ratio of the operation point; taking the horizontal normalized ratio and the vertical normalized ratio as the normalized drawing data.
7. A cross-device collaboration processing method, characterized by, The method applied to a second terminal comprises: after receiving a synchronization parameter sent by a first terminal, determining a second target indicator module corresponding to the synchronization parameter based on the synchronization parameter; generating a display control instruction based on at least one of the synchronization parameter, a third position coordinate and a second display area current coordinate, wherein the third position coordinate is a coordinate of display content of the second target indicator module in a second coordinate system, and the second display area current coordinate is a current coordinate of a second display area in the second coordinate system; displaying display content corresponding to collaborative operation on the first terminal in the second display area after adjusting the display content in the second display area based on the display control instruction; in a case where the synchronization parameter comprises a first module identifier and a normalized position parameter, the display control instruction is determined by the following steps: the third position coordinate comprises third top-left corner coordinate information of the display content of the second target indicator module in the second coordinate system; calculating a fourth difference value of a vertical coordinate value of the third top-left corner coordinate information and one-half of a second display area height, taking the fourth difference value as a second reference offset; calculating a first product of the normalized position parameter and a display height of the display content of the second target indicator module, taking the first product as an adjustment offset; calculating a first sum value of the second reference offset and the adjustment offset, taking the first sum value as a second top offset; generating the display control instruction based on the second top offset.
8. The method of claim 7, wherein, the determination of the second target indicator module corresponding to the synchronization parameter based on the synchronization parameter comprises: in a case where the synchronization parameter comprises a first module identifier and a normalized position parameter, determining a second module identifier corresponding to the first module identifier based on a corresponding relationship between the first module identifier and the second module identifier; taking an indicator module corresponding to the second module identifier as the second target indicator module.
9. The method of claim 8, wherein, the second display area current coordinate comprises second current top-left corner coordinate information of the second display area in the second coordinate system and second current bottom-left corner coordinate information of the second display area in the second coordinate system; the adjustment of the second display area according to the display control instruction comprises: calculating a second sum value of a vertical coordinate value of the second current top-left corner coordinate information and the second top offset, taking the second sum value as a vertical coordinate value in target top-left corner coordinate information, and a third sum of a vertical coordinate value of the second current bottom-left corner coordinate information and the second top offset is calculated, and the third sum is taken as a vertical coordinate value in target bottom-left corner coordinate information; based on the vertical coordinate value in the target top-left corner coordinate information and the vertical coordinate value in the target bottom-left corner coordinate information, a target display area of the second display area on the second terminal is determined.
10. The method of claim 7, wherein, after the first sum of the second reference offset and the adjustment offset is calculated, and the first sum is taken as the second top offset, the method further comprises: it is judged whether the second top offset is within a preset scrolling range, wherein a lower limit of the preset scrolling range is zero, and an upper limit of the preset scrolling range is a maximum scrollable offset of the second display area; if the second top offset is less than the lower limit, the second top offset is modified to zero; if the second top offset is greater than the maximum scrollable offset, the second top offset is modified to the maximum scrollable offset.
11. The method of claim 7, wherein, in a case where the synchronization parameter comprises a first module identifier of a first target index module and normalized drawing data, the second target index module corresponding to the synchronization parameter is determined based on the synchronization parameter, comprising: it is determined that the synchronization parameter comprises at least one group of first module identifiers and normalized drawing data; for each group of first module identifiers, based on a correspondence between the first module identifier and a second module identifier, an index module corresponding to the second module identifier corresponding to the first module identifier is determined as the second target index module.
12. The method of claim 11, wherein, the normalized drawing data comprises a horizontal normalization ratio and a vertical normalization ratio, and the third position coordinate comprises third top-left corner coordinate information of the display content of the second target index module in the second coordinate system; the display control instruction is generated based on at least one of the synchronization parameter, the third position coordinate and the second display area current coordinate, comprising: for each group of first module identifiers and normalized drawing data, a second product of the horizontal normalization ratio and a display width of the display content of the second target index module corresponding to the first module identifier is calculated, the second product is taken as a horizontal restoration offset, and a third product of the vertical normalization ratio and a display height of the display content of the second target index module is calculated, the third product is taken as a vertical restoration offset; a fourth sum of a horizontal coordinate value of the third top-left corner coordinate information and the horizontal restoration offset is calculated, and a fifth sum of a vertical coordinate value of the third top-left corner coordinate information and the vertical restoration offset is calculated; the fourth sum is taken as a horizontal coordinate value, the fifth sum is taken as a vertical coordinate value, and a restoration coordinate is generated; based on the generated restoration coordinate, the display control instruction is generated.
Citation Information
Patent Citations
Digital intelligent system based on brain map and collaboration
CN113919315A
Multi-party collaborative plotting consultation system
CN114359442A