Page operation method and device

By obtaining and generalizing reference behavior information of reference operations, the problem of reproducing operations on the same functional page in different layouts is solved, precise operation execution on different devices is achieved, and the accuracy and adaptability of operations are improved.

CN119668472APending Publication Date: 2025-03-21CHINA TELECOM CLOUD TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411777568.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-05
Publication Date
2025-03-21

AI Technical Summary

Technical Problem

It is difficult for the prior art to realize the accurate reproduction of reference operations on the same functional page with different layouts, especially in front-end pages across multiple platforms, which need to adapt to the page layout of different devices.

Method used

By obtaining the reference behavior information of the reference operation corresponding to the target operation, including reference click behavior information and reference track behavior information, and determining the target behavior information of the target operation based on the functional correspondence between the target page and the reference page, the target behavior information of the target operation is determined, so as to perform the target operation on the target page.

Benefits of technology

It realizes accurate reproduction of reference operations on the same functional page of different layouts, adapts to the page layout of different devices, and ensures the accuracy and efficiency of target operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119668472A_ABST
    Figure CN119668472A_ABST
Patent Text Reader

Abstract

The invention relates to a page operation method and device. The method comprises the steps that under the condition that a target operation needs to be executed on a target page, reference behavior information of a reference operation corresponding to the target operation is acquired; wherein the reference operation is an operation executed on a reference page, the reference page and the target page are pages with the same function, and the page layouts of the reference page and the target page are different; the reference behavior information comprises reference click behavior information and reference trajectory behavior information; determining target behavior information of the target operation according to a function corresponding relationship between the target page and the reference page and reference behavior information of the reference operation; and executing the target operation on the target page according to the target behavior information. By adopting the method, accurate reproduction of the reference operation can be realized on the same functional page with different layouts.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a page operation method and device. Background Art

[0002] Nowadays, with the development of the Internet, the front-end pages of various organizations are no longer just used to submit forms, but are often used to visually control various machines. If the actions are more complex, such as dragging with a certain speed and trajectory in addition to clicking buttons, and require frequent operations, users hope to be able to record the operations and automatically complete the corresponding actions when they need to be reproduced.

[0003] Moreover, the front-end pages often span multiple platforms, such as computers, mobile phones, and tablets, and the size and layout of the corresponding operable area will also change. Therefore, in addition to being able to record actions and reproduce actions on the same platform page, it is also necessary to be able to adapt to pages on different devices and generalize the actions. Summary of the invention

[0004] Based on this, it is necessary to provide a page operation method and device that can accurately reproduce the reference operation on the same functional page with different layouts in order to solve the above technical problems.

[0005] In a first aspect, the present application provides a page operation method, comprising:

[0006] In the case where a target operation needs to be performed on a target page, reference behavior information of a reference operation corresponding to the target operation is obtained; wherein the reference operation is an operation performed on a reference page, the reference page and the target page are the same functional page, and the page layouts of the reference page and the target page are different; the reference behavior information includes reference click behavior information and reference track behavior information;

[0007] Determining target behavior information of the target operation according to the functional correspondence between the target page and the reference page, and reference behavior information of the reference operation;

[0008] The target operation is performed on the target page according to the target behavior information.

[0009] In one of the embodiments, the reference trajectory behavior information includes reference segment information of at least two reference movement segments; the reference segment information of each reference movement segment includes reference starting position information, reference ending position information and reference weight of the reference movement segment;

[0010] The target behavior information includes target click behavior information and target trajectory behavior information; the target trajectory behavior information includes target segment information of at least two target movement segments, and the target segment information of each target movement segment includes the target starting position information, target ending position information and target weight of the target movement segment.

[0011] In one embodiment, determining the target behavior information of the target operation according to the functional correspondence between the target page and the reference page and the reference behavior information of the reference operation includes:

[0012] Determining a position mapping relationship between each pixel point of the target page and each pixel point of the reference page according to a functional correspondence relationship between the target page and the reference page;

[0013] Determining target segment information of at least two target movement segments according to the position mapping relationship and reference segment information of each reference movement segment;

[0014] The target click behavior information is determined according to the position mapping relationship and the reference click behavior information.

[0015] In one of the embodiments, determining target segment information of at least two target movement segments according to the position mapping relationship and reference segment information of each reference movement segment includes:

[0016] For any reference movement segment, determining the target starting point position information of the target movement segment corresponding to the reference movement segment according to the position mapping relationship and the reference starting point position information of the reference movement segment;

[0017] Determining target endpoint position information of a target moving segment corresponding to the reference moving segment according to the position mapping relationship and a reference endpoint position relationship of the reference moving segment;

[0018] The reference weight of the reference moving segment is used as the target weight of the target moving segment corresponding to the reference moving segment.

[0019] In one embodiment, performing the target operation on the target page according to the target behavior information includes:

[0020] For each target moving segment, a motion trajectory function of a reference moving segment corresponding to the target moving segment is obtained, and the motion trajectory function is updated according to the target segment information of the target moving segment to obtain a running trajectory corresponding to the target moving segment;

[0021] The target operation is performed on the target page according to the target click behavior information and the running tracks corresponding to each target movement segment.

[0022] In one embodiment, the reference behavior information is obtained by:

[0023] Acquire operation information of a reference operation performed based on the reference page; wherein the operation information includes reference click behavior information of a click operation in the reference operation, horizontal coordinate change information of a moving track of a moving operation relative to the reference page, and vertical coordinate change information of a moving track of a moving operation relative to the reference page;

[0024] Dividing the movement trajectory into at least two reference movement segments according to the reference click behavior information;

[0025] Determine reference starting point position information, reference end point position information and reference motion information of each reference moving segment according to the operation information;

[0026] The reference weight of each reference movement segment is determined according to the reference start position information and the reference end position information of each reference movement segment.

[0027] In one of the embodiments, the reference click behavior information includes click position information and click time of each click behavior;

[0028] The step of dividing the movement trajectory into at least two reference movement segments according to the reference click behavior information includes:

[0029] Dividing the movement trajectory into at least two reference movement segments based on the click time of the click behavior as a dividing point;

[0030] Correspondingly, determining the reference starting point position information, the reference ending point position information and the reference motion information of each reference moving segment according to the operation information includes:

[0031] For any reference movement segment, using the click position information of the click behavior corresponding to the starting time of the reference movement segment as the reference starting position information of the reference movement segment;

[0032] Using the click position information of the click behavior corresponding to the end time of the reference movement segment as the reference end position information of the reference movement segment;

[0033] The reference motion information of the reference movement segment is determined according to the horizontal coordinate change information and the vertical coordinate change information of the movement track corresponding to the reference movement segment relative to the reference page.

[0034] In one embodiment, determining the reference weight of each reference movement segment according to the reference starting point position information and the reference ending point position information of each reference movement segment includes:

[0035] For any reference moving segment, constructing a trajectory control function of the reference moving segment according to the reference motion information of the reference moving segment;

[0036] Based on a preset Gaussian function, according to the reference starting point position information and the reference end point position information of the reference moving segment, constructing an actual cost function of the reference moving segment;

[0037] A reference weight of the reference movement segment is determined according to the actual cost function and the trajectory control function.

[0038] In one embodiment, determining the reference weight of the reference movement segment according to the actual cost function and the trajectory control function includes:

[0039] The sum of the actual cost function and the trajectory control function is used as the motion trajectory function corresponding to the reference moving segment;

[0040] Determining an expected cost function corresponding to the reference moving segment according to the motion trajectory function and the reference motion information;

[0041] Taking the mean square error between the actual cost function and the expected cost function as the objective function;

[0042] The objective function is solved with the goal of minimizing the function value of the objective function to obtain the reference weight of the reference moving segment.

[0043] In a second aspect, the present application further provides a page operation device, comprising:

[0044] An information acquisition module, used for acquiring reference behavior information of a reference operation corresponding to the target operation when a target operation needs to be performed on a target page; wherein the reference operation is an operation performed on a reference page, the reference page and the target page are the same functional page, and the page layouts of the reference page and the target page are different; the reference behavior information includes reference click behavior information and reference track behavior information;

[0045] An information determination module, configured to determine target behavior information of the target operation according to a functional correspondence between the target page and the reference page, and reference behavior information of the reference operation;

[0046] The page operation module is used to perform the target operation on the target page according to the target behavior information.

[0047] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0048] In the case where a target operation needs to be performed on a target page, reference behavior information of a reference operation corresponding to the target operation is obtained; wherein the reference operation is an operation performed on a reference page, the reference page and the target page are the same functional page, and the page layouts of the reference page and the target page are different; the reference behavior information includes reference click behavior information and reference track behavior information;

[0049] Determining target behavior information of the target operation according to the functional correspondence between the target page and the reference page, and reference behavior information of the reference operation;

[0050] The target operation is performed on the target page according to the target behavior information.

[0051] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0052] In the case where a target operation needs to be performed on a target page, reference behavior information of a reference operation corresponding to the target operation is obtained; wherein the reference operation is an operation performed on a reference page, the reference page and the target page are the same functional page, and the page layouts of the reference page and the target page are different; the reference behavior information includes reference click behavior information and reference track behavior information;

[0053] Determining target behavior information of the target operation according to the functional correspondence between the target page and the reference page, and reference behavior information of the reference operation;

[0054] The target operation is performed on the target page according to the target behavior information.

[0055] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0056] In the case where a target operation needs to be performed on a target page, reference behavior information of a reference operation corresponding to the target operation is obtained; wherein the reference operation is an operation performed on a reference page, the reference page and the target page are the same functional page, and the page layouts of the reference page and the target page are different; the reference behavior information includes reference click behavior information and reference track behavior information;

[0057] Determining target behavior information of the target operation according to the functional correspondence between the target page and the reference page, and reference behavior information of the reference operation;

[0058] The target operation is performed on the target page according to the target behavior information.

[0059] The above-mentioned page operation method and device, when it is necessary to perform a target operation on a target page, obtains reference behavior information of a reference operation corresponding to the target operation, including reference click behavior information and reference trajectory behavior information. Since the reference operation is an operation performed on a reference page, and the reference page and the target page are the same functional pages with different page layouts, the reference operation can be accurately generalized based on the functional correspondence between the target page and the reference page, and the reference behavior information of the reference operation, to ensure the accuracy of the target behavior information of the target operation obtained, and to ensure that there is a small error between the target behavior information and the reference behavior information; further, based on the target behavior information, the accuracy of the target operation performed on the target page can be guaranteed. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0061] Figure 1 A schematic diagram of a flow chart of a page operation method in one embodiment;

[0062] Figure 2 A schematic diagram of a process for determining target behavior information of a target operation in one embodiment;

[0063] Figure 3 A schematic diagram of a process of determining target segment information of a target moving segment in one embodiment;

[0064] Figure 4 A schematic diagram of a process of executing a target operation on a target page in one embodiment;

[0065] Figure 5 A schematic diagram of a process for determining reference starting point position information, reference end point position information and reference motion information in one embodiment;

[0066] Figure 6 A schematic diagram of a flow chart of determining a reference weight of each reference moving segment in one embodiment;

[0067] Figure 7 A schematic diagram of a flow chart of determining a reference weight of a reference moving segment in one embodiment;

[0068] Figure 8 A schematic diagram of a flow chart of a page operation method in another embodiment;

[0069] Fig. 9 is a structural block diagram of a page operation device in an embodiment;

[0070] Fig.10 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0071] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0072] The page operation method provided in the embodiment of the present application can be applied to an application environment where the page operation of a business system or other operating system needs to be automatically reproduced. The page operation method provided in the embodiment of the present application can be executed by a computer device, which can be a server or a terminal with powerful computing power.

[0073] In one embodiment, Figure 1 As shown, a page operation method is provided, which is described by taking the method applied to a server as an example, and specifically includes the following steps:

[0074] S101, when a target operation needs to be performed on a target page, obtaining reference behavior information of a reference operation corresponding to the target operation.

[0075] The target page can be any page that can be operated, for example, the target page can be an operation page of any business system. The target operation is the operation that needs to be performed on the target page. The reference operation is the operation performed on the reference page. The reference page and the target page are the same functional page, and the page layouts of the reference page and the target page are different; the reference operation and the target operation are operations that perform the same function; the reference behavior information includes but is not limited to reference click behavior information, reference track behavior information, and input behavior information.

[0076] It should be noted that reference operations include but are not limited to click operations, move operations, input operations, etc. If a user performs a click operation on a reference page, reference click behavior information will be generated. For example, reference click behavior information includes but is not limited to the position and size of the clicked functional element in the reference page, the click time, etc. If a user performs a move operation on a reference page, reference trajectory behavior information will be generated based on the movement trajectory; for example, reference trajectory behavior information includes but is not limited to the ordinate and abscissa of the movement trajectory relative to the reference page; correspondingly, if a user performs an input operation on the reference page, input behavior information will be generated; for example, input behavior information includes but is not limited to the input content and input time, etc.

[0077] Exemplarily, before the user performs the reference operation on the reference page, he / she will click the operation recording button provided on the reference page; thereafter, the server will record the user's behavior every 10 ms using a three-dimensional array (x, y, z), where x represents the horizontal coordinate of the movement trajectory relative to the page, y represents the vertical coordinate of the movement trajectory relative to the page, and z represents the mouse click operation, which is 1 if pressed and 0 if not pressed. When z changes, the position and size of the page element at the change point are recorded. If a keyboard operation is performed, the elements and input of the keyboard operation are recorded separately, and the time point of the keyboard operation is also recorded.

[0078] It should be noted that, since the reference operation is generally a continuous operation, the movement trajectory corresponding to the movement operation in the reference operation will also be continuous. Considering this situation, in order to ensure that the movement trajectory can be accurately and conveniently recorded and analyzed, in one embodiment, the movement trajectory can be divided into at least two reference movement segments. Accordingly, the reference trajectory behavior information includes reference segment information of at least two reference movement segments; and the reference segment information of each reference movement segment includes reference starting point position information, reference end point position information and reference weight of the reference movement segment. Among them, the reference starting point position information represents the position information of the movement starting point of the reference movement segment; the reference end point position information represents the position information of the movement end point of the reference movement segment; and the reference weight represents the weight of the reference movement segment.

[0079] Optionally, when the server detects that a target operation needs to be performed on a target page, the server obtains reference behavior information of a reference operation corresponding to the target operation that is pre-stored in a memory.

[0080] S102, determining target behavior information of the target operation according to the functional correspondence between the target page and the reference page, and reference behavior information of the reference operation.

[0081] Among them, the target behavior information represents the behavior required to perform the target operation; in the embodiment of the present application, when the movement trajectory is divided into at least two reference movement segments, the reference movement segments correspond to a target movement segment respectively. Therefore, in the embodiment of the present application, the target behavior information includes target click behavior information and target trajectory behavior information; the target trajectory behavior information includes target segment information of at least two target movement segments, and the target segment information of each target movement segment includes the target starting position information, target end position information and target weight of the target movement segment.

[0082] It is understandable that the presentation and layout of the page may be different in different terminals. However, when the target page and the reference page are the same functional page, the target page and the reference page have the same functions, for example, the target page and the reference page have exactly the same functional icons. Therefore, according to the functional correspondence between the target page and the reference page, the operation behavior information of the reference operation can be mapped to the target page, and the target behavior information of the target operation can be determined through a preset mapping algorithm.

[0083] S103, performing a target operation on a target page according to the target behavior information.

[0084] Optionally, based on the target behavior information, a dynamic motion primitive model can be introduced to learn the coordinate sequence in the target behavior information, and simulate the optimal movement trajectory of the target operation to obtain the movement trajectory information of the target operation; further, the movement trajectory information is run according to a preset execution script to execute the target operation on the target page.

[0085] In the above-mentioned page operation method, when it is necessary to perform a target operation on a target page, reference behavior information of a reference operation corresponding to the target operation, including reference click behavior information and reference trajectory behavior information, is obtained. Since the reference operation is an operation performed on the reference page, and the reference page and the target page are the same functional pages with different page layouts, the reference operation can be accurately generalized based on the functional correspondence between the target page and the reference page, and the reference behavior information of the reference operation, to ensure the accuracy of the target behavior information of the target operation obtained, and to ensure that there is a small error between the target behavior information and the reference behavior information; further, based on the target behavior information, the accuracy of the target operation performed on the target page can be guaranteed.

[0086] Optionally, in one embodiment, in this case, if Figure 2 As shown, a method for determining target behavior information of a target operation is provided, which specifically includes the following steps:

[0087] S201 : determining a position mapping relationship between each pixel point of the target page and each pixel point of the reference page according to a functional correspondence relationship between the target page and the reference page.

[0088] Optionally, from the above analysis, it can be known that the target page and the reference page are pages of the same function, that is, the target page and the reference page have the same function. Therefore, the position mapping relationship between each pixel point of the target page and each pixel point of the reference page can be determined based on the corresponding relationship between the position of the same function on the target page and the position on the reference page.

[0089] S202: Determine target segment information of at least two target motion segments according to the position mapping relationship and reference segment information of each reference motion segment.

[0090] Optionally, the reference movement fragment corresponding to the reference operation performed on the reference page may be mapped to the target page according to the position mapping relationship.

[0091] S203: Determine target click behavior information according to the position mapping relationship and the reference click behavior information.

[0092] Optionally, based on the position mapping relationship, the reference click behavior based on the reference page can be mapped to the target page, and the target click behavior information based on the reference page can be obtained.

[0093] In this embodiment, taking into account the functional correspondence between the reference page and the target page, a position mapping relationship is introduced, which can accurately map the reference click behavior information based on the reference page to the target page, thereby ensuring the accuracy of the obtained target click behavior information.

[0094] Optionally, in one embodiment, Figure 3 As shown, a method for determining target segment information of at least two target moving segments is provided, which specifically includes the following steps:

[0095] S301 : For any reference movement segment, determine target starting point position information of a target movement segment corresponding to the reference movement segment according to a position mapping relationship and reference starting point position information of the reference movement segment.

[0096] Optionally, for any reference moving fragment, the pixel point corresponding to the reference starting position on the reference page can be determined based on the reference starting position information of the reference moving fragment. Furthermore, based on the position mapping relationship and the pixel point corresponding to the reference starting position on the reference page, the target starting position of the target moving fragment obtained by mapping the starting position of the reference moving fragment to the target page can be determined to obtain the target starting position information.

[0097] S302: Determine target endpoint position information of a target moving segment corresponding to the reference moving segment according to the position mapping relationship and the reference endpoint position relationship of the reference moving segment.

[0098] Correspondingly, the pixel point corresponding to the reference end point position on the reference page can be determined based on the reference end point position relationship of the reference moving fragment. Furthermore, based on the position mapping relationship and the pixel point corresponding to the reference end point position on the reference page, the target end point position of the target moving fragment obtained after mapping the end point position of the reference moving fragment to the target page can be determined to obtain the target end point position information.

[0099] S303: Using the reference weight of the reference moving segment as the target weight of the target moving segment corresponding to the reference moving segment.

[0100] In this embodiment, according to the position mapping relationship, the reference moving segment can be accurately mapped to the target page, and the accuracy of the target starting position information, the target ending position information and the target weight of the obtained target moving segment is guaranteed.

[0101] Optionally, for the target behavior information in S103 in the above embodiment, when the reference trajectory behavior information includes reference segment information of at least two reference moving segments, and the reference segment information of each reference moving segment includes reference starting position information, reference ending position information and reference weight of the reference moving segment, the target behavior information includes target click behavior information and target trajectory behavior information; the target trajectory behavior information includes target segment information of at least two target moving segments, and the target segment information of each target moving segment includes target starting position information, target ending position information and target weight of the target moving segment. In this case, according to the target behavior information, the method of performing the target operation on the target page can also be: for each target moving segment, obtain the motion trajectory function of the reference moving segment corresponding to the target moving segment, and update the motion trajectory function according to the target segment information of the target moving segment to obtain the running trajectory corresponding to the target moving segment; according to the target click behavior information and the running trajectory corresponding to each target moving segment, perform the target operation on the target page.

[0102] The motion trajectory function of the reference moving segment is a function that characterizes the motion trajectory of the reference moving segment presented on the reference page; and the running trajectory corresponding to the target moving segment is a function that characterizes the trajectory of the target moving segment presented on the target page.

[0103] Optionally, for each target moving segment, a motion trajectory function of a reference moving segment corresponding to the target moving segment is obtained. It should be noted that a second-order system can be used to model discrete operations according to the moving trajectory of the reference moving segment to obtain the motion trajectory function of the reference moving segment. The motion trajectory function also characterizes the speed and acceleration of the moving process corresponding to the reference moving segment.

[0104] Further, according to the target segment information of the target moving segment, the motion trajectory function is updated to obtain the running trajectory corresponding to the target moving segment, and the target click behavior and the running trajectory corresponding to each target moving segment are spliced, and the target operation is performed on the target page according to the spliced ​​result. It can be understood that by introducing the motion trajectory function, the accuracy of the determined motion trajectory of the target moving segment is guaranteed.

[0105] Optionally, in one embodiment, Figure 4 As shown, a method for performing a target operation on a target page is provided, which specifically includes the following steps:

[0106] S401, obtaining operation information of a reference operation performed based on a reference page.

[0107] The operation information includes reference click behavior information of the click operation in the reference operation, horizontal coordinate change information of the moving track of the moving operation relative to the reference page, and vertical coordinate change information of the moving track of the moving operation relative to the reference page.

[0108] Optionally, operation information of the reference operation performed based on the reference page may be obtained from the memory through the unique identifier of the reference operation.

[0109] As shown in the example of S101 in the above embodiment, the operation information of the reference operation obtained can be represented by a three-dimensional array (x, y, z). For example, in the reference page, click button 1 to turn on the controlled machine, then in the functional element named "Panel" on the reference page, press the left mouse button to draw an "S" shape at the required non-constant speed to control the machine to move along the mouse trajectory, and then click button 2 to turn off the controlled machine. The upper left corner position of button 1 is recorded as (10, 20), and the lower right corner position is (30, 30), the upper left corner position of the "Panel" element is (40, 40), and the lower right corner element is (1440, 1040), and the upper left corner position of button 2 is (1450, 1030), and the lower right corner position is (1470, 1040).

[0110] S402: Divide the movement trajectory into at least two reference movement segments according to the reference click behavior information.

[0111] Optionally, the movement track may be divided into at least two reference movement segments according to the click behavior information and taking the change of the click behavior as a breakpoint.

[0112] Optionally, the reference click behavior information includes click position information and click time of each click behavior; in this case, the movement trajectory can also be divided into at least two reference movement segments based on the click time of the click behavior as a dividing point.

[0113] S403: Determine reference start point position information, reference end point position information, and reference motion information of each reference moving segment according to the operation information.

[0114] Optionally, the reference starting point position information and reference end point position information of each reference moving segment can be determined according to the reference click behavior information in the operation information and based on the segmentation rules of each reference moving segment; further, the reference motion information of the reference moving segment can be determined according to the horizontal coordinate change information and the vertical coordinate change information of the moving trajectory corresponding to the reference moving segment relative to the reference page.

[0115] Exemplarily, if the operation information of the reference operation is represented by a three-dimensional array (x, y, z), the movement trajectory can be divided into at least two reference movement segments according to the coordinate of the change in z. For example, the collected movement trajectory in the above example is divided into 5 segments, namely, movement trajectory 1: click button 1, position (15, 23); movement trajectory 2: from button 1 to the position (1400, 50) of the "panel" element, during which the left mouse button is pressed in the state of 0 (i.e. not pressed); movement trajectory 3: from the position (1400, 50) of the "panel" element to the position (50, 940) of the "panel" element in the required non-constant "S" shape, during which the left mouse button is pressed in the state of 1 (i.e. pressed); movement trajectory 4: from the position (50, 940) of the panel element to the position (1456, 1038) of button 2, during which the left mouse button is pressed in the state of 0; movement trajectory 5: click button 2.

[0116] S404: Determine a reference weight of each reference movement segment according to the reference start position information and the reference end position information of each reference movement segment.

[0117] Optionally, for any reference movement segment, the reference weight of the reference movement segment can be calculated based on a preset calculation formula for the reference weight of the reference movement segment and according to the reference starting position information and the reference ending position information of the reference movement segment.

[0118] In this embodiment, by introducing the operation information of the reference operation, a method for segmenting the movement trajectory is provided, and a method for determining the reference weight of each reference movement segment is also provided.

[0119] Optionally, in one embodiment, the reference click behavior information includes the click position information and click time of each click behavior; in this case, the movement trajectory can also be divided into at least two reference movement segments based on the click time of the click behavior. Figure 5 As shown, a method for determining reference starting point position information, reference end point position information and reference motion information of each reference moving segment is provided, which specifically includes the following steps:

[0120] S501: For any reference movement segment, use the click position information of the click behavior corresponding to the starting time of the reference movement segment as the reference starting position information of the reference movement segment.

[0121] Optionally, since the reference movement segment is obtained based on the click time of the click behavior as the dividing point, for any reference movement segment, the click position information of the click behavior corresponding to the starting time of the reference movement segment can be used as the reference starting position information of the reference movement segment.

[0122] S502: Use the click position information of the click behavior corresponding to the end time of the reference movement segment as the reference end position information of the reference movement segment.

[0123] Correspondingly, when the reference movement segment is obtained by using the click time of the click behavior as a dividing point, the click position information of the click behavior corresponding to the end time of the reference movement segment can be used as the reference end position information of the reference movement segment.

[0124] S503 : Determine reference motion information of the reference moving segment according to the horizontal coordinate change information and the vertical coordinate change information of the moving track corresponding to the reference moving segment relative to the reference page.

[0125] The horizontal coordinate change information reflects the horizontal movement of the moving track; the vertical coordinate change information reflects the vertical movement of the moving track.

[0126] Optionally, a two-dimensional motion function characterizing the movement trajectory corresponding to the reference movement segment can be constructed based on the horizontal coordinate change information and the vertical coordinate change information of the movement trajectory corresponding to the reference movement segment relative to the reference page, and the constructed two-dimensional motion function can be used as the reference motion information of the reference movement segment.

[0127] In this embodiment, by introducing reference starting point position information, reference end point position information and reference motion information of the reference moving segment, a method is provided for determining relevant information of at least two moving segments when the moving trajectory is divided into at least two reference moving segments based on the click time of the click behavior.

[0128] Optionally, in one embodiment, Figure 6 As shown, a method for determining the reference weight of each reference moving segment is provided, which specifically includes the following steps:

[0129] S601 : for any reference moving segment, construct a trajectory control function of the reference moving segment according to the reference motion information of the reference moving segment.

[0130] The trajectory control function of the reference moving segment is a function that controls the motion trajectory function of the reference moving segment.

[0131] Optionally, for any reference moving segment, according to the reference motion information of the reference moving segment, Represents the reference moving segment, and the speed of the reference moving segment can be calculated based on the time step and acceleration , and use a second-order system to model the discrete motion represented by this reference moving segment, obtaining: ,in, is the trajectory control function of the reference moving segment. is the time scaling factor; and are all constants and can be set artificially based on experience, and is the damping coefficient, is the spring coefficient; is the actual cost function; is the target, which indicates the end point of the reference move segment.

[0132] S602: Based on a preset Gaussian function and according to the reference starting point position information and the reference end point position information of the reference moving segment, construct an actual cost function of the reference moving segment.

[0133] Optionally, based on a preset Gaussian function, the process of moving the reference start position information and the reference end position information of the reference segment can be expressed by the following formula (1):

[0134] (1)

[0135] in, represents a regular system, is the regular system parameter; As the basis function, that is, the preset Gaussian function, and obeys A Gaussian distribution centered on , is the width. is the number of basis functions. is the reference weight.

[0136] S603: Determine a reference weight of the reference moving segment according to the actual cost function and the trajectory control function.

[0137] Optionally, from the above analysis, it can be seen that the actual cost function includes the reference weight of the reference moving segment. Therefore, in the embodiment of the present application, the sum of the actual cost function and the trajectory control function can be used as the motion trajectory function corresponding to the reference moving segment, and the motion trajectory function corresponding to the reference moving segment is reversely deduced to obtain the reference weight of the reference moving segment.

[0138] In this embodiment, by introducing the trajectory control function and the actual cost function, the motion process of the moving trajectory of the reference moving segment is accurately simulated and controlled, further ensuring the accuracy of the determined reference weight.

[0139] Optionally, based on the above embodiment, in one embodiment, as Figure 7 As shown, a method for determining a reference weight of a reference moving segment is provided to refine the above S603, and specifically includes the following steps:

[0140] S701 , taking the sum of the actual cost function and the trajectory control function as the motion trajectory function corresponding to the reference moving segment.

[0141] Optionally, as shown in S601 in the above embodiment, the motion trajectory function corresponding to the reference moving segment can be expressed by the following formula (2):

[0142] (2)

[0143] S702: Determine an expected cost function corresponding to the reference motion segment according to the motion trajectory function and the reference motion information.

[0144] According to the motion trajectory function and the reference motion information, the expected cost function corresponding to the reference moving segment can be derived, as shown in the following formula (3):

[0145] (3)

[0146] S703, taking the mean square error between the actual cost function and the expected cost function as the objective function.

[0147] Optionally, the mean square error between the actual cost function and the expected cost function is used as the objective function, which can be expressed by the following formula (4):

[0148] (4)

[0149] S704, solving the objective function with the minimum function value of the objective function as the goal, and obtaining the reference weight of the reference moving segment.

[0150] Optionally, a local weighted regression method may be used to solve the objective function with the minimum function value of the objective function as the goal, and obtain the reference weight of the reference moving segment. Exemplarily, the obtained reference weight is shown in formula (5):

[0151] (5)

[0152] (6)

[0153] (7)

[0154] in, , … represents the dimension of the basis function in time. In the embodiment of the present application, Determined by the time scaling factor, damping coefficient, and spring constant.

[0155] In this embodiment, by introducing the expected cost function and taking the minimum mean square error between the expected cost function and the actual cost function as the goal, the accuracy and precision of the determined reference weights are guaranteed.

[0156] Optionally, in order to more intuitively describe the specific implementation process of the page operation method provided in the embodiment of the present application, in one embodiment, an implementable example is provided.

[0157] (1) Click button 1 on the reference page to turn on the controlled machine. Then, in the element named "Panel" on the page, press the left mouse button to draw an "S" shape at the required non-constant speed to control the machine to move along the mouse trajectory. Then, click button 2 to turn off the controlled machine. Record the upper left corner position of button 1 as (10, 20), and the lower right corner position as (30, 30). The upper left corner position of the "Panel" element is (40, 40), and the lower right corner element is (1440, 1040). The upper left corner position of button 2 is (1450, 1030), and the lower right corner position is (1470, 1040).

[0158] (2) The behavior is divided into 5 sections, namely, behavior 1: click button 1, position is (15, 23); behavior 2: from button 1 to the position (1400, 50) of the "panel" element, during which the left mouse button is pressed in the state of 0 (not pressed); behavior 3: from the position (1400, 50) of the "panel" element to the position (50, 940) of the "panel" element in the required non-constant "S" shape, during which the left mouse button is pressed in the state of 1 (pressed); behavior 4: from the position (50, 940) of the panel element to the position (1456, 1038) of button 2, during which the left mouse button is pressed in the state of 0; behavior 5: click button 2.

[0159] (3) The trajectories involved are behavior 2, behavior 3, and behavior 4. The reference weights of these three trajectories are calculated according to the formulas.

[0160] (4) In the target page, the center positions of button 1 (20, 25) and button 2 (700, 1065) are obtained. The upper left corner position of the "panel" element is (10, 40), and the lower right corner position is (710, 1040). Based on the relative positions, the starting point of new behavior 2 is calculated to be (20, 25) and the end point is (690, 50). The starting point of new behavior 3 is (690, 50) and the end point is (15, 940). The starting point of new behavior 4 is (15, 940) and the end point is (700, 1065). In addition, the click position of new behavior 1 is (20, 25), and the click position of new behavior 5 is (700, 1065).

[0161] (5) Calculate new behavior 2, behavior 3, and behavior 4 based on the new starting point and end point, as well as the basis function weights.

[0162] (6) Reassemble new behaviors 1 to 5 to obtain new behaviors.

[0163] Figure 8 FIG. 2 is a flow chart of a page operation method in another embodiment. Based on the above embodiment, this embodiment provides an optional example of a page operation method. Figure 8 The specific implementation process is as follows:

[0164] S801, obtaining reference click behavior information of a click operation in a reference operation based on a reference page, horizontal coordinate change information of a moving track of a moving operation relative to the reference page, and vertical coordinate change information of a moving track of a moving operation relative to the reference page.

[0165] S802: Divide the movement trajectory into at least two reference movement segments by taking the click time of the click behavior in the reference click behavior information as a dividing point.

[0166] S803: Use the click position information of the click behavior corresponding to the starting point time of each reference movement segment as the reference starting point position information of each reference movement segment.

[0167] S804: Use the click position information of the click behavior corresponding to the end time of each reference movement segment as the reference end position information of each reference movement segment.

[0168] S805 , determining reference motion information of each reference movement segment according to the horizontal coordinate change information and the vertical coordinate change information of the movement track corresponding to each reference movement segment relative to the reference page.

[0169] S806: construct a trajectory control function of each reference movement segment according to the reference motion information of each reference movement segment.

[0170] S807 , constructing an actual cost function of each reference moving segment based on a preset Gaussian function and according to the reference starting point position information and the reference end point position information of each reference moving segment.

[0171] S808 : Determine a reference weight of each reference movement segment according to the actual cost function and the trajectory control function.

[0172] Optionally, the sum of the actual cost function and the trajectory control function is used as the motion trajectory function corresponding to the reference moving segment; the expected cost function corresponding to the reference moving segment is determined based on the motion trajectory function and the reference motion information; the mean square error between the actual cost function and the expected cost function is used as the objective function; the objective function is solved with the minimum function value of the objective function as the goal, and the reference weight of the reference moving segment is obtained.

[0173] S809: Determine a position mapping relationship between each pixel point of the target page and each pixel point of the reference page according to the functional correspondence relationship between the target page and the reference page.

[0174] S810: Determine target segment information of at least two target motion segments according to the position mapping relationship and reference segment information of each reference motion segment.

[0175] Optionally, for any reference moving segment, the target starting point position information of the target moving segment corresponding to the reference moving segment is determined based on the position mapping relationship and the reference starting point position information of the reference moving segment; the target ending point position information of the target moving segment corresponding to the reference moving segment is determined based on the position mapping relationship and the reference ending point position relationship of the reference moving segment; and the reference weight of the reference moving segment is used as the target weight of the target moving segment corresponding to the reference moving segment.

[0176] S811, determining target click behavior information according to the position mapping relationship and reference click behavior information.

[0177] S812, obtaining the motion trajectory function of the reference moving segment corresponding to each target moving segment, and updating each motion trajectory function according to the target segment information of each target moving segment to obtain the running trajectory corresponding to each target moving segment.

[0178] S813, executing the target operation on the target page according to the target click behavior information and the running tracks corresponding to each target movement segment.

[0179] The specific process of the above S801-S813 can be found in the description of the above method embodiment. The implementation principle and technical effect are similar and will not be repeated here.

[0180] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0181] Based on the same inventive concept, the embodiment of the present application also provides a page operation device for implementing the page operation method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more embodiments of the page operation device provided below can refer to the limitations of the page operation method above, and will not be repeated here.

[0182] In an exemplary embodiment, Fig. 9 As shown, a page operation device 900 is provided, comprising: an information acquisition module 910, an information determination module 920 and a page operation module 930, wherein:

[0183] The information acquisition module 910 is used to obtain reference behavior information of a reference operation corresponding to a target operation when it is necessary to perform a target operation on a target page; wherein the reference operation is an operation performed on a reference page, the reference page and the target page are the same functional page, and the page layouts of the reference page and the target page are different; the reference behavior information includes reference click behavior information and reference trajectory behavior information.

[0184] The information determination module 920 is used to determine the target behavior information of the target operation according to the functional correspondence between the target page and the reference page, and the reference behavior information of the reference operation.

[0185] The page operation module 930 is used to perform a target operation on a target page according to the target behavior information.

[0186] The above-mentioned page operation device, when it is necessary to perform a target operation on a target page, obtains reference behavior information of a reference operation corresponding to the target operation, including reference click behavior information and reference trajectory behavior information. Since the reference operation is an operation performed on the reference page, and the reference page and the target page are the same functional pages with different page layouts, the reference operation can be accurately generalized based on the functional correspondence between the target page and the reference page, and the reference behavior information of the reference operation, so as to ensure the accuracy of the target behavior information of the target operation obtained, and to ensure that there is a small error between the target behavior information and the reference behavior information; further, based on the target behavior information, the accuracy of the target operation performed on the target page can be guaranteed.

[0187] In one embodiment, the reference trajectory behavior information includes reference segment information of at least two reference moving segments; the reference segment information of each reference moving segment includes reference starting point position information, reference ending point position information and reference weight of the reference moving segment; the target behavior information includes target click behavior information and target trajectory behavior information; the target trajectory behavior information includes target segment information of at least two target moving segments, and the target segment information of each target moving segment includes target starting point position information, target ending point position information and target weight of the target moving segment.

[0188] In one embodiment, the information determination module 920 includes:

[0189] The relationship determination unit is used to determine the position mapping relationship between each pixel point of the target page and each pixel point of the reference page according to the functional correspondence relationship between the target page and the reference page.

[0190] The first determining unit is configured to determine target segment information of at least two target motion segments according to the position mapping relationship and reference segment information of each reference motion segment.

[0191] The second determining unit is used to determine the target click behavior information according to the position mapping relationship and the reference click behavior information.

[0192] In one embodiment, the first determining unit is specifically configured to:

[0193] For any reference moving segment, the target starting point position information of the target moving segment corresponding to the reference moving segment is determined according to the position mapping relationship and the reference starting point position information of the reference moving segment; the target ending point position information of the target moving segment corresponding to the reference moving segment is determined according to the position mapping relationship and the reference ending point position relationship of the reference moving segment; the reference weight of the reference moving segment is used as the target weight of the target moving segment corresponding to the reference moving segment.

[0194] In one embodiment, the page operation module 930 is specifically used to:

[0195] For each target moving segment, obtain the motion trajectory function of the reference moving segment corresponding to the target moving segment, and update the motion trajectory function according to the target segment information of the target moving segment to obtain the running trajectory corresponding to the target moving segment; according to the target click behavior information and the running trajectory corresponding to each target moving segment, perform the target operation on the target page.

[0196] In one embodiment, the page operation device 900 further includes:

[0197] The first acquisition module is used to obtain operation information of a reference operation performed based on a reference page; wherein the operation information includes reference click behavior information of a click operation in the reference operation, horizontal coordinate change information of a moving trajectory of a moving operation relative to the reference page, and vertical coordinate change information of a moving trajectory of a moving operation relative to the reference page.

[0198] The segment division module is used to divide the movement trajectory into at least two reference movement segments according to the reference click behavior information.

[0199] The first determination module is used to determine the reference starting point position information, the reference ending point position information and the reference motion information of each reference moving segment according to the operation information.

[0200] The weight determination module is used to determine the reference weight of each reference movement segment according to the reference starting point position information and the reference end point position information of each reference movement segment.

[0201] In one embodiment, the reference click behavior information includes the click position information and click time of each click behavior; the segment division module is specifically used to: divide the movement trajectory into at least two reference movement segments based on the click time of the click behavior as a dividing point. Accordingly, the first determination module is also used to:

[0202] For any reference moving segment, the click position information of the click behavior corresponding to the starting time of the reference moving segment is used as the reference starting position information of the reference moving segment; the click position information of the click behavior corresponding to the ending time of the reference moving segment is used as the reference ending position information of the reference moving segment; and the reference motion information of the reference moving segment is determined according to the horizontal coordinate change information and the vertical coordinate change information of the moving trajectory corresponding to the reference moving segment relative to the reference page.

[0203] In one embodiment, the weight determination module includes:

[0204] The first construction unit is used to construct a trajectory control function of any reference movement segment according to the reference motion information of the reference movement segment.

[0205] The second construction unit is used to construct an actual cost function of the reference moving segment based on a preset Gaussian function and according to the reference starting point position information and the reference end point position information of the reference moving segment.

[0206] The weight determination unit is used to determine the reference weight of the reference movement segment according to the actual cost function and the trajectory control function.

[0207] In one embodiment, the weight determination unit is specifically used to:

[0208] The sum of the actual cost function and the trajectory control function is used as the motion trajectory function corresponding to the reference moving segment; the expected cost function corresponding to the reference moving segment is determined according to the motion trajectory function and the reference motion information; the mean square error between the actual cost function and the expected cost function is used as the objective function; the objective function is solved with the minimum function value as the goal to obtain the reference weight of the reference moving segment.

[0209] Each module in the above page operation device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0210] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Fig.10As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a page operation method is implemented.

[0211] Those skilled in the art will understand that Fig.10 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0212] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the steps of the page operation method provided in the above embodiment are implemented.

[0213] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the page operation method provided in the above embodiment are performed.

[0214] In one embodiment, a computer program product is provided, including a computer program, which implements the steps of the page operation method provided in the above embodiment when executed by a processor.

[0215] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0216] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0217] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0218] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A page operation method, characterized in that: The method comprises: In the case where a target operation needs to be performed on a target page, reference behavior information of a reference operation corresponding to the target operation is obtained; wherein the reference operation is an operation performed on a reference page, the reference page and the target page are the same functional page, and the page layouts of the reference page and the target page are different; the reference behavior information includes reference click behavior information and reference track behavior information; Determining target behavior information of the target operation according to the functional correspondence between the target page and the reference page, and reference behavior information of the reference operation; The target operation is performed on the target page according to the target behavior information.

2. The method according to claim 1, characterized in that The reference trajectory behavior information includes reference segment information of at least two reference movement segments; the reference segment information of each reference movement segment includes reference starting point position information, reference end point position information and reference weight of the reference movement segment; The target behavior information includes target click behavior information and target track behavior information; The target trajectory behavior information includes target segment information of at least two target movement segments, and the target segment information of each target movement segment includes target starting point position information, target end point position information and a target weight of the target movement segment.

3. The method according to claim 2, characterized in that The determining the target behavior information of the target operation according to the functional correspondence between the target page and the reference page and the reference behavior information of the reference operation includes: Determining a position mapping relationship between each pixel point of the target page and each pixel point of the reference page according to a functional correspondence relationship between the target page and the reference page; Determining target segment information of at least two target movement segments according to the position mapping relationship and reference segment information of each reference movement segment; The target click behavior information is determined according to the position mapping relationship and the reference click behavior information.

4. The method according to claim 3, characterized in that The determining target segment information of at least two target movement segments according to the position mapping relationship and the reference segment information of each reference movement segment includes: For any reference movement segment, determining the target starting point position information of the target movement segment corresponding to the reference movement segment according to the position mapping relationship and the reference starting point position information of the reference movement segment; Determining target endpoint position information of a target moving segment corresponding to the reference moving segment according to the position mapping relationship and a reference endpoint position relationship of the reference moving segment; The reference weight of the reference moving segment is used as the target weight of the target moving segment corresponding to the reference moving segment.

5. The method according to claim 2, characterized in that: The performing the target operation on the target page according to the target behavior information includes: For each target moving segment, a motion trajectory function of a reference moving segment corresponding to the target moving segment is obtained, and the motion trajectory function is updated according to the target segment information of the target moving segment to obtain a running trajectory corresponding to the target moving segment; The target operation is performed on the target page according to the target click behavior information and the running tracks corresponding to each target movement segment.

6. The method according to claim 2, characterized in that The reference behavior information is obtained in the following manner: Acquire operation information of a reference operation performed based on the reference page; wherein the operation information includes reference click behavior information of a click operation in the reference operation, horizontal coordinate change information of a moving track of a moving operation relative to the reference page, and vertical coordinate change information of a moving track of a moving operation relative to the reference page; Dividing the movement trajectory into at least two reference movement segments according to the reference click behavior information; Determine reference starting point position information, reference end point position information and reference motion information of each reference moving segment according to the operation information; The reference weight of each reference movement segment is determined according to the reference start position information and the reference end position information of each reference movement segment.

7. The method according to claim 6, characterized in that The reference click behavior information includes click position information and click time of each click behavior; The step of dividing the movement trajectory into at least two reference movement segments according to the reference click behavior information includes: Dividing the movement trajectory into at least two reference movement segments based on the click time of the click behavior as a dividing point; Correspondingly, determining the reference starting point position information, the reference ending point position information and the reference motion information of each reference moving segment according to the operation information includes: For any reference movement segment, using the click position information of the click behavior corresponding to the starting time of the reference movement segment as the reference starting position information of the reference movement segment; Using the click position information of the click behavior corresponding to the end time of the reference movement segment as the reference end position information of the reference movement segment; The reference motion information of the reference movement segment is determined according to the horizontal coordinate change information and the vertical coordinate change information of the movement track corresponding to the reference movement segment relative to the reference page.

8. The method according to claim 6, characterized in that The step of determining the reference weight of each reference movement segment according to the reference starting point position information and the reference ending point position information of each reference movement segment includes: For any reference moving segment, constructing a trajectory control function of the reference moving segment according to the reference motion information of the reference moving segment; Based on a preset Gaussian function, according to the reference starting point position information and the reference end point position information of the reference moving segment, constructing an actual cost function of the reference moving segment; A reference weight of the reference movement segment is determined according to the actual cost function and the trajectory control function.

9. The method according to claim 8, characterized in that The determining, according to the actual cost function and the trajectory control function, a reference weight of the reference movement segment comprises: The sum of the actual cost function and the trajectory control function is used as the motion trajectory function corresponding to the reference moving segment; Determining an expected cost function corresponding to the reference moving segment according to the motion trajectory function and the reference motion information; Taking the mean square error between the actual cost function and the expected cost function as the objective function; The objective function is solved with the goal of minimizing the function value of the objective function to obtain the reference weight of the reference moving segment.

10. A page operation device, characterized in that: The device comprises: An information acquisition module, used for acquiring reference behavior information of a reference operation corresponding to the target operation when a target operation needs to be performed on a target page; wherein the reference operation is an operation performed on a reference page, the reference page and the target page are the same functional page, and the page layouts of the reference page and the target page are different; the reference behavior information includes reference click behavior information and reference track behavior information; An information determination module, configured to determine target behavior information of the target operation according to a functional correspondence between the target page and the reference page, and reference behavior information of the reference operation; The page operation module is used to perform the target operation on the target page according to the target behavior information.