Game interface optimization methods based on user operation profiles, servers and storage media
By constructing a timing diagram of the distribution of operational behaviors and a virtual interaction inferrer to optimize the game's interactive interface, the problem of inconsistency between interface layout and user operation behavior in existing technologies has been solved, achieving automated interface configuration optimization and improving the smoothness of interaction.
Patent Information
- Application Number
- CN202611317498.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-08-28
- Publication Date
- 2026-11-10
AI Technical Summary
Existing methods for optimizing game interfaces fail to effectively consider the transfer relationship between the trajectories of adjacent contact points in different interaction areas and the process of contact pressure changes. This results in inconsistencies between the adjusted interface layout and the actual timing of user actions during continuous operation, affecting the smoothness of the interaction.
By constructing a timing diagram of operation behavior distribution, mapping the trajectory of contact points to an adjustable interaction area, generating the directed edge connection density of area transfer and the distribution of area dwell duration, and using a virtual interaction inferrer to perform operation path length and response latency statistics of candidate interface configuration instances under the constraints of virtual touch event playback, the interface configuration is automatically optimized.
It enables interface configuration optimization to be completed under the same operation behavior recording stream without actual deployment, avoiding latency and resource consumption, and improving the adaptability of terminal device interface and user operation behavior.
Smart Images

Figure CN123067983A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of data processing, and in particular to a method for optimizing game interaction interfaces based on user operation profiles, a server, and a storage medium. Background Technology
[0002] Game interface optimization refers to adjusting the geometric position and response sequence of adjustable interactive areas within the display area of a terminal device to improve path length and response latency during user operations. Currently, common game interface optimization methods typically collect data on the number of clicks or dwell time on each interactive area within a certain time period, and adjust the position or size of interactive areas with higher click frequencies based on the statistical results. However, this adjustment method relies solely on independent area statistics and does not consider the transfer relationship of adjacent contact point trajectories between different interactive areas or the process of contact pressure changes. This leads to inconsistencies between the adjusted interface layout and the actual timing of user actions during continuous operation, easily resulting in path detours between areas or misaligned response sequences, affecting the smoothness of interaction. Therefore, how to effectively optimize adjustable interactive areas based on continuous operation behavior recording has become a problem that needs to be solved in current game interface optimization. Summary of the Invention
[0003] This invention provides a method for optimizing game interaction interfaces based on user operation profiles, as well as a server and storage medium.
[0004] According to one aspect of the present invention, a method for optimizing a game interface based on a user operation profile is provided, comprising: The terminal device reports the current configuration status of the interactive interface instance and the operation behavior record stream. The current configuration status of the interactive interface instance includes the geometric boundary sequence of a set of adjustable interactive areas in the display coordinate system and the response priority sorting. The operation behavior record stream includes the contact point trajectory with timestamp, the contact duration period and the contact pressure change sequence. Based on the operation behavior record stream and the geometric boundary sequence in the current configuration state of the interactive interface instance, an operation behavior distribution time sequence diagram is constructed. The operation behavior distribution time sequence diagram uses the geometric boundary sequence as a spatial division reference, maps the trajectory of each contact point to a set of adjustable interactive areas, and generates the directed edge connection density of area transfer and the area dwell duration distribution. The directed edge connection density of area transfer represents the degree of connection between adjacent contact point trajectories in different adjustable interactive areas, and the area dwell duration distribution represents the dwell time distribution of the contact point trajectory in each adjustable interactive area. Perform perturbation expansion of candidate configuration instances on the timing diagram of operation behavior distribution to obtain a set of candidate interface configuration instances. Each candidate interface configuration instance in the set of candidate interface configuration instances contains a candidate geometric boundary sequence of adjustable interaction regions that have shifted relative to the current configuration state of the interaction interface instance, as well as the response priority sorting of the candidate geometric boundary sequence. The pre-built virtual interaction inference tool is invoked, and the set of candidate interface configuration instances and the timing diagram of operation behavior distribution are used as input. Under the constraint of virtual touch event playback, the operation path length distribution and interaction response latency statistics corresponding to each candidate interface configuration instance are obtained. Based on the distribution of operation path length and the statistics of interaction response latency, the target interface configuration instance is determined from the set of candidate interface configuration instances, and a configuration update instruction containing the adjustable interactive area geometric boundary sequence and response priority sorting of the target interface configuration instance is generated and transmitted to the terminal device.
[0005] According to another aspect of the present invention, a server is provided, the server including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of any of the above-described game interaction interface optimization methods based on user operation profiles.
[0006] According to another aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps of any of the above-described methods for optimizing game interaction interfaces based on user operation profiles.
[0007] The beneficial effects of the technical solution provided by the embodiments of the present invention are as follows: The game interaction interface optimization method based on user operation profiles provided by the present invention transforms the current configuration status of the interaction interface instance reported by the terminal device and the operation behavior record stream into an operation behavior distribution time sequence graph. This allows the dispersed contact point trajectories, contact duration periods, and contact pressure change sequences to form a unified graph structure with region transfer directed edge connection density and region dwell duration distribution under the geometric boundary sequence constraints of the adjustable interaction area. This enables the operation behavior records, which were originally difficult to compare directly, to obtain a spatialized expression that can be subsequently perturbed and expanded. On this basis, perturbation expansion of candidate configuration instances is performed on the operation behavior distribution time sequence graph, and the operation path length distribution and interaction response latency statistics of each candidate interface configuration instance are obtained through a virtual interaction inferencer under the constraints of virtual touch event playback. This allows candidate interface configuration instances to complete parallel inference and comparison under the same operation behavior record stream without actual deployment, avoiding the latency and resource consumption caused by repeatedly issuing configurations to the terminal device and waiting for real operation feedback. Finally, based on the distribution of operation path length and the statistics of interaction response latency, the target interface configuration instance is determined from the set of candidate interface configuration instances, and a configuration update instruction is generated and transmitted to the terminal device. This makes the interface adjustment process independent of human experience judgment. It can automatically update the geometric boundary sequence of adjustable interactive areas and the response priority sorting based on the regional transfer relationship and dwell distribution reflected by the operation behavior distribution time sequence diagram, thereby improving the adaptability between the terminal device interface and user operation behavior. Attached Figure Description
[0008] Figure 1 This is a schematic diagram illustrating the application environment of the game interaction interface optimization method based on user operation profiles provided in this embodiment of the invention. Figure 2 A flowchart illustrating a method for optimizing a game interface based on user operation profiles, provided in an embodiment of the present invention; Figure 3 A flowchart illustrating the sub-steps of a game interaction interface optimization method based on user operation profiles provided in an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of a server provided in an embodiment of the present invention. Detailed Implementation
[0009] Embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood that the embodiments described below with reference to the accompanying drawings are exemplary descriptions for explaining the technical solutions of the embodiments of the present invention, and do not constitute a limitation on the technical solutions of the embodiments of the present invention.
[0010] Those skilled in the art will understand that, unless otherwise stated, the singular forms “a,” “an,” “the,” and “the” used herein may also include the plural forms. It should be further understood that the terms “comprising” and “including” as used in embodiments of the invention mean that the corresponding feature can be implemented as the presented feature, information, data, step, operation, element, and / or component, but do not exclude implementation as other features, information, data, step, operation, element, component, and / or combinations thereof supported by the art. It should be understood that when we say that an element is “connected” or “coupled” to another element, the element can be directly connected or coupled to the other element, or it can mean that the element and the other element are connected through an intermediate element. Furthermore, “connected” or “coupled” as used herein can include wireless connection or wireless coupling. The term “and / or” as used herein indicates at least one of the items defined by the term, for example, “A and / or B” or “A, B” indicates implementation as “A,” or implementation as “B,” or implementation as “A and B.”
[0011] To make the objectives, technical solutions, and advantages of the present invention clearer, the embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.
[0012] In specific embodiments of this invention, any data related to an object is involved. When these embodiments are applied to specific products or technologies, permission or consent from the object is required, and the collection, use, and processing of such data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. In other words, if any of the aforementioned object-related data is involved in these embodiments, such data must be obtained with the object's authorization and consent, and in accordance with the relevant laws, regulations, and standards of the country and region.
[0013] The technical solutions of the embodiments of the present invention and the technical effects produced by the technical solutions of the present invention will be described below through several exemplary embodiments. It should be noted that the following embodiments can be referred to, learned from, or combined with each other, and the same terms, similar features, and similar implementation steps in different embodiments will not be described again.
[0014] Figure 1 This is a schematic diagram illustrating the application environment of the game interface optimization method based on user operation profiles provided in this embodiment of the invention. The application environment may include a server 101 and a terminal 102. The terminal 102 generates a stream of current configuration status and operation behavior records for the interface instance and sends it to the server 101 for execution, thereby implementing the game interface optimization method based on user operation profiles provided in this embodiment of the invention.
[0015] The game interaction interface optimization method based on user operation profiles provided in this invention can be executed by any server, which can be... Figure 1 The server shown.
[0016] The server can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server or server cluster that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The terminal can be a smartphone (such as an Android phone, iOS phone, etc.), tablet computer, laptop computer, desktop computer, smart home appliance, or in-vehicle terminal (such as an in-vehicle computer), etc. The terminal and server can be connected directly or indirectly through wired or wireless communication, but are not limited to these methods.
[0017] Figure 2 This is a flowchart illustrating a method for optimizing a game interface based on user operation profiles, provided in an embodiment of the present invention. The method is executed by a server, such as... Figure 2 As shown, the method includes: Step S100: Receive the current configuration status of the interactive interface instance and the operation behavior record stream reported by the terminal device. The current configuration status of the interactive interface instance includes the geometric boundary sequence of a set of adjustable interactive areas in the display coordinate system and the response priority sorting. The operation behavior record stream includes the contact point trajectory with timestamp, the contact duration period and the contact pressure change sequence.
[0018] An interactive interface instance is a specific configuration instance of a game's interactive interface running and presented to the user on a specific terminal device. In this instance, each adjustable interactive area has defined geometric boundaries and response priorities. An adjustable interactive area is an interface area in the game that allows users to operate via touch, and whose geometric boundaries and response priorities can be dynamically adjusted. Examples include skill release buttons, movement joysticks, item selection bars, and view switching areas. A geometric boundary sequence is a set of boundary control point coordinates arranged in a predetermined order within the display coordinate system. These boundary control point coordinates are connected sequentially to form the closed boundary of the adjustable interactive area. The display coordinate system is a two-dimensional plane coordinate system with the upper left corner of the terminal device screen as the origin, the horizontal direction to the right as the positive x-axis, and the vertical direction downwards as the positive y-axis. Response priority ranking is an ordered sequence of identifiers used to determine which adjustable interactive area responds to the touch operation first when multiple adjustable interactive areas partially overlap in space or when contact points simultaneously fall within the judgment range of multiple adjustable interactive areas. The adjustable interactive area identifier that appears earlier in the ranking has a higher response priority. The operation behavior log stream is a set of operation behavior data continuously generated and reported chronologically by the terminal device during the user's operation of the game interface. This set of operation behavior data consists of multiple timestamped contact point trajectories, contact duration periods, and contact pressure change sequences. The timestamped contact point trajectory is a trajectory formed chronologically by the contact point coordinates, each with a corresponding sampling time, obtained from touchscreen sampling during the user's swipe or click on the terminal device's touchscreen. The contact point coordinates are also defined within the display coordinate system. The contact duration period is the time interval experienced by the user's finger or stylus from the moment it touches the touchscreen until it leaves the touchscreen; each contact duration period has a start time and an end time. The contact pressure change sequence is a set of contact pressure sampling values recorded on a time axis synchronized with the contact duration periods, used to reflect the change in the pressure applied by the user's finger or stylus to the touchscreen over time.
[0019] Step S200: Construct an operation behavior distribution time sequence diagram based on the operation behavior record stream and the geometric boundary sequence in the current configuration state of the interactive interface instance. The operation behavior distribution time sequence diagram uses the geometric boundary sequence as a spatial division reference, maps the trajectory of each contact point to a set of adjustable interactive areas, and generates the directed edge connection density of area transfer and the area dwell duration distribution. The directed edge connection density of area transfer represents the degree of connection between adjacent contact point trajectories in different adjustable interactive areas, and the area dwell duration distribution represents the dwell time distribution of the contact point trajectory in each adjustable interactive area.
[0020] Alternatively, in one embodiment, reference is made to Figure 3Step S200 may specifically include the following steps S210 to S260: Step S210: Perform abrupt displacement detection on the contact point trajectories with timestamps in the operation behavior record stream, and group the contact points that meet the continuous sliding condition into the same contact trajectory segment to obtain a set of contact trajectory segments with start timestamps and end timestamps.
[0021] Adjacent contact point displacement abrupt change detection calculates the rate of change of distance between two temporally adjacent contact point coordinates in the timestamped contact point trajectory. When this rate of change exceeds a preset abrupt change threshold, it is determined that a discontinuous displacement abrupt change has occurred at that location, thus defining that location as the segmentation point between different contact trajectory segments. The continuous sliding condition requires that temporally adjacent contact points in the timestamped contact point trajectory satisfy the conditions that the rate of change of displacement does not exceed a preset abrupt change threshold and the time interval does not exceed a preset time interval threshold. A contact trajectory segment is a sub-trajectory obtained by segmenting the timestamped contact point trajectory, consisting of a continuous sliding contact point. Each contact trajectory segment has a start timestamp and an end timestamp. The start timestamp is the timestamp corresponding to the first contact point within the segment, and the end timestamp is the timestamp corresponding to the last contact point within the segment.
[0022] Specifically, the server reads the timestamped contact point trajectories one by one from the operation behavior record stream, and iterates through the contact point coordinate sequence arranged in ascending order of timestamps within each timestamped contact point trajectory. Let a timestamped contact point trajectory contain the contact point coordinate sequence P1, P2, P3 to P... arranged in chronological order. n The coordinates of two adjacent contact points P i and P i+1 The corresponding timestamp is T. i and T i+1 The server calculates the displacement distance between adjacent contact points. This displacement distance is obtained by calculating the Euclidean distance between the coordinates of the two contact points in the display coordinate system, which is the square root of the sum of the squares of the differences in the horizontal and vertical coordinates. The server also calculates the time interval between adjacent contact points, which is T. i+1Subtracting Ti yields the result. The server calculates the ratio of the displacement distance of adjacent contact points to the time interval to obtain the displacement change rate corresponding to the adjacent contact point. This displacement change rate is compared with a preset abrupt change threshold, which is set to 3.5 coordinate units per millisecond based on the hardware sampling characteristics of the terminal device's touchscreen. When the displacement change rate of adjacent contact points is less than or equal to the preset abrupt change threshold and the time interval is less than or equal to a preset time interval threshold, the server determines that the two adjacent contact points meet the continuous sliding condition and assigns them to the same contact trajectory segment. When the displacement change rate of adjacent contact points is greater than the preset abrupt change threshold or the time interval is greater than the preset time interval threshold, the server determines that there is a displacement abrupt change between the two adjacent contact points and segments the contact point trajectory at the current contact point. After traversing all adjacent contact points of the contact point trajectory, the server obtains multiple contact trajectory segments belonging to the contact point trajectory. Each contact trajectory segment records the timestamp corresponding to the first contact point in the contact trajectory segment as the start timestamp and the timestamp corresponding to the last contact point in the contact trajectory segment as the end timestamp. The server performs the above-mentioned adjacent contact point displacement abrupt change detection processing on all contact point trajectories with timestamps in the operation behavior record stream, and finally obtains a set of contact trajectory segments with start timestamp and end timestamp.
[0023] Step S220: Spatial attribution determination is performed between each contact trajectory segment in a set of contact trajectory segments and the geometric boundary sequence in the current configuration state of the interactive interface instance to obtain the adjustable interactive area identifier to which each contact trajectory segment belongs, and the attribution correspondence between the contact trajectory segments and the adjustable interactive area identifier is generated.
[0024] Spatial attribution determination is the process of determining which adjustable interactive area identifier a contact trajectory segment belongs to in terms of spatial location, based on the spatial inclusion relationship between the contact point coordinates within the contact trajectory segment and the closed area enclosed by the geometric boundary sequence of each adjustable interactive area. The attribution correspondence is a mapping formed by recording a one-to-one correspondence between the identifier information of each contact trajectory segment and the identifier of the adjustable interactive area to which that contact trajectory segment belongs.
[0025] For example, the server sequentially reads each contact trajectory segment from the set of contact trajectory segments obtained in step S210. For the currently read contact trajectory segment, the server extracts the coordinates of all contact points within the contact trajectory segment and calculates the geometric center coordinates of all contact point coordinates within the contact trajectory segment. The geometric center coordinates are obtained by calculating the average of the x-coordinates and y-coordinates of all contact points within the contact trajectory segment. The server reads a set of geometric boundary sequences of adjustable interactive areas from the current configuration state of the interactive interface instance. For each adjustable interactive area identifier corresponding to the geometric boundary sequence, the server connects the coordinates of all boundary control points in the geometric boundary sequence end to end in sequence to form a closed area boundary ring. The server uses the ray casting method to determine the spatial inclusion relationship between the geometric center coordinates of the contact trajectory segment and each closed area boundary ring. In the ray casting determination process, a ray is emitted along the positive horizontal axis of the display coordinate system, starting from the geometric center coordinates of the contact trajectory segment. The number of intersections between this ray and each boundary line segment of the closed area boundary ring is counted. If the number of intersections is odd, the geometric center coordinates are determined to be inside the closed area boundary ring; if the number of intersections is even, the geometric center coordinates are determined to be outside the closed area boundary ring. If the geometric center coordinates are inside the closed area boundary ring corresponding to an adjustable interactive area identifier, the server determines that adjustable interactive area identifier to which the contact trajectory segment belongs. If the geometric center coordinates are not inside the closed area boundary ring corresponding to any adjustable interactive area identifier, the server calculates the shortest distance between the geometric center coordinates and each closed area boundary ring, and determines the adjustable interactive area identifier with the smallest shortest distance value to which the contact trajectory segment belongs. The server records the identifier information of each contact trajectory segment and its corresponding adjustable interactive area identifier, generating a correspondence between contact trajectory segments and adjustable interactive area identifiers, and stores this correspondence in the server's operation behavior database.
[0026] Step S230: Based on the attribution correspondence, superimpose the contact pressure change sequence corresponding to each contact trajectory segment to generate the pressure change superposition result of each contact trajectory segment under the adjustable interactive area identifier.
[0027] The pressure change overlay result is a set of data obtained by overlaying the contact pressure change sequences corresponding to all contact trajectory segments belonging to the same adjustable interaction area identifier along the time axis. This data represents the statistically significant contact pressure changes experienced by the interaction area corresponding to that adjustable interaction area identifier. The pressure change overlay result is used in subsequent steps to apply pressure morphology constraints to the nodes and edges of the operation behavior distribution time sequence diagram.
[0028] The server reads the correspondence between the contact trajectory segments generated in step S220 and the adjustable interactive area identifiers. For each adjustable interactive area identifier, the server searches for all contact trajectory segments belonging to that identifier from the operation behavior record stream and reads the contact pressure change sequence corresponding to each contact trajectory segment. Each contact pressure change sequence contains contact pressure sample values arranged in timestamp order, and each contact pressure sample value is accompanied by a sampling timestamp. The server uses the start timestamp of each contact trajectory segment as the time zero point and transforms the contact pressure change sequences corresponding to all contact trajectory segments belonging to the same adjustable interactive area identifier onto a relative time axis. The server divides the relative time axis into time slots of uniform length, with the time slot length set to 50 milliseconds. For each time slot, the server performs an arithmetic average of the contact pressure sample values falling within that time slot from all contact pressure change sequences belonging to that adjustable interactive area identifier to obtain the average contact pressure value corresponding to that time slot. The server arranges the average contact pressure values corresponding to all time slots in chronological order as a pressure change superposition result and stores this pressure change superposition result corresponding to the adjustable interactive area identifier. Through the above process, each adjustable interactive area identifier corresponds to a set of pressure change superposition results. The pressure change superposition results reflect the statistical changes in the contact pressure experienced by the interactive area corresponding to the adjustable interactive area identifier during user operation.
[0029] Step S240: Perform transfer statistics on the changes in adjustable interactive area identifiers between adjacent contact trajectory segments through the attribution correspondence relationship, and generate the directed edge connection density of the region transfer connecting different adjustable interactive area identifiers.
[0030] Transfer statistics involve sequentially counting the adjustable interactive region identifiers belonging to two temporally adjacent contact trajectory segments. When two adjacent contact trajectory segments belong to different adjustable interactive region identifiers, the earlier-appearing adjustable interactive region identifier is taken as the starting region identifier, and the later-appearing adjustable interactive region identifier is taken as the ending region identifier. The number of transfers between each adjustable interactive region identifier and the spatial distribution of transfer paths are then recorded. The directed edge connection density of region transfers is a value calculated based on the transfer statistics and used to characterize the tightness of transfer connections between different adjustable interactive region identifiers.
[0031] For example, the server obtains the order of each contact trajectory segment in the time series based on the correspondence between the contact trajectory segments and the adjustable interaction area identifiers. The server traverses the set of contact trajectory segments obtained in step S210 according to the timestamp order. For the k-th and (k+1)-th contact trajectory segments that are temporally adjacent, the server reads the adjustable interaction area identifier of the k-th contact trajectory segment as the first area identifier and the adjustable interaction area identifier of the (k+1)-th contact trajectory segment as the second area identifier. If the first and second area identifiers are the same, the server does not perform transfer statistics. If the first and second area identifiers are different, the server uses the first area identifier as the starting area identifier and the second area identifier as the ending area identifier. It then checks the server's operation behavior database to see if a transfer record from the starting area identifier to the ending area identifier already exists. If not, a new transfer record is created and the transfer count is initialized to 0. If the record already exists, the transfer count corresponding to that transfer record is incremented by 1. The server simultaneously records the geometric center coordinates of the k-th and (k+1)-th contact trajectory segments, and uses the line connecting these two coordinates as the spatial location of the transfer path for this transfer. After traversing all adjacent contact trajectory segments, for each pair of different adjustable interaction region identifiers, the server obtains the transfer count value from the starting region identifier to the ending region identifier and the spatial location of all transfer paths. The server uses the transfer count value as the basic weight and the dispersion of the spatial locations of all transfer paths corresponding to the pair of adjustable interaction region identifiers as a correction factor. The smaller the dispersion, the more concentrated the transfer paths are in space and the tighter the transfer connections; the larger the dispersion, the more dispersed the transfer paths are in space and the looser the transfer connections. The server divides the basic weight by the dispersion correction factor to obtain the directed edge connection density between the pair of adjustable interaction region identifiers. The server stores the directed edge connection density of the region transfer in correspondence with the starting region identifier and the ending region identifier, generating the directed edge connection density of the region transfer connecting different adjustable interaction region identifiers.
[0032] Step S250: Aggregate the contact duration of the contact trajectory segment corresponding to each adjustable interactive area identifier to obtain the area dwell duration distribution of each adjustable interactive area identifier.
[0033] Contact duration aggregation is the process of summarizing and statistically analyzing the contact duration periods corresponding to all contact trajectory segments belonging to the same adjustable interactive area identifier according to a time axis. Area dwell duration distribution is a statistical result obtained by aggregating all contact duration periods corresponding to a certain adjustable interactive area identifier, used to characterize the dwell time distribution characteristics of contact point trajectories within that adjustable interactive area.
[0034] Specifically, the server reads the correspondence between contact trajectory segments and adjustable interactive area identifiers, and reads the contact duration corresponding to each contact trajectory segment. For each adjustable interactive area identifier, the server extracts the contact durations corresponding to all contact trajectory segments belonging to that identifier, forming a set of contact durations. The server calculates the duration of each contact duration in this set, obtained by subtracting the start time from the end time. The server sorts the contact duration set by duration in ascending order and calculates the median, first quartile, and third quartile of all durations in the set. The server performs histogram statistics on the contact duration set using a preset duration slot width (150 milliseconds), counting the number of contact durations falling within each slot. The server divides the number of contact durations corresponding to each slot by the total number of contact durations corresponding to that adjustable interactive area identifier to obtain the dwell probability density for each slot. The server arranges the dwell probability densities corresponding to all slots in slot order to obtain the regional dwell duration distribution for that adjustable interactive area identifier. The server performs the above-mentioned contact duration aggregation process on each adjustable interaction area identifier to obtain the area dwell duration distribution for each adjustable interaction area identifier.
[0035] Step S260: Align the superimposed results of the region transfer directed edge connection density, region dwell duration distribution, and pressure change according to the geometric boundary sequence in the display coordinate system to generate a time series diagram of the operation behavior distribution with the adjustable interactive region identifier as the node and the region transfer directed edge connection density as the edge strength.
[0036] Optionally, in one embodiment, step S260 may specifically include the following steps S261 to S266: Step S261: Extract all adjustable interactive region identifier pairs connected by directed edges from the directed edge connection density of the region transfer. Generate the initial spatial direction of the directed edges in the display coordinate system based on the boundary line direction of the corresponding adjustable interactive region in the geometric boundary sequence. Couple the initial spatial direction with the pressure change data corresponding to the initial adjustable interactive region identifier in the pressure change superposition result to obtain the directed edge skeleton constrained by pressure.
[0037] For example, the server reads all directed edge records in the directed edge connection density of region transfers. Each directed edge record contains a start region identifier, an end region identifier, and the corresponding directed edge connection density value for region transfers. The server extracts the adjustable interactive region identifier pair connected by each directed edge, which is the combination of the start region identifier and the end region identifier.
[0038] For each pair of adjustable interactive region identifiers, the server reads the geometric boundary sequences corresponding to the starting region identifier and the ending region identifier, respectively, and calculates the boundary center coordinates of the starting region identifier's geometric boundary sequence and the ending region identifier's geometric boundary sequence. The boundary center coordinates are obtained by calculating the average of the x-coordinates and y-coordinates of all boundary control points in the geometric boundary sequence. The server determines the boundary line orientation of the adjustable interactive region at the center of the starting region boundary based on the direction of the line connecting adjacent boundary control points in the starting region identifier's geometric boundary sequence, and determines the boundary line orientation of the adjustable interactive region at the center of the ending region boundary based on the direction of the line connecting adjacent boundary control points in the ending region identifier's geometric boundary sequence.
[0039] The server generates a smooth curve in the display coordinate system, starting from the center of the initial region boundary and extending from the center of the initial region boundary to the center of the final region boundary, using the tangent direction of the boundary line at the center of the initial region boundary as the initial emission direction and the center of the final region boundary as the final incident direction. This smooth curve is generated through cubic Bézier curve interpolation. The first control point of the cubic Bézier curve is located at a preset distance extended from the center of the initial region boundary along the initial emission direction, and the second control point is located at a preset distance extended from the center of the final region boundary in the opposite direction to the final incident direction. The server reads the pressure change data corresponding to the initial adjustable interactive region identifier from the pressure change superposition results, calculates the average pressure value of all contact pressure samples in the pressure change data, and calculates the fluctuation amplitude of the contact pressure samples on the time axis. The server determines the pressure coupling offset based on the average pressure value and the fluctuation amplitude. The pressure coupling offset is proportional to both the average pressure value and the fluctuation amplitude. The server offsets each point in the initial spatial orientation by a pressure coupling offset along the normal direction of that point, with the offset direction pointing to the side where the pressure concentration location is located in the pressure change data corresponding to the initial adjustable interactive area identifier, thus obtaining a directed edge skeleton constrained by pressure.
[0040] Step S262: Convert the contact duration distribution corresponding to each adjustable interaction area identifier in the area dwell duration distribution into a dwell state label sequence. Each dwell state label includes a dwell start time and a dwell end time. Embed the dwell state label sequence into the corresponding node position in the directed edge skeleton under pressure constraints to obtain a node skeleton carrying the dwell state label sequence.
[0041] Specifically, the server reads the contact duration distribution corresponding to each adjustable interactive region identifier in the region dwell duration distribution. For each adjustable interactive region identifier, the server extracts all contact durations from the region dwell duration distribution corresponding to that adjustable interactive region identifier. The server arranges all contact durations in chronological order of their start times. For each contact duration, the server creates a dwell state marker, writes the start time of the contact duration into the dwell start time field of the dwell state marker, and writes the end time of the contact duration into the dwell end time field of the dwell state marker. The server arranges all created dwell state markers into a dwell state marker sequence in chronological order of their dwell start times. The server reads the pressure-constrained directed edge skeleton generated in step S261 and locates the node position corresponding to each adjustable interactive region identifier in the pressure-constrained directed edge skeleton. The server embeds the dwell state marker sequence corresponding to each adjustable interactive region identifier into the internal data area of the corresponding node of the adjustable interactive region identifier in the pressure-constrained directed edge skeleton, so that each node simultaneously carries the dwell state marker sequence corresponding to the adjustable interactive region identifier. After the server performs the above embedding operation on all nodes, it obtains a node skeleton carrying a sequence of resident status markers.
[0042] Step S263: For each directed edge in the node skeleton carrying the dwell state label sequence, read the region transfer directed edge connection density corresponding to the directed edge, and read the time overlap segment of the dwell state label sequence of each node at both ends of the directed edge. Bind the time overlap segment to the directed edge to generate a directed edge skeleton with time window constraints.
[0043] For example, the server reads the node skeleton carrying the residency state marker sequence and sequentially traverses each directed edge in the node skeleton. For the currently traversed directed edge, the server reads the start node identifier and end node identifier corresponding to the directed edge, and reads the residency state marker sequence corresponding to the start node and the residency state marker sequence corresponding to the end node. The server performs pairwise overlap detection on the time segments of each residency state marker in the residency state marker sequence corresponding to the start node and the time segments of each residency state marker in the residency state marker sequence corresponding to the end node. During the overlap detection process, the server compares the residency start time and residency end time of a residency state marker of the start node with the residency start time and residency end time of a residency state marker of the end node, respectively. When the residency start time of the start node's residency state marker is less than the residency end time of the end node's residency state marker, and the residency start time of the end node's residency state marker is less than the residency end time of the start node's residency state marker, it is determined that the two residency state markers have time overlap. The server extracts the time intersection segments corresponding to all dwell state markers with temporal overlap, forming the time overlap segment of the directed edge. Simultaneously, the server reads the region transfer directed edge connection density corresponding to the directed edge and binds this density value to the time overlap segment of the directed edge for storage. The server performs the above processing on all directed edges in the node skeleton carrying the dwell state marker sequence, generating a directed edge skeleton with time window constraints.
[0044] Step S264: Spatial expansion of the pressure change data corresponding to each adjustable interactive region identifier in the pressure change superposition result along the boundary line of the geometric boundary sequence corresponding to the adjustable interactive region identifier to obtain the pressure spatial expansion shape. The pressure spatial expansion shape is then fused with the residence state mark sequence of the corresponding node in the directed edge skeleton with time window constraints to generate a directed edge skeleton with enhanced node pressure shape.
[0045] Optionally, in one embodiment, step S264 may specifically include the following steps S2641 to S2646: Step S2641: Read the pressure change data corresponding to the adjustable interactive area identifier in the pressure change superposition result, and read the spatial projection position of the contact trajectory segment that generated the pressure change data on the geometric boundary sequence corresponding to the adjustable interactive area identifier. Map the pressure change data to the boundary line arc length coordinate of the geometric boundary sequence according to the spatial projection position to obtain the distribution pattern of pressure along the boundary arc length.
[0046] The server reads the pressure change data corresponding to the currently processed adjustable interactive area identifier from the pressure change superposition results. The server searches for all contact trajectory segments belonging to the adjustable interactive area identifier from the attribution correspondence generated in step S220, and reads the contact point coordinates within each contact trajectory segment. For each contact trajectory segment, the server reads the corresponding geometric boundary sequence, which is a closed boundary formed by sequentially connecting the coordinates of multiple boundary control points. For each contact point coordinate within the contact trajectory segment, the server calculates the shortest distance from the contact point coordinate to each boundary line segment of the geometric boundary sequence, and uses the perpendicular position on the boundary line segment corresponding to the shortest distance as the spatial projection position of the contact point coordinate on the geometric boundary sequence. Using the first boundary control point in the geometric boundary sequence as the origin of the arc length, the server calculates the length of each boundary line segment sequentially according to the order of the boundary control points. The length of each boundary line segment is obtained by calculating the Euclidean distance between two adjacent boundary control points. The lengths of each boundary line segment are then summed sequentially to obtain the boundary line arc length coordinates corresponding to each spatial projection position. The server reads the contact trajectory segment identifier and sampling timestamp corresponding to each contact pressure sample value from the pressure change superposition results. Based on the spatial projection position corresponding to the contact trajectory segment identifier, it maps the contact pressure sample value to the corresponding boundary line arc length coordinate. When multiple contact pressure sample values are mapped to the same boundary line arc length coordinate position, the server takes the arithmetic mean of these contact pressure sample values. The server arranges all contact pressure sample values in ascending order of boundary line arc length coordinates to obtain the pressure distribution pattern along the boundary arc length.
[0047] Step S2642: Perform waveform segmentation on the distribution pattern of pressure along the boundary arc length, identify the peak segments in the distribution pattern where the pressure changes continuously rise and then continuously fall, connect the peak segments to form pressure peak ridges, and obtain a description of the pressure peak ridges.
[0048] The server reads the pressure distribution along the boundary arc length, which consists of a series of pressure value points arranged in ascending order of the boundary arc length coordinates. The server performs a first-order difference calculation on the pressure value sequence, obtained by calculating the difference between two adjacent pressure value points. The server identifies the inflection point where the first-order difference changes from positive to negative in the pressure value sequence; this inflection point corresponds to a local peak in the pressure value sequence. Using each local peak as the center, the server searches in both the decreasing and increasing directions of the boundary arc length coordinates. While searching in the decreasing direction, it continuously compares the pressure values of adjacent pressure value points. The search stops when the pressure value no longer decreases; this stopping point is the starting position of the rising peak segment. Similarly, while searching in the increasing direction, it continuously compares the pressure values of adjacent pressure value points. The search stops when the pressure value no longer decreases; this stopping point is the ending position of the falling peak segment. The server defines the segment between the starting position and the ending position as the peak segment. After traversing all local peak vertices, the server obtains multiple peak segments. The server connects the local peaks in adjacent peak segments sequentially according to the ascending order of the boundary line arc length coordinates. The connecting line extends along the pressure value interpolation path on the pressure value curve between adjacent peaks, forming a pressure peak ridge. The server records the boundary line arc length coordinates and pressure amplitude of each point on the pressure peak ridge, thus obtaining a description of the pressure peak ridge.
[0049] Step S2643: Read the dwell state marker sequence on the node corresponding to the adjustable interaction region identifier in the directed edge skeleton with time window constraints, divide the dwell state marker sequence into dwell time period partitions within the node according to the dwell start time and dwell end time, and obtain the dwell time period partition layout.
[0050] Dwell time partitioning transforms the time segment corresponding to each dwell time marker in the dwell time marker sequence on a node into a partition in the node's internal space, thus dividing the node's internal space into multiple consecutive spatial blocks according to the chronological order of the dwell time markers. Dwell time partitioning layout is the spatial arrangement of all dwell time partitions within a node, used to simultaneously carry dwell time information and spatial location information within the node.
[0051] Step S2644: The spatial position of the boundary arc length corresponding to the pressure wave crest ridge line is nonlinearly mapped to the temporal position of the residence period in the residence period partition layout through the spatiotemporal mapping relationship of the contact trajectory segment in the adjustable interaction area, so that the spatial position of the pressure wave crest ridge line corresponds to the temporal position of the residence period partition, and the spatiotemporal correspondence of pressure residence is obtained.
[0052] The server reads the spatial location of the boundary arc length corresponding to each peak vertex in the pressure wave crest ridge description, and reads the time segment corresponding to each dwell time partition in the dwell time partition layout. The server searches for all contact trajectory segments belonging to the adjustable interaction area identifier from the attribution correspondence generated in step S220, and reads the correspondence between the contact point coordinates and timestamps within each contact trajectory segment. For each contact trajectory segment, the server calculates the displacement distance and time interval between adjacent contact points within the segment, and divides the displacement distance by the time interval to obtain the average sliding speed between adjacent contact points. The server collects the average sliding speeds between adjacent contact points within all contact trajectory segments and constructs a mapping function from spatial location to temporal location. For each peak in the pressure wave crest description, the server reads the spatial position of the corresponding boundary arc length. Based on this boundary arc length spatial position, it searches for the corresponding contact time position in the mapping function. This search process is achieved by matching the spatial position of the boundary arc length with the spatial projection position of the contact point coordinates within the contact trajectory segment. The matching method is to calculate the absolute value of the difference between the spatial position of the boundary arc length and the spatial projection position of each contact point coordinate, and select the timestamp corresponding to the contact point coordinates with the smallest absolute value of the difference as the corresponding time position. The server establishes a one-to-one correspondence between the spatial position of the boundary arc length of each peak in the pressure wave crest description and the found time position, forming a spatiotemporal correspondence of pressure residence.
[0053] Step S2645: Based on the curvature distribution of the boundary line of the adjustable interactive region in the geometric boundary sequence, the curvature constraint adjustment is performed on the pressure residence time-space correspondence, so that the spatial position of the pressure wave crest ridge at the boundary line curvature is shifted to the inside of the boundary line, and the pressure residence time-space correspondence after curvature adjustment is obtained.
[0054] For example, the server reads the coordinates of all boundary control points in the adjustable interactive region within the geometric boundary sequence. The server groups three adjacent boundary control points together and calculates the curvature at the intermediate boundary control point for each group. The curvature is calculated by substituting the coordinates of the three boundary control points into the curvature formula, which is the perpendicular distance from the intermediate boundary control point to the line connecting the two adjacent boundary control points divided by the square of the distance between the two adjacent boundary control points. The server constructs a boundary line curvature distribution based on the curvature at all intermediate boundary control points according to the order of the boundary control points. The server reads the spatial position of the boundary arc length corresponding to each pressure peak ridge point in the pressure residence spatiotemporal correspondence and searches for the corresponding curvature value in the boundary line curvature distribution based on this spatial position. When the curvature value is greater than a preset curvature threshold, the server determines that the pressure peak ridge point is located at a point of boundary line curvature and performs curvature constraint adjustment on that pressure peak ridge point. During curvature constraint adjustment, the server determines the normal direction of the boundary line at the pressure wave crest point. The normal direction is perpendicular to the tangent direction of the boundary line at that point. The spatial position of the pressure wave crest point is then offset inward along the normal direction towards the boundary line, with the offset amount equal to the curvature value multiplied by a preset offset ratio coefficient. The server performs the above curvature constraint adjustment process on all pressure wave crest points in the pressure residence time-space correspondence to obtain the curvature-adjusted pressure residence time-space correspondence.
[0055] Step S2646: The curvature-adjusted pressure residence spatiotemporal correspondence is fused with the residence state marker sequence of the node in the directed edge skeleton with time window constraints, so that the pressure peak ridge position in the node and the time partition of the residence state marker sequence jointly determine the node pressure morphology, and a directed edge skeleton with enhanced node pressure morphology is generated.
[0056] The server reads the curvature-adjusted pressure residence spatiotemporal correspondence and the residence state marker sequence of the current processing node in the directed edge skeleton with time window constraints. The server pairs the spatial position of each residence time partition in the residence time partition layout corresponding to the current processing node with the pressure peak ridge point at the corresponding time position in the curvature-adjusted pressure residence spatiotemporal correspondence. The pairing is based on the inclusion relationship between the time segment corresponding to the residence time partition and the time position corresponding to the pressure peak ridge point. The server maps the paired pressure peak ridge point spatial positions to the interior of the corresponding residence time partition, ensuring that the spatial distribution of pressure peak ridge points within each residence time partition is consistent with the pressure change characteristics within the corresponding time segment of that residence time partition. The server adjusts the internal morphology of the current processing node based on the mapped pressure peak ridge point spatial positions. During the adjustment process, the boundary line of the current processing node is shifted towards the location of the pressure peak ridge point, with the shift amount increasing as the pressure amplitude of the pressure peak ridge point increases. The server performs the above fusion process on all nodes in the directed edge skeleton with time window constraints, generating a directed edge skeleton with enhanced node pressure morphology.
[0057] Step S265: Perform bending on each edge in the directed edge skeleton of node pressure morphology enhancement, so that each edge bends along the tangent direction of the geometric boundary sequence of the corresponding adjustable interaction region of the node when it is close to the node position, and project the bent edge path in the display coordinate system to obtain the projected edge path set.
[0058] For example, the server reads each directed edge in the directed edge skeleton of the node pressure morphology enhancement. For the currently processed directed edge, the server reads the adjustable interaction region identifiers corresponding to the nodes at both ends of the directed edge, and reads the geometric boundary sequences of the adjustable interaction regions corresponding to the starting node and the ending node, respectively. The server determines the first path segment near the starting node and the last path segment near the ending node on the directed edge path. The server calculates the tangent direction of the geometric boundary sequence corresponding to the starting node at the center of the starting node boundary, and adjusts the first path segment of the directed edge near the starting node to extend along this tangent direction. During the adjustment process, each point on the path segment is moved along the normal direction of that point to a position that aligns the path segment with the tangent direction. The server calculates the tangent direction of the geometric boundary sequence corresponding to the ending node at the center of the ending node boundary, and adjusts the last path segment of the directed edge near the ending node to extend along this tangent direction. The adjustment process is the same as the previous path segment. The server projects the bent directed edge path onto the display coordinate system, converting all three-dimensional coordinates on the path into two-dimensional coordinates in the display coordinate system, to obtain the projected edge path corresponding to the directed edge. The server performs the bending and projection processing on all directed edges, and combines all projected edge paths into a projection edge path set.
[0059] Step S266: Overlay each edge path in the projection edge path set with the corresponding region transfer directed edge connection density, using the adjustable interaction region identifier as the node and the overlaid edge path as the edge, to generate an operation behavior distribution time sequence diagram with the adjustable interaction region identifier as the node and the region transfer directed edge connection density as the edge strength.
[0060] For example, the server reads each projection edge path in the projection edge path set and simultaneously reads the region transfer directed edge connection density corresponding to that projection edge path. The server writes the region transfer directed edge connection density value as the edge strength attribute of the projection edge path into the data structure of that projection edge path. The server constructs a graph structure with adjustable interactive region identifiers as nodes and the superimposed projection edge paths as edges. The position of each node in the graph structure is aligned with the center position of the geometric boundary sequence of the adjustable interactive region identifier corresponding to that node. The server attaches the superimposed results of the region dwell duration distribution and pressure change corresponding to all adjustable interactive region identifiers as node attributes to the corresponding nodes. The server outputs the completed graph structure as an operation behavior distribution time sequence diagram, which uses adjustable interactive region identifiers as nodes and region transfer directed edge connection density as edge strength.
[0061] Step S300: Perform perturbation expansion of candidate configuration instances on the operation behavior distribution time sequence diagram to obtain a set of candidate interface configuration instances. Each candidate interface configuration instance in the set of candidate interface configuration instances contains a candidate geometric boundary sequence of adjustable interaction regions that have shifted relative to the current configuration state of the interaction interface instance, as well as the response priority sorting corresponding to the candidate geometric boundary sequence.
[0062] Optionally, in one embodiment, step S300 may specifically include the following steps S310 to S360: Step S310: Read the adjustable interaction region identifier corresponding to each node in the operation behavior distribution sequence diagram and the edge strength of the directed edges between nodes, sort the edge strengths from largest to smallest, and obtain the directed edge strength sorted list.
[0063] For example, the server reads all nodes and all directed edges in the sequence graph of operation behavior distribution. For each directed edge, the server reads its corresponding edge strength, which is the directed edge connection density of the region transfer corresponding to that edge. The server sorts all directed edges in descending order of edge strength value using the quicksort algorithm. The quicksort algorithm selects a pivot edge strength value and divides all directed edges into subsequences with edge strength greater than the pivot value and subsequences with edge strength less than the pivot value, then recursively performs the same partitioning process on the two subsequences until the sorting is complete. The server outputs the sorted directed edge sequence as a directed edge strength sorted list. Each record in this list contains the starting region identifier, ending region identifier, and edge strength value corresponding to the directed edge.
[0064] Step S320: Select the top-ranked directed edges from the directed edge strength sorting list, and form a region pair by connecting the starting adjustable interaction region identifier and the ending adjustable interaction region identifier of the selected directed edges, thus obtaining a set of perturbation seed region pairs.
[0065] Specifically, the server reads a sorted list of directed edges by strength. Starting from the first edge in this list, the server sequentially selects a preset number of directed edges downwards. This preset number is set to 20% of the total number of directed edges in the list. If the total number of directed edges multiplied by 20% is less than three, the server selects the top three edges. For each selected directed edge, the server reads the corresponding start and end adjustable interaction region identifiers. These identifiers are combined into a region pair, with the start identifier in the first position and the end identifier in the second position. The server then collects all region pairs corresponding to the selected directed edges to form a perturbation seed region pair set.
[0066] Step S330: For each pair of regions in the set of perturbation seed regions, extract the geometric boundary sequence of the two adjustable interactive regions in the current configuration state of the interactive interface instance, and perform boundary translation in opposite directions on the geometric boundary sequence of the two adjustable interactive regions in the display coordinate system to generate two sets of candidate geometric boundary sequences after relative displacement.
[0067] Optionally, in one embodiment, step S330 may specifically include the following steps S331 to S336: Step S331: Read the first adjustable interaction region identifier and the second adjustable interaction region identifier contained in the region pair in the perturbation seed region pair set, obtain the first geometric boundary sequence corresponding to the first adjustable interaction region identifier and the second geometric boundary sequence corresponding to the second adjustable interaction region identifier respectively, and extract the region transfer directed edge connection density corresponding to the directed edge connecting the first adjustable interaction region identifier and the second adjustable interaction region identifier from the operation behavior distribution time sequence diagram.
[0068] For example, the server sequentially reads each region pair from the set of perturbation seed regions. For the currently read region pair, the server extracts the first adjustable interactive region identifier located at the first position and the second adjustable interactive region identifier located at the second position. The server reads the first geometric boundary sequence corresponding to the first adjustable interactive region identifier from the current configuration state of the interactive interface instance, and reads the second geometric boundary sequence corresponding to the second adjustable interactive region identifier. Both the first and second geometric boundary sequences are stored in the form of a list of boundary control point coordinates. The server searches for the directed edge connecting the first and second adjustable interactive region identifiers from the operation behavior distribution time sequence diagram. The direction of this directed edge is from the first adjustable interactive region identifier to the second adjustable interactive region identifier. The server reads the region transfer directed edge connection density corresponding to this directed edge and stores the value of this region transfer directed edge connection density as the perturbation strength reference value corresponding to the current region pair.
[0069] Step S332: Analyze the direction attribute of the directed edge connecting the first adjustable interaction area identifier and the second adjustable interaction area identifier in the operation behavior distribution time sequence diagram, determine the first adjustable interaction area identifier as the starting area identifier and the second adjustable interaction area identifier as the ending area identifier based on the direction attribute, and generate a traction direction line from the boundary center of the geometric boundary sequence corresponding to the starting area identifier to the boundary center of the geometric boundary sequence corresponding to the ending area identifier.
[0070] The server reads the directed edge connecting the first and second adjustable interaction area identifiers in the operation behavior distribution sequence diagram. It reads the direction attribute from the data structure of this directed edge, which records the start and end area identifiers. Based on the direction attribute, the server confirms that the first adjustable interaction area identifier is the start area identifier and the second adjustable interaction area identifier is the end area identifier. The server calculates the boundary center coordinates of the first geometric boundary sequence corresponding to the start area identifier. This is done by averaging the x-coordinates of all boundary control points in the first geometric boundary sequence and averaging the y-coordinates of all boundary control points. The server calculates the boundary center coordinates of the second geometric boundary sequence corresponding to the end area identifier in the same way. The server generates a traction direction line in the display coordinate system, pointing from the boundary center of the geometric boundary sequence corresponding to the start area identifier to the boundary center of the geometric boundary sequence corresponding to the end area identifier. This traction direction line starts at the boundary center corresponding to the start area identifier and ends at the boundary center corresponding to the end area identifier.
[0071] Step S333: Read the pressure change data corresponding to the first adjustable interactive area identifier in the pressure change superposition result, and read the spatial projection position of the contact trajectory segment that generated the pressure change data on the first geometric boundary sequence. Spatially expand the pressure change data along the boundary line of the first geometric boundary sequence according to the spatial projection position to obtain the pressure distribution along the edge of the first region, and extract the pressure concentration position of the pressure distribution along the edge of the first region to obtain the pressure concentration position of the first region.
[0072] The server reads the pressure change data corresponding to the first adjustable interactive area identifier from the pressure change superposition result. The server searches for all contact trajectory segments belonging to the first adjustable interactive area identifier from the attribution correspondence generated in step S220, and reads the contact point coordinates within each contact trajectory segment. Following the spatial projection position calculation method described in step S2641, the server calculates the spatial projection position of each contact point coordinate on the first geometric boundary sequence, and maps each contact pressure sample value in the pressure change data to the boundary line arc length coordinates of the first geometric boundary sequence according to its corresponding spatial projection position, obtaining the pressure distribution along the edge of the first region. The server performs pressure concentration location extraction on the pressure distribution along the edge of the first region. During the extraction process, the server traverses all pressure value points in the pressure distribution along the edge of the first region, finds the pressure value point with the largest pressure value, and uses the boundary line arc length coordinates corresponding to this pressure value point as the pressure concentration location of the first region.
[0073] Step S334: Deflect the traction direction line according to the pressure concentration location of the first region, shift the traction direction line to the side where the pressure concentration location of the first region is located, generate the deflected disturbance direction line, and use the deflected disturbance direction line to perform displacement on each boundary control point in the first geometric boundary sequence to obtain the first candidate geometric boundary sequence.
[0074] The server reads the arc length coordinates of the boundary line corresponding to the pressure concentration location in the first region and converts these coordinates into spatial coordinates within the display coordinate system. This conversion is achieved through linear interpolation based on the correspondence between the boundary control point coordinates and the boundary line arc length coordinates in the first geometric boundary sequence. The server reads the start and end coordinates of the traction direction line and calculates its direction vector within the display coordinate system. The server calculates the positional relationship between the pressure concentration location in the first region and the traction direction line, determining which side of the traction direction line the pressure concentration location is on. This positional relationship is determined by calculating the directed distance from the pressure concentration location to the traction direction line; a positive directed distance indicates it is on one side of the traction direction line, and a negative directed distance indicates it is on the other side. The server deflects the traction direction line towards the side where the pressure concentration location in the first region is located by a preset angle. This preset angle is determined based on the region transfer directed edge connection density read in step S331. A higher region transfer directed edge connection density results in a larger deflection angle, with a maximum deflection angle of 15 degrees, generating the deflected disturbance direction line. The server performs displacement on each boundary control point in the first geometric boundary sequence. The displacement direction of each boundary control point is consistent with the direction of the deflected disturbance direction line. The displacement distance of each boundary control point is equal to the preset base displacement distance multiplied by the distance attenuation coefficient from the boundary control point to the pressure concentration location in the first region. The distance attenuation coefficient decreases as the distance from the boundary control point to the pressure concentration location in the first region increases. The server arranges all the displaced boundary control points in their original order to obtain the first candidate geometric boundary sequence.
[0075] Step S335: Perform a displacement on the second geometric boundary sequence that is symmetrical to that of the first geometric boundary sequence, so that each boundary control point in the second geometric boundary sequence is displaced by the same distance in the opposite direction of the deflected disturbance direction line, thus obtaining the second candidate geometric boundary sequence.
[0076] The server reads the deflected disturbance direction line and the displacement distance of each boundary control point in the first geometric boundary sequence. The server calculates the reverse direction of the deflected disturbance direction line, which differs from the direction of the deflected disturbance direction line by 180 degrees. The server performs displacement on each boundary control point in the second geometric boundary sequence, with the displacement direction being the reverse direction of the deflected disturbance direction line. The displacement distance of each boundary control point is the same as the displacement distance of the corresponding boundary control point in the first geometric boundary sequence. The correspondence of displacement distances is determined by the index of the boundary control point in its respective geometric boundary sequence; that is, the displacement distance of the j-th boundary control point in the second geometric boundary sequence is equal to the displacement distance of the j-th boundary control point in the first geometric boundary sequence. The server arranges all the displaced boundary control points in their original order to obtain the second candidate geometric boundary sequence.
[0077] Step S336: Perform spatial intersection detection between the first candidate geometric boundary sequence and the second candidate geometric boundary sequence and the geometric boundary sequence of the adjustable interactive area that has not participated in the disturbance in the current configuration state of the interactive interface instance. Eliminate the candidate geometric boundary sequence that intersects with the geometric boundary sequence of the adjustable interactive area that has not participated in the disturbance, and output the two sets of candidate geometric boundary sequences after relative displacement.
[0078] Specifically, the server reads the geometric boundary sequences of all adjustable interactive areas in the current configuration state of the interactive interface instance, excluding the first and second adjustable interactive area identifiers. For the first candidate geometric boundary sequence, the server connects all the boundary control point coordinates in the first candidate geometric boundary sequence end-to-end in sequence to form a first closed area. It then connects all the boundary control point coordinates in the geometric boundary sequences of each unperturbed adjustable interactive area end-to-end in sequence to form an undisturbed closed area. The server performs spatial intersection detection on the first closed area and each undisturbed closed area. The spatial intersection detection process determines whether there is an intersection point between the boundary segments of the first closed area and the boundary segments of the undisturbed closed areas. If an intersection point exists, an intersection is determined. Simultaneously, the server determines whether the endpoints on the boundary of the first closed area fall inside the undisturbed closed area, and vice versa. If any endpoint falls inside the other closed area, an intersection is determined. When an intersection is detected between the first candidate geometric boundary sequence and any undisturbed closed area, the server discards that first candidate geometric boundary sequence. The server performs the same spatial intersection detection and elimination process on the second candidate geometric boundary sequence. The server outputs the first and second candidate geometric boundary sequences that were not eliminated as two sets of candidate geometric boundary sequences after relative displacement.
[0079] Step S340: Based on the edge strength of the directed edge in the time sequence diagram of the operation behavior distribution, the response priorities of the two adjustable interaction regions in the region pair are interchanged to obtain the candidate response priority ranking corresponding to the candidate geometric boundary sequence.
[0080] For example, the server reads the response priority ranking from the current configuration state of the interactive interface instance. The server reads the edge strength of the directed edge connecting the two adjustable interactive region identifiers in the current processing region pair from the operation behavior distribution sequence diagram. This edge strength value has been read and stored as a disturbance strength reference value in step S331. The server determines whether the edge strength value is greater than a preset swap threshold, which is set to the median of the directed edge connection density values for all region transfers. When the edge strength value is greater than the preset swap threshold, the server swaps the corresponding positions of the first and second adjustable interactive region identifiers in the response priority ranking within the current processing region pair. That is, the adjustable interactive region identifier originally placed earlier is moved to a later position, and the adjustable interactive region identifier originally placed later is moved to a earlier position. The swapped response priority ranking is the candidate response priority ranking. When the edge strength value is less than or equal to the preset swap threshold, the server does not perform a response priority swap and maintains the response priority ranking in the current configuration state of the interactive interface instance as the candidate response priority ranking.
[0081] Step S350: Combine the candidate geometric boundary sequence and the candidate response priority into a candidate interface configuration instance. Perform spatial overlap detection on the candidate geometric boundary sequence in the candidate interface configuration instance. If there is a boundary intersection with the unperturbed adjustable interactive area in the current configuration state of the interactive interface instance, discard the candidate interface configuration instance; otherwise, retain it.
[0082] Specifically, the server combines the first candidate geometric boundary sequence and the second candidate geometric boundary sequence obtained in step S330 with the candidate response priority sort obtained in step S340 into a candidate interface configuration instance. During the combination process, the server sets the candidate geometric boundary sequence corresponding to the first adjustable interaction area identifier as the first candidate geometric boundary sequence, sets the candidate geometric boundary sequence corresponding to the second adjustable interaction area identifier as the second candidate geometric boundary sequence, and maintains the geometric boundary sequence corresponding to the unperturbed adjustable interaction area identifier as the original geometric boundary sequence in the current configuration state of the interaction interface instance. The candidate response priority sort is used as the response priority sort for this candidate interface configuration instance. The server performs spatial overlap detection on all candidate geometric boundary sequences in this candidate interface configuration instance, and the detection process is the same as the spatial intersection detection method in step S336. When it is detected that any candidate geometric boundary sequence in the candidate interface configuration instance intersects with the geometric boundary sequence of the unperturbed adjustable interaction area in the current configuration state of the interaction interface instance, the server discards the candidate interface configuration instance. When it is detected that no boundary intersection exists, the server retains the candidate interface configuration instance.
[0083] Step S360: Add the retained candidate interface configuration instances to the candidate interface configuration instance set, and continue to select the next set of directed edges from the directed edge strength sorting list and repeat the above process until the candidate interface configuration instance set reaches the preset size.
[0084] Optionally, in one embodiment, step S360 may specifically include the following steps S361 to S366: Step S361: Read the candidate geometric boundary sequence of each candidate interface configuration instance that has been added to the current candidate interface configuration instance set, and perform spatial difference analysis on the candidate geometric boundary sequence of each candidate interface configuration instance and the candidate geometric boundary sequences of other candidate interface configuration instances in the set to obtain the spatial difference distribution results within the set.
[0085] For example, the server reads all candidate interface configuration instances already added to the current candidate interface configuration instance set. For each different pair of candidate interface configuration instances in the set, the server reads the candidate geometric boundary sequences of adjustable interactive regions contained in each pair of candidate interface configuration instances. The server calculates the spatial difference between the candidate geometric boundary sequences corresponding to the same adjustable interactive region identifier in the pair of candidate interface configuration instances. The spatial difference calculation is obtained by summing the Euclidean distances between the coordinates of each corresponding boundary control point in the two candidate geometric boundary sequences. The server uses the sum of the spatial difference values corresponding to all adjustable interactive region identifiers in the pair of candidate interface configuration instances as the degree of spatial difference between the pair of candidate interface configuration instances. The server collects the spatial difference degree values between all pairwise candidate interface configuration instances in the set to obtain the spatial difference distribution result within the set.
[0086] Step S362: Determine whether the number of candidate interface configuration instances already included in the current candidate interface configuration instance set has reached the preset scale. If the preset scale has not been reached, obtain the next directed edge that has not yet been used in the directed edge strength sorting list, and parse the identifiers of the two adjustable interactive areas connected by the directed edge.
[0087] The server reads the number of candidate interface configuration instances already included in the current candidate interface configuration instance set and compares this number with a preset size. The preset size is set to 24 candidate interface configuration instances. When the number of included candidate interface configuration instances is greater than or equal to the preset size, the server stops the candidate configuration instance perturbation expansion process. When the number of included candidate interface configuration instances is less than the preset size, the server reads the directed edge strength sorting list and searches for the next unused directed edge in the list. This search process starts from the current used position in the directed edge strength sorting list and searches downwards sequentially, skipping directed edges that have already been selected as perturbation seeds, until the first unused directed edge is found. The server parses the data structure of this directed edge and reads the start region identifier and end region identifier of the directed edge. These start region identifier and end region identifier are the identifiers of the two adjustable interaction regions connected by the directed edge.
[0088] Step S363: Extract the dwell state marker sequence of the two adjustable interaction regions connected by the directed edge on the corresponding nodes in the operation behavior distribution time sequence diagram, compare the time overlap segment of the dwell state marker sequence on the two nodes with the existing generated records of the candidate interface configuration instance set, and obtain the perturbation novelty marker corresponding to the directed edge.
[0089] The server reads the identifiers of the two adjustable interaction regions connected by the directed edge, and reads the dwell state marker sequences on the corresponding nodes from the operation behavior distribution time sequence diagram. Following the time overlap segment calculation method described in step S263, the server performs pairwise overlap detection on the dwell state marker sequences of the two nodes to obtain the time overlap segments of the dwell state marker sequences of the two nodes. The server reads the existing generation records of the candidate interface configuration instance set, which store the perturbation seed region pair information and time overlap segment information corresponding to each added candidate interface configuration instance. The server compares the two adjustable interaction region identifiers and time overlap segments corresponding to the current directed edge with the perturbation seed region pair information and time overlap segments in the existing generation records. During the comparison, the server calculates the time overlap ratio between the current time overlap segment and the time overlap segments in each existing generation record. The time overlap ratio is obtained by dividing the intersection duration of the two time overlap segments by the union duration. If an existing generated record exists, and its perturbation seed region pair has the same identifier as the two currently adjustable interaction regions and the time overlap ratio is greater than a preset overlap threshold (e.g., 60%), then the server sets the perturbation novelty flag corresponding to the directed edge to not meet the preset novelty tolerance. If no such existing generated record exists, then the server sets the perturbation novelty flag corresponding to the directed edge to meet the preset novelty tolerance.
[0090] Step S364: When the perturbation novelty tag does not meet the preset novelty tolerance, skip the directed edge and continue to obtain the next unused directed edge in the directed edge strength sorting list until a directed edge whose perturbation novelty tag meets the preset novelty tolerance is found as a new perturbation seed.
[0091] The server reads the perturbation novelty tag corresponding to the current directed edge. When the perturbation novelty tag does not meet the preset novelty tolerance, the server skips the directed edge, marks it as used, and then returns to step S362 to continue searching for the next unused directed edge from the directed edge strength sorting list. The server then performs the perturbation novelty tag calculation in step S363 on the newly found directed edge. The server repeats the above process until it finds a directed edge whose perturbation novelty tag meets the preset novelty tolerance, and uses this directed edge as a new perturbation seed.
[0092] Step S365: Generate new candidate interface configuration instances through the region pairs corresponding to the new perturbation seed, add the new candidate interface configuration instances to the candidate interface configuration instance set, and record the directed edges corresponding to the new perturbation seed as used in the candidate interface configuration instance set.
[0093] During the specific execution of step S365, the server reads the directed edge corresponding to the new perturbation seed, extracts the starting adjustable interaction region identifier and the ending adjustable interaction region identifier connected by the directed edge, and forms a region pair with the starting adjustable interaction region identifier and the ending adjustable interaction region identifier. Following the processing flow in steps S330 to S350, the server performs geometric boundary sequence perturbation, response priority adjustment, and spatial overlap detection on the region pair to generate a new candidate interface configuration instance. The server adds the new candidate interface configuration instance to the candidate interface configuration instance set. The server appends a record to the existing generation records in the candidate interface configuration instance set, which contains the region pair information corresponding to the new perturbation seed, the time overlap segment information, and the edge strength value of the directed edge, and marks the directed edge as used.
[0094] Step S366: Return to the step of determining whether the number of candidate interface configuration instances already included in the current candidate interface configuration instance set has reached the preset size, and update the spatial difference distribution result within the set after each new candidate interface configuration instance is added, until the candidate interface configuration instance set reaches the preset size.
[0095] Specifically, returning to step S362, the server rereads the number of candidate interface configuration instances already included in the current candidate interface configuration instance set and compares it with the preset size. Simultaneously, following the spatial difference analysis method in step S361, the server supplements the spatial difference distribution result within the set with the spatial difference degree values between the newly added candidate interface configuration instances and all existing candidate interface configuration instances in the set, completing the update of the spatial difference distribution result within the set. The server repeats the above judgment, selection, generation, and update process until the number of candidate interface configuration instances already included in the candidate interface configuration instance set reaches the preset size. Step S300 ends, and the candidate interface configuration instance set is output.
[0096] Step S400: Invoke the pre-built virtual interaction inference tool, take the candidate interface configuration instance set and operation behavior distribution time sequence diagram as input, and obtain the operation path length distribution and interaction response delay statistics corresponding to each candidate interface configuration instance under the constraint of virtual touch event playback.
[0097] Optionally, in one embodiment, step S400 may specifically include the following steps S410 to S460: Step S410: Extract all timestamped contact point trajectories and contact duration periods from the operation behavior record stream associated with the operation behavior distribution time sequence diagram, and arrange them in the order of timestamps to form a virtual touch event playback sequence.
[0098] The server reads the operation behavior record stream associated with the operation behavior distribution sequence diagram. The server extracts all timestamped contact point trajectories from the operation behavior record stream; each timestamped contact point trajectory contains multiple timestamped contact point coordinates. The server also extracts each contact duration from the operation behavior record stream. The server sorts all timestamped contact point trajectories according to their start times, from smallest to largest, using the start time of each contact duration as the sorting criterion. After sorting, the server associates and binds each timestamped contact point trajectory with its corresponding contact duration, forming a virtual touch event playback sequence. Each virtual touch event in the virtual touch event playback sequence contains a timestamped contact point trajectory, the corresponding contact duration, and the contact pressure change sequence corresponding to that timestamped contact point trajectory.
[0099] Step S420: For each candidate interface configuration instance in the candidate interface configuration instance set, write the candidate geometric boundary sequence contained in the candidate interface configuration instance into the geometric boundary storage area of the virtual interactive inferrer to obtain the virtual display layout.
[0100] For example, the server sequentially reads each candidate interface configuration instance from the set of candidate interface configuration instances. For the currently read candidate interface configuration instance, the server extracts all adjustable interactive area identifiers and their corresponding candidate geometric boundary sequences. The server writes all candidate geometric boundary sequences into the geometric boundary storage area of the virtual interaction inferrer, storing each candidate geometric boundary sequence in a one-to-one correspondence with its corresponding adjustable interactive area identifier during the writing process. Simultaneously, the server writes the response priority sorting information contained in the candidate interface configuration instance into the response priority storage area of the virtual interaction inferrer. The server combines the contents of the geometric boundary storage area and the response priority storage area to form a virtual display layout, which is the virtual interface layout corresponding to that candidate interface configuration instance.
[0101] Step S430: Read the trajectory of each touch point in the virtual touch event playback sequence in sequence, map the coordinates of the touch point trajectory within the virtual display layout, and obtain the spatial path of the touch point trajectory relative to each adjustable interactive area in the virtual display layout.
[0102] Optionally, in one embodiment, step S430 may specifically include the following steps S431 to S436: Step S431: Read the candidate geometric boundary sequence corresponding to all adjustable interactive areas in the virtual display layout, connect all the boundary control points in each candidate geometric boundary sequence to form a closed area boundary loop, and group the closed area boundary loops according to the adjustable interactive area identifier to obtain a set of area boundary closed loops.
[0103] The server reads the candidate geometric boundary sequences corresponding to all adjustable interactive areas in the virtual display layout. For each candidate geometric boundary sequence, the server connects all boundary control points in the sequence sequentially, and connects the last boundary control point to the first boundary control point to form a closed region boundary loop. The server associates each closed region boundary loop with its corresponding adjustable interactive area identifier, and groups the closed region boundary loops according to the adjustable interactive area identifier, with all closed region boundary loops corresponding to the same adjustable interactive area identifier grouped into the same group. The server then combines all grouped closed region boundary loops into a set of region boundary closed loops.
[0104] Step S432: Read the directed edge connection density of the region transfer from the operation behavior distribution time sequence diagram. Compare the starting adjustable interaction region identifier and the ending adjustable interaction region identifier of each directed edge in the region transfer directed edge connection density with the adjustable interaction region identifier in the region boundary closed loop set one by one. Attach the region transfer directed edge connection density that matches the comparison to the corresponding closed region boundary ring in the region boundary closed loop set to obtain the region boundary closed loop set carrying the connection density label.
[0105] The server reads the directed edge connection density of region transfer from the operation behavior distribution sequence diagram. For each directed edge in the directed edge connection density of region transfer, the server reads the starting adjustable interaction region identifier and the ending adjustable interaction region identifier of the directed edge. The server compares the starting adjustable interaction region identifier with each adjustable interaction region identifier in the set of region boundary closure loops one by one, and compares the ending adjustable interaction region identifier with each adjustable interaction region identifier in the set of region boundary closure loops one by one. When the starting adjustable interaction region identifier matches the adjustable interaction region identifier corresponding to a certain closed region boundary loop, the server attaches the region transfer directed edge connection density value of the directed edge to the closed region boundary loop as an outgoing edge marker. When the ending adjustable interaction region identifier matches the adjustable interaction region identifier corresponding to a certain closed region boundary loop, the server attaches the region transfer directed edge connection density value of the directed edge to the closed region boundary loop as an incoming edge marker. The server performs the above comparison and attachment process on all directed edges to obtain a set of region boundary closure loops carrying connection density markers.
[0106] Step S433: Read a touch point trajectory from the virtual touch event playback sequence, determine the inclusion relationship between the touch point coordinates contained in the touch point trajectory and each closed region boundary ring in the set of region boundary closed rings carrying connection density markers, record the crossing position and crossing order when the touch point coordinates cross the closed region boundary rings, and generate a crossing position sequence.
[0107] For example, the server reads the trajectory of a touch point from the virtual touch event playback sequence. The server extracts the touch point coordinates from this trajectory in ascending order of timestamps and performs an inclusion relationship determination on each touch point coordinate with each closed region boundary ring in the set of region boundary closed rings carrying connection density markers. The inclusion relationship determination uses a ray casting method, emitting a ray along the positive horizontal axis starting from the current touch point coordinates. The number of intersections between this ray and each boundary segment of the closed region boundary ring is counted. If the number of intersections is odd, the touch point coordinates are determined to be inside the closed region boundary ring. The server records the inclusion relationship determination result for each touch point coordinate. When the inclusion relationship determination results of two adjacent touch point coordinates change—that is, the previous touch point coordinates are inside a closed region boundary ring while the next touch point coordinates are outside the closed region boundary ring, or vice versa—the server determines that a boundary crossing has occurred. The server calculates the coordinates of the intersection point of the line connecting the two adjacent contact points and the boundary segment of the closed region's boundary ring. This intersection point is recorded as the crossing location. Simultaneously, the server records the adjustable interactive region identifier of the closed region's boundary ring corresponding to this crossing location and the order in which the crossings occur. The server then arranges all crossing locations according to the crossing order, generating a crossing location sequence.
[0108] Step S434: Read the contact point trajectory segment between adjacent crossing positions in the crossing position sequence, align the direction of the contact point trajectory segment in the virtual display layout with the direction of the directed edge connection density in the set of closed loops of the region boundary carrying connection density markers, so that the direction of the contact point trajectory segment is consistent with the direction of the directed edge, and obtain the direction-aligned contact point trajectory segment.
[0109] For example, the server reads the contact point trajectory segment between two adjacent crossing positions in the crossing position sequence. Based on the adjustable interaction region identifiers corresponding to the two adjacent crossing positions, the server determines the two adjustable interaction regions traversed by the contact point trajectory segment. The server reads the region transfer directed edge connection density between the two adjustable interaction region identifiers from the set of region boundary closed loops carrying connection density markers, and determines the direction attribute of the directed edge, which records the direction from the starting adjustable interaction region identifier to the ending adjustable interaction region identifier. The server calculates the direction vector of the contact point trajectory segment within the virtual display layout, which is obtained by subtracting the starting crossing position coordinates from the ending crossing position coordinates of the contact point trajectory segment. The server calculates the angle between the direction vector and the directed edge direction vector. When the angle is greater than 90 degrees, the server reverses the direction of the contact point trajectory segment to align it with the directed edge direction; when the angle is less than or equal to 90 degrees, the server keeps the direction of the contact point trajectory segment unchanged. The server performs the above direction alignment processing on the contact point trajectory segments between all adjacent crossing positions in the crossing position sequence to obtain the direction-aligned contact point trajectory segments.
[0110] Step S435: Reassemble the contact point trajectory segments after direction alignment with the crossing positions in the crossing position sequence in order to obtain the corrected contact point coordinate sequence.
[0111] For example, the server reads the first crossing position from the crossing position sequence and uses it as the starting point of the corrected contact point coordinate sequence. The server inserts the direction-aligned contact point trajectory segments between two adjacent crossing positions in the order of the crossing positions in the sequence. During insertion, the server aligns the starting endpoint of the current direction-aligned contact point trajectory segment with the previous crossing position and the ending endpoint with the next crossing position. The server then inserts all contact point coordinates within the trajectory segment, arranged chronologically, into the corrected contact point coordinate sequence. The server repeats this insertion process until all direction-aligned contact point trajectory segments have been inserted into the corrected contact point coordinate sequence. Finally, the last crossing position in the crossing position sequence is used as the endpoint of the corrected contact point coordinate sequence, resulting in the corrected contact point coordinate sequence.
[0112] Step S436: Based on the line direction between adjacent contact point coordinates in the corrected contact point coordinate sequence, generate a continuous path within the virtual display layout and output it as the spatial path of the contact point trajectory relative to each adjustable interactive area in the virtual display layout.
[0113] The server reads all contact point coordinates from the corrected contact point coordinate sequence. Starting from the first contact point coordinate in the corrected contact point coordinate sequence, the server connects adjacent contact point coordinates sequentially with line segments, the direction of which is determined by the difference between the coordinates of adjacent contact points. The server connects all the line segments end-to-end to form a continuous path. The server positions this continuous path within the virtual display layout, ensuring that the spatial position of the continuous path maintains the correct relative spatial relationship with the closed boundary rings of each adjustable interactive area in the virtual display layout. The server outputs this continuous path as the spatial path of the contact point trajectory relative to each adjustable interactive area in the virtual display layout.
[0114] Step S440: Perform segment length statistics on the spatial path, calculate the path length of each contact point trajectory across different adjustable interaction areas, and generate the operation path length distribution corresponding to the candidate interface configuration instance.
[0115] Specifically, the server reads the spatial paths corresponding to all contact point trajectories under the current candidate interface configuration instance. For each spatial path, the server divides it into multiple path segments based on the closed region boundary loop it traverses. Each path segment is located within an adjustable interactive area or between two adjacent adjustable interactive areas. The server calculates the length of each path segment by summing the Euclidean distances between the coordinates of adjacent contact points within that path segment. The server sums the lengths of all path segments of the spatial path to obtain the corresponding operation path length. The server statistically analyzes the operation path lengths corresponding to all spatial paths under the current candidate interface configuration instance, calculates the median and interquartile range of all operation path lengths, and performs histogram analysis on all operation path lengths according to the preset length slot width to obtain the operation path length distribution corresponding to the candidate interface configuration instance.
[0116] Step S450: Based on the contact duration in the virtual touch event playback sequence and the response priority sorting of the candidate interface configuration instance, determine the response waiting time for the adjustable interaction area into which each touch point trajectory falls, and generate the interaction response latency statistics corresponding to the candidate interface configuration instance.
[0117] Optionally, in one embodiment, step S450 may specifically include the following steps S451 to S456: Step S451: Read the contact duration period corresponding to each contact point trajectory in the virtual touch event playback sequence and the adjustable interaction area identifier into which the contact point trajectory falls. Match the contact duration period with the adjustable interaction area identifier in the corresponding area dwell duration distribution in the operation behavior distribution time sequence diagram to obtain the dwell duration matching relationship.
[0118] The server reads the contact duration corresponding to the currently processed contact point trajectory from the virtual touch event playback sequence. Based on the spatial path corresponding to the contact point trajectory in step S430, the server determines the adjustable interaction area identifier into which the contact point trajectory falls. When the spatial path of the contact point trajectory is entirely within an adjustable interaction area, the identifier of that adjustable interaction area is the identifier of the adjustable interaction area into which the contact point trajectory falls. When the spatial path of the contact point trajectory crosses multiple adjustable interaction areas, the identifier of the adjustable interaction area with the largest proportion of spatial path length is used as the identifier of the adjustable interaction area into which the contact point trajectory falls. The server reads the area dwell duration distribution corresponding to the adjustable interaction area identifier from the operation behavior distribution time sequence diagram. The server performs time-segment matching between the contact duration of the contact point trajectory and each contact duration in the area dwell duration distribution. During the matching process, the server calculates the duration ratio of the contact duration to each contact duration in the area dwell duration distribution, and takes the contact duration with the duration ratio closest to 1 as the matching result, recording this matching result as the dwell duration matching relationship.
[0119] Step S452: Obtain the response priority sorting contained in the candidate interface configuration instance, parse the arrangement position of the adjustable interactive area identifier from the response priority sorting, and extract all adjustable interactive area identifiers arranged before the adjustable interactive area identifier to form a predecessor area identifier set.
[0120] The server reads the response priority sorting contained in the current candidate interface configuration instance. The server searches for the position of the currently adjustable interactive area identifier within this response priority sort, comparing it sequentially from the first adjustable interactive area identifier in the sort until a matching position is found. The server extracts all adjustable interactive area identifiers preceding this position in the response priority sort, forming a predecessor area identifier set. When the adjustable interactive area identifier is the first position in the response priority sort, the predecessor area identifier set is empty.
[0121] Step S453: Read the regional dwell duration distribution corresponding to each adjustable interaction area identifier in the predecessor area identifier set from the operation behavior distribution time sequence diagram, and perform overlap analysis on the dwell time period of the predecessor area identifier set and the contact duration period to obtain the predecessor dwell overlap time period distribution.
[0122] For example, the server sequentially reads each adjustable interaction region identifier from the set of predecessor region identifiers and reads the region dwell duration distribution corresponding to that adjustable interaction region identifier from the operation behavior distribution time sequence diagram. For each contact duration period in the region dwell duration distribution corresponding to each adjustable interaction region identifier, the server performs overlap detection between the start and end times of the contact duration period and the start and end times of the contact duration period of the current contact point trajectory. The overlap detection method is the same as the time overlap segment calculation method described in step S263. The server extracts all contact duration periods with time overlap and records the adjustable interaction region identifier corresponding to each overlapping period. The server groups the overlapping periods corresponding to all predecessor region identifiers according to the adjustable interaction region identifier to obtain the predecessor dwell overlap period distribution.
[0123] Step S454: Read the pressure change data corresponding to the adjustable interactive area identifier into which the contact point trajectory falls in the pressure change superposition result, mark the time period in the pressure change data that is synchronized with the contact duration as the synchronous pressure period, and align the synchronous pressure period with the distribution of the overlapping period of the precursor residence to generate a synchronous pressure alignment relationship.
[0124] The server reads the pressure change data corresponding to the adjustable interactive area identifier into which the contact point trajectory falls from the pressure change superposition result. Based on the start and end times of the contact duration of the contact point trajectory, the server extracts a segment of the pressure change data that is synchronized with the contact duration, marking this segment as the synchronized pressure period. The server aligns the time axis of the synchronized pressure period with the time axis of the preceding residence overlap period distribution, using the start time of the contact duration as the common time origin during the alignment process. The server records the time position corresponding to each contact pressure sample value within the synchronized pressure period in the preceding residence overlap period distribution, establishing a correspondence between the time positions of pressure sample values in the synchronized pressure period and the time positions of residence periods in the preceding residence overlap period distribution, generating a synchronized pressure alignment relationship.
[0125] Step S455: Based on the synchronous pressure alignment relationship, the start time of the contact duration period is shifted backward along the time axis. The shifting process first defines the range of the delay period by the time interval of the overlapping period of the precursor residence, and then determines the response start time within the range of the delay period by the pressure change of the synchronous pressure period.
[0126] Specifically, the server reads the synchronization pressure alignment relationship and the distribution of preceding residence overlap periods. Starting from the beginning of the contact duration, the server moves backward along the time axis, with the maximum range limited by the time interval of the preceding residence overlap period distribution. The upper limit of the delayable period range is set to the latest end time of the overlapping periods in the preceding residence overlap period distribution. Within the delayable period range, the server reads the pressure change data corresponding to the synchronization pressure periods, searching for the inflection point where the pressure value changes from decreasing to increasing within that range. This inflection point represents the starting position of pressure recovery and growth within the delayable period range. The server determines the time position corresponding to the inflection point closest to the beginning of the contact duration period that satisfies the condition of pressure value changing from decreasing to increasing as the response start time. When there is no inflection point satisfying the condition of pressure value changing from decreasing to increasing within the delayable period range, the server determines the midpoint time position of the delayable period range as the response start time. The server records this response start time as the response start time of the adjustable interaction area into which the contact point trajectory falls.
[0127] Step S456: Determine the time interval between the response start time and the start time of the contact point trajectory as the response waiting time of the contact point trajectory, integrate the response waiting times of all contact point trajectories under the same candidate interface configuration instance, and generate the interaction response latency statistics corresponding to the candidate interface configuration instance.
[0128] During the specific execution of step S456, the server reads the response start time determined in step S455 and the start time of the contact point trajectory. This start time is the start time of the contact duration corresponding to the contact point trajectory. The server subtracts the start time of the contact point trajectory from the response start time to obtain the response waiting time of the contact point trajectory. The server performs the above response waiting time calculation on all contact point trajectories under the current candidate interface configuration instance, sorts all response waiting times in ascending order of value, calculates the average and standard deviation of all response waiting times, and performs histogram statistics on all response waiting times according to the preset delay slot width to obtain the interaction response delay statistics corresponding to the candidate interface configuration instance.
[0129] Step S460: Bind the operation path length distribution and interaction response latency statistics to the candidate interface configuration instances, and output the operation path length distribution and interaction response latency statistics corresponding to each candidate interface configuration instance.
[0130] Specifically, the server binds and stores the operation path length distribution corresponding to the candidate interface configuration instance generated in step S440 and the interaction response latency statistics corresponding to the candidate interface configuration instance generated in step S450, along with the instance identifier of the candidate interface configuration instance. The server performs steps S420 to S450 on each candidate interface configuration instance in the candidate interface configuration instance set to obtain the operation path length distribution and interaction response latency statistics corresponding to each candidate interface configuration instance. The server outputs the binding relationships between all candidate interface configuration instances and their respective operation path length distributions and interaction response latency statistics, completing step S400.
[0131] Step S500: Based on the operation path length distribution and interaction response delay statistics, determine the target interface configuration instance from the candidate interface configuration instance set, and generate a configuration update instruction containing the adjustable interactive area geometric boundary sequence and response priority sorting of the target interface configuration instance, and transmit it to the terminal device.
[0132] Optionally, in one embodiment, step S500 may specifically include the following steps S510 to S560: Step S510: For each candidate interface configuration instance in the candidate interface configuration instance set, parse its operation path length distribution to obtain the main peak position of the path length and the dispersion range of the path length, and parse its interaction response latency statistics to obtain the latency concentration period and latency outlier period.
[0133] The server sequentially reads the operation path length distribution and interaction response latency statistics for each candidate interface configuration instance from the binding results output in step S460. For the operation path length distribution, the server reads the histogram statistics corresponding to the operation path length distribution, finds the length slot with the highest probability density in the histogram, and uses the center value of the length value interval corresponding to that slot as the main peak position of the path length. The server calculates the first quartile and the third quartile of all operation path lengths in the operation path length distribution, and uses the difference between the third quartile and the first quartile as the path length dispersion range. For the interaction response latency statistics, the server reads the histogram statistics corresponding to the interaction response latency statistics, finds the latency slot with the most response waiting times in the histogram, and uses the time interval corresponding to that latency slot as the latency concentration period. The server categorizes the time periods corresponding to response waiting times exceeding 1.5 times the average response waiting time in the interaction response latency statistics as latency outlier periods. The server performs the above parsing process on all candidate interface configuration instances to obtain the main peak position of the path length, the path length dispersion range, the latency concentration period, and the latency outlier period for each candidate interface configuration instance.
[0134] Step S520: Map the path length peak position and latency concentration period of each candidate interface configuration instance to the same two-dimensional comparison plane to generate the joint distribution position of the candidate interface configuration instances.
[0135] Specifically, the server establishes a two-dimensional comparison plane with the peak position of path length as the first coordinate axis and the concentrated latency period as the second coordinate axis. The scale range of the first coordinate axis is from the minimum to the maximum value of the peak position of path length for all candidate interface configuration instances, and the scale range of the second coordinate axis is from the minimum to the maximum value of the concentrated latency period for all candidate interface configuration instances. For each candidate interface configuration instance, the server uses the peak position of path length of the candidate interface configuration instance as the first coordinate value and the center value of the time interval of the concentrated latency period of the candidate interface configuration instance as the second coordinate value, and determines a coordinate point in the two-dimensional comparison plane. This coordinate point is the joint distribution position of the candidate interface configuration instance. The server generates corresponding joint distribution positions for all candidate interface configuration instances in the two-dimensional comparison plane.
[0136] Step S530: Compare the joint distribution positions of all candidate interface configuration instances, and mark the candidate interface configuration instances whose joint distribution positions are not simultaneously dominated by the joint distribution positions of other candidate interface configuration instances as non-dominant candidate interface configuration instances.
[0137] For example, the server iterates through each candidate interface configuration instance in the candidate interface configuration instance set. For the currently iterated candidate interface configuration instance, the server compares the peak position of its path length and the concentrated period of its latency with the peak positions of the path length and the concentrated periods of latency of all other candidate interface configuration instances in the set. If there exists another candidate interface configuration instance whose peak position of path length is shorter than that of the current candidate interface configuration instance, and whose concentrated period of latency is shorter than that of the current candidate interface configuration instance, the server determines that the joint distribution position of the current candidate interface configuration instance is simultaneously dominated by the joint distribution position of that other candidate interface configuration instance. If no other candidate interface configuration instance can simultaneously dominate the joint distribution position of the current candidate interface configuration instance, the server marks the current candidate interface configuration instance as a non-dominated candidate interface configuration instance. After the server has traversed all candidate interface configuration instances, it obtains all non-dominated candidate interface configuration instances.
[0138] Step S540: From the non-dominated candidate interface configuration instances, normalize the path length dispersion range of each candidate interface configuration instance to obtain the path length dispersion index, normalize the time delay outlier period to obtain the time delay outlier index, and select the candidate interface configuration instance with the middle position of the dispersion distribution based on the dimensionless dispersion distribution formed by the path length dispersion index and the time delay outlier index as the target interface configuration instance.
[0139] Optionally, in one embodiment, step S540 may specifically include the following steps S541 to S546: Step S541: Read the path length dispersion range and latency outlier period of each candidate interface configuration instance in the set of non-dominated candidate interface configuration instances. Normalize the path length dispersion range to obtain the path length quantile interval and normalize the latency outlier period to obtain the latency quantile interval. Correspond the path length quantile interval with the edge strength level in the operation behavior distribution time sequence graph to obtain the first correspondence between the path length quantile interval and the edge strength level.
[0140] For example, the server reads the path length dispersion range and latency outlier periods for each candidate interface configuration instance in the set of non-dominated candidate interface configuration instances. The server performs min-max normalization on all path length dispersion ranges in the set of non-dominated candidate interface configuration instances. For the path length dispersion range of the m-th candidate interface configuration instance, the path length quantile interval is calculated by subtracting the minimum value among all path length dispersion ranges from the path length dispersion range, and then dividing by the difference between the maximum and minimum values among all path length dispersion ranges. The server performs the same normalization on the latency outlier periods to obtain the latency quantile intervals. The server reads the directed edge connection density values for all region transfers from the operation behavior distribution time sequence diagram, and divides these values into 5 equal-frequency intervals in ascending order. Each equal-frequency interval corresponds to an edge strength level, with level numbers increasing sequentially from 1 to 5. The server maps the path length quantile intervals of each non-dominated candidate interface configuration instance to five edge strength levels. The mapping method involves mapping the path length quantile intervals to a 0-1 range, and determining the corresponding edge strength level based on the 0-1 sub-interval the path length quantile interval falls into: 0-0.2 corresponds to edge strength level 1, 0.2-0.4 to edge strength level 2, 0.4-0.6 to edge strength level 3, 0.6-0.8 to edge strength level 4, and 0.8-1 to edge strength level 5. The server records this mapping relationship between the path length quantile intervals and corresponding edge strength levels for each non-dominated candidate interface configuration instance as the first mapping relationship.
[0141] Step S542: Match the delay quantile interval with the number of region identifiers arranged before the corresponding adjustable interaction region identifier in the response priority sorting to obtain the second correspondence between the delay quantile interval and the number of preceding region identifiers.
[0142] Specifically, the server reads the response priority ranking of each non-dominated candidate interface configuration instance. For each non-dominated candidate interface configuration instance, the server reads the highest-ranked adjustable interaction area identifier from the response priority ranking and calculates the number of area identifiers preceding it, which is 0. The server also reads the latency quantile interval of the candidate interface configuration instance and maps it to the number of preceding area identifiers. During this mapping process, the server maps the latency quantile interval to a 0-1 range and normalizes the number of preceding area identifiers to a 0-1 range by dividing the number of preceding area identifiers by the total number of adjustable interaction area identifiers in the response priority ranking minus 1. The server records the mapping relationship between the latency quantile interval of each non-dominated candidate interface configuration instance and the corresponding normalized number of preceding area identifiers as a second mapping relationship.
[0143] Step S543: For each non-dominated candidate interface configuration instance, associate the edge strength level in the first correspondence with the number of preceding region identifiers in the second correspondence on the operation behavior distribution time sequence diagram to obtain the node path association form of the candidate interface configuration instance.
[0144] The server reads the first and second correspondences corresponding to each non-dominated candidate interface configuration instance. From the first correspondence, the server reads the edge strength level of the candidate interface configuration instance and searches for all directed edges with that edge strength level in the operation behavior distribution time sequence graph. From the second correspondence, the server reads the number of preceding region identifiers corresponding to the candidate interface configuration instance and determines the adjustable interaction region identifier nodes corresponding to that number in the operation behavior distribution time sequence graph. The server performs path association between the found directed edges and the determined adjustable interaction region identifier nodes in the operation behavior distribution time sequence graph. The path association process starts from the determined adjustable interaction region identifier node and extends along the directed edges corresponding to the edge strength level in the operation behavior distribution time sequence graph to adjacent nodes, forming a node path association pattern. The server performs the above node path association processing on all non-dominated candidate interface configuration instances to obtain the node path association pattern for each candidate interface configuration instance.
[0145] Step S544: Compare the node path association patterns of all non-dominant candidate interface configuration instances pairwise, and determine the repulsion direction between instances based on the overlap of the shared edge strength level and the number of shared front area identifiers in the association patterns, thus obtaining the instance repulsion direction set.
[0146] For example, the node path association patterns of all non-dominated candidate interface configuration instances are paired up. For each pair of non-dominated candidate interface configuration instances, the server compares the number of shared edge strength levels and the number of shared preceding region identifiers in the node path association patterns of the pair. When the number of shared edge strength levels is greater than 0 and the number of shared preceding region identifiers is greater than 0, the server determines that there is an inter-instance repulsion force between the pair of candidate interface configuration instances. The server calculates the direction of the inter-instance repulsion force between the pair of candidate interface configuration instances. The repulsion force direction points from the candidate interface configuration instance with the larger path length peak position to the candidate interface configuration instance with the smaller path length peak position, and simultaneously from the candidate interface configuration instance with the larger latency concentration period to the candidate interface configuration instance with the smaller latency concentration period. The two direction vectors are combined to obtain the inter-instance repulsion force direction between the pair of candidate interface configuration instances. The server collects all the inter-instance repulsion force directions obtained from the pairwise pairings to obtain the instance repulsion direction set.
[0147] Step S545: Based on the instance rejection direction set, the non-dominated candidate interface configuration instance set is gradually shifted in position in the virtual instance space until the instance distribution in the virtual instance space forms a stable cluster state, and the central instance in the stable cluster state is output as the target interface configuration instance.
[0148] A virtual instance space is established using the path length dispersion index as the first coordinate axis and the latency outlier index as the second coordinate axis. All non-dominated candidate interface configuration instances are initially positioned within this virtual instance space according to their respective path length dispersion indices and latency outlier indices. The server reads the instance repulsion direction set and, based on the direction of the repulsion force between instances in the set, progressively offsets the positions of the corresponding two non-dominated candidate interface configuration instances. Each offset step is 10% of the distance between the two instances in the virtual instance space. After each offset, the server recalculates the pairwise distances between all non-dominated candidate interface configuration instances and calculates the variance of all pairwise distances. When this variance is less than a preset stability threshold, the server determines that the instance distribution in the virtual instance space has formed a stable clustering state. The preset stability threshold is set to 5% of the current average of all pairwise distances. Under the stable clustering state, the server calculates the geometric center position of all non-dominated candidate interface configuration instances in the virtual instance space, identifies the non-dominated candidate interface configuration instance closest to this geometric center position as the output object, and uses this output object as the target interface configuration instance.
[0149] Step S546: Output the candidate geometric boundary sequence of the adjustable interactive area and the response priority sorting corresponding to the target interface configuration instance.
[0150] During the specific execution of step S546, the server reads the candidate geometric boundary sequence and response priority sort of the adjustable interactive area corresponding to the target interface configuration instance. The server organizes all adjustable interactive area identifiers, the candidate geometric boundary sequence corresponding to each adjustable interactive area identifier, and the response priority sort into structured data, and outputs the structured data, thus completing step S540.
[0151] Step S550: Extract the candidate geometric boundary sequence of adjustable interactive areas and the response priority sorting contained in the target interface configuration instance, and serialize the boundary control point coordinates of the candidate geometric boundary sequence and the adjustable interactive area identifiers in the response priority sorting into configuration load data.
[0152] Optionally, in one embodiment, step S550 may specifically include the following steps S551 to S556: Step S551: Read the candidate geometric boundary sequence of adjustable interactive areas contained in the target interface configuration instance, and spatially align the coordinates of the boundary control points corresponding to each adjustable interactive area identifier with the anchor point position of the node corresponding to the adjustable interactive area identifier in the operation behavior distribution time sequence diagram to obtain the coordinates of the boundary control points after anchor point alignment.
[0153] Specifically, the server reads all candidate geometric boundary sequences of adjustable interactive areas contained in the target interface configuration instance. For each candidate geometric boundary sequence corresponding to an adjustable interactive area identifier, the server calculates the boundary center coordinates of the candidate geometric boundary sequence. The server reads the node anchor point position of the node corresponding to the adjustable interactive area identifier from the operation behavior distribution sequence diagram. In step S260, the node anchor point position was aligned with the boundary center position of the geometric boundary sequence corresponding to the adjustable interactive area identifier in the current configuration state of the interactive interface instance. The server calculates the offset between the boundary center coordinates of the candidate geometric boundary sequence and the node anchor point position. The offset is obtained by subtracting the boundary center coordinates of the candidate geometric boundary sequence from the node anchor point position coordinates. The server adds the offset to the coordinates of each boundary control point in the candidate geometric boundary sequence, so that the boundary center coordinates of the candidate geometric boundary sequence coincide with the node anchor point position, thus obtaining the boundary control point coordinates after anchor point alignment.
[0154] Step S552: Read the response priority sorting contained in the target interface configuration instance, match the order of adjustable interactive area identifiers in the response priority sorting with the direction connection density of the region transfer in the operation behavior distribution time sequence diagram, and obtain the response priority and transfer direction matching result.
[0155] For example, the server reads the response priority sorting from the target interface configuration instance. It sequentially extracts two adjacent adjustable interaction area identifiers from the response priority sorting, forming multiple adjacent identifier pairs. For each adjacent identifier pair, the server searches the operation behavior distribution sequence graph for a directed edge connecting the two adjustable interaction area identifiers in that pair. When a directed edge exists pointing from the first adjustable interaction area identifier to the second in the adjacent identifier pair, the server determines that the direction of the adjacent identifier pair is consistent with the direction of the area transfer directed edge; when a directed edge exists pointing from the second adjustable interaction area identifier to the first in the adjacent identifier pair, the server determines that the direction of the adjacent identifier pair is opposite to the direction of the area transfer directed edge; when no directed edge connects the two adjustable interaction area identifiers in the adjacent identifier pair, the server determines that the adjacent identifier pair has no corresponding transfer direction. The server collects the direction determination results for all adjacent identifier pairs to obtain the response priority and transfer direction matching result.
[0156] Step S553: Based on the response priority and transfer direction matching results, arrange the coordinates of the boundary control points after anchor point alignment along the transfer direction, and write the arranged boundary control point coordinates into the coordinate stream according to the adjustable interactive area identifier order to obtain the directional boundary coordinate stream.
[0157] For example, the server reads the response priority and transfer direction matching results and the anchor-aligned boundary control point coordinates. The server processes the anchor-aligned boundary control point coordinates for each adjustable interactive region identifier in the order of the adjustable interactive region identifiers in the response priority sorting. For the currently processed adjustable interactive region identifier, the server arranges the anchor-aligned boundary control point coordinates along the corresponding transfer direction based on the direction determination result corresponding to that adjustable interactive region identifier in the response priority and transfer direction matching results. When the direction determination result corresponding to the adjustable interactive region identifier is consistent with the direction, the server writes the anchor-aligned boundary control point coordinates of that adjustable interactive region identifier into the coordinate stream in the original order; when the direction determination result corresponding to the adjustable interactive region identifier is opposite to the direction, the server writes the anchor-aligned boundary control point coordinates of that adjustable interactive region identifier into the coordinate stream in the reverse order of the original order; when the direction determination result corresponding to the adjustable interactive region identifier is that there is no corresponding transfer direction, the server writes the coordinates into the coordinate stream in the original order. The server performs the above processing on all adjustable interactive region identifiers to obtain a directional boundary coordinate stream.
[0158] Step S554: Perform geometric continuity on the boundary control point coordinates between adjacent adjustable interaction regions in the directional boundary coordinate flow, so that the boundary control point coordinates of adjacent adjustable interaction regions maintain a density distribution in the coordinate flow that is consistent with the edge strength in the operation behavior distribution time sequence diagram, and obtain the coordinate flow after density distribution processing.
[0159] For example, the server reads the directed edge connection density of region transfers from the directional boundary coordinate stream and the operation behavior distribution time sequence diagram. The server sequentially reads the boundary control point coordinate segments between two adjacent adjustable interaction regions from the directional boundary coordinate stream. For each pair of adjacent adjustable interaction regions, the server reads the directed edge connection density of the region transfers corresponding to the directed edge connecting the identifiers of that pair of adjustable interaction regions from the operation behavior distribution time sequence diagram. The server determines the density of the boundary control point coordinates between the pair of adjacent adjustable interaction regions based on the value of this directed edge connection density. A higher directed edge connection density results in a smaller distance between the boundary control point coordinates of the pair of adjacent adjustable interaction regions, indicating a more compact arrangement; conversely, a lower directed edge connection density results in a larger distance between the boundary control point coordinates of the pair of adjacent adjustable interaction regions, indicating a more sparse arrangement. The server adjusts the density of boundary control point coordinates by resampling. During resampling, the server samples the boundary control point coordinate segments between the pair of adjacent adjustable interactive regions evenly according to the target spacing. The target spacing is obtained by dividing the total length of the boundary control point coordinate segments between the pair of adjacent adjustable interactive regions by the number of target sampling points. The number of target sampling points is proportional to the density of directed edges connecting the regions transferred between the pair of adjacent adjustable interactive regions. The server replaces the original coordinate segments with the resampled boundary control point coordinates to obtain the coordinate flow after density distribution processing.
[0160] Step S555: Merge and encapsulate the coordinate stream after density distribution processing with the adjustable interaction region identifier order in the response priority sorting to generate compact configuration load data.
[0161] Compact configuration load data is a data structure for transmission obtained by merging and encapsulating the coordinate stream after density distribution processing with the adjustable interaction area identifier order in the response priority sorting.
[0162] During the specific execution of step S555, the server reads the coordinate stream after density-distribution processing and the adjustable interaction region identifier order from the response priority sorting. The server creates a configuration load data container containing an adjustable interaction region identifier order field and a boundary coordinate stream field. The server sequentially writes the adjustable interaction region identifiers from the response priority sorting into the adjustable interaction region identifier order field, with each adjustable interaction region identifier occupying a fixed length of identifier storage space in the order field. The server sequentially writes all boundary control point coordinates from the density-distribution processed coordinate stream into the boundary coordinate stream field, with each boundary control point coordinate occupying a fixed length of coordinate storage space, with the x-coordinate and y-coordinate each occupying half of the coordinate storage space. The server inserts a separator between the adjustable interaction region identifier order field and the boundary coordinate stream field to complete the merging and encapsulation, generating compact configuration load data.
[0163] Step S556: Add a terminal device identifier and a configuration update flag to the compact configuration load data, generate a configuration update command, and send the configuration update command to the terminal device.
[0164] During the specific execution of step S556, the server reads the compact configuration load data generated in step S555 and the terminal device identifier recorded in step S100. The server adds a terminal device identifier field to the header of the compact configuration load data and writes the terminal device identifier into this field. The server also adds a configuration update flag field to the header of the compact configuration load data and writes the configuration update flag into this field. This configuration update flag is used to instruct the terminal device to update the current configuration state of the interactive interface instance after receiving the compact configuration load data. The server encapsulates the compact configuration load data with the terminal device identifier and configuration update flag added into a configuration update instruction and sends the configuration update instruction to the terminal device through the network connection between the server and the terminal device.
[0165] Step S560: Add a terminal device identifier and a configuration update flag to the configuration load data, generate a configuration update command, and send the configuration update command to the terminal device.
[0166] Specifically, the server reads the configuration load data corresponding to the target interface configuration instance. The server adds a terminal device identifier to the configuration load data; this identifier was already recorded in the server when the current configuration state and operation behavior record stream of the interactive interface instance was received in step S100. The server adds a configuration update flag to the configuration load data, which enables the terminal device to identify the update instruction type corresponding to the configuration load data. The server encapsulates the configuration load data with the added terminal device identifier and configuration update flag into a configuration update instruction and sends the configuration update instruction to the terminal device via a wireless network. After receiving the configuration update instruction, the terminal device parses the adjustable interactive area candidate geometric boundary sequence and response priority sorting of the target interface configuration instance in the configuration update instruction, and updates the current configuration state of the interactive interface instance based on the parsing results, completing the game interactive interface optimization based on the user operation profile.
[0167] This invention provides a server, including a memory, a processor, and a computer program stored in the memory. The processor executes the computer program to implement the steps of the method provided in any optional embodiment of this invention.
[0168] In one alternative embodiment, a server is provided, such as Figure 4 As shown, Figure 4The server 4000 shown includes a processor 4001 and a memory 4003. The processor 4001 and the memory 4003 are connected, for example, via a bus 4002. Optionally, the server 4000 may further include a transceiver 4004, which can be used for data interaction between the server and other servers, such as sending and / or receiving data. It should be noted that in practical applications, the transceiver 4004 is not limited to one type, and the structure of the server 4000 does not constitute a limitation on the embodiments of the present invention.
[0169] Processor 4001 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this invention. Processor 4001 may also be a combination that implements computational functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.
[0170] Bus 4002 may include a pathway for transmitting information between the aforementioned components. Bus 4002 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. Bus 4002 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 4 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.
[0171] The memory 4003 may be ROM (Read Only Memory) or other types of static storage devices capable of storing static information and instructions, RAM (Random Access Memory) or other types of dynamic storage devices capable of storing information and instructions, or EEPROM (Electrically Erasable Programmable Read Only Memory), CD-ROM (Compact Disc Read Only Memory) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media, other magnetic storage devices, or any other medium capable of carrying or storing computer programs and capable of being read by a computer, without limitation herein.
[0172] The memory 4003 stores a computer program for executing embodiments of the present invention, and its execution is controlled by the processor 4001. The processor 4001 executes the computer program stored in the memory 4003 to implement the steps shown in the foregoing method embodiments.
[0173] This invention provides a computer-readable storage medium storing a computer program, which, when executed by a processor, can implement the steps and corresponding content of the aforementioned method embodiments.
[0174] The above description is only an optional implementation of some scenarios of the present invention. It should be noted that for those skilled in the art, other similar implementation methods based on the technical concept of the present invention, without departing from the technical concept of the present invention, also fall within the protection scope of the embodiments of the present invention.
Claims
1. A method for optimizing game interaction interfaces based on user operation profiles, characterized in that, include: The terminal device receives the current configuration status and operation behavior record stream of the interactive interface instance. The current configuration status of the interactive interface instance includes the geometric boundary sequence of a set of adjustable interactive areas in the display coordinate system and the response priority sorting. The operation behavior record stream includes the contact point trajectory with timestamp, the contact duration period and the contact pressure change sequence. Based on the operation behavior record stream and the geometric boundary sequence in the current configuration state of the interactive interface instance, an operation behavior distribution time sequence diagram is constructed to obtain the operation behavior distribution time sequence diagram. The operation behavior distribution time sequence diagram uses the geometric boundary sequence as a spatial division reference to map the trajectory of each contact point to the set of adjustable interactive areas and generate the directed edge connection density of the region transfer and the region dwell duration distribution. The directed edge connection density of the region transfer represents the degree of connection between adjacent contact point trajectories in different adjustable interactive areas, and the region dwell duration distribution represents the dwell time distribution of the contact point trajectory in each adjustable interactive area. Perform candidate configuration instance perturbation expansion on the operation behavior distribution time sequence diagram to obtain a candidate interface configuration instance set. Each candidate interface configuration instance in the candidate interface configuration instance set includes a candidate geometric boundary sequence of an adjustable interaction region that has shifted relative to the current configuration state of the interaction interface instance and a response priority sorting corresponding to the candidate geometric boundary sequence. The pre-built virtual interaction inference tool is invoked, and the set of candidate interface configuration instances and the timing diagram of operation behavior distribution are used as input. Under the constraint of virtual touch event playback, the operation path length distribution and interaction response delay statistics corresponding to each candidate interface configuration instance are obtained. Based on the operation path length distribution and interaction response latency statistics, a target interface configuration instance is determined from the candidate interface configuration instance set, and a configuration update instruction containing the adjustable interactive area geometric boundary sequence and response priority sorting of the target interface configuration instance is generated and transmitted to the terminal device.
2. The method according to claim 1, characterized in that, The operation behavior distribution time sequence diagram is constructed based on the operation behavior record stream and the geometric boundary sequence in the current configuration state of the interactive interface instance. The operation behavior distribution time sequence diagram uses the geometric boundary sequence as a spatial partitioning reference, maps the trajectory of each contact point to the set of adjustable interactive areas, and generates the directed edge connection density for region transfer and the region dwell duration distribution. The directed edge connection density for region transfer represents the tightness of connection between adjacent contact point trajectories in different adjustable interactive areas, and the region dwell duration distribution represents the dwell time distribution of the contact point trajectory in each adjustable interactive area, including: The contact point trajectories with timestamps in the operation behavior recording stream are subjected to adjacent contact point displacement abrupt change detection. Contact points that meet the continuous sliding condition are grouped into the same contact trajectory segment, resulting in a set of contact trajectory segments with start timestamps and end timestamps. Each contact trajectory segment in the set of contact trajectory segments is spatially assigned to the geometric boundary sequence in the current configuration state of the interactive interface instance to obtain the adjustable interactive area identifier to which each contact trajectory segment belongs, and a correspondence between the contact trajectory segments and the adjustable interactive area identifier is generated. Based on the attribution correspondence, the contact pressure change sequence corresponding to each contact trajectory segment is superimposed to generate the pressure change superposition result of each contact trajectory segment under the adjustable interactive area identifier; The change of adjustable interactive area identifiers between adjacent contact trajectory segments is statistically analyzed through the attribution correspondence relationship, and the directed edge connection density of the region transfer connecting different adjustable interactive area identifiers is generated. Aggregate the contact duration periods for the contact trajectory segments corresponding to each adjustable interactive area identifier to obtain the area dwell duration distribution for each adjustable interactive area identifier; Align the region transfer directed edge connection density, the region dwell duration distribution, and the pressure change superposition result according to the geometric boundary sequence in the display coordinate system to generate an operation behavior distribution time sequence diagram with adjustable interactive region identifiers as nodes and region transfer directed edge connection density as edge strength.
3. The method according to claim 2, characterized in that, The step of aligning the superimposed results of the region transfer directed edge connection density, the region dwell duration distribution, and the pressure change according to the geometric boundary sequence within the display coordinate system to generate a timing diagram of the operation behavior distribution with adjustable interactive region identifiers as nodes and region transfer directed edge connection density as edge strength includes: Extract all adjustable interactive region identifier pairs from the directed edge connection density of the region transfer. Generate the initial spatial direction of the directed edge in the display coordinate system based on the boundary line direction of the corresponding adjustable interactive region in the geometric boundary sequence. Couple the initial spatial direction with the pressure change data corresponding to the initial adjustable interactive region identifier in the pressure change superposition result to obtain the directed edge skeleton constrained by pressure. The contact duration distribution corresponding to each adjustable interactive area identifier in the area dwell duration distribution is converted into a dwell state label sequence. Each dwell state label includes a dwell start time and a dwell end time. The dwell state label sequence is embedded into the corresponding node position in the directed edge skeleton under pressure constraint to obtain a node skeleton carrying the dwell state label sequence. For each directed edge in the node skeleton carrying the dwell state marker sequence, read the region transfer directed edge connection density corresponding to the directed edge, and read the time overlap segment of the dwell state marker sequence of each node at both ends of the directed edge. Bind the time overlap segment to the directed edge to generate a directed edge skeleton with time window constraints. The pressure change data corresponding to each adjustable interactive region identifier in the pressure change superposition result is spatially expanded along the boundary line of the geometric boundary sequence corresponding to the adjustable interactive region identifier to obtain the pressure spatial expansion shape. The pressure spatial expansion shape is then fused with the dwell state mark sequence of the corresponding node in the directed edge skeleton with time window constraints to generate a directed edge skeleton with enhanced node pressure shape. Bending is performed on each edge in the directed edge skeleton of node pressure morphology enhancement, so that each edge bends along the tangent direction of the geometric boundary sequence of the corresponding adjustable interaction region of the node when it is close to the node. The bent edge path is then projected in the display coordinate system to obtain the set of projected edge paths. Each edge path in the projection edge path set is superimposed with the corresponding region transfer directed edge connection density. The adjustable interaction region identifier is used as the node, and the superimposed edge path is used as the edge. This generates a time sequence diagram of the operation behavior distribution with the adjustable interaction region identifier as the node and the region transfer directed edge connection density as the edge strength.
4. The method according to claim 3, characterized in that, The pressure change data corresponding to each adjustable interaction region identifier in the pressure change superposition result is spatially expanded along the boundary line of the geometric boundary sequence corresponding to the adjustable interaction region identifier to obtain a pressure spatial expansion shape. This pressure spatial expansion shape is then fused with the dwell state marker sequence of the corresponding nodes in a directed edge skeleton with time window constraints to generate a directed edge skeleton with enhanced node pressure shape, including: Read the pressure change data corresponding to the adjustable interactive area identifier in the pressure change superposition result, and read the spatial projection position of the contact trajectory segment that generated the pressure change data on the geometric boundary sequence corresponding to the adjustable interactive area identifier. Map the pressure change data to the boundary line arc length coordinate of the geometric boundary sequence according to the spatial projection position to obtain the distribution pattern of pressure along the boundary arc length. The distribution pattern of pressure along the boundary arc length is segmented into waveforms, and the peak segments in the distribution pattern that continuously rise and then continuously fall in pressure change are identified. The peak segments are connected to form pressure peak ridges, and the pressure peak ridge description is obtained. Read the dwell state marker sequence on the node corresponding to the adjustable interaction region identifier in the directed edge skeleton with time window constraints, divide the dwell state marker sequence into dwell time period partitions within the node according to the dwell start time and dwell end time, and obtain the dwell time period partition layout. The spatial position of the boundary arc length corresponding to the pressure wave crest ridge line is nonlinearly mapped to the temporal position of the dwell time period in the dwell time period partition layout through the spatiotemporal mapping relationship of the contact trajectory segment in the adjustable interaction area, so that the spatial position of the pressure wave crest ridge line corresponds to the temporal position of the dwell time period partition, and the spatiotemporal correspondence of pressure dwell time is obtained. Based on the curvature distribution of the boundary line of the adjustable interactive region in the geometric boundary sequence, the curvature constraint adjustment is performed on the spatiotemporal correspondence of pressure residence, so that the spatial position of the pressure wave crest ridge at the boundary line curvature is shifted to the inside of the boundary line, and the curvature-adjusted spatiotemporal correspondence of pressure residence is obtained. The curvature-adjusted pressure residence spatiotemporal correspondence is fused with the residence state marker sequence of the node in the directed edge skeleton with time window constraints. This allows the pressure peak ridge position within the node to jointly determine the node pressure morphology with the time partition of the residence state marker sequence, thus generating a directed edge skeleton with enhanced node pressure morphology.
5. The method according to claim 1, characterized in that, The step involves performing a perturbation expansion of candidate configuration instances on the timing diagram of the operation behavior distribution to obtain a set of candidate interface configuration instances. Each candidate interface configuration instance in the set includes a candidate geometric boundary sequence of an adjustable interaction region that has shifted relative to the current configuration state of the interaction interface instance, and a response priority sorting corresponding to the candidate geometric boundary sequence, including: Read the adjustable interaction area identifier corresponding to each node in the timing diagram of the operation behavior distribution and the edge strength of the directed edges between nodes, sort the edge strengths from largest to smallest, and obtain the directed edge strength sorted list. Select the top-ranked directed edges from the directed edge strength sorting list, and form a region pair by connecting the starting adjustable interaction region identifier and the ending adjustable interaction region identifier of the selected directed edges, thus obtaining a set of perturbation seed region pairs. For each pair of regions in the set of perturbation seed regions, extract the geometric boundary sequence of the two adjustable interactive regions in the current configuration state of the interactive interface instance, and perform boundary translation in opposite directions on the geometric boundary sequence of the two adjustable interactive regions in the display coordinate system to generate two sets of candidate geometric boundary sequences after relative displacement. Based on the edge strength of the directed edge in the time sequence diagram of the operation behavior distribution, the response priorities of the two adjustable interaction regions in the region pair are interchanged to obtain the candidate response priority ranking corresponding to the candidate geometric boundary sequence. The candidate geometric boundary sequence and the candidate response priority are sorted and combined into a candidate interface configuration instance. Spatial overlap detection is performed on the candidate geometric boundary sequence in the candidate interface configuration instance. If there is a boundary intersection with the unperturbed adjustable interactive area in the current configuration state of the interactive interface instance, the candidate interface configuration instance is discarded; otherwise, it is retained. Add the retained candidate interface configuration instances to the candidate interface configuration instance set, and continue to select the next set of directed edges from the directed edge strength sorting list and repeat the above process until the candidate interface configuration instance set reaches the preset size.
6. The method according to claim 5, characterized in that, For each pair of regions in the set of perturbation seed regions, the geometric boundary sequences of the two adjustable interactive regions in the current configuration state of the interactive interface instance are extracted. Then, in the display coordinate system, the geometric boundary sequences of the two adjustable interactive regions are translated in opposite directions to generate two sets of candidate geometric boundary sequences after relative displacement, including: Read the first adjustable interaction region identifier and the second adjustable interaction region identifier contained in the region pair in the perturbation seed region pair set, obtain the first geometric boundary sequence corresponding to the first adjustable interaction region identifier and the second geometric boundary sequence corresponding to the second adjustable interaction region identifier respectively, and extract the region transfer directed edge connection density corresponding to the directed edge connecting the first adjustable interaction region identifier and the second adjustable interaction region identifier from the operation behavior distribution time sequence diagram. The direction attribute of the directed edge connecting the first adjustable interaction area identifier and the second adjustable interaction area identifier in the sequence diagram of the operation behavior distribution is analyzed. Based on the direction attribute, the first adjustable interaction area identifier is determined as the starting area identifier and the second adjustable interaction area identifier is determined as the ending area identifier. A traction direction line is generated from the boundary center of the geometric boundary sequence corresponding to the starting area identifier to the boundary center of the geometric boundary sequence corresponding to the ending area identifier. Read the pressure change data corresponding to the first adjustable interactive area identifier in the pressure change superposition result, and read the spatial projection position of the contact trajectory segment that generated the pressure change data on the first geometric boundary sequence. Spatially expand the pressure change data along the boundary line of the first geometric boundary sequence according to the spatial projection position to obtain the pressure distribution along the edge of the first region, and extract the pressure concentration position of the pressure distribution along the edge of the first region to obtain the pressure concentration position of the first region. The traction direction line is deflected according to the pressure concentration location in the first region, and the traction direction line is shifted to the side where the pressure concentration location in the first region is located to generate a deflected disturbance direction line. The displacement of each boundary control point in the first geometric boundary sequence is performed using the deflected disturbance direction line to obtain the first candidate geometric boundary sequence. Perform a displacement symmetrical to that of the first geometric boundary sequence on the second geometric boundary sequence, so that each boundary control point in the second geometric boundary sequence is displaced by the same distance in the opposite direction of the deflected disturbance direction line, thus obtaining the second candidate geometric boundary sequence. The first and second candidate geometric boundary sequences are spatially intersected with the geometric boundary sequences of the adjustable interactive areas that are not disturbed in the current configuration state of the interactive interface instance. Candidate geometric boundary sequences that intersect with the geometric boundary sequences of the adjustable interactive areas that are not disturbed are removed, and the two sets of candidate geometric boundary sequences after relative displacement are output.
7. The method according to claim 5, characterized in that, The step of adding the retained candidate interface configuration instances to the candidate interface configuration instance set, and continuing to select the next group of directed edges from the directed edge strength sorting list and repeating the above process until the candidate interface configuration instance set reaches a preset size, includes: Read the candidate geometric boundary sequence of each candidate interface configuration instance that has been added to the current candidate interface configuration instance set, and perform spatial difference analysis on the candidate geometric boundary sequence of each candidate interface configuration instance and the candidate geometric boundary sequences of other candidate interface configuration instances in the set to obtain the spatial difference distribution results within the set; Determine whether the number of candidate interface configuration instances already included in the current candidate interface configuration instance set has reached the preset scale. If it has not reached the preset scale, obtain the next unused directed edge in the directed edge strength sorting list and parse the identifiers of the two adjustable interactive areas connected by the directed edge. Extract the dwell state marker sequence of the two adjustable interaction regions connected by the directed edge on the corresponding nodes in the operation behavior distribution time sequence diagram, compare the time overlap segment of the dwell state marker sequence on the two nodes with the existing generated records of the candidate interface configuration instance set, and obtain the perturbation novelty marker corresponding to the directed edge. When the perturbation novelty tag does not meet the preset novelty tolerance, skip the directed edge and continue to obtain the next unused directed edge in the directed edge strength sorting list until a directed edge whose perturbation novelty tag meets the preset novelty tolerance is found as a new perturbation seed. A new candidate interface configuration instance is generated by the region corresponding to the new perturbation seed. The new candidate interface configuration instance is added to the candidate interface configuration instance set, and the directed edge corresponding to the new perturbation seed is recorded as used in the candidate interface configuration instance set. Return to the step of determining whether the number of candidate interface configuration instances already included in the current candidate interface configuration instance set has reached a preset size, and update the spatial difference distribution result within the set after each new candidate interface configuration instance is added, until the candidate interface configuration instance set reaches the preset size.
8. The method according to claim 1, characterized in that, The invocation of the pre-built virtual interaction inference tool takes the set of candidate interface configuration instances and the timing diagram of the operation behavior distribution as input, and obtains the operation path length distribution and interaction response latency statistics corresponding to each candidate interface configuration instance under the constraint of virtual touch event playback, including: Extract all timestamped contact point trajectories and contact duration periods from the operation behavior record stream associated with the operation behavior distribution time sequence diagram, and arrange them in the order of timestamps to form a virtual touch event playback sequence; For each candidate interface configuration instance in the candidate interface configuration instance set, write the candidate geometric boundary sequence contained in the candidate interface configuration instance into the geometric boundary storage area of the virtual interactive inferrer to obtain the virtual display layout; Read the trajectory of each touch point in the virtual touch event playback sequence in sequence, map the coordinates of the touch point trajectory within the virtual display layout, and obtain the spatial path of the touch point trajectory relative to each adjustable interactive area in the virtual display layout. Segment length statistics are performed on the spatial path, and the path length of each contact point trajectory across different adjustable interactive areas is calculated to generate the operation path length distribution corresponding to the candidate interface configuration instance. Based on the contact duration in the virtual touch event playback sequence and the response priority sorting of the candidate interface configuration instance, the response waiting time is determined for the adjustable interaction area into which each touch point trajectory falls, and the interaction response latency statistics corresponding to the candidate interface configuration instance are generated. Bind the operation path length distribution and interaction response latency statistics to the candidate interface configuration instance, and output the operation path length distribution and interaction response latency statistics corresponding to each candidate interface configuration instance.
9. The method according to claim 8, characterized in that, The step of sequentially reading the trajectory of each touch point in the virtual touch event playback sequence, mapping the touch point trajectory to coordinates within the virtual display layout, and obtaining the spatial path of the touch point trajectory relative to each adjustable interactive area in the virtual display layout includes: Read the candidate geometric boundary sequence corresponding to all adjustable interactive areas in the virtual display layout, connect all the boundary control points in each candidate geometric boundary sequence to form a closed area boundary loop, and group the closed area boundary loops according to the adjustable interactive area identifier to obtain the set of area boundary closed loops. Read the directed edge connection density of the region transfer from the time sequence diagram of the operation behavior distribution. Compare the starting adjustable interaction region identifier and the ending adjustable interaction region identifier of each directed edge in the region transfer directed edge connection density with the adjustable interaction region identifier in the set of region boundary closure loops one by one. Attach the region transfer directed edge connection density that matches the comparison to the corresponding closed region boundary ring in the set of region boundary closure loops to obtain the set of region boundary closure loops carrying connection density labels. Read a touch point trajectory from the virtual touch event playback sequence, determine the inclusion relationship between each touch point coordinate contained in the touch point trajectory and each closed region boundary ring in the set of region boundary closed rings carrying connection density markers, record the crossing position and crossing order when the touch point coordinates cross the closed region boundary rings, and generate a crossing position sequence. Read the contact point trajectory segment between adjacent crossing positions in the crossing position sequence, align the direction of the contact point trajectory segment within the virtual display layout with the direction of the directed edge connection density in the set of closed loops of the region boundary carrying connection density markers, so that the direction of the contact point trajectory segment is consistent with the direction of the directed edge, and obtain the direction-aligned contact point trajectory segment. The contact point trajectory segment after direction alignment is recombined with the crossing position in the crossing position sequence in order to obtain the corrected contact point coordinate sequence. Based on the direction of the line connecting adjacent contact point coordinates in the corrected contact point coordinate sequence, a continuous path is generated within the virtual display layout, and the output is the spatial path of the contact point trajectory relative to each adjustable interactive area in the virtual display layout.
10. A server, comprising a memory, a processor, and a computer program stored in the memory, characterized in that, The processor executes the computer program to implement the steps of the method according to any one of claims 1 to 9.
11. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 9.
